transformers – techinterview

techinterview.org

Companies
Cheat Sheets
Resume
🎁 Win $100

🎁 Win a $100 Amazon Gift Card →

Topics

System Design
Algorithms
Coding Patterns
AI / ML
Quant Finance
Frontend
Browse all topics

Companies

All companies
Company guides category

Roadmaps

Beginner (0–1y)
Intermediate (2–4y)
Advanced (5+y)

Tools

All tools
Study plan generator
Resume / ATS checker
Total comp calculator
Big-O visualizer
STAR answer builder

Cheat Sheets

Big-O cheat sheet
Algorithm patterns
Problems by difficulty

More

Resume
About
Contact

Skip to content

techinterview

Home
All Problems
By Topic
By Difficulty
Company Guides
System Design
Algorithms
AI/ML Questions
Resume Guides
Quant Finance
Interview Prep

techinterview

About
Advanced Interview Preparation Guide (5+ Years)
Beginner Interview Preparation Guide (0-1 Years)
Big-O Cheat Sheet: Time and Space Complexity Guide
Big-O Complexity Visualizer
Blog
Browse All Topics
Coding Interview Study Plan Generator
Common Algorithm Patterns Cheat Sheet
Complete Problem Index
Contact
Free Interview Prep Tools
Free Resume & ATS Checker
Home
Intermediate Interview Preparation Guide (2-4 Years)
Privacy Policy
Problems by Difficulty
Problems by Topic
STAR Method Answer Builder
Tech Total Comp & Offer Calculator
Terms of Service
Win a $100 Amazon Gift Card — Share an Interview Question

NLP Interview Questions: Tokenization, Embeddings, and BERT

techinterview.org / April 16, 2026

6 min read NLP interview questions appear across ML engineer, data scientist, and applied researcher roles at companies like Google, Meta, OpenAI, and […] Read article

AI/ML Interview Questions

How Transformer Models Work: Attention Mechanism Explained

techinterview.org / April 16, 2026

6 min read Transformers are the architecture behind GPT, BERT, Claude, and every other major language model. Understanding how they work — especially Read article

AI/ML Interview Questions

Fine-tuning LLMs vs Training from Scratch: When and How

techinterview.org / April 16, 2026

6 min read One of the most common LLM interview questions in 2026: “Would you fine-tune a model or train from scratch?” Almost Read article

Topics

System Design
Coding Patterns
Company Guides
Cheat Sheets
Problem Index

Study Paths

Beginner (0-1y)
Intermediate (2-4y)
Advanced (5+y)

Resources

Big-O Cheat Sheet
Algorithm Patterns
Problems by Difficulty
Problems by Topic

Site

About
Contact
Privacy Policy
Terms of Service

About
|
Contact
|
Privacy Policy
|
Terms of Service

🎁 Win $100share one interview Q →

Scroll to Top

This site uses cookies for analytics and to display ads via Google AdSense. By continuing to use the site you consent to our use of cookies. See our Privacy Policy for details and opt-out links.