The transformer questions that go past the diagram
7 min read The transformer internals interviewers push on, from why attention scales by sqrt(d_k) to KV cache memory and grouped-query attention. Read article
AI/ML Interview Questions
AI/ML Interview Questions
What LLM interviewers actually ask about transformers
7 min read A quick reference for the attention, tokenization, KV-cache, RAG, and evaluation questions that come up in LLM and machine learning interviews. Read article
