Why 671B total and 37B active is the whole MoE interview
7 min read How mixture-of-experts models split parameter count from compute per token, and the routing, memory, and serving tradeoffs interviewers test. Read article
7 min read How mixture-of-experts models split parameter count from compute per token, and the routing, memory, and serving tradeoffs interviewers test. Read article
7 min read The transformer internals interviewers push on, from why attention scales by sqrt(d_k) to KV cache memory and grouped-query attention. Read article
7 min read A quick reference for the attention, tokenization, KV-cache, RAG, and evaluation questions that come up in LLM and machine learning interviews. Read article
6 min read NLP interview questions appear across ML engineer, data scientist, and applied researcher roles at companies like Google, Meta, OpenAI, and Read article
6 min read One of the most common LLM interview questions in 2026: “Would you fine-tune a model or train from scratch?” Almost Read article
6 min read Transformers are the architecture behind GPT, BERT, Claude, and every other major language model. Understanding how they work — especially Read article
What's missing, wrong, or worth adding? One line helps.
Sent — thank you. We read every one.