GPTQ, AWQ, and FP8 in the LLM inference interview
6 min read The weight, activation, and KV-cache tradeoffs interviewers probe when they ask how you would shrink a model to fit on one GPU. Read article
AI/ML Interview Questions
newsletter
What's actually being asked right now
Interview patterns & comp trends, straight to your inbox.
No spam. Unsubscribe anytime.
worth a read
Mars For The Rest of Us — a weekly-or-more deep dive on the technical side of Mars exploration: rocket propulsion, microbiology, mission architecture, and everything in between. Written by Maciej Ceglowski.
Read it on Substack →