Scaled dot-product attention fits in ten lines of NumPy. The interview is the follow-ups: why divide by the square root of d, how to make softmax stable, where the causal mask goes, what the KV cache saves, and why grouped-query attention exists. A complete walkthrough.
DeepMind runs closer to Google than to a startup lab: algorithm-style coding where the code must run, a maths-and-ML fundamentals round candidates call the quiz, ML design as the hardest part of the loop, and a hiring committee at the end. What each round tests and how to prepare.