Introduced the Transformer architecture.
Read the paper ↗
“Attention Is All You Need” replaces recurrence with self-attention. Almost every frontier model since is built on it.