IO-aware exact attention that made long contexts practical.
Read the paper ↗
Exact attention made memory-efficient by being IO-aware. A key enabler of long context windows.