What comes after attention? This startup says it already knows.

Subquadratic, a startup, claims to have developed a model that can handle large context windows beyond traditional attention. This breakthrough could revolutionize natural language processing. The model can handle a 12-million token context window. This advancement could improve AI's ability to understand and process complex information. It's a significant step forward in the field of AI research.