The AI Architecture That Could Make Everything You Know Obsolete
A new paper challenges the core assumption of transformer design: feedforward layers may be unnecessary. Attention alone can match or outperform standard architectures. This rethink could lead to leaner, cheaper, and more interpretable AI models.