Continual Learning Is a Dead End. AGI Will Come From Somewhere Else Entirely.
Every new capability an LLM gains requires retraining from scratch. That’s not a bug β it’s the fundamental bottleneck keeping AGI out of reach. But the real breakthrough won’t come from solving continual learning. It’ll come from abandoning it entirely and building systems that dynamically query a growing external knowledge base, making internal model updates unnecessary.