AI Made Students 18% Better at Homework. Then Their Exam Scores Collapsed.

You know that quiet pit in your stomach when an AI spits out exactly what you needed? It’s relief, followed immediately by a whisper of dread. You just got the job done in three minutes. But did you actually do anything?

A recent study tracked what happens when students bring AI into the classroom. Homework scores jumped by 18%. It looked like a massive win for education. Then, the exams happened. Scores dropped by 20%.

Every time you ask AI to do the heavy lifting, you aren’t saving time—you’re quietly renting capability from your future self.

The immediate reaction is to say, “See? AI is bad for learning.” But that’s the easy out. The real takeaway is much darker: homework was always a hackable metric. We just never had a machine that could hack it this efficiently.

When you optimize for the proxy, you destroy the underlying capability. The homework was never the point. The point was the struggle required to complete it. The process of figuring it out. By removing the friction, AI makes students look more successful while making them significantly less educated.

A commenter on this study made a point that should terrify every white-collar worker: “In my professional career, my employers give me a lot more assignments than exams.”

It’s a fair defense. Work is mostly “assignments” now. But the nature of those assignments is shifting. When AI does the work, you become the router, not the craftsman. You aren’t building a moat of knowledge; you’re just managing a temporary interface.

If your job is just prompting AI to do the job you were hired to do, you aren’t an employee anymore. You’re just a middleman for the algorithm.

We cannot ban AI. It’s here, and it’s brilliant. But we have to redesign how we measure competence. We need to test the struggle, the process, and the unassisted recall. Because the exam is coming. It might be a job interview, a sudden crisis, or a task the AI can’t figure out. And when that day comes, you will have no muscle memory to solve it.

The ultimate danger of AI isn’t that it will replace you. It’s that it will make you soft, right up until the moment it leaves you behind.

FAQ

Q: What if work really is just assignments? If AI does them better, shouldn't we just let it?

A: If your entire job is prompting AI to do assignments, you've made yourself a middleman. Middlemen get cut when the algorithm improves. You need to be the one who knows what to do when the AI fails.

Q: How should schools and companies change their assessments?

A: Stop grading the final output and start grading the process. Test unassisted recall and struggle. If you only measure the polished result, you're just measuring how well someone uses a tool, not what they actually know.

Q: Isn't this just the same argument people made about calculators?

A: No. Calculators automated calculation; AI automates cognition. A calculator won't write your business strategy, but AI will. We are offloading the actual thinking, not just the arithmetic.

📎 Source: View Source