AI Product Managers Who Don’t Understand Evals Are Just Pretending to Build Products
The traditional AI product management playbook is fundamentally broken. According to Anthropic’s Head of Product, writing lengthy PRDs is no longer enough. To survive non-continuous model capabilities, PMs must build rigorous evaluation systems, dig into every single token, and translate vague user complaints into reproducible test cases. If you don’t understand evals, you’re just pretending to build products.