You’re in a hurry. You click a link. The page loads, but instead of the article, you get a spinning wheel, a puzzle, a checkbox saying “I am not a robot.” You wait. You solve it. You finally get through. And you wonder: who was that gate really built for?
It wasn’t built for you. It was built for the machines that will never get bored, never blink, never run out of patience. And yet, you’re the one stuck waiting — every single day.
This is the Anubis trap. In ancient Egyptian mythology, Anubis weighed your heart against a feather to decide if you could enter the afterlife. Today, every website has its own Anubis: a bot detection system that decides whether you’re human or machine. But here’s the dirty secret — it can’t tell the difference. Not really. So it punishes everyone.
And the punishment is time — your time. Finite, fragile, irreplaceable time.
We’re in the middle of an arms race. AI companies need data, so they send crawlers to scrape everything. Websites want to protect their content, so they deploy CAPTCHAs, rate limits, JavaScript challenges, and weird visual riddles. Each measure makes sense in isolation. But collectively, they’re turning the web into a series of tollbooths. Every single one of them slows you down far more than it slows down a bot.
Think about it. A bot can wait ten seconds for a page to render. It doesn’t mind retrying sixty times. It never sighs, never abandons the search out of frustration. You? You have exactly one lifetime. Machines have infinite patience. You have exactly one lifetime.
That’s the asymmetry nobody talks about. The defenders are building walls that keep out a few determined crawlers while locking out millions of humans. It’s a tragedy of the commons played out in milliseconds: every site’s anti-bot decision is rational for them, but the sum of all those rational decisions is an internet that feels like a haunted house where every door requires a key you don’t have.
And the most infuriating part? The scrapers don’t care. They’ll still find a way — through VPNs, headless browsers, or paying for API access. The ones who suffer are the casual readers, the curious students, the people who just want to read one damn article without proving their humanity.
You’ve probably noticed that the web feels slower, clunkier, more suspicious than it did five years ago. That’s not your imagination. It’s the tax. Every time you solve a CAPTCHA, you’re paying a tax so AI companies can keep scraping.
This isn’t about being against AI. It’s about being for people. We need a new approach — one that doesn’t treat every human as a potential bot. Maybe it’s digital signatures. Maybe it’s reputation systems. Maybe it’s something we haven’t invented yet. But the current model is broken. You are not a robot. Stop being treated like one.
FAQ
Q: Isn't it necessary to block AI crawlers to protect content?
A: Yes, but the current methods are blunt instruments. They hurt humans more than bots. Better solutions exist — like cryptographically signed requests or reputation systems — but they aren't widely deployed because it's easier to just add another CAPTCHA.
Q: What can I do as an ordinary user?
A: Not much individually, but you can choose to support websites that prioritize human experience. Use browser extensions that bypass some blocks (where legal). And push for industry standards that make the web faster for humans, not just safer against bots.
Q: Aren't these defenses just a necessary evil in the age of AI?
A: Only if we accept that humans are collateral damage. But the real evil is the arms race itself — AI companies that scrape without consent, and site owners who react with overkill. The contrarian take: we should tax AI crawlers, not humans. Make them pay for the data they extract, and use that revenue to keep the web open and fast for everyone.