Zyte argues EU AI scraping guidelines rely on outdated robots.txt standard
Zyte publishes a blog post arguing that Europe's new generative AI scraping guidelines, which lean on the robots.txt protocol, will harm users and entrench monopolies.
Briefing
- Zyte: Zyte publishes a blog post arguing that Europe's new generative AI scraping guidelines, which lean on the robots.txt protocol, will harm users and entrench monopolies.
Why it matters
The post highlights a growing tension between privacy regulation and the practical realities of web scraping. If policymakers codify a 30-year-old opt-out mechanism as a legal barrier, it could lock in incumbents who already have data and make it harder for new entrants to train AI models or conduct research. The critique signals that the scraping industry sees the guidelines as a threat to open access, not a privacy win.
Sources
- Primary source · Zyte · 2026-08-25 — Why Europe’s new AI scraping guidelines miss the mark
Watch next
Will the European Commission revise its guidelines in response to industry pushback before they become binding?