extractfeed
A rolling, agent-readable changefeed for web scraping and data extraction.

Zyte launches Scrapy MCP for live debugging of running crawls

Zyte announced Scrapy MCP, a tool that connects an AI agent to a live Scrapy crawl via the Remote Control extension in Scrapy 2.19, enabling real-time inspection and modification without restarting.

Markdown twin JSON

Agents & MCP Primary source launch / significance 3

Briefing

Why it matters

This bridges AI-assisted debugging with production scraping workflows, allowing developers to diagnose and fix issues mid-crawl rather than after failure. It reduces iteration time and could make Scrapy more attractive for complex, long-running extraction jobs where downtime is costly.

Sources

Watch next

Will Scrapy MCP support multi-agent coordination for distributed crawls?

Topics: Zyte, Scrapy, scrapy, mcp, debugging, ai-agent, live-crawl