Apify benchmarks four web unblockers across 384 challenging URLs
Apify published a benchmark comparing four web unblockers against a deliberately difficult set of 384 URLs.
Infrastructure & Proxies
Apify streamlines Actor creation with one-click Git repo setup
Apify now lets users select a Git provider during Actor setup, automatically creating a repository, pushing template code, and configuring builds on every push.
Bright Data announces Openhuman integration
Bright Data has introduced a new integration called Openhuman, as detailed on their blog.
Bright Data Defends Its Network Against Misuse Claims
Bright Data publishes a blog post arguing that its proxy network cannot be used in the ways critics allege.
Bright Data integrates with Cherry Studio for AI-driven data extraction
Bright Data announced an integration with Cherry Studio, combining its proxy and scraping infrastructure with Cherry Studio's AI capabilities.
Bright Data integrates with Paperclip for AI-driven data extraction
Bright Data announces a partnership or integration with Paperclip, an AI tool, as detailed in a blog post on their site.
Browserless blog post examines the pitfalls of persisting browser profiles
Browserless published a blog post discussing the challenges and drawbacks of persisting browser profiles in automated environments.
Browserless introduces session isolation for browser automation
Browserless has published a blog post detailing session isolation, a feature that separates browser sessions to prevent data leakage and improve reliability.
Browserless publishes enterprise Docker deployment guide for self-hosting
Browserless released a guide detailing how to deploy its browser automation service in an enterprise Docker environment.
Browserless publishes guide on browser infrastructure for computer use agents
Browserless has published a blog post discussing the infrastructure requirements for running browser-based agents that interact with web interfaces on behalf of users.
Browserless publishes guide on improving CPU performance for web scraping
Browserless released a blog post offering tips on reducing CPU usage during web scraping operations.
Cloudflare launches Monetization Gateway beta to let sellers charge AI agents via HTTP 402
Cloudflare has opened a closed beta for its Monetization Gateway, enabling sellers to charge AI agents for API tokens, MCP tools, and other digital resources using the HTTP 402 status code.
Cloudflare Wallets launch to give AI agents programmable payments and identity
Cloudflare announced Cloudflare Wallets, a programmable wallet that enables AI agents to make autonomous payments and verify identity on the web using the x402 protocol.
CloudX.ai details how replacing actions/setup-go scaled Golang CI
A blog post on CloudX.ai explains the engineering behind swapping out the standard GitHub Actions setup-go step to improve CI performance for Go projects.
Crawlbase argues AI agent failures are infrastructure failures, not code problems
Crawlbase publishes a blog post claiming that most AI agent failures stem from infrastructure issues like Markdown normalization, retrieval circuit breakers, and storage-backed memory.
Crawlbase blog explains health-scored proxy rotation with EWMA and circuit breakers
Crawlbase published a technical blog post describing a smart AI proxy rotation method in Python that uses exponentially weighted moving averages for success and latency, plus a circuit breaker, instead of simple round-robin.
Crawlbase publishes technical guide on scaling headless browser fleets to 10,000 concurrent sessions
Crawlbase's blog post details the architecture and capacity planning required to run 10,000 concurrent Playwright sessions across roughly 100 nodes.
Jane Street scales and benchmarks a critical message bus with a new indexing strategy
Jane Street published a blog post detailing how they scaled and benchmarked a critical message bus using a novel indexing strategy.
Oxylabs adds Masque protocol support to its proxy infrastructure
Oxylabs announced support for the Masque protocol, a modern tunneling protocol designed to improve proxy performance and security.
Oxylabs launches IP transparency tool for ethically sourced residential proxies
Oxylabs has introduced a new tool that provides users with visibility into the ethical sourcing of its residential proxy IPs.
Postgres DELETE scaling techniques explored in new blog post
A blog post on dbos.dev examines how to scale DELETE operations in PostgreSQL, a topic relevant to data management in web scraping and extraction pipelines.
Rouler lets Windows users steer app and IP traffic across multiple network interfaces
A new tool called Rouler enables Windows users to route specific applications or IP ranges through different network interfaces, such as running Slack over OpenVPN while sending Chrome traffic through Tailscale.
ScraperAPI publishes guide on interpreting web scraping success rate claims
ScraperAPI released a guide explaining why published success rates vary from 40% to 100% and how to measure reliability for specific targets.
Scrapfly publishes guide on using proxies with C# HttpClient
Scrapfly released a blog post explaining how to configure authenticated and rotating proxies with C# HttpClient and SocketsHttpHandler, highlighting connection-pool pitfalls that cause 407 errors.
ScrapingBee adds geolocation support to classic proxies, covering 40+ countries
ScrapingBee announced that its classic proxy offering now allows users to select a target country from over 40 options via the request builder or API parameter.
ScrapingBee ranks top proxies for Amazon scraping in 2026
ScrapingBee published a guide evaluating residential, ISP, and mobile proxies for Amazon scraping, noting that Amazon's anti-bot updates can render previously effective proxies obsolete.
ScrapingBee ranks top sneaker proxies for 2026 drops
ScrapingBee published a guide ranking ISP, residential, and datacenter proxies for sneaker bots, focusing on checkout success during limited drops.
Scry offers programmable internet search with congestion-based pricing on a 500 TB ClickHouse index
A new service called Scry provides a 500 TB NVMe internet index in ClickHouse, allowing users to run arbitrary read-only SQL and Datalog queries, with congestion-based micro-auction pricing to manage resource contention.
SerpApi launches Markdown output for all search APIs
SerpApi now offers a Markdown output option for all 100+ of its search APIs, delivering the same data as JSON with roughly half the tokens and no additional configuration.
SerpApi resolves Google /goto URL redirect rollout
SerpApi announced it has fixed an issue where Google changed result links to use google.com/goto redirects, restoring direct destination URLs in its API output.
Stagehand SDK exposes Browserbase Search and Fetch across TypeScript, Python, and Go
Stagehand SDK version 4.1.0a0.dev1494 adds Browserbase Search and Fetch APIs to its TypeScript and Python facades, with equivalent Go support via the existing HTTP transport.
Study finds only 34.5% of free proxies work, thousands tamper with traffic
Crawlbase reports on two peer-reviewed studies that tested 640,600 free proxies, finding that just over a third were functional and many altered traffic.
TSMC details next-gen A14 node with world's smallest SRAM cell
TSMC revealed technical details of its A14 NanoFlex Pro platform at IEDM, claiming the smallest SRAM cell and highest macro density to date.
Vacation rental intelligence platform scales to 1 billion monthly crawl requests with Crawlbase Enterprise Crawler
Crawlbase published a case study detailing how a vacation rental intelligence platform processed 5.52 billion requests in six months with 99.96% success using its Enterprise Crawler.
Zenrows Batch lets users run 100,000 URLs as a single managed scraping job
Zenrows published a blog post detailing its Batch feature for submitting, monitoring, and rerunning large-scale web scraping jobs with webhooks, HMAC verification, and scheduling.
Zenrows launches self-service payment for AI agents
Zenrows has introduced a dedicated portal where AI agents can autonomously obtain credentials and pay for Fetch and Extract services via x402, MPP, or card.
Zenrows publishes Browserbase alternative comparison for protected web access
Zenrows benchmarks its own service against Browserbase on four protected targets, comparing success rates, session costs, and developer experience.
Zyte adds CDP support for browser automation on its infrastructure
Zyte has introduced Chrome DevTools Protocol (CDP) support, allowing users to run browser automation scripts on Zyte's managed infrastructure.
Zyte engineer shares infrastructure lessons from building a pickleball MMO side project
A Zyte blog post recounts how scaling a silly pickleball game to 3,000 matches taught the author about edge routing, memory management, and monitoring.
Zyte publishes guide on running Playwright at scale with its CDP browser
Zyte released a blog post explaining how to connect Playwright to its CDP browser for scalable web scraping.