Vendors
Every scraper,
behind one API.
routes each request across 14+ scraping vendors. The Cost Ladder starts on the cheapest route that works and climbs only when a site fights back. Every vendor below is a set of routes in that ladder; each page covers what the vendor is good at, what it costs through gottem, and how to bring your own key.
Spider covers more of the ladder than any other vendor. Plain HTTP at the entry rung, JS-rendered Chrome, residential proxies, an auto-tier smart mode, and a full remote browser. It also reports exact per-request cost back to gottem, so Spider pages bill at true vendor cost rather than an estimate.
Firecrawl turns pages into clean, LLM-ready markdown, and it is one of the best extraction layers in the catalogue for feeding scraped content straight into a RAG pipeline or an agent's context window. gottem routes it at the cheap end of the ladder, with a JS-rendering rung one tier up.
ZenRows is an anti-bot toolkit behind a simple API: header/fingerprint management, JS rendering, and premium residential proxies. In gottem's catalogue it spans three rungs, basic, JS-rendered, and residential-premium, making it one of the smoother escalation paths for sites that block plain HTTP.
ScrapingBee is a straightforward scraping API with JS rendering and premium proxy options, a reliable, low-drama workhorse for the easy-to-medium band of the web. gottem routes it across three rungs: basic, JS-rendered, and residential-premium.
Bright Data operates one of the largest proxy networks in the world, and its Web Unlocker and Scraping Browser are built for the pages that stop everything else. In gottem's catalogue they are the heavy rungs, the routes the ladder climbs to when cheaper vendors keep coming back blocked.
Zyte (the company behind Scrapy) runs an ML-driven extraction API that decides per-request how to fetch a page: which proxy class, whether to render, how to beat the wall in front of it. In gottem's catalogue zyte.api is a single smart rung that handles a wide band of difficulty on its own.
Apify is an actor platform, running programmable scraping jobs on real browser compute in the cloud. gottem routes to its Web Scraper actor for pages that benefit from scriptable browsing, with costs that vary with the compute the actor consumes.
Oxylabs runs premium proxy and scraper infrastructure with enterprise-grade unblocking. It is also one of the vendors that reports exact per-request cost back to gottem, so Oxylabs pages bill at true vendor cost rather than a static estimate.
Browser Use puts an AI agent behind the wheel of a real browser. It reads the page, decides what to click, and works through interactions that no static fetch can. It is the final rung of gottem's ladder, the route for pages that defeat everything else.
Browserbase is a headless-browser cloud: real Chrome sessions over CDP, built to look and behave like real users. gottem routes to it for pages that need genuine browser rendering with strong stealth characteristics.
Browserless runs managed headless Chrome at scale, a straightforward, battle-tested way to render JavaScript-heavy pages over CDP without operating your own browser fleet. In gottem's catalogue it is the value rung among the browser routes.
2Captcha solves the challenges themselves: CAPTCHAs and interactive walls that block a fetch mid-flight. In gottem's catalogue it isn't a page-fetching route but a challenge rung: it clears the wall so a fetch can complete.
ScraperAPI is a general-purpose scraping API with large-scale proxy rotation and anti-bot handling behind a single endpoint. gottem routes through it as one of the pooled vendors in the ladder.
also routed: Crawlbase · Diffbot · route details on the pricing page.
One key, one bill, one response shape. When a vendor returns a CAPTCHA, 403, or Cloudflare wall, the same request retries through another. Failed fetches are effectively free.