Agent Switchboard

Tasks

I need to scrape websites

Crawl sites and turn pages into clean text or structured data an agent can use.

20 tools · 4 official

Picked from listings that mention scrape, scraping, crawl or web data in their name, description, tags or skills; those in Browser & Computer Use, Data & Analytics or Research & Knowledge, or with API or MCP access, rank higher.

Best fits · 12

  1. context.dev

    API · MCP · CLI

    Scrapes, crawls and searches the web for agents through a REST API, SDKs, CLI and hosted MCP server, returning…

    VerifiedNewby context.dev · Browser & Computer Use, Research & Knowledge · 5 skills · API Key

    Why Scrape to Markdown: Turns any URL into Markdown, HTML, screenshots, images or CSS-parsed fields in one POST /v1/web/scrape request.

  2. Oxylabs MCP

    MCP

    Lets AI agents scrape any URL with JavaScript rendering and geo-targeting, pull Google and Amazon results, and crawl…

    VerifiedNewby Oxylabs · Research & Knowledge, Browser & Computer Use · 5 skills · Bearer Token

    Why Universal Scraper: Scrapes any URL with optional JavaScript rendering and geo-targeting, returning Markdown, HTML, or extracted links.

  3. Firecrawl

    API · MCP · CLI

    Turn websites into LLM-ready data — crawl, scrape, and convert web pages to clean markdown for AI consumption.

    Verifiedby Firecrawl · Research & Knowledge, Data & Analytics · API Key

  4. ScrapeGraphAI

    API · MCP · CLI

    Scrapes websites from a natural-language description of the data you want, building the extraction graph automatically…

    Verifiedby ScrapeGraphAI · Research & Knowledge, Browser & Computer Use · 3 skills · API Key

    Why Search Scraper: Runs a web search and scrapes the top results into one consolidated structured answer.

  5. Crawl4AI

    API · CLI · MCP

    Crawls and scrapes web pages into clean Markdown for RAG pipelines, with CSS, XPath, and LLM-driven structured…

    Verifiedby UncleCode · Browser & Computer Use, Research & Knowledge · 5 skills · No auth

    Why Deep Site Crawling: Traverses whole sites with BFS and best-first strategies under page limits, using prefetch URL discovery and resumable crash…

  6. Nimble

    API · MCP · CLI

    Searches, extracts, maps and crawls the live web and runs cited research agents, for AI agents that need real-time web…

    VerifiedNewby Nimble · Research & Knowledge, Browser & Computer Use · 5 skills · API Key

    Why Site Crawl: Crawls multiple pages of a site with path filtering, subdomain control, and progress tracking.

  7. Bright Data MCP

    MCP

    Enterprise web scraping and browser automation MCP. Lets agents search, crawl, and extract any website without bot…

    VerifiedOfficialby Bright Data · Browser & Computer Use · 4 skills · API Key

    Why Page Scraping: Scrape any website including JavaScript-rendered pages through Bright Data's managed proxy network

  8. Apify MCP Server

    MCP

    Runs thousands of ready-made Apify Actors through an official MCP server — scrape social media, search engines, maps…

    Verifiedby Apify · Data & Analytics · 3 skills · API Key

    Why Actor Execution: Runs any of thousands of Apify Actors with automatic schema validation to scrape or automate a target site.

  9. AgentQL MCP

    API · MCP · Extension

    Extracts structured web data using natural language queries — no XPath or selectors needed. Works via Python/JS SDKs…

    Verifiedby TinyFish · Browser & Computer Use · 3 skills · API Key

    Why REST API Extraction: Fetches and parses public-facing web data from any URL via REST API without a browser session running locally.

  10. Scrapling

    API

    High-performance Python web scraping library with anti-bot bypass, async support, and smart element auto-matching…

    Verifiedby Scrapling OSS · Browser & Computer Use · 5 skills · No auth

    Why Async Scraping: Scrape multiple URLs concurrently with asyncio for high-throughput data collection

  11. Browserless

    API · MCP · CLI

    Runs hosted or self-hosted headless browsers for agents and scripts, with REST APIs for screenshots, PDFs, and…

    Verifiedby Browserless · Browser & Computer Use · 4 skills · API Key

    Why MCP Browser Agent: Gives AI assistants a stateful browser agent plus smart scraping, page export, crawling, and Lighthouse audits through the…

  12. superagnt_

    MCP · API

    Connects agents to social, web, SEO and lead-enrichment data across 10 platforms and 262 REST endpoints, reachable over…

    VerifiedNewby agntdata, inc. · Data & Analytics, Sales & Marketing · 5 skills · OAuth 2.0

    Why Web Scraping: Scrapes any page to clean markdown or structured JSON, searches the web with full page content, and maps a site's URLs.

See all 20 on Browse, with filters

Official · 4

The ones published by the company behind the product.

In stacks

Missing a tool that does this? Suggest a listing.

/tasks/scrape-websites
I need to scrape websites · 20 fit · 4 official · keywords: scrape, scraping, crawl, web data · categories: browser-computer, data-analytics, research · access: api+mcp
Crawl sites and turn pages into clean text or structured data an agent can use.
best fits
context-devapi+mcp+cliScrape to Markdown: Turns any URL into Markdown, HTML, screenshots, images or CSS-parsed fields in one POST /v1/web/scrape request.oxylabs-mcpmcpUniversal Scraper: Scrapes any URL with optional JavaScript rendering and geo-targeting, returning Markdown, HTML, or extracted links.firecrawlapi+mcp+cliTurn websites into LLM-ready data — crawl, scrape, and convert web pages to clean markdown for AI consumption.scrapegraphaiapi+mcp+cliSearch Scraper: Runs a web search and scrapes the top results into one consolidated structured answer.crawl4aiapi+cli+mcpDeep Site Crawling: Traverses whole sites with BFS and best-first strategies under page limits, using prefetch URL discovery and resumable crash…nimbleapi+mcp+cliSite Crawl: Crawls multiple pages of a site with path filtering, subdomain control, and progress tracking.bright-data-mcpmcpPage Scraping: Scrape any website including JavaScript-rendered pages through Bright Data's managed proxy networkapify-mcpmcpActor Execution: Runs any of thousands of Apify Actors with automatic schema validation to scrape or automate a target site.agentql-mcpapi+mcp+browser-extensionREST API Extraction: Fetches and parses public-facing web data from any URL via REST API without a browser session running locally.scraplingapiAsync Scraping: Scrape multiple URLs concurrently with asyncio for high-throughput data collectionbrowserlessapi+mcp+cliMCP Browser Agent: Gives AI assistants a stateful browser agent plus smart scraping, page export, crawling, and Lighthouse audits through the…superagntmcp+apiWeb Scraping: Scrapes any page to clean markdown or structured JSON, searches the web with full page content, and maps a site's URLs.
official
bright-data-mcp, jina-reader, agent-browser, parallel-web
related tasks
/tasks/search-the-web27 fitsearch the web/tasks/automate-a-browser37 fitautomate a browser/tasks/read-pdfs-and-documents28 fitread PDFs and documents/tasks/search-my-documents65 fitsearch my documents
in stacks
/stacks/research-analystparallel-webA research analyst in five tools
more
/browse?task=scrape-websitesall 20, with filters/tasksevery task/api/tasks/scrape-websitesthis task as JSONGET · no auth