Crawl4AI MCP Server by Bjorn Melin

MCP Servers Chevron right icon

Crawl4AI

Provider

Bjorn Melin

Classification

community

Released On

May 5, 2025

Provides web scraping and crawling capabilities for extracting content from single pages, conducting multi-page research, discovering URLs, and monitoring crawl status through a Cloudflare Worker-based server.

GitHub Repo (6 stars)

Related Servers

Search1API

fatwang2

Execute web searches, news queries, and content extraction.

Classification

community

Est Downloads (All Time)

10.1k

Release Date

Nov 26, 2024

FireCrawl

Mendable

Integration with FireCrawl to provide advanced web scraping capabilities for extracting structured data from complex...

Classification

official

Est Downloads (All Time)

750k

Release Date

Dec 6, 2024

Cloudflare Workers

Glen Maddern

Cloudflare Workers-based MCP implementation enables AI assistants to execute custom serverless logic at the edge.

Classification

community

Est Downloads (All Time)

Release Date

Dec 13, 2024

Google Search

mixelpixx

Integrates with Google Custom Search API and web scraping tools to enable web searches, content extraction, and...

Classification

community

Est Downloads (All Time)

1.2k

Release Date

Dec 19, 2024

Apify Actor

Apify

Use 4,000+ pre-built cloud tools, known as Actors, to extract data from websites, e-commerce, social media, search...

Classification

official

Est Visitors (All Time)

176k

Release Date

Jan 3, 2025

Puppeteer

J Waldor

Integrates Puppeteer-based browser automation for web scraping, testing, and AI model interaction with live web content.

Classification

community

Est Downloads (All Time)

144

Release Date

Jan 7, 2025

Cloudflare Workers

Cloudflare

Enables MCP capabilities in Cloudflare Workers for deploying low-latency, scalable AI services at the network edge.

Classification

official

Est Downloads (All Time)

182k

Release Date

Jan 8, 2025

Web Content Extractor

Brian W. Smith

Extracts and processes web content using TypeScript, Cheerio, and Turndown for tasks like scraping, summarization,...

Classification

community

Est Downloads (All Time)

1.7k

Release Date

Jan 8, 2025

Web Crawler

jitsmaster

Configurable web crawler that extracts structured content from websites while respecting robots.txt rules and...

Classification

community

Est Downloads (All Time)

144

Release Date

Jan 10, 2025

UseScraper

Tane van Wifferen

Integrates with UseScraper API to extract web content in various formats with advanced proxy options and custom data...

Classification

community

Est Downloads (All Time)

577

Release Date

Jan 11, 2025

Deep Web Research

qpd-v

Enables deep web searches and content extraction through automated Google searches, webpage visits, and screenshot...

Classification

community

Est Downloads (All Time)

12k

Release Date

Jan 13, 2025

Doc Scraper (Jina.ai)

John George

Converts web documentation to clean markdown using Jina.ai's API, enabling easy transformation of online docs for...

Classification

community

Est Downloads (All Time)

1.2k

Release Date

Jan 21, 2025

JinaAI

Scott Spence

Extracts and processes web content for efficient parsing and analysis of online information

Classification

community

Est Downloads (All Time)

4.7k

Release Date

Jan 19, 2025

JinaAI Grounding

Scott Spence

Integrates JinaAI's content extraction and analysis capabilities for web scraping, documentation parsing, and text...

Classification

community

Est Downloads (All Time)

4.3k

Release Date

Jan 24, 2025

JinaAI Search

Scott Spence

Integrates JinaAI's search capabilities for web content discovery, information retrieval, and data extraction

Classification

community

Est Downloads (All Time)

4.3k

Release Date

Jan 24, 2025

Firecrawl

Msparihar

Integrates with the Firecrawl API to enable web scraping and intelligent content searching for extracting structured...

Classification

community

Est Downloads (All Time)

288

Release Date

Feb 8, 2025

Google Custom Search

WeiDwonder

Integrates with Google Custom Search Engine to enable automated web crawling, content extraction, and search result...

Classification

community

Est Downloads (All Time)

17.8k

Release Date

Feb 8, 2025

Simple Tool (Website Fetcher)

Kirill Markin

Integrates with web servers to fetch and retrieve webpage content for analysis and processing tasks.

Classification

community

Est Downloads (All Time)

288

Release Date

Feb 18, 2025

Serper Search and Scrape

Marco Pesani

Integrates with the Serper API to enable web searches and webpage content extraction, supporting research, content...

Classification

community

Est Downloads (All Time)

37.1k

Release Date

Feb 21, 2025

Firecrawl

Cody De Arkland

Integrates with the Firecrawl API to enable website crawling, content translation, and structured data extraction for...

Classification

community

Est Downloads (All Time)

144

Release Date

Feb 26, 2025

Cloudflare Browser Rendering

Amotivv

Integrates with Cloudflare's Browser Rendering API to enable web scraping and screenshot capture using Puppeteer for...

Classification

community

Est Downloads (All Time)

1.3k

Release Date

Mar 1, 2025

Scraper.is

Integrates with Scraper.is API to enable web content extraction, structured data parsing, and Markdown conversion for...

Classification

official

Est Downloads (All Time)

6.3k

Release Date

Mar 3, 2025

WebSearch Tools

m4s1t4

Integrates with web search APIs and crawling tools to enable internet-wide information retrieval, content extraction,...

Classification

community

Est Downloads (All Time)

144

Release Date

Mar 4, 2025

Crawlab

Crawlab Team

Integrates with Crawlab to enable AI-driven web scraping, task automation, and data extraction workflows through...

Classification

official

Est Downloads (All Time)

866

Release Date

Mar 4, 2025

Scrapezy

Integrates with the Scrapezy API to extract structured data from websites based on user-specified prompts, enabling...

Classification

official

Est Downloads (All Time)

3.6k

Release Date

Mar 5, 2025

Web Crawler

orange-fruit01

Enables web crawling capabilities for extracting website content in markdown format, containerized with Docker for...

Classification

community

Est Downloads (All Time)

—

Release Date

Mar 17, 2025

Browser Tools

Chi

Enables web browsing capabilities through tools for content extraction, link following, and browser automation with...

Classification

official

Est Downloads (All Time)

—

Release Date

Mar 17, 2025

Web Research

PhialsBasement

Enables AI web browsing through Google search, webpage extraction, and screenshot capture tools with session...

Classification

community

Est Downloads (All Time)

Release Date

Mar 18, 2025

Crawl4AI (Web Scraping & Crawling)

Ritvij Kumar Sharma

Integrates web scraping and crawling capabilities with tools for single-page content extraction, metadata retrieval,...

Classification

community

Est Downloads (All Time)

3.8k

Release Date

Mar 6, 2025

FireCrawl

Mendable

Enables web scraping, crawling, and data extraction through the FireCrawl API with configurable parameters for...

Classification

official

Est Downloads (All Time)

—

Release Date

Mar 18, 2025

Browser Use

Freddie

Enables AI assistants to navigate websites, extract content, and automate browser tasks through asynchronous...

Classification

community

Est Downloads (All Time)

144

Release Date

Mar 18, 2025

Browser Automation

Big Sweet Potato Studio

Enables web browsing capabilities through Puppeteer and Chrome, allowing navigation, content extraction, and...

Classification

community

Est Downloads (All Time)

4.7k

Release Date

Mar 19, 2025

Search1API

fatwang2

Integrates with Search1API to enable web searches, website crawling, and content extraction with configurable...

Classification

community

Est Downloads (All Time)

144

Release Date

Mar 19, 2025

Jina AI Web Search

GARCHENG

Integrates with Jina AI's web search and content fetching APIs, enabling web searches and URL content extraction for...

Classification

community

Est Downloads (All Time)

721

Release Date

Mar 12, 2025

Scrapling Fetch

cyberchitta

Enables AI to access text content from websites protected by bot detection mechanisms through three protection levels...

Classification

community

Est Downloads (All Time)

7.7k

Release Date

Mar 20, 2025

Scrappey

pim97

Bridges AI models with Scrappey's web automation platform, enabling browser session management, HTTP requests, and...

Classification

community

Est Downloads (All Time)

—

Release Date

Mar 21, 2025

Cloudflare Edge Services

Turinhub

Provides image generation, URL content extraction, and web search capabilities through Cloudflare Workers deployed...

Classification

community

Est Downloads (All Time)

—

Release Date

Mar 14, 2025

Web Content Explorer

wolfyy970

Fetches and explores web content with recursive link-following capabilities, using a dual-strategy approach with...

Classification

community

Est Downloads (All Time)

Release Date

Mar 22, 2025

Web Content Pick

kilicmu

Extracts structured content from web pages using customizable selectors for crawling, parsing, and analyzing HTML...

Classification

community

Est Downloads (All Time)

5.6k

Release Date

Mar 5, 2025

DeepResearch

Ameer Alns

Provides a stateful web research system that iteratively explores topics using Firecrawl for searches and GPT-4 for...

Classification

community

Est Downloads (All Time)

3.3k

Release Date

Mar 5, 2025

WebSearch (Google)

Manh La

Provides real-time web search capabilities via a dedicated crawler service with configurable result limits, language...

Classification

community

Est Downloads (All Time)

7.4k

Release Date

Mar 25, 2025

Docs Scraper

felores

Scrapes web-based documentation through multiple crawling strategies like sitemap traversal and menu navigation,...

Classification

community

Est Downloads (All Time)

288

Release Date

Mar 25, 2025

Mattermost Fetch

Kakehashi Inc

Web scraping server that fetches and processes web content with robust features like robots.txt compliance, LRU...

Classification

community

Est Downloads (All Time)

433

Release Date

Mar 26, 2025

One Search

zac ma

Provides a unified search and web scraping platform that integrates multiple search providers like SearxNG and...

Classification

community

Est Downloads (All Time)

9.2k

Release Date

Mar 18, 2025

Documentation Crawler

Jason Ruan

Documentation crawler service that fetches and serves technical documentation from specified sources, enabling access...

Classification

community

Est Downloads (All Time)

—

Release Date

Mar 28, 2025

Prysm Web Scraper

Pink Pixel

Provides web scraping capabilities with three specialized tools (scrapeFocused, scrapeBalanced, scrapeDeep) for...

Classification

community

Est Downloads (All Time)

3.8k

Release Date

Apr 4, 2025

Dumpling AI

Provides a bridge to Dumpling AI's data extraction API for performing web searches, scraping content, extracting...

Classification

official

Est Downloads (All Time)

Release Date

Mar 26, 2025

ScrAPI

DevEnterprise Software

Enables web scraping from sites with bot detection, captchas, or geolocation restrictions through residential proxies...

Classification

official

Est Downloads (All Time)

4.7k

Release Date

Apr 8, 2025

Web Scraper

Vishwajeet Dabholkar

Connects Claude Desktop to a local web scraper for retrieving and processing website content in markdown format with...

Classification

community

Est Downloads (All Time)

433

Release Date

Apr 9, 2025

Brave Deep Research

suthio

Combines Brave Search with web scraping to provide deep research capabilities by extracting full content from pages...

Classification

community

Est Downloads (All Time)

1.7k

Release Date

Mar 10, 2025

AI Cursor Scraping Assistant

The Web Scraping Club

Streamlines web scraper development for e-commerce sites by analyzing website structure, detecting anti-bot...

Classification

community

Est Downloads (All Time)

6.2k

Release Date

Apr 13, 2025

WebScraping.AI

Anand Kamble

Integrates with Instagram through the private API to provide authentication, profile management, content discovery,...

Classification

community

Est Downloads (All Time)

Release Date

Apr 15, 2025

Web Search and Semantic Similarity

DeepSpring AI

Provides web search and information extraction capabilities using SearchAPI.io for queries, Firecrawl for content...

Classification

community

Est Downloads (All Time)

288

Release Date

Apr 17, 2025

Chrome Browser Automation

dlwjdtn535

Enables AI-driven web automation through Chrome browser integration for tasks like navigation, interaction, form...

Classification

community

Est Downloads (All Time)

866

Release Date

Apr 17, 2025

Browser Scraping & Search

Raghu6798

Enables web scraping, internet searching, and local file interactions through Playwright, Firecrawl, and Tavily...

Classification

community

Est Downloads (All Time)

288

Release Date

Apr 20, 2025

Browser Use

Pietro Zullo

Enables AI to automate web browsing tasks through a unified interface that accepts natural language instructions for...

Classification

community

Est Downloads (All Time)

5.2k

Release Date

Apr 21, 2025

Crawl4ai Web Crawler

Ken Ye

Provides a bridge to the Crawl4ai web crawling service, enabling extraction of website content with configurable...

Classification

community

Est Downloads (All Time)

577

Release Date

Apr 21, 2025

Cloudflare Browser Rendering

Cloudflare

Browser automation for Cloudflare Workers and quick browser actions.

Classification

official

Est Downloads (All Time)

33.5k

Release Date

May 1, 2025

WebforAI Text Extractor

Yuta Kobayashi

Extracts and processes web page content into clean, readable markdown format for research and information gathering

Classification

community

Est Downloads (All Time)

288

Release Date

May 3, 2025

Website Scraper and Analyzer

Elizabeth Siegle

Enables website analysis and content extraction using Cloudflare Workers, providing tools to scrape, summarize, and...

Classification

community

Est Downloads (All Time)

866

Release Date

May 1, 2025

Crawl4AI RAG

Cole Medin

Integrates web crawling with RAG functionality to enable website content retrieval, storage in vector databases, and...

Classification

community

Est Downloads (All Time)

279k

Release Date

May 4, 2025

ScreenshotOne

Goon

Enables AI to capture and process screenshots of webpages with customizable parameters through the ScreenshotOne API...

Classification

community

Est Downloads (All Time)

727

Release Date

May 6, 2025

Puppeteer Vision Web Scraper

Denis Jannot

Automates web scraping by intelligently handling cookie banners, CAPTCHAs, and paywalls to extract clean markdown...

Classification

community

Est Downloads (All Time)

816

Release Date

May 15, 2025

Simplescraper

Integrates with the Simplescraper API to enable automated data extraction from websites without managing direct API...

Classification

official

Est Visitors (All Time)

16.2k

Release Date

May 26, 2025

Cloudflare AutoRAG

noops888

Enables AI systems to interact with Cloudflare's AutoRAG system for efficient document retrieval and contextual...

Classification

community

Est Downloads (All Time)

—

Release Date

May 23, 2025

Web Curl

Rayss

Enables web content retrieval and API interaction with customizable resource blocking, authentication options, and...

Classification

community

Est Downloads (All Time)

1.3k

Release Date

May 24, 2025

Better Fetch

flutterninja9

Fetches and processes web content with nested URL crawling capabilities. Transform any documentation site or web...

Classification

community

Est Downloads (All Time)

4.2k

Release Date

May 28, 2025

Web Scraper

navin4078

Provides web scraping capabilities through specialized tools for extracting text, links, images, tables, headlines,...

Classification

community

Est Downloads (All Time)

721

Release Date

Jun 7, 2025

Light Research

Code-Hex

Provides web content search and extraction through DuckDuckGo and GitHub Code Search APIs, converting web pages into...

Classification

community

Est Downloads (All Time)

Release Date

Jun 17, 2025

Web Crawler Data Bridge

Ben Caulfield

Advanced search and retrieval for web crawler data. Supports WARC, wget, Katana, SiteOne, and InterroBot crawlers.

Classification

community

Est Downloads (All Time)

18.8k

Release Date

Jun 19, 2025

Crawl4AI

Cole Medin

Provides advanced web crawling and RAG capabilities through Crawl4AI with semantic search, knowledge graph...

Classification

community

Est Downloads (All Time)

433

Release Date

Jul 15, 2025

Web Scraper

Laurence Morgan

Provides web scraping capabilities using Chrome's headless browser with automatic HTTP fallback, handling...

Classification

community

Est Downloads (All Time)

288

Release Date

Jul 15, 2025

Crawl4AI

omgwtfwow

Integrates with Crawl4AI to provide web crawling, content extraction, screenshot capture, PDF generation, and batch...

Classification

community

Est Downloads (All Time)

1.3k

Release Date

Jul 31, 2025

Crawl4AI RAG

Jason Guo

Combines web crawling with vector search to enable content extraction, semantic indexing, and retrieval-augmented...

Classification

community

Est Downloads (All Time)

Release Date

Jul 31, 2025

Crawl4AI

Nexus Digital Automations

Integrates Crawl4AI's async web crawler to extract webpage content in HTML or markdown formats, capture screenshots,...

Classification

community

Est Downloads (All Time)

144

Release Date

Aug 1, 2025

Jina Web Search

hypersniper05

Provides web crawling and search capabilities through Jina AI's API with URL content extraction and semantic web...

Classification

community

Est Downloads (All Time)

433

Release Date

Aug 9, 2025

Spider Web Scraper

Bosegluon2

Provides web scraping capabilities using Puppeteer and Cheerio to search Bing, extract webpage content, and convert...

Classification

community

Est Downloads (All Time)

144

Release Date

Aug 14, 2025

Exa AI

Anush D'Souza

Integrates with Exa AI's search engine to provide real-time web searching, company research, LinkedIn profile...

Classification

community

Est Downloads (All Time)

144

Release Date

Aug 15, 2025

LinkedIn Scraper

superyuser

Automates LinkedIn profile data extraction using Selenium WebDriver with anti-detection measures and progressive...

Classification

community

Est Downloads (All Time)

577

Release Date

Aug 24, 2025

Advanced Multi-Tool Analytics

Hezron Kimutai

Multi-purpose server that combines web scraping with content analysis, statistical data visualization, real-time...

Classification

community

Est Downloads (All Time)

—

Release Date

Aug 20, 2025

Firecrawl

Supercorp

Integrates with Firecrawl API to provide web scraping and search capabilities, enabling extraction of markdown...

Classification

community

Est Downloads (All Time)

Release Date

Aug 21, 2025

Scrapling

D4Vinci

Provides advanced web scraping capabilities with browser fingerprint impersonation, dynamic content fetching via...

Classification

official

Est Downloads (All Time)

—

Release Date

Oct 13, 2024

Web Search

hexdecimal16

Performs Google searches and crawls content from the top 5 non-social media results, filtering out social platforms...

Classification

community

Est Downloads (All Time)

577

Release Date

Sep 13, 2025

AnyCrawl

AnyCrawl Team

Integrates with the AnyCrawl API to provide web scraping and crawling capabilities with configurable depth limits,...

Classification

official

Est Downloads (All Time)

644

Release Date

Sep 15, 2025

Dumpling AI

Integrates with Dumpling AI's platform to provide web scraping, search, document conversion, multimedia processing,...

Classification

official

Est Downloads (All Time)

—

Release Date

Sep 28, 2025

Scraper

cotdp

Extracts content from websites through four core tools for HTML scraping, markdown conversion, text extraction, and...

Classification

community

Est Downloads (All Time)

577

Release Date

Oct 31, 2025

WebClone

Ruslan Magana

Website cloning engine with intelligent crawling, asset downloading, PDF generation, authentication support, and...

Classification

community

Est Downloads (All Time)

144

Release Date

Nov 25, 2025

Jina Supabase RAG

Marty Martin

Crawls and indexes documentation websites using Jina AI Reader API and Crawl4AI for intelligent content extraction,...

Classification

community

Est Downloads (All Time)

144

Release Date

Nov 26, 2025

WaterCrawl

Web crawling and scraping with search capabilities

Classification

community

Est Downloads (All Time)

Release Date

Apr 21, 2025

Multi-Agent Deep Researcher

anubhav-77-dev

Orchestrates three specialized agents (web searcher, research analyst, and technical writer) using CrewAI to automate...

Classification

community

Est Downloads (All Time)

144

Release Date

Nov 8, 2025

Crew Risk

DeeppathAI

Evaluates websites for crawling compliance and safety by analyzing robots.txt files, detecting anti-crawling...

Classification

community

Est Downloads (All Time)

433

Release Date

Nov 3, 2025