sadiuysal / crawl4ai-mcp-server
🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.
Why this job: name: mcp; says: mcp server, model context protocol; topics: model-context-protocol, mcp
What it does
- MCP Tools. Exposes 4 powerful tools: scrape, crawl, crawl_site, crawl_sitemap via stdio MCP server
- Web Scraping. Single-page scraping with markdown extraction
- Web Crawling. Multi-page breadth-first crawling with depth control
- Adaptive Crawling. Smart crawling that stops when sufficient content is gathered
- Safety. Blocks internal networks, localhost, and private IPs
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Inactive
- Last commit 9 months ago
- Stars
- 118
- +1 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 82% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 50% closed
- 1 still open
- Pull requests
- 0 merged
- 1 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| DasDigitaleMomentum / searxNcrawl | 189 | 2 days ago | MIT | No downloads |
| brightdata / brightdata-mcp | 2,722 | 3 days ago | MIT | No downloads |
| KnockOutEZ / wigolo | 5,538 | 2 days ago | Custom | Mac, Windows, Linux |
More: languages, topics and project record
Languages
- Python 82%
- Shell 15%
- Dockerfile 4%
Topics
- ai-agents
- claude-code
- crawl4ai
- cursor
- firecrawl-alternative
- mcp
- model-context-protocol
- openai-agents
- openai-agents-sdk
- web-crawling
- web-scraping
Project record
- JobMCP servers
- StatusListed
- Commits15
- Forks22
- Watching3
- Stars in 28 days+3
- CreatedAug 14, 2025
- First seen by usNov 7, 2026
- CheckedNov 8, 2026