brainfish-ai / webcrawl-anything
Give your AI agent the whole web. Free, local, no API key. Search, scrape, map, crawl and monitor any site, PDF, YouTube video or CVE from Claude Code, Cursor, Codex or the CLI.
Why this job: topics: web-scraping, crawler, web-crawler
What it does
That installs all eight Webcrawl Agent Skills into Claude Code, Cursor, Codex, Gemini, Windsurf or any agent that reads SKILL.md. Only want one? Pick it by name:
Get started
npx webcrawl setup- Maintenance
- Active
- Last commit 2 days ago
- Stars
- 15
- +13 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v1.4.5
- Released 2 days ago
- Built with
- TypeScript
- 96% of the code
Is it looked after?
- Contributors
- 3
- Last 90 days
- Issues
- 20% closed
- 4 still open
- Pull requests
- 27 merged
- 2 waiting
- Releases
- 16
- 16 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| ScrapeGraphAI / Scrapegraph-ai | 32,668 | 35 days ago | MIT | No downloads |
| firecrawl / firecrawl | 200,182 | today | AGPL-3.0 | No downloads |
| fastcrw / crw | 1,240 | yesterday | AGPL-3.0 | Mac, Linux |
More: languages, topics and project record
Languages
- TypeScript 96%
- JavaScript 2%
- HTML 2%
- Shell 1%
Topics
- ai-agents
- claude-code
- cursor
- mcp
- pdf-parser
- search-engine
- typescript
- web-crawler
- codex
- crawler
- firecrawl-alternative
- llm
Project record
- JobAutomation and scraping
- StatusNew to our list
- Commits70
- Forks4
- Watching0
- CreatedOct 31, 2026
- First seen by usNov 7, 2026
- CheckedNov 10, 2026