Skip to content
The Daily Repo

Automation and scraping, page 2

151 repos on our list for this job.

Ranked by a score of how recently it was updated, contributors, growth, stars gained and total stars, and releases. How we rank

More repos in this job

More repos in this job in Automation and scraping, page 2
126. FronkonGames /Steam-Games-Scraper

Extract information from all games published in Steam thanks to its Web API, and store it in JSON format.

168 stars+3 this week

127. mdowis /anansi

A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identity layer (Chrome TLS fingerprints, matched personas, vendor-aware Cloudflare/Akamai/DataDome handling) works to slip past bot detection. Ships with an MCP server so any LLM can drive a full crawl by conversation.

117 stars0 this week

128. m92vyas /llm-reader

Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.

315 stars+1 this week

129. mishushakov /llm-scraper

Turn any webpage into structured data using LLMs

6,953 stars+4 this week

130. normal-computing-oss /fuji-web

Fuji is an AI agent that lives in your browser's sidepanel. You can now get tasks done online with a single command!

598 stars0 this week

131. leoxiaoping /pbottleRPA

pbottleRPA is a professional RPA+AI software for professional users. It supports process automation for both web browsers and desktop client applications, and allows workflow development with JavaScript and Python scripting.

154 stars0 this week

132. maypaz /md.page

Instantly turn Markdown into a shareable web page. Self-hostable open-source engine of md.page.

117 stars0 this week

133. paulpierre /markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

480 stars+1 this week

134. ShuxinYang111 /oysterworkflow

Teach AI how your work actually gets done. Capture real computer work, extract the workflow graph and judgment, then run it with Codex or your own agent.

175 stars0 this week

135. ai-naymul /BrowserPilot

Open‑source alternative to Perplexity Comet, director.ai and firecrawl combined

180 stars0 this week

136. X-isdoingreat /canvas-pilot

Local-first Canvas LMS AI agent that learns each course's recurring assignment workflow and reuses it through scan -> approval -> execute with student review.

125 stars0 this week

137. oxbshw /Open-Workflow-Library

Open workflow intelligence for discovering, validating, repairing, and generating automation workflows across frameworks — starting with n8n.

558 stars+1 this week

138. EthanXiang777 /ash-agents

A swarm of disposable agents for unattributable web interaction

414 stars-3 this week

139. instructa /browser-echo

⚡ Stream browser logs to terminal, zero setup, perfect for Ai Agents

320 stars+1 this week

140. rodricios /wxpath

wxpath - declarative web crawling with XPath; a Web Query Language (WQL)

110 stars0 this week

Type to search.

Try

Stars
This week
Contributors, 90 days
Updated
Licence