yohasebe / wp2txt
A command-line tool to extract plain text from Wikipedia dumps with category and section filtering
Why this job: works in the areas we cover, but does not say which job it does
What it does
- Auto-download. Automatically download dumps by language code
- Article extraction by title. Extract specific articles without downloading full dumps
- Category-based extraction. Extract all articles from a specific Wikipedia category
- Category metadata extraction. Preserves article category information in output
- Template expansion. Expands common templates (dates, units, coordinates) to readable text
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 15 days ago
- Stars
- 196
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Ruby
- 100% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 48% closed
- 11 still open
- Pull requests
- 3 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| kermitt2 / entity-fishing | 269 | 8 months ago | Apache-2.0 | No downloads |
| bilibili / Index-1.9B | 1,038 | 17 days ago | Apache-2.0 | No downloads |
| Roriz / active_genie | 166 | 3 months ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Ruby 100%
- Shell <1%
- Dockerfile <1%
Topics
- corpus
- machine-learning
- nlp
- ruby
- wikipedia
- wikipedia-dump
Project record
- JobOther AI tools
- StatusListed
- Commits258
- Forks36
- Watching10
- Stars in 28 days0
- CreatedJun 6, 2012
- First seen by usNov 7, 2026
- CheckedNov 8, 2026