ConardLi / easy-dataset
A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
Why this job: topics: fine-tuning, dataset, fine tuning
What it does
- Intelligent Document Processing. Supports PDF, Markdown, DOCX, TXT, EPUB and more formats with intelligent recognition
- Intelligent Text Splitting. Multiple splitting algorithms (Markdown structure, recursive separators, fixed length, code-aware chunking), with customizable visual segmentation
- Intelligent Question Generation. Auto-extract relevant questions from text segments, with question templates and batch generation
- Domain Label Tree. Intelligently builds global domain label trees based on document structure, with auto-tagging capabilities
- Answer Generation. Uses LLM API to generate comprehensive answers and Chain of Thought (COT), with AI optimization
Get started
git clone https://github.com/ConardLi/easy-dataset.git
cd easy-dataset - Maintenance
- Inactive
- Last commit 6 months ago
- Stars
- 15,111
- +31 this week
- Licence
- Custom
- Read before business use
- Downloads for
- 3 systems
- Mac, Windows, Linux
- Latest version
- 1.7.3
- Released 7 months ago
- Built with
- JavaScript
- 100% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 79% closed
- 119 still open
- Pull requests
- 129 merged
- 17 waiting
- Releases
- 33
- 6 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| R6410418 / Jackrong-llm-finetuning-guide | 1,741 | 9 days ago | Apache-2.0 | No downloads |
| tensorflow / datasets | 4,611 | yesterday | Apache-2.0 | No downloads |
| arkorlab / fine-tuning | 146 | 22 days ago | MIT | No downloads |
More: download files, languages, topics and project record
Download files, 1.7.3
- Mac2 files, 1,807 downloads
- Windows1 file, 6,706 downloads
- Linux2 files, 799 downloads
Languages
- JavaScript 100%
- HTML <1%
- Shell <1%
- Dockerfile <1%
Topics
- dataset
- javascript
- llm
- fine-tuning
- rag
Project record
- JobFine-tuning
- StatusListed
- Commits951
- Forks1,545
- Watching64
- Stars in 28 days+132
- CreatedMar 4, 2025
- First seen by usNov 7, 2026
- CheckedNov 8, 2026