datamllab / OpenEBFM
Open-source code for training and scaling up energy-based foundation models.
Why this job: topics: fine-tuning, reinforcement-learning
What it does
On DCLM, validation BPB falls as training tokens and model size increase. Zero-shot accuracy scales with model size across ClimbMix, DCLM, and FineWeb, and improves with training tokens.
Get started
uv sync --extra gpu --extra hf --extra web
source .venv/bin/activate - Maintenance
- Active
- Last commit 6 days ago
- Stars
- 301
- +58 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 99% of the code
Is it looked after?
- Contributors
- 2
- Last 90 days
- Issues
- 0% closed
- 2 still open
- Pull requests
- 0 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Goekdeniz-Guelmez / MLX-LoRA-Studio | 287 | 13 days ago | MIT | Mac |
More: languages, topics and project record
Languages
- Python 99%
- Shell 1%
Topics
- energy-based-models
- fine-tuning
- language-models
- llm
- post-training
- pretraining-model
- scaling-laws
- energy-based-language-models
- ai
- foundation-models
- large-language-model
- pre-training
Project record
- JobFine-tuning
- StatusListed
- Commits18
- Forks26
- Watching19
- Stars in 28 days+271
- CreatedSep 21, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026