openvinotoolkit / nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
Why this job: matched by what the repo talks about: inference, compression, framework, network
What it does
- Automatic, configurable model graph transformation to obtain the compressed model.
- Common interface for compression methods.
- GPU-accelerated layers for faster compressed model fine-tuning.
- Distributed training support.
- Git patch for prominent third-party repository (huggingface-transformers) demonstrating the process of integrating NNCF into custom training pipelines.
Get started
pip install nncf- Maintenance
- Active
- Last commit 3 days ago
- Stars
- 1,219
- +1 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v3.4.0
- Released 56 days ago
- Built with
- Python
- 92% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 93% closed
- 26 still open
- Pull requests
- 3,337 merged
- 33 waiting
- Releases
- 37
- 6 in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| tensorflow / model-optimization | 1,584 | 2 months ago | Apache-2.0 | No downloads |
| PaddlePaddle / PaddleNLP | 12,990 | 5 months ago | Apache-2.0 | No downloads |
| robertknight / rten | 363 | 2 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 92%
- Jupyter Notebook 7%
- Cuda <1%
- C++ <1%
Topics
- quantization
- pruning
- sparsity
- quantization-aware-training
- mixed-precision-training
- compression
- semantic-segmentation
- object-detection
- classification
- nlp
- bert
- transformers
Project record
- JobLocal LLMs
- StatusListed
- Commits3,160
- Forks315
- Watching32
- Stars in 28 days+9
- CreatedMay 13, 2020
- First seen by usNov 7, 2026
- CheckedNov 10, 2026