opendatalab / MinerU-HTML

What it does

• LLM-Powered Extraction. Uses state-of-the-art language models to intelligently identify main content
• Extensible Output. Integrated with MinerU-Webkit to support efficient conversion of extracted HTML into Markdown, JSON and Txt.
• Compact Format. Now use compact format for the model instead of the original JSON format for faster inference speed
• Regex structured output. Now use regex structured output for the model instead of the custom logits processor, so we can use vLLM v1 backend for inference.
• Complete Processing Pipeline. Includes HTML simplification, prompt construction, LLM inference, result parsing, main content extraction, and other complete processes