R_REDDYX.XYZ
AIPython★ 302⑂ 28 forksApache-2.0

opendatalab/MinerU-HTML

SLM EXTRACTOR FOR MAIN HTML CONTENT

MinerU-HTML uses a small language model to extract main content from HTML pages. Outputs clean HTML without clutter. Ideal for RAG, deep research agents, and training data generation.

// KEY FEATURES

  • Extracts main content via SLM
  • Returns clean HTML without navigation and ads
  • Runs offline on CPU without API keys
  • Suits RAG, scraping, and datasets
#article-extractor#corpus-tools#nlp#rag#scraping#text-extraction#trafilatura#web-scraping#webagent
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

HarnessKit - Universal Agent Manager★ 302COLETTE Multimodal RAG★ 302ADLOOP: AI HUB FOR ADVERTISING★ 302AGENTSWARMS AI BUSINESS PLATFORM★ 302Soku CLI for data★ 302ALGO‑SENSEI:AI MENTOR FOR ALGORITHMS★ 302

← FULL CATALOG

opendatalab/MinerU-HTML — Slm Extractor For Main Html Content