R_REDDYX.XYZ
AIPython★ 1,860⑂ 378 forksApache-2.0

NVIDIA-NeMo/Curator

CURATOR: LLM DATA PREPARATION

Curator is a toolkit for preprocessing and curating data, accelerating LLM training.

// KEY FEATURES

  • Automatic data cleaning and normalization
  • Support for multiple formats (CSV, JSON, Parquet)
  • Integration with popular LLM frameworks
#data#data-curation#data-prep#data-preparation#data-processing#data-processing-pipelines#data-quality#datacuration#datarecipes#deduplication#fast-data-processing#fine-tuning
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

MCP SERVER FOR BRAZILIAN API★ 1863HOPE-AGENT: SMART AI AGENT FOR DESKTOP★ 1857TencentDB Agent Memory★ 1865BEST LLM SKILLS COLLECTION★ 1865GPTDISCORD: MULTIFUNCTIONAL AI BOT★ 1852TOOLS FOR CLAUDE CODE★ 1851

← FULL CATALOG

NVIDIA-NeMo/Curator — Curator: LLM Data Preparation