R_REDDYX.XYZ
AIHTML★ 969⑂ 257 forksApache-2.0

data-prep-kit/data-prep-kit

DATA PREP KIT: ACCELERATE AI GENERATION

Open-source toolkit for preparing data to train and use GenAI models. Simplifies cleaning, transformation, and labeling of datasets.

// KEY FEATURES

  • Automatic text cleaning and normalization
  • Support for multiple formats: CSV, JSON, Parquet
  • Ready-made pipelines for RAG and fine‑tuning
#code-quality#data#data-prep#data-preparation#data-preprocessing#data-preprocessing-pipelines#datacuration#datarecipes#deduplication#finetuning#large-language-models#large-scale-data-processing
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

GROUNDING LMM: SEE AND UNDERSTAND★ 969AWESOME-HOSTING TOP CHEAP HOSTINGS★ 970REARK AI-ANALYSIS APK AND HAP★ 970AI Application Evaluation★ 971AgileRL - Evolutionary Acceleration★ 967ONE ID FOR AI AGENT★ 972

← FULL CATALOG

data-prep-kit/data-prep-kit — Data Prep Kit: Accelerate AI…