AIHTML★ 969⑂ 257 forksApache-2.0
data-prep-kit/data-prep-kit
DATA PREP KIT: ACCELERATE AI GENERATION
Open-source toolkit for preparing data to train and use GenAI models. Simplifies cleaning, transformation, and labeling of datasets.
// KEY FEATURES
- Automatic text cleaning and normalization
- Support for multiple formats: CSV, JSON, Parquet
- Ready-made pipelines for RAG and fine‑tuning
#code-quality#data#data-prep#data-preparation#data-preprocessing#data-preprocessing-pipelines#datacuration#datarecipes#deduplication#finetuning#large-language-models#large-scale-data-processing
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram