arcee-ai/mergekit

Mergekit offers tools to merge pretrained LLMs, combining weights, averages, and layers from different architectures like Llama. Output is a single model preserving the strengths of the sources.

// KEY FEATURES

• Merges weights of several models using averaging or linear interpolation.
• Supports merging Llama, Falcon and other architectures via adapter layers.
• Allows selecting specific layers or attention‑heads for fine‑tuning.
• Exports the resulting model as Hugging Face Transformers ready for quick deployment.

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.