R_REDDYX.XYZ
AIPython★ 7,452⑂ 805 forksLGPL-3.0

arcee-ai/mergekit

COMBINE LLM MODELS EASILY

Mergekit offers tools to merge pretrained LLMs, combining weights, averages, and layers from different architectures like Llama. Output is a single model preserving the strengths of the sources.

// KEY FEATURES

  • Merges weights of several models using averaging or linear interpolation.
  • Supports merging Llama, Falcon and other architectures via adapter layers.
  • Allows selecting specific layers or attention‑heads for fine‑tuning.
  • Exports the resulting model as Hugging Face Transformers ready for quick deployment.
#llama#llm#model-merging
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Tiny Pixel Effect Snippets★ 7450IPOLLOWORK: Local AI Workspace★ 7457AGENT-ORCHESTRATOR - Autonomous AI Agent Orchestrator★ 7446GLM-5: FROM VIBE CODE TO AGENTIC ENGINEERING★ 7459AI Short Video Maker★ 7444HERTZBEAT: AI MONITORING IN REAL TIME★ 7470

← FULL CATALOG

arcee-ai/mergekit — Combine LLM Models Easily | REDDYX AI