R_REDDYX.XYZ
AIJupyter Notebook★ 42,461⑂ 4,389 forksApache-2.0

lyogavin/airllm

AIRLLM: 70B Model on 4GB GPU

Running huge LLMs on weak hardware. AirLLM enables inference of 70B models on a single 4GB GPU.

// KEY FEATURES

  • 70B model on 4GB GPU
  • Memory optimization for inference
  • Running on low-end hardware
#chinese-llm#chinese-nlp#finetune#generative-ai#instruct-gpt#instruction-set#llama#llm#lora#open-models#open-source#open-source-models
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Jan: Offline GPT Chat★ 42498Ray: AI Compute Engine★ 42516Nanobot: lightweight agent★ 42240OPENHUMAN: YOUR AI GIANT★ 42704Kong API Gateway★ 43377Claude Code Collection★ 43430

← FULL CATALOG

lyogavin/airllm — AIRLLM: 70B Model on 4GB GPU | REDDYX AI