AIJupyter Notebook★ 21,491
lyogavin/airllm
AIRLLM: 70B Model on 4GB GPU
Running huge LLMs on weak hardware. AirLLM enables inference of 70B models on a single 4GB GPU.
// KEY FEATURES
- 70B model on 4GB GPU
- Memory optimization for inference
- Running on low-end hardware
#chinese-llm#chinese-nlp#finetune#generative-ai#instruct-gpt#instruction-set#llama#llm#lora#open-models#open-source#open-source-models
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram