R_REDDYX.XYZ
AIJavaScript★ 357⑂ 44 forksMIT

jasonacox/TinyLLM

RUN LLM LOCALLY ON ANY HARDWARE

TinyLLM lets you run a local LLM and chatbot on consumer hardware. The JavaScript project uses llama-cpp-python for inference without GPU. 352 stars on GitHub.

// KEY FEATURES

  • Runs on CPU without GPU via llama-cpp-python
  • OpenAI API compatible for easy migration
  • Ready-to-use chat interface out of the box
  • One-command install via npm
#artificial-intelligence#chatbot#large-language-models#llama-cpp-python#llm#openai#rag#retrieval-augmented-generation#vllm
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

CLAWMETRY - SEE AGENT THOUGHTS★ 357TESTDRIVERAI - E2E TEST AUTOMATION★ 357COLPALI-COOKBOOKS — COOKING MULTIMODAL RAG★ 357OAuth framework for AI★ 357LoRA Dataset Studio★ 357COMPREHENSIVE DATA SCIENCE PORTFOLIO★ 357

← FULL CATALOG

jasonacox/TinyLLM — Run LLM Locally ON Any Hardware