AIJavaScript★ 357⑂ 44 forksMIT
jasonacox/TinyLLM
RUN LLM LOCALLY ON ANY HARDWARE
TinyLLM lets you run a local LLM and chatbot on consumer hardware. The JavaScript project uses llama-cpp-python for inference without GPU. 352 stars on GitHub.
// KEY FEATURES
- Runs on CPU without GPU via llama-cpp-python
- OpenAI API compatible for easy migration
- Ready-to-use chat interface out of the box
- One-command install via npm
#artificial-intelligence#chatbot#large-language-models#llama-cpp-python#llm#openai#rag#retrieval-augmented-generation#vllm
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram