AITypeScript★ 2,205⑂ 230 forksMIT
withcatai/node-llama-cpp
RUN LLM LOCALLY IN NODE.JS
Run AI models directly on your computer via Node.js. Enforced JSON schema validation right at the generation level.
// KEY FEATURES
- Local model launch without servers
- JSON schema at generation level
- TypeScript bindings for llama.cpp
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram