R_REDDYX.XYZ
AITypeScript★ 2,205⑂ 230 forksMIT

withcatai/node-llama-cpp

RUN LLM LOCALLY IN NODE.JS

Run AI models directly on your computer via Node.js. Enforced JSON schema validation right at the generation level.

// KEY FEATURES

  • Local model launch without servers
  • JSON schema at generation level
  • TypeScript bindings for llama.cpp
#ai#bindings#catai#cmake#cmake-js#cuda#embedding#function-calling#gguf#gpu#grammar#json-schema
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

LLM Token Compression★ 2206MCP-GSC: SEO Insights with Claude AI★ 2207macOS System Data Analysis★ 2208OHMYGAME — GAME STUDIO AI★ 2214MEMMI-AGENT SHARED AI MEMORY★ 2217YOVOICE LOCAL AI STUDIO★ 2193

← FULL CATALOG

withcatai/node-llama-cpp — Run LLM Locally IN Node.JS