R_REDDYX.XYZ
AIKotlin★ 633⑂ 98 forksApache-2.0

NightMean/OlliteRT

OLLITERT LLM SERVER ANDROID

OlliteRT turns your Android smartphone into a local inference server compatible with the OpenAI API. It works completely offline, ensuring privacy and open-source code in Kotlin.

// KEY FEATURES

  • Runs LLM inference directly on the device without needing the cloud.
  • Provides an HTTP endpoint fully compatible with the OpenAI API (chat/completions).
  • Supports Gemma and Anthropic models via LiteRT (TensorFlow Lite) in Kotlin.
  • Easy integration with Home Assistant for voice control of a smart home.
#android#anthropic-api#gemma#home-assistant#kotlin-android#litert#litert-lm#llm#llm-inference#local-llm#on-device-ai#openai-api
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

ZEPTOCLAW - LOCAL AI ON RUST★ 633LIBRETTO: AI Browser Automation★ 634LLM-BASED BANK AUTOMATION★ 634TOUCHDESIGNER ARRIVES ON MCP★ 634COCO Superintelligent Agent★ 632DOCKER SKILLS FOR AI AGENTS★ 634

← FULL CATALOG

NightMean/OlliteRT — Ollitert LLM Server Android | REDDYX AI