Openai API: open-source projects on GitHub
86 repositories on Openai API, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
OpenAI Cookbook
Examples and guides for using the OpenAI API.
★ 73,662 · Jupyter NotebookFree GPT Access
The xtekky/gpt4free repository offers open access to a variety of powerful language models such as Opus 4.6, GPT‑5.3, Kimi 2.5, DeepSeek V3.2 and Gemini 3, enabling users
★ 66,265 · PythonLLM API Management
A unified platform for managing LLM API with support for OpenAI, Azure, Claude, and others. Provides a single binary, Docker image, and easy installation.
★ 33,542 · JavaScriptLLM Server for Apple Silicon
A powerful inference server with support for continuous batching and SSD caching, running on Apple Silicon and controlled via the macOS menu bar.
★ 14,445 · PythonLangChain4j for JVM
Java library for LLM applications: a unified API to providers and vector stores, tool calling, agents, RAG, and integration with Quarkus and Spring Boot.
★ 11,973 · JavaXINFERENCE - ANY LLM ONE LINE
Replace GPT with any open model by changing just one line of code. Run LLM, multimodal, and speech models via a single production-ready API.
★ 9,318 · PythonCONNECT ANY AGENTS TO LLM
Connect any AI agents and tools to any LLM provider via a unified gateway. Supports Anthropic, OpenAI and other APIs, tracking cost and usage.
★ 7,636 · TypeScriptSmart Model Router
Automatically selects the optimal model for each agent request, reducing inference costs by up to 70%.
★ 6,565 · TypeScriptATOMIC AI AGENTS
A project for creating AI agents using a modular approach. Easy to assemble, extend, and integrate.
★ 6,330 · PythonATOMIC-AGENTS - BUILD AGENTS ATOMICALLY
Framework for building AI agents from minimal components. Python, flexible architecture, 5.9K stars.
★ 5,948 · PythonVLMEvalKit - TOP TOOL FOR MODEL EVALUATION
Open tool for evaluating multimodal models. Supports 220+ LMM and 80+ benchmarks.
★ 4,492 · PythonOPTILLM — SPEEDING LLM INFERENCE
optillm — a proxy accelerator for LLMs that reduces latency and saves resources during inference.
★ 4,343 · PythonLLAMA-SWAP - RELIABLE MODEL REPLACEMENT
Utility for seamless model replacement on local servers (llama.cpp, vLLM, etc.)
★ 4,328 · GoLemonade SDK
Lemonade helps users run local AI applications by optimizing LLM performance on their GPU and NPU. Join our Discord!
★ 4,059 · C++LANGRID - Multi-agent AI for Code
A simple framework for building LLM-based agents with memory and tool support.
★ 4,029 · PythonSIMPLE AND POWERFUL FRAMEWORK
Lightweight framework for building multi-agent workflows and voice agents in TypeScript.
★ 3,141 · TypeScriptOPEN AI FOR SWIFT
The Swift developer community introduced a convenient package for working with the public OpenAI API.
★ 2,914 · SwiftPROJECT MAYA: LOCAL LLM ENGINE
Project Maya lets you run GLM-5.3-Flash (321B MoE) locally on a single GPU or up to 16 GPUs, supporting NVIDIA and AMD on Linux and Windows. The package includes engine,
★ 2,898 · C++ORCALITE LLM ROUTER SELF-HOSTED
Self-hosted LLM router with managed safety net and OpenAI‑compatible API. Supports BYOK, a single workspace, and streaming generation. For advanced routing use the hosted
★ 2,794 · PythonGenerative AI Roadmap Projects
A collection of generative AI resources: roadmap, projects, interview and coding preparation.
★ 2,670 · Jupyter NotebookOPEN SPEC FOR OPENAI API
OpenAPI specification enabling easy integration and documentation of OpenAI model calls.
★ 2,584NATIVE LLM SERVER FOR MAC
LLM server compatible with OpenAI+Anthropic, no Python required. Includes MLX Core macOS: chat, agent, and tool calling.
★ 2,472 · ZigEXCELLENT LIST OF CHATGPT RESOURCES
A curated list of the best libraries, SDKs, and APIs for working with ChatGPT. Support the project by starring it!
★ 2,419PHP SDK FOR OPENAI
The community has developed a PHP SDK for working with the OpenAI API. Supports GPT‑3, DALL·E 2 and other models, easily integrates into Laravel and CakePHP.
★ 2,360 · PHPMEMMI-AGENT SHARED AI MEMORY
Personal AI agent and local memory hub for all AI assistants. Provides a shared, controllable context storage so each AI remembers the same user.
★ 2,217 · TypeScriptFast Local AI Engine
Rapid-MLX is the fastest local AI engine for Apple Silicon, running 4.2× faster than Ollama and providing a cached first-token time of just 0.08s.
★ 2,185 · PythonGPTDISCORD: MULTIFUNCTIONAL AI BOT
GPTDiscord — a powerful Discord bot that combines ChatGPT‑style conversations, image generation, AI moderation, custom knowledge bases and YouTube summarisation. It suppo
★ 1,852 · PythonSGLANG-OMNI: OMNI-SERVICE FOR AI
SGLang-Omni provides high-performance execution of TTS, ASR, and speech omni-models on Python.
★ 1,791 · PythonTRANSLATE BOOKS WITH LLM
Translates books and documents using Ollama, OpenAI, Gemini, and other models. Preserves formatting and resumes translation from the last point.
★ 1,770 · PythonLLM Inference on AWS Trainium
Open-source LLM inference engine for AWS Trainium featuring NKI megakernels, 1M-token context, and OpenAI-compatible API.
★ 1,585 · PythonAI WRITES COMMITS FOR YOU
A Go CLI tool that uses gpt-4.1 to automatically generate commit messages and perform a quick code review directly from the terminal.
★ 1,506 · GoFAST LAUNCH QWEN3.8 ON AMD
The project provides scripts for instant deployment of Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151) GPU via HIP. All dependencies are built automatically, and inference
★ 1,349 · ShellNEUROAPI: RUSSIAN AI API
NeuroAPI provides secure one‑click installers for Windows/macOS, connecting Codex CLI and Claude Code to the Russian AI API. Works with Anthropic, OpenAI and local LLM mo
★ 1,318 · PowerShellKUBEAI – Integral Inference Operator
AI Inference Operator for Kubernetes: the simplest way to deploy ML models in production. Supports VLM, LLM, embeddings, and STT.
★ 1,291 · GoSEARCH2AI - Smart Search for LLM
Connect web search to your LLMs and get up-to-date answers in real time.
★ 1,288 · JavaScriptLightAgent: AI Agent with Memory
A lightweight framework for AI agents with memory, MCP, and skills. Supports multi-agent interaction, self-learning, and major LLMs.
★ 1,247 · PythonRUST RUNTIME FOR LLM INFERENCE AND EDITING
larql — Rust runtime to run, serve, and edit models. VINDEX3 format makes models executable and inspectable. 1173⭐ on GitHub.
★ 1,175 · RustSCHEMA-GUIDED REASONING AGENT
sgr-agent-core — a framework for building agent systems using Schema-Guided Reasoning in Python from the neuraldeep community.
★ 1,128 · PythonRUN LARGE LLMS LOCALLY
PolyStrata runs Qwen3.8-Flash, GLM 5.3 Flash, DeepSeek V4 and more on your PC. One-click install for Windows and Linux with OpenAI/Anthropic API on localhost.
★ 1,037 · C++AI-GATEWAY: EXPLORE AI MODELS NOW
AI Gateway on Azure and Foundry: explore models, MCP servers and agents in Jupyter.
★ 1,010 · Jupyter NotebookOPEN BEDROCK GATEWAY API
The project gives an OpenAI‑compatible REST interface to Amazon Bedrock, allowing models to be called via familiar requests. It supports chat/completions, embeddings endp
★ 1,003 · PythonLLM TUTORIALS IN PYTHON
Collection of notebooks for learning LLM: LangChain, LlamaIndex, OpenAI. Ready scripts for RAG, ChromaDB and Pinecone vector stores. 933 stars on GitHub.
★ 933 · Jupyter NotebookVOICE CONTROL YOUR WORLD
Linguflex is a voice AI assistant in Python with function calling. Control code, files, and APIs with one phrase via OpenAI.
★ 813 · PythonFREE TPU FOR QWEN3.8-27B
The kaggle-tpu-lab project runs Qwen3.8-27B (bf16) on a free Kaggle TPU, providing an OpenAI‑compatible API. It supports a 262k token context and ~130 tokens/s speed, wor
★ 801 · PythonSWIFTLM: SWIFT LLM ON APPLE
Native LLM inference server in Swift with MLX, OpenAI‑compatible API, SSD streaming for MoE >100B and TurboQuant KV‑cache compression.
★ 799 · SwiftPARROT.NVIM: STOCHASTIC PARROT
The plugin adds an AI parrot to Neovim, generating code and comments on the fly.
★ 792 · LuaHACKER-NEWS-DIGEST - READ FASTER WITH AI
Automatically summarizes fresh Hacker News with ChatGPT so you stay updated without extra reading.
★ 754 · PythonNORNICDB: ULTRAFAST GRAPH-VECTOR DB
A distributed database featuring sub-millisecond HNSW search, graph traversal, and support for Neo4j Bolt/Cypher plus Qdrant gRPC.
★ 753 · GoPEGAINFER: Rust + CUDA Infer
Pure Rust LLM engine with CUDA acceleration, OpenAI API compatible, runs Qwen3 and Kimi‑K2 without PyTorch.
★ 742 · RustMLX Studio: Main JANG_Q Tool
Image generation and editing, chat and code in one place with support for OpenClaw and Anthropic API.
★ 727RAGLight modular RAG framework
A flexible framework for Retrieval-Augmented Generation in Python. Support for various LLMs, embeddings, vector stores, and seamless integration with MCP.
★ 674 · PythonSTART AI CHATBOTS
A set of examples for quick-starting applications on OpenAI ChatKit SDK. Allows integrating AI chat into any projects in minutes.
★ 670SWIFTOPENAI: COMPLETE SDK FOR OPENAI
The most complete open-source Swift package for working with the public OpenAI API. Support for all models, streaming output, and convenient types.
★ 666 · SwiftOPENAI SDK FOR FLUTTER/DART
A Dart/Flutter package that lets you easily integrate ChatGPT, DALL·E, and other OpenAI services into your app.
★ 665 · DartOLLITERT LLM SERVER ANDROID
OlliteRT turns your Android smartphone into a local inference server compatible with the OpenAI API. It works completely offline, ensuring privacy and open-source code in
★ 633 · KotlinCHATS - UNIVERSAL AI GATEWAY
A powerful frontend gateway for LLM with support for 21+ models and simple integration.
★ 621 · C#API RELAY SECURITY SCANNER
Local scanner for AI API relays and LLM proxies. 620 ⭐ on GitHub.
★ 620 · PythonVMLX - NEXT-GEN MLX MODELS
Ultra-fast compressed MLX models with two-level cache, hybrid scheduler, and continuous batching.
★ 561 · PythonSIMPLEMIND: LIGHTWEIGHT AI API CLIENT
Python client for Anthropic, Gemini, and other LLMs. Replaces LangChain and LangGraph for common tasks — no extra abstractions or complexity.
★ 541 · PythonPENTEST HARNESS FOR HACKERS
Pentest Harness — a self‑hosted AI‑agent framework for authorized pentests, bug bounty, security labs, and CTFs. Connect your own model via API; all sessions run strictly
★ 471 · TypeScriptNew projects on this topic in Telegram
Telegram →