AIPython★ 606
zhudotexe/kani
KANI: MICROFRAMEWORK FOR LLM TOOLS
Kani — a Python microframework for building tool‑calling agents with support for GPT‑4, Llama and other LLMs. It lets you quickly connect arbitrary functions and tools via a simple API. Developed within NLP‑OSS and presented at EMNLP 2023.
// KEY FEATURES
- Generates JSON‑schema for functions directly from docstring via @tool decorator
- Supports async tool invocation and streaming output of LLM responses
- Caches tool‑call results in memory, reducing tokens on repeated calls
- Integration with OpenAI, Anthropic and local LLMs via a unified API
#chatgpt#framework#function-calling#gpt-4#large-language-models#llama#llms#microframework#openai#tool-use
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram