R_REDDYX.XYZ
AIPython★ 613⑂ 33 forksMIT

zhudotexe/kani

KANI: MICROFRAMEWORK FOR LLM TOOLS

Kani — a Python microframework for building tool‑calling agents with support for GPT‑4, Llama and other LLMs. It lets you quickly connect arbitrary functions and tools via a simple API. Developed within NLP‑OSS and presented at EMNLP 2023.

// KEY FEATURES

  • Generates JSON‑schema for functions directly from docstring via @tool decorator
  • Supports async tool invocation and streaming output of LLM responses
  • Caches tool‑call results in memory, reducing tokens on repeated calls
  • Integration with OpenAI, Anthropic and local LLMs via a unified API
#chatgpt#framework#function-calling#gpt-4#large-language-models#llama#llms#microframework#openai#tool-use
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

Code Complexity Optimizer★ 613Arkon — AI Management for Teams★ 612Best practices for AI agents★ 614ALTIMATE-CODE AI FOR DATA★ 612AGENT2AGENT: ALL IN ONE★ 614AI Task Gen for Claude★ 612

← FULL CATALOG

zhudotexe/kani — Kani: Microframework For LLM Tools