R_REDDYX.XYZ

Compression: open-source projects on GitHub

12 repositories on Compression, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094MCP 1601Agent 547Anthropic 452Claude Code 1595Cursor 358RAG 533Token Optimization 33LLM Inference 76Context Engineering 84Context Window 16Fastapi 101Langchain 196Openai 690
headroomlabs-ai/headroom

LLM Input Compression

Compresses tool outputs, logs, files, and RAG chunks before sending to the LLM, cutting token usage by 60‑95% without loss of quality.

★ 79,744 · Python
deepspeedai/DeepSpeed

DeepSpeed: optimization library for training

DeepSpeed is an optimization deep learning library ensuring efficient distributed training and inference. Supports ZeRO, MoE and parallelism for training models with hund

★ 43,332 · Python
aiming-lab/SimpleMem

MEMORY FOR AI AGENTS

SimpleMem — efficient long-term memory for LLM agents with support for text and multimodal data.

★ 3,878 · Python
vortex-data/vortex

VORTEX — MOST STRUCTURED DATA FORMAT

Vortex is an extensible framework for columnar data compression and the fastest open columnar format. It is the primary tool for next‑generation analytics from LFAI&Data.

★ 2,966 · Rust
chopratejas/headroom

headroom — compression for LLM

Compresses tool outputs, logs, files, and RAG chunks before sending to the LLM, cutting tokens by 60–95% while preserving answer quality. Library, proxy, and MCP server.

★ 1,828 · Python
openvinotoolkit/nncf

NNCFF - ACCELERATING MODEL INFERENCE

NNCFF is a neural network compression framework for accelerated inference in OpenVINO™. It reduces model size while preserving accuracy.

★ 1,221 · Python
ooples/token-optimizer-mcp

TOKEN OPTIMIZER: -95% TOKENS

Reduces token usage in Claude Code by 95%+ through caching, compression, and smart tool selection.

★ 582 · TypeScript
Context-Engine-AI/Context-Engine

CONTEXT-ENGINE CONTEXT COMPRESSION

Context-Engine MCP compresses agent prompts, boosting LLM efficiency without losing meaning. It supports Python and is ready for integration.

★ 402 · Python
trvon/yams

YAMS — MEMORY FOR LLM

Persistent storage for LLM and applications: a content‑addressable DB with deduplication, compression, full‑text and vector search.

★ 372 · C++
Picovoice/picollm

PICOLLM - OFFLINE LLM ON DEVICE

picollm enables running LLM on-device through extreme k‑bit quantization, delivering fast and private inference without the cloud.

★ 320 · Python
8b-is/smart-tree

SMART-TREE AI REVOLUTION

Context-aware code tree with MEM8 quantum compression, semantic search, and AST-smart editing — replaces 20+ tools.

★ 274 · Rust
surya-koritala/Glyd

GLYD: LOSSLESS AI COMPRESSION

Glyd reduces GPU memory by 33% without losing data, ensuring bit‑for‑bit identity. The project is written in Rust and supports CUDA, C‑ABI, and CLI for convenient benchma

★ 200 · Rust

New projects on this topic in Telegram

Telegram →
Compression — 12 open-source GitHub projects | REDDYX AI