R_REDDYX.XYZ
AIPython★ 1,287⑂ 43 forks

eagle-hq/EAGLE-4

EAGLE-4 Speculative Decoding

Official inference code for EAGLE-4, a speculative decoding method that accelerates LLM generation by drafting tokens via feature-level extrapolation.

// KEY FEATURES

  • Drafts tokens using feature extrapolation from previous hidden states
  • Reduces LLM inference latency with minimal quality degradation
  • Supports Llama, Vicuna, and other transformer-based models
#eagle#gpu#llm-inference#sglang#speculative-decoding#tokenspeed#vllm
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

CHUNKHOUND: Local Code Intelligence★ 1288AIPex: AI Browser Automation★ 1286SEARCH2AI - Smart Search for LLM★ 1288SKILLEVALUATOR: AI AGENT EVALUATION★ 1286Full-Stack AI Template★ 1289n8n-as-code Super Power AI Agent★ 1285

← FULL CATALOG

eagle-hq/EAGLE-4 — EAGLE-4 Speculative Decoding | REDDYX AI