R_REDDYX.XYZ
AIPython★ 3,101⑂ 204 forksApache-2.0

ridgerchu/matmulfreellm

MATMUL-FREE LLM IN PYTHON

The matmulfreellm project implements a language model without usual matrix multiplication operations, using linear transformers. This significantly reduces computational load during training and inference of large language models.

// KEY FEATURES

  • Performs LLM forward-pass without matrix multiplication via linear attention.
  • Compatible with HuggingFace Transformers API for fast model loading.
  • Supports training and fine-tuning on standard datasets like WikiText and C4.
  • Reduces GPU memory usage by up to 40% compared to standard transformers.
#large-language-model#linear-transformer#llm
Open on GitHub →

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.

Join on Telegram
← Full catalog·Full index

// SIMILAR REPOSITORIES

basic-memory - MEMORY FOR AI CHATS★ 3102AI AGENT MICROSERVICE IN PYTHON★ 3098MCP SERVER FOR SHADCN UI★ 3098paper-search-mcp - FAST SEARCH FOR SCIENTIFIC PAPERS★ 3097Create Videos on Your PC★ 3094AI-native vector design app★ 3093

← FULL CATALOG

ridgerchu/matmulfreellm — Matmul-Free LLM IN Python