Natural Language Processing: open-source projects on GitHub
29 repositories on Natural Language Processing, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
🤗 Transformers
A framework for defining machine learning models in text, vision, audio, and multimodal models, for inference and training.
★ 160,482 · PythonDATASETS - HUGE DATABASE FOR AI
The largest platform with ready-made datasets for training AI models, offering fast and convenient tools for working with data.
★ 21,583 · PythonDocsGPT: Private AI Assistant
Private AI platform for agents, assistants, and enterprise search with support for multiple models.
★ 17,882 · PythonDocument Structuring
An open ETL solution for converting complex documents into clean structured data formats for language models.
★ 14,764 · HTMLLUDWIG - LOW-CODE AI FRAMEWORK
Build LLMs and neural networks without code. Simplicity for custom AI models included!
★ 11,791 · PythonOPTIMIZATION AND DEPLOYMENT OF AI MODELS
Toolkit for optimizing and deploying deep learning models. Supports conversion from PyTorch, TensorFlow, ONNX and inference on CPU, GPU, and Intel NPU.
★ 11,656 · C++ARGILLA - CREATE DATASETS FASTER
Argilla helps AI engineers and domain experts collaboratively create high-quality datasets for training models.
★ 5,203 · PythonSPARK-NLP - REVOLUTION IN NLP
Spark NLP provides state-of-the-art NLP models and ready-to-use pipelines for scalable text processing in Scala.
★ 4,163 · ScalaAI‑ENGINEER HQ: SCIENCE CORE
The project contains Jupyter notebooks with methods for training models, RAG pipelines on LangChain and data structure algorithms for AI agents. It allows quickly creatin
★ 3,780 · Jupyter NotebookEVOLUTION OF MULTI-AGENT SYSTEMS
EvoAgentX is a framework for building self-evolving AI agents with memory. Supports multi-agent scenarios and LLM integration. GitHub stars: 3.3k.
★ 3,435 · PythonLLM Agents: Best Works
A curated list of essential papers on agents based on large language models.
★ 3,030OSWorld: BENCHMARK FOR AI AGENTS
OSWorld is a benchmark for evaluating multimodal AI agents in real computer environments. Open tasks in real operating systems.
★ 2,911 · PythonSUPERLINKED INFERENCE ENGINE
Open-source server for embedding inference, reranking, and data extraction. 2000+ stars on GitHub.
★ 2,029 · PythonRAGHUB: Resources and RAG Frameworks
The community gathers the best RAG frameworks, projects, and materials for AI developers. Contribute and discover new solutions.
★ 2,019CURATOR — DATA FOR POST-TRAINING
Synthetic data curation for LLM fine-tuning and structured information extraction. 1686 stars ⭐
★ 1,767 · PythonLLM IN SPACY PIPELINE PAINLESSLY
spacy-llm connects GPT, Claude, Cohere and open models to spaCy pipeline. Configure via config, get structured Doc with entities and relations. No wrapper code — pure NLP
★ 1,399 · PythonLIGHTMEM — Efficient LLM Memory
Lightweight generation with extended memory from the authors of ICLR 2026. 934 stars on GitHub.
★ 1,223 · PythonGUIDE TO AI SYSTEMS
A practical guide to designing production-ready AI systems and evaluating their quality for engineers.
★ 1,132ASREVIEW - ACTIVE LEARNING FOR REVIEWS
Asreview uses active learning to speed up systematic literature reviews, reducing the number of required readings.
★ 1,074 · PythonJapanese NLP: Top Resources
A collection of libraries, models, corpora, and datasets for Japanese language processing in Python. Includes Claude Code skills for quick resource discovery.
★ 1,031Keras Hub: Models for Keras
Platform with ready-to-use pretrained models for Keras 3, simplifying AI integration into projects.
★ 999 · PythonHow to Train Your LLM
Build a modern LLM from scratch — every line of code is commented and explained simply, as if for a five-year-old.
★ 984 · Jupyter NotebookTRUSTLLM: EVALUATION OF LLM TRUSTWORTHINESS
TrustLLM — a toolkit for assessing LLM trustworthiness, presented at ICML 2024. It includes benchmark suites, metrics, and datasets for measuring hallucinations, bias, an
★ 636 · PythonMMMU: Multimodal Benchmark
Code evaluation for MMMU benchmark measuring multidisciplinary multimodal understanding and reasoning for expert AGI.
★ 601 · PythonOSWorld-V2 - AGENT REAL TASK TEST
OSWorld 2.0 evaluates AI agents' ability to complete long real computer tasks using only Python.
★ 421 · PythonPICOLLM - OFFLINE LLM ON DEVICE
picollm enables running LLM on-device through extreme k‑bit quantization, delivering fast and private inference without the cloud.
★ 320 · PythonOPEN DATA SCIENCE COURSE
Open lecture notes on AI and Data Science in LaTeX format, ready for use in Jupyter Notebook.
★ 307 · Jupyter Notebook🔍 LIGHTHOUSE: VIDEO MOMENT RETRIEVAL
User-friendly library for reproducible video moment retrieval and highlight detection. Also supports audio. Published at EMNLP2024 Demo, ICASSP 2025 and ICASSP 2026.
★ 274 · PythonAccelerated Text Generation
Fast and lossless output of language models using double diffusion decoding.
★ 46 · PythonNew projects on this topic in Telegram
Telegram →