R_REDDYX.XYZ

Natural Language Processing: open-source projects on GitHub

29 repositories on Natural Language Processing, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM 2094Machine Learning 190NLP 84Deep Learning 105Pytorch 98Large Language Models 154Artificial Intelligence 157Language Model 39RAG 533Computer Vision 41Agent 547Transformers 50Llama 106Multimodal 143
huggingface/transformers

🤗 Transformers

A framework for defining machine learning models in text, vision, audio, and multimodal models, for inference and training.

★ 160,482 · Python
huggingface/datasets

DATASETS - HUGE DATABASE FOR AI

The largest platform with ready-made datasets for training AI models, offering fast and convenient tools for working with data.

★ 21,583 · Python
arc53/DocsGPT

DocsGPT: Private AI Assistant

Private AI platform for agents, assistants, and enterprise search with support for multiple models.

★ 17,882 · Python
Unstructured-IO/unstructured

Document Structuring

An open ETL solution for converting complex documents into clean structured data formats for language models.

★ 14,764 · HTML
ludwig-ai/ludwig

LUDWIG - LOW-CODE AI FRAMEWORK

Build LLMs and neural networks without code. Simplicity for custom AI models included!

★ 11,791 · Python
openvinotoolkit/openvino

OPTIMIZATION AND DEPLOYMENT OF AI MODELS

Toolkit for optimizing and deploying deep learning models. Supports conversion from PyTorch, TensorFlow, ONNX and inference on CPU, GPU, and Intel NPU.

★ 11,656 · C++
argilla-io/argilla

ARGILLA - CREATE DATASETS FASTER

Argilla helps AI engineers and domain experts collaboratively create high-quality datasets for training models.

★ 5,203 · Python
JohnSnowLabs/spark-nlp

SPARK-NLP - REVOLUTION IN NLP

Spark NLP provides state-of-the-art NLP models and ready-to-use pipelines for scalable text processing in Scala.

★ 4,163 · Scala
hemansnation/AI-Engineer-Headquarters

AI‑ENGINEER HQ: SCIENCE CORE

The project contains Jupyter notebooks with methods for training models, RAG pipelines on LangChain and data structure algorithms for AI agents. It allows quickly creatin

★ 3,780 · Jupyter Notebook
ANative-Lab/EvoAgentX

EVOLUTION OF MULTI-AGENT SYSTEMS

EvoAgentX is a framework for building self-evolving AI agents with memory. Supports multi-agent scenarios and LLM integration. GitHub stars: 3.3k.

★ 3,435 · Python
zjunlp/LLMAgentPapers

LLM Agents: Best Works

A curated list of essential papers on agents based on large language models.

★ 3,030
xlang-ai/OSWorld

OSWorld: BENCHMARK FOR AI AGENTS

OSWorld is a benchmark for evaluating multimodal AI agents in real computer environments. Open tasks in real operating systems.

★ 2,911 · Python
superlinked/sie

SUPERLINKED INFERENCE ENGINE

Open-source server for embedding inference, reranking, and data extraction. 2000+ stars on GitHub.

★ 2,029 · Python
Andrew-Jang/RAGHub

RAGHUB: Resources and RAG Frameworks

The community gathers the best RAG frameworks, projects, and materials for AI developers. Contribute and discover new solutions.

★ 2,019
bespokelabsai/curator

CURATOR — DATA FOR POST-TRAINING

Synthetic data curation for LLM fine-tuning and structured information extraction. 1686 stars ⭐

★ 1,767 · Python
explosion/spacy-llm

LLM IN SPACY PIPELINE PAINLESSLY

spacy-llm connects GPT, Claude, Cohere and open models to spaCy pipeline. Configure via config, get structured Doc with entities and relations. No wrapper code — pure NLP

★ 1,399 · Python
zjunlp/LightMem

LIGHTMEM — Efficient LLM Memory

Lightweight generation with extended memory from the authors of ICLR 2026. 934 stars on GitHub.

★ 1,223 · Python
ombharatiya/ai-system-design-guide

GUIDE TO AI SYSTEMS

A practical guide to designing production-ready AI systems and evaluating their quality for engineers.

★ 1,132
asreview/asreview

ASREVIEW - ACTIVE LEARNING FOR REVIEWS

Asreview uses active learning to speed up systematic literature reviews, reducing the number of required readings.

★ 1,074 · Python
taishi-i/awesome-japanese-nlp-resources

Japanese NLP: Top Resources

A collection of libraries, models, corpora, and datasets for Japanese language processing in Python. Includes Claude Code skills for quick resource discovery.

★ 1,031
keras-team/keras-hub

Keras Hub: Models for Keras

Platform with ready-to-use pretrained models for Keras 3, simplifying AI integration into projects.

★ 999 · Python
raiyanyahya/how-to-train-your-gpt

How to Train Your LLM

Build a modern LLM from scratch — every line of code is commented and explained simply, as if for a five-year-old.

★ 984 · Jupyter Notebook
HowieHwong/TrustLLM

TRUSTLLM: EVALUATION OF LLM TRUSTWORTHINESS

TrustLLM — a toolkit for assessing LLM trustworthiness, presented at ICML 2024. It includes benchmark suites, metrics, and datasets for measuring hallucinations, bias, an

★ 636 · Python
MMMU-Benchmark/MMMU

MMMU: Multimodal Benchmark

Code evaluation for MMMU benchmark measuring multidisciplinary multimodal understanding and reasoning for expert AGI.

★ 601 · Python
xlang-ai/OSWorld-V2

OSWorld-V2 - AGENT REAL TASK TEST

OSWorld 2.0 evaluates AI agents' ability to complete long real computer tasks using only Python.

★ 421 · Python
Picovoice/picollm

PICOLLM - OFFLINE LLM ON DEVICE

picollm enables running LLM on-device through extreme k‑bit quantization, delivering fast and private inference without the cloud.

★ 320 · Python
yogeshhk/TeachingDataScience

OPEN DATA SCIENCE COURSE

Open lecture notes on AI and Data Science in LaTeX format, ready for use in Jupyter Notebook.

★ 307 · Jupyter Notebook
line/lighthouse

🔍 LIGHTHOUSE: VIDEO MOMENT RETRIEVAL

User-friendly library for reproducible video moment retrieval and highlight detection. Also supports audio. Published at EMNLP2024 Demo, ICASSP 2025 and ICASSP 2026.

★ 274 · Python
chiennv2000/orthrus

Accelerated Text Generation

Fast and lossless output of language models using double diffusion decoding.

★ 46 · Python

New projects on this topic in Telegram

Telegram →
Natural Language Processing — 29 open-source GitHub projects | REDDYX AI