AIMDX★ 3,547⑂ 374 forksMIT
any4ai/AnyCrawl
ANY SITE TO LLM DATA
AnyCrawl — a Node.js crawler that turns websites into LLM‑ready data and extracts structured search results from Google, Bing, Baidu, and others.
// KEY FEATURES
- Website parsing to LLM format
- SERP extraction from 6+ search engines
- Multithreaded request processing
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram