AIPython★ 89⑂ 8 forksApache-2.0
RayenMlayeh/jevcrawl
AI Web Answer Crawler
A MCP server and CLI that crawls websites to locate answer pages for AI agents, achieving twice the hit rate of Crawl4AI at one‑tenth the cost of Claude crawling.
// KEY FEATURES
- Provides a MCP server exposing a crawl API for AI agents.
- Includes a CLI tool to crawl sites and output answer URLs.
- Gives 2× higher answer-page hit rate than Crawl4AI at 1/10 Claude crawl cost.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram