AIRust★ 998⑂ 66 forksAGPL-3.0
dondai44423/donsetch
DONSETCH: WEB SEARCH FOR AI AGENTS
Donsetch is a Rust library for extracting, searching, and crawling web pages without API keys or registration. It supports anti‑bot bypass, PDF handling, and MCP protocol, licensed under AGPL v3.
// KEY FEATURES
- Extracts HTML and text from arbitrary web pages in milliseconds.
- Performs full‑text search over indexed content with facet support.
- Bypasses bot protections (CAPTCHA, rate‑limit) and crawls sites in depth.
- Extracts data from PDF and interacts with MCP servers, AGPL v3 licensed.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram