AIRust★ 349
dondai44423/donsetch
DONSETCH: WEB SEARCH FOR AI AGENTS
Donsetch is a Rust library for extracting, searching, and crawling web pages without API keys or registration. It supports anti‑bot bypass, PDF handling, and MCP protocol, licensed under AGPL v3.
// KEY FEATURES
- Extracts HTML and text from arbitrary web pages in milliseconds.
- Performs full‑text search over indexed content with facet support.
- Bypasses bot protections (CAPTCHA, rate‑limit) and crawls sites in depth.
- Extracts data from PDF and interacts with MCP servers, AGPL v3 licensed.
#agpl#ai-agents#anti-bot#crawling#mcp#pdf#rust#web-scraper#web-search
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram