webclaw

Llm Open Source

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

★ 2,367 Stars ⑂ 235 Forks License: GNU Affero General Public License v3.0

Download Latest Release Official Website ↗ GitHub Repository ↗

About webclaw

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

Supported Platforms

ai-agents ai-scraping apify-alternative cli crawl4ai-alternative firecrawl-alternative html-to-markdown jina-alternative

Related in Llm

hermes-agent

The agent that grows with you

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

firecrawl

🔥 Supercharge your AI agents with data from the web and beyond. A web data API to search, scrape, and access more sources.

ollama

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

dify

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)