Sublime

You can now crawl entire websites and extract LLM-ready data with a single tool. Crawl4AI is an open-source repo built for AI agents, RAG, and data pipelines. It supports both browser-based and HTTP crawling, with real-time Markdown generation from any site. https://t.co/9Zwnk5AKAi