Sublime

Gather clean data from all accessible subpages, even without a sitemap.

Firecrawl

The internet used to be fun

projects.kwon.nyc

Firecrawl

firecrawl.dev

Scrappy

Pontus Granström pontus.granstrom.me

Thumbnail of www-x-com-omarsar0-status-1841173994898407905-68dae320df6f4c01

Crawl4AI is an open-source web-crawling and data-extraction tool built to integrate well with LLM and AI applications. It has a comprehensive list of features ranging from simultaneous URL crawling to advanced extraction strategies based on LLMs. https://t.co/7KpA5AvmG6

elvis

x.com

Actively doing is the key to alpha. https://t.co/fkjbzQ70sr

Justin Skycak

x.com

Unlighthouse

unlighthouse.dev

Firecrawl 官方出了个 MCP Server，可以将强大的网页抓取功能快速集成到 Cursor、Claude 或者任何其他 LLM 客户端😋 之前在 Rednote Host 这个项目上就已经感受过 Firecrawl 的强大🥳 现在可以在 Cursor 里面直接调用，这样将 Cursor 当做知识库做深度研究更是如鱼得水了🤔 链接见评论👇 https://t.co/bWZTWQ4INM

MapleShaw x.com

Thumbnail of www-x-com-eglyman-status-1880268394525782522

Genuine career advice: hang this poster in your room (or closet). https://t.co/asoaRTVG7v

Eric Glyman

x.com