Sublime

An inspiration engine for ideas

AllPeopleCollectionsArticlesAudioBooksFilesHighlightsImagesLinksNotesTextTweetsVideosSocial

Thumbnail of www-x-com-tom-doerr-status-1947868377231364567-664d0b47d1ca4024

Python web scraping with built-in browser and proxy support https://t.co/lUnU8UmgBn

Tom Dörr

x.com

multi-engine web crawler for fast, large-scale data extraction https://t.co/UErVTwmctk

Tom Dörr

x.com

Here's the full automation in the gif, paste in any tech review video and connect your Ghost account (or delete the ghost node to try without) https://t.co/zVI9HaShbj

Max Brodeur-Urbas x.com

Thumbnail of www-x-com-tom-doerr-status-1883402874593357853-cf635fcc6d174e09

Crawlee for Python: Web scraping and browser automation library https://t.co/sGH3iaWnXX

Tom Dörr

x.com

ghostie built using @v0 https://t.co/jDQ76L4zmS

dazai x.com

Made this cool bento/grid animation for @firecrawl_dev https://t.co/Ow1Her7MUu

Rodz x.com

Thumbnail of www-x-com-tom-doerr-status-1854664123646132331-3fd22409ab614aa3

"Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation."

Tom Dörr

x.com

If you waste days every month fixing broken crawlers check out Bytebot's new launch. https://t.co/Lyac3I1pOd Most people don't know this but I paid for my first year of college building ad hoc web crawlers and selling data. The #1 issue I had was website changes, multiply that by every website and I had massive profit... See more

jason liu x.com

Thumbnail of www-x-com-tom-doerr-status-1886537294804337014-079cbac811bb4b7d

Scrapling: Python web scraping library https://t.co/5S38sJPWUa

Tom Dörr

x.com