Are you using Scrapy mainly for scraping, or do you do crawling, as well? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		heavyset_go on Oct 11, 2021 \| parent \| context \| favorite \| on: The State of Web Scraping in 2021 Are you using Scrapy mainly for scraping, or do you do crawling, as well?

MrDresden on Oct 12, 2021 [–]

In my case I am only using it for direct scraping.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact