Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

From the repo (clipped):

When using Scraperr, please remember to:

Respect robots.txt

Terms of Service

Rate Limiting

Kudos for promoting ethical usage; makes a change from some of the grifters selling borderline ddos-bots as crawlers.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: