Scrapers want to scrape every website, and ~every website has HTML. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Retr0id 5 days ago \| parent \| context \| favorite \| on: Stop crawling my HTML – use the API Scrapers want to scrape every website, and ~every website has HTML.

prmoustache 5 days ago [–]

For years my website was just a text file.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact