I'm working on a WordPress PaaS with dedicated lanes for bots. The status quo ar... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		thekonqueror 75 days ago \| parent \| context \| favorite \| on: Ask HN: What are you working on? (September 2025) I'm working on a WordPress PaaS with dedicated lanes for bots. The status quo around WordPress is that you block bots using Cloudflare, else your site crashes. Since AI search is here to stay, we need a way to let bots crawl WordPress sites without crashing the server. Currently at MVP stage, no domain yet.

maltelandwehr 75 days ago [–]

Regular Cloudflare + heavy caching should solve all crawling problems, no?

For most bot visits, there should not be a single database request.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact