Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Feel like that’s the fault of LLMs, not cloudflare




Looking into this more, it does indeed seem to be a cloudflare problem. It looks like cloudflare made a significant error in their bot fingerprinting, and Perplexity wasn't actually bypassing robots.txt.

https://www.perplexity.ai/hub/blog/agents-or-bots-making-sen...

To be honest I find cloudflare a much more scammy company than Perplexity. I had a DDoS attack a few years ago which originated from their network, and they had zero interest in it.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: