AI crawlers haven't learned to play nice with websites

Theregister | 18-03-2025 09:41pm |

SourceHut says it's getting DDoSed by LLM bots SourceHut, an open source git-hosting service, says web crawlers for AI companies are slowing down services through their excessive demands for data....

Stay Updated with the Latest News!

Don't miss out on breaking stories and in-depth articles.