cm0002@lemmy.world to Opensource@programming.dev · 1 month agoAnubis - Weighs the soul of incoming HTTP requests to stop AI crawlersgithub.comexternal-linkmessage-square8linkfedilinkarrow-up170arrow-down12
arrow-up168arrow-down1external-linkAnubis - Weighs the soul of incoming HTTP requests to stop AI crawlersgithub.comcm0002@lemmy.world to Opensource@programming.dev · 1 month agomessage-square8linkfedilink
minus-squareisolatedscotch@discuss.tchncs.delinkfedilinkarrow-up3·1 month agoai scrapers send thousands of requests per second, they’ll just deem a small website using it “not worthy”
ai scrapers send thousands of requests per second, they’ll just deem a small website using it “not worthy”