Pro@programming.dev to Technology@lemmy.worldEnglish · 1 month agoCodeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.i.imgur.comimagemessage-square57fedilinkarrow-up1790arrow-down16file-textcross-posted to: Technology@programming.dev
arrow-up1784arrow-down1imageCodeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.i.imgur.comPro@programming.dev to Technology@lemmy.worldEnglish · 1 month agomessage-square57fedilinkfile-textcross-posted to: Technology@programming.dev
minus-squareqaz@lemmy.worldlinkfedilinkEnglisharrow-up2·1 month agoI think the issue is that the scrapers are fully automatically collecting text, jumping from link to link like a search engine indexer.
I think the issue is that the scrapers are fully automatically collecting text, jumping from link to link like a search engine indexer.