Drunk & Root to Selfhosted@lemmy.worldEnglish • 5 months agoHow to combat large amounts of Ai scrapersmessage-square54fedilinkarrow-up1125arrow-down15file-text
arrow-up1120arrow-down1message-squareHow to combat large amounts of Ai scrapersDrunk & Root to Selfhosted@lemmy.worldEnglish • 5 months agomessage-square54fedilinkfile-text
everytime i check nginx logs its more scrapers then i can count and i could not find any good open source solutions
minus-squareBahnd RollardlinkfedilinkEnglish14•5 months agoWern’t there a few AI maze projects in the works? I wonder if running one of those for a bit will cause you to be added to an ignore list, clearly they dont respect your robots file.
minus-squareslazer2aulinkfedilinkEnglish17•5 months agoTar pits I think is the term they use to pollute AI data.
Wern’t there a few AI maze projects in the works? I wonder if running one of those for a bit will cause you to be added to an ignore list, clearly they dont respect your robots file.
Tar pits I think is the term they use to pollute AI data.