gerald_eliasweb@reddthat.com to Memes@lemmy.mlEnglish · 5 days agoHuman on the internet vs bot on the internetlemmy.mlexternal-linkmessage-square15fedilinkarrow-up1355arrow-down15
arrow-up1350arrow-down1external-linkHuman on the internet vs bot on the internetlemmy.mlgerald_eliasweb@reddthat.com to Memes@lemmy.mlEnglish · 5 days agomessage-square15fedilink
minus-squarebrbposting@sh.itjust.workslinkfedilinkEnglisharrow-up15·5 days ago It was created by Xe Iaso in response to Amazon’s web crawler overloading their Git server, as it did not respect the robots.txt exclusion protocol and would work around restrictions. Jeff wouldn’t do that!
Jeff wouldn’t do that!