gedaliyah@lemmy.world to Technology@lemmy.worldEnglish · 6 months agoReddit blocking all major search engines, except Googlereadwrite.comexternal-linkmessage-square183fedilinkarrow-up1661arrow-down116
arrow-up1645arrow-down1external-linkReddit blocking all major search engines, except Googlereadwrite.comgedaliyah@lemmy.world to Technology@lemmy.worldEnglish · 6 months agomessage-square183fedilink
minus-squaregedaliyah@lemmy.worldOPlinkfedilinkEnglisharrow-up21·6 months ago“We always obey the robots.txt” A bunch of corporations that have no accountability and plenty of incentive to just ignore it and have all been caught training AI on off-limits data.
“We always obey the robots.txt”