Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square104fedilinkarrow-up1506arrow-down16
arrow-up1500arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square104fedilink
minus-squaretee9000@lemmy.worldlinkfedilinkEnglisharrow-up2arrow-down7·5 hours agoDo you even know what robots.txt is?
minus-squareWhyJiffie@sh.itjust.workslinkfedilinkEnglisharrow-up6·4 hours agothe scraper bots surely don’t
minus-squaretee9000@lemmy.worldlinkfedilinkEnglisharrow-up1·33 minutes agoAnd nobody in this scenario has done anything illegal.
Do you even know what robots.txt is?
the scraper bots surely don’t
And nobody in this scenario has done anything illegal.