Cloudflare's new marketplace will let websites charge AI bots for scraping | TechCrunch
techcrunch.com
Cloudflare announced plans on Monday to launch a marketplace in the next year where website owners can sell AI model providers access to scrape their
  • gaylord_fartmaster@lemmy.worldEnglish
    46·
    2 months ago

    They’re already ignoring robots.txt, so I’m not sure why anyone would think they won’t just ignore this too. All they have to do is get a new IP and change their useragent.