Perplexity is sneaking onto websites to scrape blocked content, says Cloudflare
Summary
Cloudflare has accused Perplexity, an AI company, of circumventing websites' no-crawl directives to scrape content that is meant to be blocked. In response, Cloudflare is taking measures to prevent such unauthorized data collection, highlighting ongoing tensions between AI firms seeking training data and website owners aiming to protect their content. This incident underscores the need for clearer guidelines and enforcement around data usage in AI development.