The biggest names in AI are backing a new way to opt out of scraping
Proposed by Anthropic's Kevin Kelley as part of the IETF, the new standard will live in robots.txt files. This allows publishers to set training preferences across multiple AI companies simultaneously rather than individually.
Key points
- New shared 'policy token' for scraping opt-outs
- Supported by OpenAI, Google, Microsoft, and Anthropic
- Standard will be implemented within robots.txt files
Summary and key points written by AI from the headline and a short excerpt, so they can be incomplete or wrong. The Verge did the reporting; read the original for the full story.
Read the full story at The Verge
