Updated 23 min ago 5-minute briefNewsletterRSS Visits 128
More
Search

Google, Anthropic and others to support new AI crawling opt-out standard

Source: SiliconANGLEMaria DeutscherOctober 31, 2026
Read the full story at SiliconANGLE

The proposed standard will allow website operators to block AI developers from using their content for model training. This builds upon the existing robots.txt system to give site owners more control over their data.

Key points

  • Google, Microsoft, Anthropic, and OpenAI support the new opt-out standard.
  • Website operators will be able to block AI training crawlers.
  • The technology is based on the concept of the robots.txt file.

Summary and key points written by AI from the headline and a short excerpt, so they can be incomplete or wrong. SiliconANGLE did the reporting; read the original for the full story.

Read the full story at SiliconANGLE

More in AI & Automation

Discover all