Google, Microsoft, and OpenAI announced plans on Friday to honor a shared robots.txt line for AI training preferences. A site could use it to state one training preference to every provider that...
OpenAI, Google, Microsoft and Anthropic pledged on Friday to give media outlets and other websites a single way to prevent their content from being scraped to train artificial intelligence (AI)...
Publishers currently have to implement multiple blocking commands for every bot that crawls the web to collect data
Google, OpenAI, Anthropic and Microsoft back a shared robots.txt standard giving publishers greater control over AI training crawlers.
Google announced on October 30, 2026 that it plans to support a shared AI training control in robots.txt, giving website owners a single way to express training preferences across multiple AI...
First reported:
First saved on ClustZ:
Coverage updated:
We use cookies to improve your experience and analyze site traffic. By clicking "Accept", you agree to our use of cookies. See our Privacy Policy.