Making it easier for websites to express AI training preferences
OpenAI honors robots.txt signals for AI training preferences. This update lets website owners control data access for AI models. It aligns with industry standards for web scraping and data governance.