The New York Times has blocked OpenAI’s web crawler, meaning that OpenAI can’t use content from the publication to train its AI models. If you check the NYT’s robots.txt page, you can see that the NYT disallows GPTBot, the crawler that OpenAI introduced earlier this month. Based on the Internet Archive’s Wayback Machine, it appears NYT blocked the crawler as early as Aug. 17.
The change comes after the NYT updated its terms of service at the beginning of this month to prohibit the use of its content to train AI models. New York Times spokesperson Charlie Stadtlander spokesperson declined to comment. OpenAI didn’t immediately reply to a request for comment.
Comments
No comments on this item Please log in to comment by clicking here