The NYT’s robot.txt page that controls how it appears to automated bots built to index the internet now specifically disallows OpenAI’s GPTBot.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more: