OpenAI's ChatGPT New Web Crawler - GPTBot

14:21 07.08.2023
OpenAI, the folks behind ChatGPT, have published information on its web crawler named GPTBot. You can now see if OpenAI is crawling your site, how much so, and you can disallow access to all or part of your site with the robots.txt protocol....
Теги: site web
  282