Google To Drop Any Support For crawl-delay, nofollow, and noindex in robots.txt

18:33 02.07.2019
Google posted this morning that they are going to stop unofficially supporting the noindex, nofollow and crawl-delay directives within robots.txt files. Google has been saying this for years actually and hinted this was coming really soon and now it is here....
Теги: Google
  372