Google's webmaster channel is on a series of posts every hour around the Robots Exclusion Protocol - in short, an hour ago, Google announced that after 25 years of being a de-facto standard, Google has worked with Martijn Koster, webmasters, and other search engines to make the Robots Exclusion Protocol an official standard....
-
Google Works To Make Robots Exclusion Protocol A Real Standard
seroundtable.com