Google Clarified Support For Robots.txt Fields With Tiny Change

14:11 08.10.2024
Google added eight or so words between brackets to clarify that fields that aren't explicitly listed in the robots.txt documentation aren't supported. Why did they do this? Because sometimes Google gets questions about it....
Теги: Google
  151