Google's John Mueller said in a Google Webmaster Help thread that it makes most sense to keep the default setting found within your content management system for your robots.txt access control......
-
Google: Keep The Default CMS Robots.txt Setting
seroundtable.com
