Google's John Mueller said on Twitter that when you want to "unindex," remove indexed pages from Google Search, you should not block Google with robots.txt, but rather use noindex. He said only unindex pages when if you don't care if the page doesn't rank but if you want it to rank, then improve the page....