Google: Changing WWW to Non-WWW Doesn't Change Much (For Ranking)

Google's John Mueller said that changing from www to non-www for your domain shouldn't change much. I suspect he means that doing that wouldn't hurt or benefit your rankings that much and Google will likely pick up on the change and the rankings would not suffer much from the change....