Google's John Mueller posted one of the more detailed responses I've seen from him on the topic of overall search spam, penalties, quality algorithms and more. I am not sure if the comment is showing up anymore on Reddit, so here is a screenshot of it....