I guess what I'm unclear on is, if there isn't a reputation feature or some kind of third-party ranking, how do you learn that sites are nazi sites without having to review each of them individually and wade through their shit?

Or if it really is that each server operator has to maintain their own blacklist, how does this scale?