It's probably because people link furries and Anthros with all that dirty stuff, so they see it as a dirty obsession. Many don't realise that there is more to it than being into animals, and most of the time it is nothing like that. There are probably some like that, but the majority aren't.
