Liking anime is the same as anything else. There will be people who don't like it, don't have the same taste, or simply think that you are weird because of your interest.
For everyone that does enjoy anime, yet feel like your tastes are off. If you have a favorite then that is your favorite so no one has the right to say otherwise.
For the haters that just don't like it, you are allowed to have your own interests. And your preference against it, is your opinnion, you just don't need to share it with us.