you're right but it goes both ways. from my experiences, i'd guess that more than 50% of people out there aren't even "listening" to music to begin with. when i say listening i mean actively processing what's coming out of their speakers.
yea sometimes people don't like what they're hearing but say they do just because for what ever reason they're drawn to that artist. but it goes both ways, a lot of people will hear something but because they got preconceived notions about it or it's unfamiliar to them, they're aren't going to listen to it honestly and no matter what they're gonna dislike it.
on the flipside, if you listen to something once, particularly an album, and formulate an opinion on it, that opinion holds zero weight with me. if you hear a professional piece of music for the third or fourth time the same as when you listened to it your first time, you pretty much suck at listening to music, unless your musical intelligence is abnormally high and you just have the capacity to simultaneously hear everything that's going on upon first listen.