It matters when the topic of conversation is trends and the overall popularity of certain subjects. Pointing out that only a relatively few number of people prefer a Thing but happen to have loud 'voices' about it is absolutely valid. That's not kinkshaming.