It’s funny because I always heard that the rich preferred perfumes over bathing, and looked down on peasants for their bathing, especially public baths.

No source. It’s just what I heard. Even if it’s true, who knows what era and people it applied to.