For me, it was The One I Love by R.E.M. from when I was about four or five.

Besides being a banger of a song, I think part of the appeal to my younger self was how easy the lyrics were to understand and memorize, which I still have memorized. They were my first favorite band too.