I remember watching O's-Yankees games on TV as a kid and hearing that song in the background during the postgame wrap-up. I think they only played it after wins if I remember correctly, so I obviously was not in a good mood whenever I heard it.
I will say on my trips to Yankee Stadium (2 each old/new) that it was cool to hear it live in person for sentimental reasons. Yankees have won all 4 games I've seen in person including 2 against the Birds.