I'm a huge Danny Kaye fan, but I can't really think of any "defining" songs that particularly stand out.
By the way, let it be known that the first time I ever watched a Kaye film (Court Jester), I laughed so hard I had to pause the tape. I really did almost piss my pants.