Maybe it would help a bit if I put the singers with the songs/sketches...
The Sound of the Letter A - Big Bird and others
Oscar's B Sandwich - Oscar and I believe Herbert Birdsfoot
Four Furry Friends - Herry, Grover, Cookie, and Oscar
Ha Ha - Harvey Kneeslapper, Herry Monster and Big Bird...