Haha, I hadn't seen that clip before!
Anyway, I don't have time to look it up now, but i remember in "The Muppets on Puppets" (on the season 3 boxset) there was a bit where they did a puppet show then explained the 'behind the scenes' process and effects. It included an explosion that from memory was some sort of powder (probably flour) blown out of a tube.