I wonder if maybe Steve Whitmire was only available to perform Kermit's scene, which was presented on a TV and used a different set (though I don't know whether the regular street set is set up at all times). Frank Oz probablly had limited availability; the scenes with Grover and Cookie Monster could easily have been taped in less than 30 minutes.