We've seen Muppets consume alcohol before....
"If you put enough sugar in this, it tastes just like Ginger Ale!"
In the Great Muppet Caper, Kermit, Piggy, and Fozzie all drink champagne, and we've seen Kermit and Piggy drinking the finest wine in Idaho, and there have been plenty others...