I always thought it was a bird. Rowlf, as Dr. Bob, says in Vet's Hospital: "let's face it, this bird has one foot in the grave".
Interestingly enough, the Don Knotts & Rudolf Nureyev episodes were the first that I ever had on tape, so I was quite used to it, although I agree, it was a little...