I think you're likely right because most of the Fraggles we see in the show, save a handful, all look about the same age. There could be a lot of difference in age between them, but it doesn't appear to be a big thing to them, especially since they don't seem to have a sense of time in terms of years but rather seasons.