He does have his glasses back when we see him later in the episode.
At a practical/puppet level, his 'hair' is ostrich-feathers, which are very light and floaty. They're used on a lot of characters though (Floyd, for example) who are certainly not ghosts, so it's no indication in itself. But...