Actually, one thing I like about the writing in the olden times is that it never (as far as I've ever seen) went there. Not about him OR his living quarters. Because that kind of thing is just so...easy. Predictable. Cheap, even.
Nowadays it comes up from time to time, which just makes me roll my eyes. It's like, "Sure, go for the low-hanging fruit. How creative."
Anyway, I've always imagined that, if anything, what would cling to him would be more like mold than anything else. Because of how he looks----like a walking pile of moss**. Just a general dampness would probably surround him. I'm sure that among the many words that could accurately describe his home, one would definitely be "moist." =)
(**Although Forgetful Jones' description of him as "that fella that looks like green shredded wheat" was epic.)