That’s true, and even videos that reached mass circulation in the 90s disappeared when VHS tapes fell out of fashion. The Puzzle Place had five volumes out with two episodes each. If you can find copies in thrift stores (and still have a working VCR) you’re lucky.
Some vintage titles may be found on DVD or iTunes, like Sesame Street or Disney. These are the two biggest brands, which have the biggest power to release and distribute their product.
Richard Scarry’s titles, I believe were released through Random House Video..
Random House is still a giant in the book industry. Videos, not so much.