The men who own one are mostly the men having sex
Which is the opposite of the picture in nearly every joke about it.
In the national survey that put sex toy use among heterosexual men at 44.8 per cent, use was reported both alone and with a partner, and it was more common among men in a relationship than among men without one. The same pattern runs through masturbation research generally: partnered people masturbate more, not less.
The lonely man with a drawer full of plastic is a comedy premise, and it survives because nobody argues with it out loud. The data says something plainer. A sex life makes people more interested in sex, and the interest shows up in both places at once.
What to do with it
It is also usable with a partner, which is the part most owners never try. Handing over the sleeve makes the pace somebody else's decision, and that is a different evening from using it alone.
If it has been hidden until now, saying it out loud is easier than being found out, and the honest version of the sentence is the one in the research: most of the men who own one are men who are having sex.