This guy have a crush on me, but everyone thinks he's gay.. I don't know what to do?

there is a guy that Ive been talking to that openly says that he has a crush on me, but whenever people talk about him they say that the way he carries himself and talks (like the sound of his voice) makes him seem gay. It's honestly made me apprehensive to be with him. am I being shallow? :/ I'm kind of worried to date him for my reputation's sake, even though I know that makes me sound shallow as a kiddie-pool. :/