I've sorta noticed it, too, and also noticed others noticing it. Or noticing me for it.
I look like this:

It's a terrible picture (and one I've shown before) in craptastic lighting as I stand under the blazing heat lamps in my bathroom, but it works. Normally my hair isnt quite that straight though. The part that hangs below my ears is normally much more curled (yet still manages to hang down to a bit past my shoulder), but I aggressively went at it with a comb until it briefly stopped doing that. Dont even know why I ever bother combing it like that, it just curls back up again like 10 minutes later.
So yeah, that's me. I'm well aware my appearance is unusual. I've been *very* often told that I appear to have a major blend of both feminine & masculine traits (works for me, I like the idea of androgyny to be honest). I get alot of stares (and I can never be sure why they do it, but I do know it makes me nervous when it happens) and am mistaken for a girl every now and then. It's not just my face, either. My bodyshape is also a bit... off. But hey, that's fine by me.
But: The way I see it, all of that doesnt automatically = "attractive". There's an old saying: "beauty is in the eye of the beholder". I dont really think there's any one proper definition of "good" appearance. Hell, I know PLENTY of people wouldnt like the way I look... males are supposed to be masculine, to many. I do get pestered for the way I look at times, since I'm very clearly NOT on the masculine side (which again, is fine by me... I dont really want to look all masculine). Apparently it's a sin, to some. I tend to figure though... that's their problem, not mine.
To me you look like a totally male British band member in his 30's. idk if you are brittish and or in a band, but for whatever reason that's how you strike me. I notice however that your eyes are not synchronized. Which I have noticed in many people with autism and I'm told it's that way with me too. Although for you it might be something else causing it.