^
You're fine; unless you're actually shorter than most women you meet, other things will matter more.
I know at least 3 very short guys with gorgeous wives but all are charming personalities and generally fascinating and entertaining people.
I also have a colleague who's barely 5'4", he's not particularly charming or good looking, but he's interesting and somewhat "brooding" - he has 3 kids, 2 ex-wifes and a gorgeous, tall girlfriend who's the maternal type and very protective of him
It's much harder (generally, as an Aspie) if you live in small or very conformist places... Generally speaking, you have to compensate somehow for all the "minuses" (less than average) but if you have the chance of living in a large, varied place you can easily end up meeting women who might appreciate conventional "minuses" as something interesting and out of the ordinary 
_________________
"Facts do not cease to exist because they are ignored." Aldous Huxley