I tend to take things very literally and I'm a bit of a perfectionist. Taking you close to where you asked to be dropped off, would never have been an option for me (without tons of reassurance from you to change the drop off location). And there are times where this type of thing would have annoyed me, since I would expect people to be as attentive to details as I would be when doing a favor.
But like the others said, it isn't a big deal. My husband often says, "let it go", which really helps me in these situations. I'm sure they didn't mean any harm or offense and you were probably able to get to your intended location fairly easily.
I do understand your initial annoyance and yes, I do think it's an Aspie thing. Perhaps even exasperated by a higher than average anxiety level.
_________________
Later,
Kimberly