I used to be extremely stressed by the telephone. I'm fairly habituated to phones nowadays; I still dislike using them, but I do it if I have to. I won't use them for social calls, though, and while I do have a mobile phone it stays uncharged at the bottom of a drawer somewhere.
What I find difficult about phones is perhaps the opposite of what many of you get: I feel like I need the other person to be able to see me. I find I rely quite heavily on deliberate gestures and expressions to communicate - at a rough pop-psych guess, I am compensating for not automatically "getting it" by pausing to very self-consciously insert grins and so on all the time -
- it's not so pronounced with typing, mind, so this sort of thing is much easier than the phone. Also my natural mode is a sardonic / sarcastic / self-deprecating one which the other person needs to see I'm not taking myself entirely seriously... not something that works well over the phone. Fah. Or something, I dunno, really.
A friend of mine - also aspie, though I didn't know about the condition back then - used to want to talk with me on the phone for hours. I found it unbearable - I can't do extended conversation face to face, never mind on the phone - and I ended up making excuses not to, though I guessed she needed to talk.
*pauses for melodramatic and maudlin wave at the sky* If we do meet up in some other place, at least we won't be short on subjects for conversation... 
_________________
No one has gone missing or died.
The year is still young.