I don't like to whisper and have difficultly when I've tried because I can't speak softly enough in that situation.
On the other hand, for years I had trouble speaking loud enough to be heard in normal conversation. I got so tired of it because everyone would tell me to speak up and when I did I felt like I was yelling. I don't have as much trouble with that now but it is still a problem occasionally.