I would explore what about sex, or women causes such a strong trigger reaction. It really doesn't seem feasible to avoid over half of the total population, and avoidance can escalate symptoms sometimes.
I've had similar experiences due to some things in my past. (The right) medication helped me along with writing things down to help process what exactly is happening. Have you tried journaling? An outlet to channel everything so you don't bottle up and meltdown?
Otherwise, I hear the monasteries have plenty of vacancies...