Anger or frustration?
I for one deal with chronic frustration with the world around me because I'm so intolerant of the sounds, movements, smells, and behaviors of other people. And it's not because there is anything inherently wrong with them, but because I find I am unable to tune it all out, and am therefore distracted because it all ends up demanding my attention. In the case of neighbors, noises like barking dogs and loud music can lead me to fits of enraged insanity--but it's still mostly frustration. It's frustration with others for not being sensitive to me and my condition and it's frustration with myself for not being able to tune out such ambient distractions like "normal" people can so effortlessly do. In the case of a work environment, co-workers with loud earphones, who make a lot of unnecessary movements like tapping or fidgeting (even though I myself tap and fidget), who wear strong deodorants or perfumes, who insist on making conversation with me when I'm trying to do my job, who get loose at the end of the work day and treat our shared office space like it is their personal home despite other co-workers also staying late and attempting to finish projects, etc, will cause a significant strain on my nerves--but this is also frustration. There are countless other environs and stimuli that can be factored in as well, but generally my immediate reaction to discomforts imposed upon me by others or the environment itself (like an overly noisy air-conditioner that property management refuses to fix) is one of frustration.
For me, frustration crosses over into anger when I've attempted to resolve such situations amicably only to find my condition--my sensitivities and my wish to have them respected--disregarded or ridiculed, which seems to happen more often than it doesn't. My frustration also becomes a strange mix of depression and anger when I feel helpless to change a such situations that repeat themselves consistently, especially when I've reached a point where I'm unwilling to attempt to communicate because of the results of previous such attempts (the disregard and ridicule).
The anger builds up over time, but the frustration is more immediate, which can itself trigger any built-up anger. I think it is useful to know the difference between the built-up anger and the triggering frustration. For me, mindfully separating the two can help quell an outburst and even help calm the percolation of built-up anger enough to allow me to think about and decide upon a course of action that allows me to better tolerate uncomfortable circumstances. It sometimes helps me to bear in mind that I am the outlander who is struggling to co-exist with a dominant species of human that is oblivious to conditions such as mine, and who can effortlessly tune out the same sorts of distractions that I'm often so bothered by. I cannot expect most people to understand me, or to be sensitive to my needs. It's a jungle of normals, and I have to use my wits to figure out how to survive in this jungle or be eaten by my own insanity.
I'm just thinking out loud (or in ASCII, as it were). Don't know if it will help. But your post brought about this thought process which I hoped might yield something of use to you.