Yeah, it sounds like they don't like the autistic behavior(the obsessions and the crying). Actually, my guess is that they take advantage of the crying because they know you flee when you do. And they can't spank you anymore, so why not give them a little grief? 
_________________
"I'm sorry, I seem to have a tin ear for other people's feelings..." -Naoto Shirogane