Just a question (seriously), what permit fees do you pay? I pay the fees for all the permits I take out, have never had an inspector pay a dime on one. Yes, we all know you pay taxes too, but taxes start in the private sector, not the public sector. Without the private sector, the $ would not be there to pay you, unless you were federal, then Uncle Sam could just print money. Just for the record, my parents were both schoolteachers & my brother is a retired library director. Not bashing public sector but keeping it in tune with reality.
I don't blame you for walking away when people are abusive. No excuse for that. But I find in interesting that the OP is in Mass. I have a friend who worked there & CT. Said many inspectors there would not even tell a contractor why he failed inspection; would make him go all through a big job for a needle in a haystack. That is authority gone to someone's head. We fought King George over abuses of authority.