Is the facility one which is covered by ADA?
If so, see
this link.
There you will find:
and
308 basically says 48" max if there are no obstructions keeping a wheelchair from pulling up next to the wall. Lower if there are obstructions.
I think that there is ample support for the inspectors position, with room for dispute about whether the panel is an accessible element in an accessible room and whether it meets the exception to 205.1. But that is limited in turn by:
This definitely shows that circuit breakers are operable parts, but may not totally remove the opportunity to apply the Exception.
No, I have not seen this enforced, but there are a lot of things I have not seen. And if you want to dispute the inspector's finding you will need more than a quick reading of the standard to support you.
PS: The 48" would be to the highest control which is required to be accessible. That will probably include the Main. But not to the top of the panel or even the panel door.