I often install the disposal on a switched receptacle, with the switch under the sink inside the cabinet. There's usually room to do it that way, and it keeps the switch from being confused with a light switch.
As for the inspector, either he's following a local code, or he's making it up. I've never heard of any rule requiring the disposal switch to be within a certain distance of the disposal.