The NEMA starter sizes are rated for current; the larger the number the larger the motor that can be connected to it. As long as you are going to a smaller motor you should have absolutly no issues provided that you are able to adjust the starter's overloads to the correct setting to protect the smaller motor.
Just curious, why the change to a smaller motor?