1. If its not grounded and there is a line to case fault, the fault current can't get back to its source.
2. On a non grounded CPT, when you check voltages, if you go to ground as a normal system, you get odd readings.
3. I have not seen a nongrounded CPT, they may be used in locations where you can't tolerate a system shut down.