Is it okay to leave a brand new hair dryer plugged in?

Yes, the hair dryer should have an Alternating Current detection system in it and it will protect it from raising the voltage, and prevent it from running when it is plugged and the switch is turned to off.