Speaker only works when I am talking over the phone. But if I put it on speaker phone it won't work?

If I'm going to watch a video sound does not work whatsoever but if I'm on speakerphone you can barely hear the sound but if I don't have it on speakerphone you can hear it loud and clear. I've tried restarting my phone nothing workS