Why does water's taste change depending on its storage? e.g. Water from a canteen tastes metallic?

Metals lose electrons easily. That makes ions, and ions dissolve in water. If you have a slime problem in stored water, such as your dog's watering bowl, you put a couple of copper pennies and one or two pieces of silver in the water. All forms of slime are killed by either copper or silver ions.