Should I make my tea/coffee with tap water?

if you're worried about the quality of the water then you could boil it. boiling water is a way to purify it. or you could buy a water filter for your sink.

Yes you can, but of course, you also have to consider the quality of your water as it may affect the taste of the drink. To be sure that the quality is good and it's safe, you better use www.aquasafe.com.au water filters that you can conveniently use at home. A clean and safe water will let you enjoy your coffee or tea better.