How to turn off vibration in new Android 5.1 phone while touching screen or keyboard?

Step 1 :-

Settings --> Personal --> Language & Input --> Android Keyboard Settings ( of active keyboard) --> Preferences --> Vibrate on Keypress --> Touch to switch off.

Step 2 :-

Settings --> Device --> Audio Profiles -->
General --> Edit --> (scroll down to bottom of screen) --> System --> Vibrate on Touch

Aforementioned both steps are necessary.

Special thanks to Sukumar Satyen for asking this.

Have a great day !