Disabling speed dialling on nexus 5,as it causes problems.

I find all numbers We use or receive from ,get on the screen and causes a problem .just a touch makes the call to that number. I would like to disable this speed dial function. At most restrict to only 2 numbers.
How to do it?
J pereira