Google will penalise sites for not being mobile optimised

Google mobile

Or rather if your site is not responsive and optimised for mobile then it will be pushed much further down the rankings when searched for on a mobile device.