Problem with displacement based texturing.

I’m trying to create real world displacement but regardless of the texture quality , my final material looks jagged and has surface spikes.
I have tried varying the tessellation multiplier but to no avail.
Please help in making it look more believable.