Hyper Speckly Materials?

I have a material consisting of a gold damask pattern on red wallpaper and my base texture looks alright up close:
http://i4.photobucket.com/albums/y149/sa0ri-chan/Closeup.jpg~original

But when I zoom out a bit or view it at an angle, I get these tiny, shimmery effects:
http://i4.photobucket.com/albums/y149/sa0ri-chan/OffAngle.jpg~original

I have the gold bit set to a Metalness value of 1, a Base Color corresponding to the recommended Base Color in the Physically Based Materials page (1.000, 0.766, 0.336) and a Scalar Parameter with the value of .4 plugged into Roughness.

Is how I set the material off…? Or could it be more of an issue with how my lighting is set up? o: