Glossy reflections noise problem

[ambikeshmishra]

Hi all! I am encountering a lot of noise in the glossy areas(white pixels) of my wood material(See attached image). http://postimg.org/image/temb62kar/

 

I looked a lot for solutions online but to no avail. I tried increasing the reflection subdivs of the materials, increasing the max subdivs of the image sampler and the decreasing the adaptive amount and noise thresholds. Other than that I tried setting my irradiance map and light cache to really high settings but still no luck in improving the noise.

Here's are my VRay settings:

 

Another thing which I notice is when the light cache builds up, the noise areas already appear very white.