What you are using (V-Ray 5, 6, or V-Ray 7)? Whether you are rendering a still image or an animation ?
Controlled globally by the Noise Threshold in newer V-Ray versions. If using an older version, set to 16 or 24 . Light Cache Settings (Secondary Engine)