What sheen do you have now and what are you looking for or are you just wanting to make the finish smoother. Varnish is not as hard as shellac or lacquer so it doesn't lend itself to finishing to a higher sheen. In any case wait atleast 4-6 weeks before doing anything.
Regards
Jerry
Regards
Jerry