In theory your idle jet could be the wrong size as soon as you change your setup, especially modifications to the airbox and such will have an effect on the idle mixture, and indeed also on the mixture at low rpms and low throttle...
In practice, with a 50, 72 and 85cc, I've upjetted idle jets to one or two sizes larger, and the only difference I could notice was that I needed to readjust the idle mixture screw...
My guess is that we drive our small CVT controlled engines in the half/full throttle / higher rpm range for most of the time, so we don't really spend noticeable time in the lower rpm/throttle range where the idle jet would make a difference...