Internal diameter does not matter. Drilling out (not by free hand, with box column drill or turning lathe) a usual modification.
For a good optimization you need the best overall weight and all the rollers of the same weight.
Therefore you can use sets with rollers in many different weights. They are not intended for eternal use, they wear out fast. Try out the optimal weight and then choose rollers of high quality with this weight.
Or as mentioned above drill out 5-10% and try, then another ...
But then you will notice the optimum only when things become worse again, you already bore too much.