I have to move the fader. Then it jumps to value of controller position.
My work around is to save my parts with all the volumes down. Then when I change kits/patterns I have all the faders down (end of previous kit jam).
A quick reload part on OT and Im ready to jam the next pattern. On Rytm (and pehaps A4) there is an option to reload kit upon change or something like that that would make this workaround work well for you with faderfox I recon.
Just save kit with all volumes at zero, end your previous jam with faders all down, switch kit, then fade up as you wish