It should work. I do the same thing sometimes, with the Digitakt. If I load the Digitakt plugin on a midi channel in Ableton, then the sync still works, too. Then, just route the audio in from your audio interface, instead of from the OB plugin.
Then, set this setting to “on” to make sure audio still comes out of the Digitakt’s 1/4-inch outs.
Should be the same for RYTM.