Machines to DAW, then to OT, add machines and to DAW again

Hi, anyone managed to do this without latency problems?

I´m sending audio over USB from Rytm and DN to Ableton, as well as OT´s CUE. Then everything is routed into OT´s AB, sampled, sliced and returned to Ableton. I want to add more DN and Rytm to that but the latency is already too high.

I´d like to do it jamming live, is it possible?