There are a few things to consider here.
Firstly, there is the latency. We want to keep this to the minimum but perhaps the RPi needs to work with larger buffers than a state of the art PC. This depends on the architecture, chipset, USB driver, etc. more than the raw power. A RT kernel might help with this.
Then, there is the computing power. At the moment, the algorithm uses only the 4% of a CPU in my case. There are a few resampling algorithms to choose from so this could be parameterized if we need to use a faster one.
Finally, there are a few things to consider for the ARM architecture. We want to disable dummy cores (see the README.md), because this can cause problems in RT applications and I’m not sure it this would be possible. Besides, ARM uses something called big.LITTLE that is the name they use to indicate that not all cores are equal, which might cause trouble too. But this depends on the actual micro.
I can not go deeper than this.
But the best way to know is to try it out. I think it could work.