I never had problems in Linux with my Elektrons. Are you using pipewire? If not, go for it
It’s possible that the sample rate of your system is set to something else than 48kHz which would explain the problems.