An audio isolator will solve this problem. It will be cheaper than a usb one. TE sells one but you can find them much cheaper elsewhere: https://teenage.engineering/store/ground-loop-noise-isolator