This shouldnt be the case. Are you using a mono (TS) cable? in that case the stereo signal would send signal down the ground path of the TS cable causing a hum similar to a ground loop.
To solve, use a stereo TRS cable for the headphone out; and mono TS cable for each L and R out.