The 6581 SID chip is prone to lot’s of noise. They released a later version that is less dirty sounding, the 8580 (also sold as the 6582).
If the noise is a issue you might have to run a noise gate.