Do you know of any better quality needles I could use?

As I said, there is audible line hum from the transformer. It’s very low level and gets pretty well masked by the music. Unless you mean some other kind of noise?

I’m not expecting this setup to pass any kind of technical standards, just want to be able to listen to my records again in an uncritical, home environment, after a year of having them sit around unloved.