Mac or PC? And what are you using for a sound card? Sounds like your buffer sample size is probably set very high. If using an audio interface you should be able to adjust this via it’s software. If using built in audio (on Mac) you can adjust this via Live’s preferences under ‘Audio’. Lower size = less latency. However it can also mean lower quality playback if you don’t have good enough hardware.