There is no reason why it would distort more if you stay between VOL -63 and VOL 0, as you still have 12 db headroom between VOL 0 and VOL +63.
It’s a solution.
Unity settings