try turning on “starts silent” for your tracks in the pattern settings of the pattern you are switching to…