I think it depends a lot on the musical instrument in question. Some instruments don’t have the concept of sounds that can arranged as kits. Others might not even have patch memory.
And in the case of the Rytm — and with Elektron style instruments in general, — yes, it does reward taking advantage of their abilities and bringing all of the features together, enhanced with sequencing and performance features on top.
Even a nice starting point doesn’t preclude being able to deform sounds into something new.