I bought an OT to do just what you described. It works, but I found that using a small mixer was in the end more convenient.

Something like the XENYX 1002USB is super tiny, has 4 stereo input channels, and comes with a decent USB audio interface built in for less than $100.