It certainly can be overwhelming. Try not to overthink it. Iāve already done that, and hereās the results from hours of combing through every single factory sample. YMMV.
I keep a few DIY ākitsā stored in a single project template. I like to use an LFO on Sample Slot switch, so tend to stack complementary samples next to each other in the project template. This process will take you maybe a few hours tops. Be selective on what you include but not to the point of obsession (you can change things later).
Hereās my basic DIY quick template:
Sample slots 1-4 are kicks, 5-16 snares, claves and such, 17-24 toms, 25-32 hats, 33-40 bass, and I leave the rest empty to be added as needed. This covers the basics for putting together a quick improv kit on tracks 1-5. Save the project as your template and then resave it and name it after a genre, venue, whatever. Get busy whacking up beats.
Once I get some beats rolling I can quickly and randomly add samples to the project. Synths, stabs + other stuff Iāve put on the drive like vinyl FX, birds chirping, bugs bugginā, movie dialog, cartoon SFX, ad nauseam. My Drive samples are organized into appropriately named folders for quick and easy access.
LFO sample slot switch usually only needs a depth of 1 to 2 to produce some nice variation, and you can go back to the SRC page and nudge / select 1 or 2 samples over for a little more variation. Set the depth from 2-4 (or even higher) if youāre feeling freaky 
I use factory samples all the way for the basics (never bought a sound pack).
Notably missing in the factory samples are cuicas which I find immensely useful after riding the rail up to the top Corcovado. Free cuicas are easy to find online.
I pretty much have 2 basic project templates which have morphed into genres and other nonsense over time.