Looking for AI powered sound library categorization app

I’ve got some 25000 unlabelled (no metadata) FX and Foley sounds that I need to categorize into different folders so I can put them into tonverk. I was wondering if there is an app that can do this via machine learning/AI by listening to the sounds and grouping similar ones together? For windows

I found this app called orion-sfx which does just that, unfortunately file management on it isn’t very good as I can only drag and drop one at a time into a windows folder out of it’s GUI, and it only copies them rather than moving them. Which creates a problem since there is going to be overlap between some of the sounds’ characteristic/categories which would mean I’d end up with duplicates across folders.

Looking for a similar AI powered app which can allow me to group sounds into categories like weather, ambience, nature, animal, percussive, Foley, water, swell, explosion, impact, voice, etc. While allowing batch moving them from a source folder to another folder. Anyone know if something like this exists?

I suppose I can do them one by one using orion-sfx, copy and delete, but that would take ages.

1 Like

Yeah. This is what I want AI to help me with. Not generating music.

5 Likes

It’s something I’d like too. I’ve considered using AI to build me an app to do this but honestly I haven’t put any effort into that so far.

1 Like

You may want to know about this thread

A few responders go on to mention tools for sample organisation.

2 Likes
2 Likes

Awesome, thanks. I’ll have a look there :slight_smile:

I tried this actually, it seems quite good except for a few tags not quite hitting the mark. Also need more sfx library specific tags. It’s not anywhere near the level of orion’s categorization algorithm though which is quite surprisingly amazing at finding whatever sound you describe.

For some reason sononym is bugged for me as in when I press a tag in the tags window it doesn’t filter for it. The other issue is it doesn’t update the library after deleting a file in windows and after restarting the app it seems to think none of the audio files are preset requiring a rescan. It’s kind of buggy

Do you know if sononym would allow me to batch move files to windows folders (not just copy paste)?

Use Claude Code and build it. I have no coding experience and have built quite a few studio apps now for my own use. You have to be willing to put in a bit of time and bug test and will need a paid version, but it’s pretty remarkable what you can do. As you said this is the kind of stuff that AI is good for, making custom tools that are designed to do exactly what you need. I’m kind of addicted so after my current very ambitious build I’m going to cancel my subscription, otherwise I’m just tempted to build everything cool that pops into my head.

2 Likes

do it man, build cool stuff. share it. tell the world. maybe there’s someone out there willing to pay for it and you get extra income if you’re lucky

1 Like

Nah. I’m no coder. I wouldn’t want to be responsible for fixes and security and all that stuff. I love what I’ve built though.

2 Likes

Can claude actually analyze the audio and recognize what it’s hearing to classify it?

1 Like

I’ve built a sample organizer that uses spectral analysis. You’ll have to see if it works for you. That doesn’t employ an LLM and runs locally. Using an LLM you can probably do even more.

1 Like

Claude will find a way to do that, if you tell it that’s what you want. Claude code will help you build a program to do it, and I’m pretty sure there will be a way to get Claude work(or is it cowork ?) to do it directly.

Exactly how it classifies stuff depends on you explaining what you want.