it's a long story 😂

i basically had an insane epiphany

i have a theory of an ai hardware device composer that enriches itself with all available knowledge on music. it has its own very deep music system – like music psychology, music theory, rythm, sythesis etc.

but then its completely adaptive to human input and cc messages on said hardware devices.

im basically building a system that you can talk to - you walk in to the studio and say give me something synthwavey and kind of like moderat. and it starts playing. and you go 'nah thats too dark. make it a bit more fun in an 80's way'... and away it goes.

And then... when you start playing with the devices themselves... it learns. and it uses cc and midi input as further instruction.

Insane right?

😂

Reply to this note

Please Login to reply.

Discussion

Chat GPT but the output is played through the synths. Sounds cool! How is it going so far?

yeah kinda but it also needs to be very erm.... domain specific – music. so it uses OpenAI apis but then it has all these engines to enrich that data so it has guardrails I guess from hallucinations etc. from just a straight up LLM. but top level - yeah its chatgpt as a studio assistant. But it would be primarily a voice interface... so you just literally talk to it

Very nice!

sorry missed your question! so far its going well. the concept is validated. it can control my gear in a musical way. there's a lot to do but i know it will work, its just a case of working through shit now

Sounds like a fun project!

and so... i've kind of validated the – can text based input control midi devices in a musical way bit.... it's already playing chord progressions and stuff on my prophet.... It can!

It can already spit out drum patterns. So I imagine melodies too. You have it enter the notes into ableton and it plays your synth that way?

no the current (mvp i guess) UI is web based... but the backend is a separate server so any interface could connect to it – plugins for example, a macos app... but at the moment its using webmidi... so in your browser. it automatically detect what hardware is plugged in.... it has already ingested their manuals and understands all their cc mappings and nuances... and away it goes

You give it the manual and it understands all the cc mappings. That’s crazy