When my own software becomes my creative studio: music, visuals and AI working together

in Cur8 • yesterday

When my own software becomes my creative studio: music, visuals and AI working together

I've been experimenting with something that makes me particularly happy: using software I've developed myself to create music and audiovisual content, with AI helping me connect all the pieces.

The result is this short video:

🎬 Watch the video:

But there's a little more behind those 45 seconds.

The music was performed live inside StudioMio, my own DAW, developed with the help of Claude Opus. It's an ongoing project that has grown into a proper music production environment, with its own synthesizer, mixer, effects, racks and sequencing tools.

GitHub: https://github.com/davvoz/studiomio

For the visuals, I used Aurora Player, another project of mine. It's a modern reinterpretation of the classic Windows Media Player visualizations, with graphics that react to the audio in real time.

GitHub: https://github.com/davvoz/sound_player_music_visualizer

I recorded the performance with NVIDIA and then brought Claude into the post-production process.

This is where things got particularly interesting.

Claude worked on the video itself: selecting and cutting the footage, adjusting its duration, adapting the framing and format for a vertical YouTube Short, and assembling the final sequence.

It also opened StudioMio, captured different parts of the application, including clips, mixer, synthesizer and effects, and integrated those shots into the video, synchronizing the editing with the beat.

The result combines live music, real-time audio visualization and footage of the actual software used to create it.

What I enjoy most about this experiment is that AI wasn't simply asked to generate something from a prompt. It became an active part of a creative workflow built around tools that I developed myself.

StudioMio produces the music, Aurora Player gives it a visual dimension, and Claude helps bring everything together.

I'm increasingly interested in this kind of workflow, where software development and artistic production become two sides of the same process.

And honestly, seeing my own applications being used to create something like this is incredibly satisfying.

More experiments coming!

image.png

Sort:  

Lo que aprendí viendo esos 45 segundos es que Claude Opus ya no es solo un asistente, sino parte del motor creativo de StudioMio, sin vueltas. La vida me enseñó que cuando Aurora Player reacciona en tiempo real, el código se vuelve música 🎧.