This is a visualization of music I composed called “Number Station.” The visualizations are generated by the volume of each channel from the original multitrack file.
Generated using Processing and Minim libraries with 14 channels of streaming audio on an unbelievably fast machine.
If you were a video editor or small production studio and you wanted to lay down some music on a film, you could use Abaltat’s Muse.
But I see this technology as much more significant than a suggested attempt to put composers on the dole.
Mark Altekruse at Abaltat suggested that as a composer, I could use this to sketch out ideas. He was right: Inside of an hour I was inserting cue points into the timeline and adjusting instrumentation according to color information.
It was a much different composing experience. Instead of writing a piece of music and then plopping it down onto the scene, I could essentially work backwards. By laying down a sketch, I could think about what mood or depth of instrumentation I could use and work out the timing, instead of worrying about the details of the music too early on.
Muse's Color Timeline
The wonderful part is that Muse allows one to export sound files and midi files for placement (exporting cues to AAF files doesn’t seem to be an option yet) and for perfectly reasonable use.Changing the scale of the current composition is quite easy. I could see using Muse on a tight deadline.
What’s most exciting is that Muse is a truly synaesthetic tool for creating dynamic sound from image.
Dragon is a tool developed by the Media Computing Group at RWTH Aachen University. It allows for direct manipulation of objects on the screen according to their trajectory. In their study, they found that users preferred this method of interaction over a basic slider because it gave them more perceptual control. In the screen grab of their video (on the Dragon project page) you can click on the object to move it in time and trajectory.