[microsound] image sonification techniques

[Dara Shayda]

These are great experiments and ideas. Thank you for sharing. 

Instead of Image Synth, if you do Image Filter i.e. turn the video frames into filter masks, then you can control the way a pre-existing sound file plays i.e. the motions of the limps dictates which parts of the frequency spectrum are in high intensity. 

This way the  dancer does not generate the sound, but controls the amplitude for the frequency map of an existing sound. 

Then dancer can perform moves that will up the amplitude for frequency regions he or she likes to hear through her bodily motion. 

Perhaps as you mention 'virtual pads' would allow for multiple such sound generation and frequency manipulations.

Thanx again for these innovative experiments. I like to learn more.
Dara
On 2012-01-10, at 2:33 PM, Jaime Munarriz Ortiz wrote:

> I did motion capture at Amsterdam long time ago, body and facial.
> You can use ultrareflective material for the dots, and infrared cameras to receive a really clean image.
> But you don't need a scientific precision: I had great results using just the "difference factor" between 2 frames, i.e., the amount of change.
> You can read motion from different sections of the image, getting some "virtual pads" that can flow to different sound parameters. From them you can extract the moving blobs, the amount of certain colors, the changes in time... this coul lead to a very expressive system, without the scientific precission of motion capture.
> 
> 
> _______________________________________________
> microsound mailing list
> microsound at microsound.org
> http://or8.net/mailman/listinfo/microsound
>