[microsound] Sardine Run: Video Sonification

[Dara Shayda]

Hello

http://soundcloud.com/dara-o-shayda/sardine-run  

A video of Sardines running from predators i.e. seagulls, dolphins and whales, turned into counterpoint tunes made from 8-frame 256x256 strips of video, in three keys.

The strips are not suitable for sonification, indeed Wavelets were used to extract FEATURES of the animal motion. Similar method was successfully used to extract the glitter of the sun rays without the large over-exposure of  sun reflection that disturbs the sonification. 

Feature Examples: Dolphins tend to be the same colour as the ocean water, the silhouette of dolphins automatically appears in the Wavelets decomposition without any explicit programming. The whale torso is fully extracted while the water surface/waves removed all together!!! Seagulls body extracted while the water surface, cloud and the sky is eliminated. 

Oddest phenomenon in this investigation: Sounds similar to the water motility as well as sounds similar to dolphins chirping were generated from the video-image strip without any special effects!!!

Soundcloud textual annotation is used to describe the different aspects of the hunt and identify each animal.

A new method was deployed, each individual sonification of each strip was played (in counterpoint) in three different keys:

A, C#, G# 

Remarkably the key differentials are audible and recognizable, testament to the prowess of the MethaSynth developer. This technique shall allow the composer to overlay a melody or a chord into the sonification of the video strips!

Files (will make git soon):
svn://svn.devzing.com/lossofgenerality/SardineRun 

I will upload the video segments and other sound files after 2am tomorrow.


Dara

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://or8.net/pipermail/microsound/attachments/20120120/03f37913/attachment.html>