[microsound] image sonification techniques

Tue Jan 10 02:21:45 EST 2012

Hello Dara,

Indeed, the face and eye motion tracking are interesting. I have seen your
work on wavelets and been meaning to wrap my brain around it as I think it
would provide the sort of detailed analysis that is needed for working with
the face.

SoundLines is my first work in this area and I approached it as a composer
thinking about the role of a performer. I simply removed the instrumental
extension of the performer and was left with the body, hence, a dancer was
the right choice at the time. I have been thinking about smaller more
focused places to take this and like your idea. I have also been thinking
about working without humans, using robots. I have done some experiments
but am not satisfied with the results yet. It turns out (as is obvious upon
reflection) that continuously moving wind up toys (my robot stand ins) are
well.. continuously moving. So I am thinking about how to reshape the
environment they exist in.

What I like about your suggestion is that it is more focused, yet retains
the expressivety of humans. I'll see what I can figure out.

Cheers~
Christopher

On Mon, Jan 9, 2012 at 10:48 PM, Dara Shayda <dara1339 at hotmail.com> wrote:

> Hello Sir
>
> I would be interested in image-synth sort of ideas for human motion as you
> prototyped in this wonderful work.
>
> Facial muscular motions for pronouncing the phonemes would be a good
> start, does not have to be about dancing.
>
> Also eye motion tracking is another wonderful domain for image  synth.
>
> Dara
>
> On 2012-01-07, at 1:34 PM, christopher jette wrote:
>
> Glad to see this topic has come up, enjoying the results.  I have also
> been doing some work with scan synthesis, although I was working with a
> dancer as input. (http://vimeo.com/28209478).  The project is resting and
> evolving at this time, but we are going to reopen it in a few weeks and
> perform in Palo Alto.
>
> Cheers~
> Christopher
>
>
> On Sat, Jan 7, 2012 at 10:29 AM, Dara Shayda <dara1339 at hotmail.com> wrote:
>
>> Hello and thank you for this link I will look at it.
>>
>> I use:
>>
>> http://www.uisoftware.com/MetaSynth/index.php
>>
>> These are really kool software developers and musicians. They are
>> professional astute and quite competent.
>>
>> If you take a sound pattern and turn it into an image, as in image
>> filter, say the patters of voice of a human chanter, and use the latter as
>> an image-filter against say wind or water or thunderstorm:
>>
>> http://soundcloud.com/dara-o-shayda/beginning
>>
>> What you hear is wind or water or thunderstorm chanting! A very different
>> effect is heard distinctly different than the overlaying or superimposition.
>>
>> Dara
>>
>> On 2012-01-07, at 12:53 PM, imagimuse wrote:
>>
>> Your site is interesting.
>> I  also used Metasynth for some parts of my works, for example:
>> "Acousmatic Tranmutations"
>> http://charles.platel.pagesperso-orange.fr/music/transmut/index.htm
>> This kind of tool may provide interesting sounds and pitch shaping. But
>> it needs some experience feedback to identify what pictures are appropriate
>> for "sonification" or which filters to apply to make pictures appropriate,
>> mainly thresholds, contrast, inversion... so that pictures begin to look
>> like drawings (look at the Panorama link of the above page), as  the
>> picture you present yourself.
>> Recursively I tried to use Audacity in spectrogram display as a new
>> picture, but I have not yet found something of interest. But why not?
>>
>> Charles
>>
>>
>>
>>  Le 7 janv. 2012 à 15:51, J a écrit :
>>
>> Not working with digital images as such, but this perhaps loosely relates
>> to "recursive techniques" between light and sound:
>>
>> http://www.jeremykeenan.info/Jeremy_Keenan/Light_Loop.html
>>
>> 2012/1/7 Kovács Balázs <mmi at art.pte.hu>
>>
>>> Hi microsound list,
>>>
>>> i'm currently working on a daily image sonification project
>>> (http://soundsofpictures.**blogspot.com<http://soundsofpictures.blogspot.com/>),
>>> which targets to
>>> present existing and under-development mapping approaches.
>>> I'm looking for sources to build the topology topology
>>> which could provide an overview of this field, but
>>> didn't found, so if somebody has suggestions then welcome!
>>> Anyway the project is of course open to cooperations.
>>>
>>> so, currently i'm following this topology, and would like to
>>> expand it with new fields:
>>>
>>> 1) materialist approaches
>>> - data bending audification
>>> - scanning synthesis, color synth, pixel to frequency mapping
>>> - histogram to spectral processing
>>>
>>> 2) perceptual approach
>>> - computer vision (great sources by Jean-Marc Pelletier)
>>>        - edge, shape detection, background extraction on videos or
>>> still images,
>>> - computer vision to spatialization
>>>
>>> 3) interactive approaches
>>> - data exploration (it has literature, Gil Weinberg-Tr. Thatcher for ex.)
>>> - model based sonification (it has also literature, Th. Hermann etc.)
>>> - recoursive techniques (the sound output feeds back the mapping)
>>>
>>> and the endless variations of them.
>>> more ideas welcome, and if somebody feels that has a topic which fits
>>> in the project, please contact me!
>>>
>>> and for avoiding the monthly reminder, i'm not posting to the
>>> announce list because i expect response from the community, and those
>>> list isn't the place for it.
>>>
>>> best/thanks,
>>> Balázs
>>>
>>> --
>>>
>>> PTE Muveszeti Kar, Media- es Alkalmazott Muveszetek Intezete
>>> PTE Faculty of Arts, Institute for Media and Applied Arts
>>> H-7630 Pecs, Zsolnay Vilmos u. 16.
>>> tel/fax:+36(72)501540
>>> mobil:+36(20)2331867
>>> e-mail: mmi at art.pte.hu
>>> www: http://www.art.pte.hu/menu/92
>>> blog: http://art.pte.hu/**211orchestra/<http://art.pte.hu/211orchestra/>
>>> ______________________________**_________________
>>> microsound mailing list
>>> microsound at microsound.org
>>> http://or8.net/mailman/**listinfo/microsound<http://or8.net/mailman/listinfo/microsound>
>>>
>>
>>
>>
>> --
>> www.jeremykeenan.info
>> www.callandresponse.org.uk
>> www.fromhoneytoashes.co.uk
>> www.upsidedownumbrella.info
>>
>>  _______________________________________________
>> microsound mailing list
>> microsound at microsound.org
>> http://or8.net/mailman/listinfo/microsound
>>
>>
>> _______________________________________________
>> microsound mailing list
>> microsound at microsound.org
>> http://or8.net/mailman/listinfo/microsound
>>
>>
>>
>> _______________________________________________
>> microsound mailing list
>> microsound at microsound.org
>> http://or8.net/mailman/listinfo/microsound
>>
>>
>
>
> --
> www.cj.lovelyweather.com
> christopherjette at gmail.com
> 617.869.3968
>  _______________________________________________
> microsound mailing list
> microsound at microsound.org
> http://or8.net/mailman/listinfo/microsound
>
>
>
> _______________________________________________
> microsound mailing list
> microsound at microsound.org
> http://or8.net/mailman/listinfo/microsound
>
>

-- 
www.cj.lovelyweather.com
christopherjette at gmail.com
617.869.3968
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://or8.net/pipermail/microsound/attachments/20120109/78d72244/attachment-0001.html>