[microsound] image sonification techniques
Dara Shayda
dara1339 at hotmail.com
Tue Jan 10 02:43:57 EST 2012
Hello Christopher
These are grand ideas. I play around with MetaSynth 5 and some videos and report back.
I would not do the robotic route, they are too primitive as you found out.
I have some ideas from you so I will sketch out some trials.
Thanx
Dara
On 2012-01-10, at 2:21 AM, christopher jette wrote:
> Hello Dara,
>
> Indeed, the face and eye motion tracking are interesting. I have seen your work on wavelets and been meaning to wrap my brain around it as I think it would provide the sort of detailed analysis that is needed for working with the face.
>
> SoundLines is my first work in this area and I approached it as a composer thinking about the role of a performer. I simply removed the instrumental extension of the performer and was left with the body, hence, a dancer was the right choice at the time. I have been thinking about smaller more focused places to take this and like your idea. I have also been thinking about working without humans, using robots. I have done some experiments but am not satisfied with the results yet. It turns out (as is obvious upon reflection) that continuously moving wind up toys (my robot stand ins) are well.. continuously moving. So I am thinking about how to reshape the environment they exist in.
>
> What I like about your suggestion is that it is more focused, yet retains the expressivety of humans. I'll see what I can figure out.
>
> Cheers~
> Christopher
>
> On Mon, Jan 9, 2012 at 10:48 PM, Dara Shayda <dara1339 at hotmail.com> wrote:
> Hello Sir
>
> I would be interested in image-synth sort of ideas for human motion as you prototyped in this wonderful work.
>
> Facial muscular motions for pronouncing the phonemes would be a good start, does not have to be about dancing.
>
> Also eye motion tracking is another wonderful domain for image synth.
>
> Dara
>
> On 2012-01-07, at 1:34 PM, christopher jette wrote:
>
>> Glad to see this topic has come up, enjoying the results. I have also been doing some work with scan synthesis, although I was working with a dancer as input. (http://vimeo.com/28209478). The project is resting and evolving at this time, but we are going to reopen it in a few weeks and perform in Palo Alto.
>>
>> Cheers~
>> Christopher
>>
>>
>> On Sat, Jan 7, 2012 at 10:29 AM, Dara Shayda <dara1339 at hotmail.com> wrote:
>> Hello and thank you for this link I will look at it.
>>
>> I use:
>>
>> http://www.uisoftware.com/MetaSynth/index.php
>>
>> These are really kool software developers and musicians. They are professional astute and quite competent.
>>
>> If you take a sound pattern and turn it into an image, as in image filter, say the patters of voice of a human chanter, and use the latter as an image-filter against say wind or water or thunderstorm:
>>
>> http://soundcloud.com/dara-o-shayda/beginning
>>
>> What you hear is wind or water or thunderstorm chanting! A very different effect is heard distinctly different than the overlaying or superimposition.
>>
>> Dara
>>
>> On 2012-01-07, at 12:53 PM, imagimuse wrote:
>>
>>> Your site is interesting.
>>> I also used Metasynth for some parts of my works, for example: "Acousmatic Tranmutations" http://charles.platel.pagesperso-orange.fr/music/transmut/index.htm
>>> This kind of tool may provide interesting sounds and pitch shaping. But it needs some experience feedback to identify what pictures are appropriate for "sonification" or which filters to apply to make pictures appropriate, mainly thresholds, contrast, inversion... so that pictures begin to look like drawings (look at the Panorama link of the above page), as the picture you present yourself.
>>> Recursively I tried to use Audacity in spectrogram display as a new picture, but I have not yet found something of interest. But why not?
>>>
>>> Charles
>>>
>>>
>>>
>>> Le 7 janv. 2012 à 15:51, J a écrit :
>>>
>>>> Not working with digital images as such, but this perhaps loosely relates to "recursive techniques" between light and sound:
>>>>
>>>> http://www.jeremykeenan.info/Jeremy_Keenan/Light_Loop.html
>>>>
>>>> 2012/1/7 Kovács Balázs <mmi at art.pte.hu>
>>>> Hi microsound list,
>>>>
>>>> i'm currently working on a daily image sonification project
>>>> (http://soundsofpictures.blogspot.com), which targets to
>>>> present existing and under-development mapping approaches.
>>>> I'm looking for sources to build the topology topology
>>>> which could provide an overview of this field, but
>>>> didn't found, so if somebody has suggestions then welcome!
>>>> Anyway the project is of course open to cooperations.
>>>>
>>>> so, currently i'm following this topology, and would like to
>>>> expand it with new fields:
>>>>
>>>> 1) materialist approaches
>>>> - data bending audification
>>>> - scanning synthesis, color synth, pixel to frequency mapping
>>>> - histogram to spectral processing
>>>>
>>>> 2) perceptual approach
>>>> - computer vision (great sources by Jean-Marc Pelletier)
>>>> - edge, shape detection, background extraction on videos or
>>>> still images,
>>>> - computer vision to spatialization
>>>>
>>>> 3) interactive approaches
>>>> - data exploration (it has literature, Gil Weinberg-Tr. Thatcher for ex.)
>>>> - model based sonification (it has also literature, Th. Hermann etc.)
>>>> - recoursive techniques (the sound output feeds back the mapping)
>>>>
>>>> and the endless variations of them.
>>>> more ideas welcome, and if somebody feels that has a topic which fits
>>>> in the project, please contact me!
>>>>
>>>> and for avoiding the monthly reminder, i'm not posting to the
>>>> announce list because i expect response from the community, and those
>>>> list isn't the place for it.
>>>>
>>>> best/thanks,
>>>> Balázs
>>>>
>>>> --
>>>>
>>>> PTE Muveszeti Kar, Media- es Alkalmazott Muveszetek Intezete
>>>> PTE Faculty of Arts, Institute for Media and Applied Arts
>>>> H-7630 Pecs, Zsolnay Vilmos u. 16.
>>>> tel/fax:+36(72)501540
>>>> mobil:+36(20)2331867
>>>> e-mail: mmi at art.pte.hu
>>>> www: http://www.art.pte.hu/menu/92
>>>> blog: http://art.pte.hu/211orchestra/
>>>> _______________________________________________
>>>> microsound mailing list
>>>> microsound at microsound.org
>>>> http://or8.net/mailman/listinfo/microsound
>>>>
>>>>
>>>>
>>>> --
>>>> www.jeremykeenan.info
>>>> www.callandresponse.org.uk
>>>> www.fromhoneytoashes.co.uk
>>>> www.upsidedownumbrella.info
>>>>
>>>> _______________________________________________
>>>> microsound mailing list
>>>> microsound at microsound.org
>>>> http://or8.net/mailman/listinfo/microsound
>>>
>>> _______________________________________________
>>> microsound mailing list
>>> microsound at microsound.org
>>> http://or8.net/mailman/listinfo/microsound
>>
>>
>> _______________________________________________
>> microsound mailing list
>> microsound at microsound.org
>> http://or8.net/mailman/listinfo/microsound
>>
>>
>>
>>
>> --
>> www.cj.lovelyweather.com
>> christopherjette at gmail.com
>> 617.869.3968
>> _______________________________________________
>> microsound mailing list
>> microsound at microsound.org
>> http://or8.net/mailman/listinfo/microsound
>
>
> _______________________________________________
> microsound mailing list
> microsound at microsound.org
> http://or8.net/mailman/listinfo/microsound
>
>
>
>
> --
> www.cj.lovelyweather.com
> christopherjette at gmail.com
> 617.869.3968
> _______________________________________________
> microsound mailing list
> microsound at microsound.org
> http://or8.net/mailman/listinfo/microsound
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://or8.net/pipermail/microsound/attachments/20120110/3cefe861/attachment.html>
More information about the microsound
mailing list