[microsound] image sonification techniques
Kovács Balázs
mmi at art.pte.hu
Tue Jan 10 02:03:36 EST 2012
Hi Dara,
sorry for the late response, and many thanks for the support!
i plan to begin the interaction-based works in the last part of the
project, probably
the next week? i built a basic eye/mouth follower
(http://vimeo.com/31281227),
but i don't have experiences with phoneme recognition... anyway it would
be very
good to include it in the series, so if You have idea, then welcome and
i would join
in! maybe i could also develop a system for the end of the next weak,
but as i see
you have experiences in the field with this wonderful "Beginning" work!
All the best,
Balázs
2012.01.09. 22:48 keltezéssel, Dara Shayda írta:
> Hello Sir
>
> I would be interested in image-synth sort of ideas for human motion as
> you prototyped in this wonderful work.
>
> Facial muscular motions for pronouncing the phonemes would be a good
> start, does not have to be about dancing.
>
> Also eye motion tracking is another wonderful domain for image synth.
>
> Dara
>
> On 2012-01-07, at 1:34 PM, christopher jette wrote:
>
>> Glad to see this topic has come up, enjoying the results. I have
>> also been doing some work with scan synthesis, although I was working
>> with a dancer as input. (http://vimeo.com/28209478). The project is
>> resting and evolving at this time, but we are going to reopen it in a
>> few weeks and perform in Palo Alto.
>>
>> Cheers~
>> Christopher
>>
>>
>> On Sat, Jan 7, 2012 at 10:29 AM, Dara Shayda <dara1339 at hotmail.com
>> <mailto:dara1339 at hotmail.com>> wrote:
>>
>> Hello and thank you for this link I will look at it.
>>
>> I use:
>>
>> http://www.uisoftware.com/MetaSynth/index.php
>>
>> These are really kool software developers and musicians. They are
>> professional astute and quite competent.
>>
>> If you take a sound pattern and turn it into an image, as in
>> image filter, say the patters of voice of a human chanter, and
>> use the latter as an image-filter against say wind or water or
>> thunderstorm:
>>
>> http://soundcloud.com/dara-o-shayda/beginning
>>
>> What you hear is wind or water or thunderstorm chanting! A very
>> different effect is heard distinctly different than the
>> overlaying or superimposition.
>>
>> Dara
>>
>> On 2012-01-07, at 12:53 PM, imagimuse wrote:
>>
>>> Your site is interesting.
>>> I also used Metasynth for some parts of my works, for example:
>>> "Acousmatic Tranmutations"
>>> http://charles.platel.pagesperso-orange.fr/music/transmut/index.htm
>>> This kind of tool may provide interesting sounds and pitch
>>> shaping. But it needs some experience feedback to identify what
>>> pictures are appropriate for "sonification" or which filters to
>>> apply to make pictures appropriate, mainly thresholds, contrast,
>>> inversion... so that pictures begin to look like drawings (look
>>> at the Panorama link of the above page), as the picture you
>>> present yourself.
>>> Recursively I tried to use Audacity in spectrogram display as a
>>> new picture, but I have not yet found something of interest. But
>>> why not?
>>>
>>> Charles
>>>
>>>
>>>
>>> Le 7 janv. 2012 à 15:51, J a écrit :
>>>
>>>> Not working with digital images as such, but this perhaps
>>>> loosely relates to "recursive techniques" between light and sound:
>>>>
>>>> http://www.jeremykeenan.info/Jeremy_Keenan/Light_Loop.html
>>>>
>>>> 2012/1/7 Kovács Balázs <mmi at art.pte.hu <mailto:mmi at art.pte.hu>>
>>>>
>>>> Hi microsound list,
>>>>
>>>> i'm currently working on a daily image sonification project
>>>> (http://soundsofpictures.blogspot.com
>>>> <http://soundsofpictures.blogspot.com/>), which targets to
>>>> present existing and under-development mapping approaches.
>>>> I'm looking for sources to build the topology topology
>>>> which could provide an overview of this field, but
>>>> didn't found, so if somebody has suggestions then welcome!
>>>> Anyway the project is of course open to cooperations.
>>>>
>>>> so, currently i'm following this topology, and would like to
>>>> expand it with new fields:
>>>>
>>>> 1) materialist approaches
>>>> - data bending audification
>>>> - scanning synthesis, color synth, pixel to frequency mapping
>>>> - histogram to spectral processing
>>>>
>>>> 2) perceptual approach
>>>> - computer vision (great sources by Jean-Marc Pelletier)
>>>> - edge, shape detection, background extraction on
>>>> videos or
>>>> still images,
>>>> - computer vision to spatialization
>>>>
>>>> 3) interactive approaches
>>>> - data exploration (it has literature, Gil Weinberg-Tr.
>>>> Thatcher for ex.)
>>>> - model based sonification (it has also literature, Th.
>>>> Hermann etc.)
>>>> - recoursive techniques (the sound output feeds back the
>>>> mapping)
>>>>
>>>> and the endless variations of them.
>>>> more ideas welcome, and if somebody feels that has a topic
>>>> which fits
>>>> in the project, please contact me!
>>>>
>>>> and for avoiding the monthly reminder, i'm not posting to the
>>>> announce list because i expect response from the community,
>>>> and those
>>>> list isn't the place for it.
>>>>
>>>> best/thanks,
>>>> Balázs
>>>>
>>>> --
>>>>
>>>> PTE Muveszeti Kar, Media- es Alkalmazott Muveszetek Intezete
>>>> PTE Faculty of Arts, Institute for Media and Applied Arts
>>>> H-7630 Pecs, Zsolnay Vilmos u. 16.
>>>> tel/fax:+36(72)501540 <tel:%2B36%2872%29501540>
>>>> mobil:+36(20)2331867 <tel:%2B36%2820%292331867>
>>>> e-mail: mmi at art.pte.hu <mailto:mmi at art.pte.hu>
>>>> www: http://www.art.pte.hu/menu/92
>>>> blog: http://art.pte.hu/211orchestra/
>>>> _______________________________________________
>>>> microsound mailing list
>>>> microsound at microsound.org <mailto:microsound at microsound.org>
>>>> http://or8.net/mailman/listinfo/microsound
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> www.jeremykeenan.info <http://www.jeremykeenan.info/>
>>>> www.callandresponse.org.uk <http://www.callandresponse.org.uk/>
>>>> www.fromhoneytoashes.co.uk <http://www.fromhoneytoashes.co.uk/>
>>>> www.upsidedownumbrella.info <http://www.upsidedownumbrella.info/>
>>>>
>>>> _______________________________________________
>>>> microsound mailing list
>>>> microsound at microsound.org <mailto:microsound at microsound.org>
>>>> http://or8.net/mailman/listinfo/microsound
>>>
>>> _______________________________________________
>>> microsound mailing list
>>> microsound at microsound.org <mailto:microsound at microsound.org>
>>> http://or8.net/mailman/listinfo/microsound
>>
>>
>> _______________________________________________
>> microsound mailing list
>> microsound at microsound.org <mailto:microsound at microsound.org>
>> http://or8.net/mailman/listinfo/microsound
>>
>>
>>
>>
>> --
>> www.cj.lovelyweather.com <http://www.cj.lovelyweather.com/>
>> christopherjette at gmail.com <mailto:christopherjette at gmail.com>
>> 617.869.3968
>> _______________________________________________
>> microsound mailing list
>> microsound at microsound.org <mailto:microsound at microsound.org>
>> http://or8.net/mailman/listinfo/microsound
>
>
> _______________________________________________
> microsound mailing list
> microsound at microsound.org
> http://or8.net/mailman/listinfo/microsound
--
PTE Muveszeti Kar, Media- es Alkalmazott Muveszetek Intezete
PTE Faculty of Arts, Institute for Media and Applied Arts
H-7630 Pecs, Zsolnay Vilmos u. 16.
tel/fax:+36(72)501540
mobil:+36(20)2331867
e-mail: mmi at art.pte.hu
www: http://www.art.pte.hu/menu/92
blog: http://art.pte.hu/211orchestra/
More information about the microsound
mailing list