<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><a href="http://orazon-art.com/ressources/tool/mocap/mocap_01.jpg">http://orazon-art.com/ressources/tool/mocap/mocap_01.jpg</a> This is what I was referring to in terms of makeup. You place some sticky dots on your face and then videotape yourself talking or singing and so on.<div><br></div><div>You can write a little tool (or borrow from some 100s of others who do facial gesture capture research) and extract the 2D/ 3D movements of the face. </div><div><br></div><div>Then redo the video without the dots.</div><div><br></div><div>Use the dots as input parameters into you software, so they will serve like a sequencer for local synthetizers you can attach to each dot. Synthesize individual dots and then superimpose the sounds. </div><div><br></div><div>The redone video without the dots can be image synthed frame by frame. You can then have the dots data to drive changes to the audio track of the voice.</div><div><br></div><div>So you get three sets of sounds generated from facial gestures.</div><div><br></div><div>Similar concept can work with the rest of the limbs. </div><div><br></div><div>There are expensive 3D gear for the whole body and face. But you might be able to do with the sticky dots for the beginning.</div><div><br></div><div>D<br><div><div>On 2012-01-10, at 2:03 AM, Kovács Balázs wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div> Hi Dara,<br><br>sorry for the late response, and many thanks for the support!<br><br>i plan to begin the interaction-based works in the last part of the project, probably<br>the next week? i built a basic eye/mouth follower (<a href="http://vimeo.com/31281227">http://vimeo.com/31281227</a>),<br>but i don't have experiences with phoneme recognition... anyway it would be very<br>good to include it in the series, so if You have idea, then welcome and i would join<br>in! maybe i could also develop a system for the end of the next weak, but as i see<br>you have experiences in the field with this wonderful "Beginning" work!<br><br>All the best,<br>Balázs<br></div></blockquote></div><br></div></body></html>