[sldev] Anyone here with OpenCV experience?

[Melinda Green]

Philip Rosedale wrote:
> Good conversation, overall confirms the direction we've been thinking.  
> OK, so I put up a new page in the wiki which is a project page for the 
> specific work we're thinking of doing next: 
>
> https://wiki.secondlife.com/wiki/Gesture_Recognition
>
> We have an intern starting at beginning of June who will work on this 
> project.  It would be fabulous if someone here wants to do a patch for 
> Snowglobe that does the viewer side of this (see doc), which is to 
> listen for local network packets and trigger gestures and set lookAt 
> based on the contents of those packets.  That would allow us to have the 
> intern focus totally on the recognition/analysis app, and would also 
> allow folks in the community who want to play with other hardware or 
> analysis algorithms to do so.
>
> Summary:  hopefully this summer we can update Snowglobe to make your 
> avatar nod, shake its head, and look around in response to what a 
> commodity webcam can see.   

OK, this is very helpful information. It clears up the confusion around 
whether you were looking to trigger high-level gestures (or other 
action) versus translating user motion into avatar movements. It turns 
out that you want to do both. :-) That raises some interesting questions 
about how these two input streams will interact with each other, but the 
viewer already contains a rich avatar animation layering mechanism so it 
should be straightforward to find a good priority for the animation 
part. The look-at system has a similar priority system and a suitable 
priority will need to be chosen for this part as well. And of course 
we'll need two new saved settings so that a user can enable/disable each 
part independently.

In order to get my head around the project I created the attached 
diagram showing the design space in which we're working. I think it will 
be important in these discussions to always be clear which data paths 
we're talking about at any particular time.

-Melinda
-------------- next part --------------
A non-text attachment was scrubbed...
Name: gestures.png
Type: image/png
Size: 6230 bytes
Desc: not available
Url : http://lists.secondlife.com/pipermail/sldev/attachments/20090522/31be215a/attachment.png