 clapping.avi |
 drumming.avi |
 flapping.avi |
 jumping.avi |
 marching.avi |
 waving.avi. |
 cymbals.avi |
 conducting.avi |
We have developed a real-time, view-based gesture recognition system. Optical flow is estimated and segmented into motion blobs. Gestures are recognized using a rule-based technique based on characteristics of the motion blobs such as relative motion and size. Parameters of the gesture (e.g., frequency) are then estimated using context specific techniques. The system has been applied to create an interactive environment for children.
Example gestures are shown below, with downloadable movies that show the optical flow estimation and segmentation, and two applications.
clapping.avi |
drumming.avi |
flapping.avi |
jumping.avi |
marching.avi |
waving.avi. |
cymbals.avi |
conducting.avi |
Ross Cutler and Matthew Turk. "View-based Interpretation of Real-time Optical Flow for Gesture Recognition," IEEE International Conference on Automatic Face and Gesture Recognition, April 1998, Nara, Japan. Abstract. PS. PDF.
Ross Cutler's home page
Last updated on June 16, 2000