A talk about my undergraduate individual project which I gave at BarCampNorthEast 2007, several months before completing my project. It gives an overview of a hand gesture recognition system, detailing how interesting points on a hand are found and tracked.

1. Hand Gesture
Recognition
Emma Persky
storyteller, geek, believer, etc

2. Why Recognise
Gestures?

3. New Models of
Interaction

4. Accessibility!

5. Parameters of
Recognition

7. How Does it Work?
• Find the Hand (not my problem!)
• Find Interesting Regions on Hand
• Track Interesting Points
• Compare Hand Path / Relative Position

8. Interesting Points
• Edge Detection
• Corner Detection
• Regions of High Gradient of Change
• Brightness / Colour Histogram

9. Tracking Points
• Iterative Lucas - Kanade Method
• Pyramid Feature
• Outputs New Points and Probabilities

10. Tracking the Hand
• ‘Flock’ of points
• Cull outliers
• Median (x and y) of Points is Centre of
Hand

11. Recognising Gestures
• Relative Position of Hands from ‘Start’
• Trace Path of Hand Centre

12. Applications
• TV Control
• Ubiquitous Systems Control
• Games (Johnny Lee Eat Your Heart
Out)!

13. Demo!