Using a Wii Remote for Finger Tracking and Gesture Recognition: Improving Human Computer Interaction

There has been much recent innovations in the field of HCI in the last decade, with touch- based devices as well as other forms of interactionfirst introduced by the Nintendo Wii. This book looks at another form of HCI as an alternative - using yourfingers to directly manipulate objects on screen. The Wii remote is the key device that, when used with a source of infra red light, enables finger tracking and allows this form of interaction. The project examines experimental set-ups and methods as well as outlines possible methods for gesture recognition using this tracking approach. In this book I describe how a HCI system can be implemented using the Wii remote that allows manipulation of objects on screen through simple dynamic gestures and how it can be extended for symbolic ges- ture recognition using higher level modelling. The proposed and implemented gesture recognition engine uses modelling of dynamics for manipulation gestures and is based on a finite state machine framework for symbolic gestures.