Gesture recognition using a marionette model and Dynamic Bayesian Networks (DBNs)

Jörg Rett, Jorge Dias

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

18 Scopus citations

Abstract

This paper presents a framework for gesture recognition by modeling a system based on Dynamic Bayesian Networks (DBNs) from a Marionette point of view. To incorporate human qualities like anticipation and empathy inside the perception system of a social robot remains, so far an open issue. It is our goal to search for ways of implementation and test the feasibility. Towards this end we started the development of the guide robot 'Nicole' equipped with a monocular camera and an inertial sensor to observe its environment. The context of interaction is a person performing gestures and 'Nicole' reacting by means of audio output and motion. In this paper we present a solution to the gesture recognition task based on Dynamic Bayesian Network (DBN). We show that using a DBN is a human-like concept of recognizing gestures that encompass the quality of anticipation through the concept of prediction and update. A novel approach is used by incorporating a marionette model in the DBN as a trade-off between simple constant acceleration models and complex articulated models.

Original languageBritish English
Title of host publicationImage Analysis and Recognition - Third International Conference, ICIAR 2006, Proceedings
PublisherSpringer Verlag
Pages69-80
Number of pages12
ISBN (Print)3540448942, 9783540448945
DOIs
StatePublished - 2006
Event3rd International Conference on Image Analysis and Recognition, ICIAR 2006 - Povoa de Varzim, Portugal
Duration: 18 Sep 200620 Sep 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4142 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd International Conference on Image Analysis and Recognition, ICIAR 2006
Country/TerritoryPortugal
CityPovoa de Varzim
Period18/09/0620/09/06

Fingerprint

Dive into the research topics of 'Gesture recognition using a marionette model and Dynamic Bayesian Networks (DBNs)'. Together they form a unique fingerprint.

Cite this