Visual based human motion analysis: Mapping gestures using a puppet model

Jörg Rett, Jorge Dias

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

This paper presents a novel approach to analyze the appearance of human motions with a simple model i.e. mapping the motions using a virtual marionette model. The approach is based on a robot using a monocular camera to recognize the person interacting with the robot and start tracking its head and hands. We reconstruct 3-D trajectories from 2-D image space (IS) by calibrating and fusing the camera images with data from an inertial sensor, applying general anthropometric data and restricting the motions to lie on a plane. Through a virtual marionette model we map 3-D trajectories to a feature vector in the marionette control space (MCS). This implies inversely that now a certain set of 3-D motions can be performed by the (virtual) marionette system. A subset of these motions are considered to convey information (i.e. gestures). Thus, we are aiming to build up a database which keeps the vocabulary of gestures represented as signals in the MCS. The main contribution of this work is the computational model of the IS-MCS-Mapping. We introduce the guide robot "Nicole" to place our system in an embodied context. We sketch two novel approaches to represent human motion (i.e. Marionette Space and Labananalysis). We define a gesture vocabulary organized in three sets (i.e. Cohens Gesture Lexicon, Pointing Gestures and Other Gestures).

Original languageBritish English
Title of host publicationProgress in Artificial Intelligence - 12th Portuguese Conference on Artificial Intelligence, EPIA 2005, Proceedings
Pages398-409
Number of pages12
DOIs
StatePublished - 2005
Event12th Portuguese Conference on Artificial Intelligence, EPIA 2005 - Progress in Artificial Intelligence - Covilha, Portugal
Duration: 5 Dec 20058 Dec 2005

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume3808 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference12th Portuguese Conference on Artificial Intelligence, EPIA 2005 - Progress in Artificial Intelligence
Country/TerritoryPortugal
CityCovilha
Period5/12/058/12/05

Fingerprint

Dive into the research topics of 'Visual based human motion analysis: Mapping gestures using a puppet model'. Together they form a unique fingerprint.

Cite this