On-line incremental 3D human body reconstruction for HMI or AR applications

L. Almeida, F. Vasconcelos, J. P. Barreto, P. Menezes, J. Dias

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

This research proposes an on-line incremental 3D reconstruction framework that can be used on human machine interaction (HMI) or augmented reality (AR) applications. There is a wide variety of research opportunities including high performance imaging, multi-view video, virtual view synthesis, etc. One fundamental challenge in geometry reconstruction from traditional cameras array is the lack of accuracy in low-texture or repeated pattern region. Our approach explores virtual view synthesis through motion body estimation and hybrid sensors composed by video cameras and a depth camera based on structured-light or time-of-flight. We present a full 3D body reconstruction system that combines visual features and shape-based alignment. The proposed mesh generation algorithm is based on Crust and efficiently adds new vertices to an already existing surface. Modeling is based on meshes computed from dense depth maps in order lower the data to be processed and create a 3D mesh representation that is independent of view-point.

Original languageBritish English
Title of host publicationField Robotics - Proceedings of the 14th International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines, CLAWAR 2011
Pages355-362
Number of pages8
StatePublished - 2012
Event14th International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines, CLAWAR 2011 - Paris, France
Duration: 6 Sep 20118 Sep 2011

Publication series

NameField Robotics - Proceedings of the 14th International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines, CLAWAR 2011

Conference

Conference14th International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines, CLAWAR 2011
Country/TerritoryFrance
CityParis
Period6/09/118/09/11

Keywords

  • 3D reconstruction
  • Augmented reality
  • Tele-presence
  • Virtual view synthesis

Fingerprint

Dive into the research topics of 'On-line incremental 3D human body reconstruction for HMI or AR applications'. Together they form a unique fingerprint.

Cite this