On-line 3D body modelling for augmented reality

Luis Almeida, Paulo Menezes, Jorge Dias

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Building 3D body models is an important task for virtual and augmented reality applications in telerehabilitation, education, 3DTV, entertainment and tele-presence. We propose a real-time full 3D reconstruction system that combines visual features and shape-based alignment using low cost depth sensor and video cameras targeting three-dimensional conferencing applications. With this approach we overcome the classic video based reconstruction problem in low-texture or repeated pattern regions. Alignment between successive frames is computed by jointly optimizing over both appearances and shape matching. Appearance-based alignment is done over 2D SURF features annotated with 3D position. Shape-based alignment is performed using the motion transformation estimation between consecutive annotated 3D point clouds through a linear method. A solution to avoid wrong annotated 3D matched points is proposed. 3D mesh model representation is used to lower the processed data and create a 3D representation that is independent of view-point.

Original languageBritish English
Title of host publicationGRAPP 2012 IVAPP 2012 - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications
Pages472-479
Number of pages8
StatePublished - 2012
EventInternational Conference on Computer Graphics Theory and Applications, GRAPP 2012 and International Conference on Information Visualization Theory and Applications, IVAPP 2012 - Rome, Italy
Duration: 24 Feb 201226 Feb 2012

Publication series

NameGRAPP 2012 IVAPP 2012 - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications

Conference

ConferenceInternational Conference on Computer Graphics Theory and Applications, GRAPP 2012 and International Conference on Information Visualization Theory and Applications, IVAPP 2012
Country/TerritoryItaly
CityRome
Period24/02/1226/02/12

Keywords

  • 3D reconstruction
  • Augmented reality
  • Tele-presence
  • Virtual view synthesis

Fingerprint

Dive into the research topics of 'On-line 3D body modelling for augmented reality'. Together they form a unique fingerprint.

Cite this