SkeletonFusion: Reconstruction and tracking of human body in real-time

This paper presents a new pipeline for capturing the performance of the human body with two depth cameras in real time. Our online approach reconstructs not only the movement of the skeleton, but also the dense nonrigid 3D surface. The key to our algorithm is a coarse-to-fine strategy: large-scale deformations or rapid movements are captured by the skeleton pose tracker, with which the dense volumetric 6D motion field can be estimated robustly for dense geometry reconstruction. Shown in various sequences, our approach was able to accurately capture the 3D motion of the human body and produce increasingly denoised, detailed, and complete geometric reconstructions.