Real-time virtual fitting with body measurement and motion smoothing

•A real-time virtual garment fitting room using a depth sensor.•Adjust the size of the avatar using body measurements and determine a specific garment size.•Customized motion filters to eliminate artifacts due to noise from depth data and self-occlusions.•Bone splitting to obtain a realistic rendering of joints, such as elbows.

We present a novel virtual fitting room framework using a depth sensor, which provides a realistic fitting experience with customized motion filters, size adjustments and physical simulation. The proposed scaling method adjusts the avatar and determines a standardized apparel size according to the user׳s measurements, prepares the collision mesh and the physics simulation, with a total of 1 s preprocessing time. The real-time motion filters prevent unnatural artifacts due to the noise from depth sensor or self-occluded body parts. We apply bone splitting to realistically render the body parts near the joints. All components are integrated efficiently to keep the frame rate higher than previous works while not sacrificing realism.

Graphical abstractFigure optionsDownload full-size imageDownload high-quality image (193 K)Download as PowerPoint slide