Integral imaging display for natural scene based on KinectFusion

In this paper, we propose an integral imaging display system based on KinectFusion, using only a moving low-cost depth camera as the pickup device. The multi-frame depth data of the observed scene streamed from a Kinect sensor is fused into a single global surface model represented by the volumetric truncated signed distance function. Thus, the inherent noise associated with single frame depth data can be eliminated. The elemental image array for display is obtained by ray casting the volumetric truncated signed distance function. To match the pickup part and the display part, the relationship between the pickup voxel and the display voxel is deduced using the ray optics theory. Experimental results show the validity of the proposed method.