Relative pose estimation of satellites using PMD-/CCD-sensor data fusion

Rendezvous & Docking to passive objects, as of relevance for space debris removal, raises new challenges with respect to relative navigation. Whenever the position and orientation (pose) of an object is required in terrestrial and in space applications, sensor systems such as laser scanners and stereo vision systems are often employed. This paper presents an approach to pose estimation using a 3D time-of-flight camera for ranging information in combination with a high resolution grayscale camera. We have designed a pose estimation method that fuses the data streams of the two sensors in order to benefit from each sensors׳ advantages. A rigorous test campaign on a Real-Time Hardware-In-The-Loop Rendezvous and Docking Simulator - the European Proximity Operations Simulator (EPOS) - was performed in order to evaluate the performance of the resulting algorithm. The proposed pose estimation method does not exceed an average distance error of 3 cm while being capable of providing pose estimates at up to 60 FPS on recent hardware. Thus, when regarding proximity operations, an attractive sensor system is used to characterize the dynamics of the target object for safe approach results.