Derivative-based imaging

We present a new biologically inspired imaging framework which uses sensor motion in a constructive way, contrary to most current imaging techniques. In addition to measuring light intensity, the spatial derivatives of the scene are estimated by measuring the temporal derivatives of the output of the vibrating photoreceptors. This is inspired from the fixational eye movements of the human visual system. When motion is known, these measured spatial derivatives can be used to improve the quality of the intensity image, as well as for object and pattern recognition tasks. This image reconstruction is based on integrating the derivatives while using the measured intensities as integration constants. The results of the imaging framework and of the reconstruction step are high quality images of the light intensities and of its spatial derivatives, which is relevant for further scene understanding. The advantages and the potential of this new imaging framework are shown in many simulations in this paper.