Recovering variations in facial albedo from low resolution images

Recovering facial albedo from low quality face images is a challenging task which arises when face recognition is attempted in the wild. Low quality of facial images is usually caused by extrinsic factors such as low resolution and noises, and intrinsic ones such as expressions. Existing research recovers facial albedo by dealing with the extrinsic and intrinsic factors separately. However, it is more natural and potentially more useful to approach albedo recovery by removing the two effects simultaneously. In this paper, we present a novel framework which can recover facial albedo by jointly solving these for both the extrinsic and intrinsic sources of uncertainty. This framework models albedo recovery problem by a joint optimization process which alternatively (1) removes intra-personal variations and (2) performs super resolution. To deal with the intrinsic sources of albedo variability, we use a linear model. To handle extrinsic problems associated with low quality imaging, we use a sparse coding method which is applied to super resolution. The proposed method can also significantly improve the performance of face recognition and clustering in case of very low resolution and in the presence of various facial variations. Extensive experiments and comparisons are conducted on the AR and FERET face databases. Experimental results show the effectiveness of the proposed method.