An effective and objective criterion for evaluating the performance of denoising filters

Denoising filters are useful for reducing noise; however, they often blur and smear the edges and boundaries, which are necessary for segmenting or locating the objects. In order to overcome above problem, many filters with contrast enhancement capability have been developed, and they have wide applications in related fields. Recently, researchers found that the traditional criteria, such as mean squared error (MSE), signal-to-noise ratio (SNR), are not suitable for evaluating such filters.Due to lack of effective metrics for such tasks, visual inspection by human and some newly proposed image quality assessment (QA) criteria, such as structural similarity (SSIM) index are utilized. However, visual inspection depends on the subjectivity of observers heavily.This paper has proved that evaluating denoising filters is different from image quality assessment, i.e., existing image quality assessment criteria cannot effectively evaluate the performance of denoising filters, especially, of the filters having contrast enhancement capability; and new criteria should be established. Further, it proposes a novel objective and effective assessment criterion, homogeneity mean difference (HMD), to evaluate the performance of the filters since it can describe the textual and structural information and/or the changes in textual and structural information well. We have employed 503 images from three databases to demonstrate the superiority of the proposed metric over the existing ones, and to prove that HMD is an effective and useful metric for assessing denoising filters with/without contrast enhancement, which may find wide applications in image processing and computer vision.

► Proved that the QA metrics and other existing metrics cannot be utilized for evaluating the performance of denoising filters.
► An objective criterion, homogeneity mean difference (HMD), is proposed.
► HMD can assess the performance of the denoising filters effectively.
► The HMD is sensitive to noise and insensitive to contrast enhancement.
► We compared HMD with different kinds of metrics to demonstrate its superiority.