Dealing with under-reported variables: An information theoretic solution

•Information theoretic testing, estimation and ranking in under-reported scenarios.•Valid tests with known power by incorporating prior knowledge.•Corrections for point/interval estimates of the mutual information.•Estimates that capture both relevance and redundancy.•Different ways for ranking under-reported.

Under-reporting occurs in survey data when there is a reason for participants to give a false negative response to a question, e.g. maternal smoking in epidemiological studies. Failing to correct this misreporting introduces biases and it may lead to misinformed decision making. Our work provides methods of correcting for this bias, by reinterpreting it as a missing data problem, and particularly learning from positive and unlabelled data. Focusing on information theoretic approaches we have three key contributions: (1) we provide a method to perform valid independence tests with known power by incorporating prior knowledge over misreporting; (2) we derive corrections for point/interval estimates of the mutual information that capture both relevance and redundancy; and finally, (3) we derive different ways for ranking under-reported risk factors. Furthermore, we show how to use our results in real-world problems and machine learning tasks.