Beyond the 2 × 2 -contingency table: A primer on entropies and mutual information in various scenarios involving m diagnostic categories and n categories of diagnostic tests

Information theoretical concepts are particularly useful for diagnostic problems requiring more than the usual binary classification. Quantitative test results can be properly analyzed, and in contrast to popular concepts such as ROC analysis, the effects of variations of pre-test probabilities of the diagnostic categories can be explicitly taken into account.