The often overlooked issue of statistical power: This and other issues regarding assessing importance weighting in quality of life measures

In the area of quality of life research, researchers may ask respondents to rate importance as well as satisfaction of various life domains (such as job and health) and use importance ratings as weights to calculate overall, or global, life satisfaction. The practice of giving more important domains more weight, known as importance weighting, has not been without controversy. Several previous studies assessed importance weighting using the analytical approach of moderated regression. This study discusses major issues related to how importance weighting has been assessed. Specifically, this study highlights that studies on importance weighting without considering statistical power are prone to type II error, i.e., failing to reject the null hypothesis of no significant weighting effect when the null hypothesis is actually false. The sample size required for adequate statistical power to detect importance weighting functions appeared larger than most previous studies could offer.