Testing and estimation of purely nonparametric effects in repeated measures designs

The several sample case of the so-called nonparametric Behrens–Fisher problem in repeated measures designs is considered. That is, even under the null hypothesis, the marginal distribution functions in the different groups may have different shapes, and are not assumed to be equal. Moreover, the continuity of the marginal distribution functions is not required so that data with ties and, particularly, ordered categorical data are covered by this model. A multiple relative treatment effect is defined which can be estimated by using the mid-ranks of the observations within pairwise samples. The asymptotic distribution of this estimator is derived, along with a consistent estimator of its asymptotic covariance matrix. In addition, a multiple contrast test and related simultaneous confidence intervals for the relative marginal effects are derived and compared to rank-based Wald-type and ANOVA-type statistics. Simulations show that the ANOVA-type statistic and the multiple contrast test appear to maintain the pre-assigned level of the test quite accurately (even for rather small sample sizes) while the Wald-type statistic leads, as expected, to somewhat liberal decisions. Regarding the power, none of the statistics is uniformly superior. A real data set illustrates the application.