Using implementation evaluation to uncover a child neglect prevention program

• We examined the fidelity of a program targeting child neglect.
• Implementation data was collected from 50 families over a two-year period.
• The results demonstrate uniformity for the program's adherence and quality.
• However, significant differences were found in dosage and family participation.

Child neglect is an ecosystemic problem with a great variety of risk factors to consider and, therefore, it requires a multimodal and individualized intervention. Although such an intervention is better for the families, it represents a great challenge for the evaluation process.ObjectivesThe purpose of this study is to document, using Dane and Schneider's model (1998), the differences between the services received by parents participating in a parental group designed to prevent the presence or the recurrence of child neglect.MethodsQuantitative program implementation data was collected from 50 families who took part in a four-module program over a two-year period.ResultsThe results demonstrate uniformity with regard to the program's central elements despite the differences in the services each family received. Adherence to the program was mainly respected despite slight variations in the number of sessions offered and in the group sizes. On the other hand, dosage varied greatly, with families attending from one to four offered modules. For each module, attendance varied from participation in one group session to participation in all ten group sessions. Moreover, for families who participated in at least two modules, attendance significantly increased between the first and second module. The families’ level of participation also differed, with families being rated from low to highly engaged at the end of each group session.ConclusionsInterventions must be adjusted to the specific needs of the clientele and to the characteristics of the environment in which they will be implemented. These variations could have important impacts on the effects of the intervention on the families. Therefore, evaluating these programs requires the consideration of these variations and of their repercussions on the program's effects.