Table 1 Evaluation framework
RE-AIM dimension | Current project definition | Time point measured |
|---|---|---|
Reach | The number, proportion and representativeness of (a) practitioners who participate in each tier of training; (b) practitioners who participate in supervision/mentoring; (c) practitioners who participate in a FASD practitioner network; (d) children who are assessed; (e) caregivers, families and other key stakeholders who receive support, advocacy or follow-up. | All items will be measured post implementation. |
Effectiveness | Practitioners: • knowledge regarding (a) risks of alcohol use during pregnancy; and (b) FASD. • practitioner level of confidence and proportion who: (a) routinely ask individuals of reproductive age and/or pregnant women and their support networks about alcohol use; (b) provide individuals of reproductive age and/or pregnant women and their support networks with information about alcohol use; or (c) routinely provide individuals of reproductive age with information about effective contraceptive use if not planning pregnancy • practitioner confidence and proportion who routinely ask parents/caregivers of children presenting with developmental concerns about prenatal alcohol exposure as a part of their developmental assessment • practitioner competence for each tier of the assessment process • participation in assessments or referral for assessments Children and families Qualitative information will be collected regarding: • awareness of FASD • knowledge of child development stages • ability to access neurodevelopmental services • satisfaction regarding the services accessed • changes in child/family functioning reported by caregivers following access to services in the community. | Practitioner items will be measured at multiple stages throughout implementation. Child and family items will be measured post implementation |
Adoption | The number, proportion and representativeness of settings that adopted the Yapatjarrathati Assessment Protocol | Measured post implementation |
Implementation | The extent to which assessments were delivered according to the prototype, and the extent to which training was delivered as intended; the time and cost involved for both training and assessment. The number of iterations required to finalise each prototype will be documented for (a) educational tools, (b) assessment process, and (c) training process as an indication of fidelity to user-centered design. Qualitative information will be collected regarding the facilitators and barriers to implementation (assessment and training) from multiple perspectives: caregivers and family members; other key stakeholders; government and non-government organisations (NGOs). | Process variables will be measured throughout implementation. |
Maintenance | At the setting level: the number, proportion and representativeness of organisations that incorporate tiered assessments into their ongoing usual care. At the individual level: the number, proportion and representativeness of practitioners that (a) continue to implement tiered assessments; (b) provide referrals for neurodevelopmental assessments training; engagement in practitioner network 6-months post-training At the community level: Awareness and ability to access Yapatjarrathati Project services | All items will be measured at 6 month follow up. |