Using the Medical Research Council framework for development and evaluation of complex interventions in a low resource setting to develop a theory-based treatment support intervention delivered via SMS text message to improve blood pressure control

Abstract

Background

Several frameworks now exist to guide intervention development but there remains only limited evidence of their application to health interventions based around use of mobile phones or devices, particularly in a low-resource setting. We aimed to describe our experience of using the Medical Research Council (MRC) Framework on complex interventions to develop and evaluate an adherence support intervention for high blood pressure delivered by SMS text message. We further aimed to describe the developed intervention in line with reporting guidelines for a structured and systematic description.

Methods

We used a non-sequential and flexible approach guided by the 2008 MRC Framework for the development and evaluation of complex interventions.

Results

We reviewed published literature and established a multi-disciplinary expert group to guide the development process. We selected health psychology theory and behaviour change techniques that have been shown to be important in adherence and persistence with chronic medications. Semi-structured interviews and focus groups with various stakeholders identified ways in which treatment adherence could be supported and also identified key features of well-regarded messages: polite tone, credible information, contextualised, and endorsed by identifiable member of primary care facility staff. Direct and indirect user testing enabled us to refine the intervention including refining use of language and testing of interactive components.

Conclusions

Our experience shows that using a formal intervention development process is feasible in a low-resource multi-lingual setting. The process enabled us to pre-test assumptions about the intervention and the evaluation process, allowing the improvement of both. Describing how a multi-component intervention was developed including standardised descriptions of content aimed to support behaviour change will enable comparison with other similar interventions and support development of new interventions. Even in low-resource settings, funders and policy-makers should provide researchers with time and resources for intervention development work and encourage evaluation of the entire design and testing process.

Trial registration

The trial of the intervention is registered with South African National Clinical Trials Register number (SANCTR DOH-27-1212-386; 28/12/2012); Pan Africa Trial Register (PACTR201411000724141; 14/12/2013); ClinicalTrials.gov (NCT02019823; 24/12/2013).

Background

Raised blood pressure is an important and common modifiable risk factor for cardiovascular and related diseases including stroke and chronic kidney disease [1]. Although evidence exists that lowering blood pressure substantially reduces this risk, strategies to achieve sustained blood pressure control are complex. These include modifying a range of behaviours related to health including attending clinic appointments, taking medication regularly and persisting with treatment [2,3,4,5].

Mobile communications technology has the potential to support behaviour change and treatment adherence in real time by facilitating remote, interactive, timely access to relevant information, providing context-specific support and prompts to action [6].

Systematic reviews of health behaviour change interventions delivered by mobile phones or devices (m-health) have shown small beneficial effects for some conditions in some settings but results are not consistent [7, 8]. Some though not all trials have shown modest effects on treatment adherence and disease outcomes for m-health interventions among adults living with HIV [9, 10]. Similar results have been found in trials of m-health interventions to support behaviour change for people with high blood pressure, diabetes, and heart disease [11, 12].

Behavioural interventions, including those delivered using m-health technologies are often not systematically developed, specified, or reported [13]. The potential to accumulate evidence of effectiveness and to identify the “active components” in successful m-health interventions depends in part on replication of successful interventions across settings and in part on refining interventions (adding or subtracting elements) using evidence of behaviour change [14]. Adequate descriptions of the theory of the intervention and specific intervention components are needed to extend the evidence base in the field and to facilitate evidence synthesis [15].

Several frameworks are now available to guide intervention development but there is limited evidence of their application to describe the development of m-health interventions particularly in resource constrained settings [16, 17]. The Medical Research Council (MRC) Framework for the development of complex interventions (initially published in 2000 and up-dated in 2008) has been used successfully across disciplines which suggest its flexible, non-linear approach may be usefully applied to the iterative design processes used in the development of new technology-based systems [15, 18,19,20].

The aim of this paper is to describe our experience of using the 2008 MRC framework to develop and test a theory-based behaviour change intervention to support adherence to high blood pressure treatment delivered by mobile phone text message; to reflect on the benefits and challenges of applying this framework in a resource constrained setting, and to describe the final intervention in line with reporting guidelines for a structured and systematic description [13].

Methods

We used a non-sequential, flexible approach guided by the 2008 MRC Framework for the development and evaluation of complex interventions (see Fig. 1) [18]. Table 1 shows the stages of the 2008 MRC framework alongside with the activities we undertook in the development process. Implicit in this development process is the identification of contextual factors that can affect outcomes [21].

Fig. 1

Process of intervention development adapted from Smith et al. [20]

Table 1 Mapping activities to MRC framework

Results

Developing a complex intervention

Identifying the evidence base

We searched PubMed, Cochrane reviews, and Google for systematic reviews and published original studies from 2000 onwards that were written in English. We used search terms including “mobile health, text-message, adherence, high blood pressure, hypertension and adherence”. We revisited the literature and narrowed the focus of our reviews as development of the intervention progressed. We set up automatic alerts to monitor the relevant literature for updates.

There is some evidence that clinical outcomes for treatment of chronic conditions can be modestly improved through targeting adherence behaviour [4, 22], with a number of trials in hypertension [5, 23,24,25]. The most effective strategies for improving adherence were complex including combinations of more instructions and health education for patients, disease and treatment-specific adherence counselling, automated and in-person telephone follow-up, and reminders (for pills, appointments, and prescription refills) [22]. In addition some strategies can be costly, for example with case management and pharmacy-based education. These approaches may not be practical in a low-resource setting.

Some studies report that mobile phone messaging interventions may provide benefit in supporting the self-management of long-term illnesses [7, 26], and have the potential to support lifestyle change, including smoking cessation [7, 27]. However randomised trials of the effectiveness of mobile phone messaging in the management of hypertension are few, include additional components (telemonitoring), often focus on high-risk groups such as stroke survivors and renal transplant recipients, and are based in high-resource settings [23, 28,29,30,31].

Identifying appropriate theory

We set up an expert multi-disciplinary group comprising two specialist general practitioners, two specialist physicians, three biomedical engineers, a health systems researcher, and an epidemiologist. As a team we met formally to agree upon the research problem and the underlying principles guiding the intervention development process. Thereafter we worked in smaller groups to develop the intervention. We maintained written logs of the iterative steps of the intervention development and remained in regular contact with the full group via email and teleconference. When the group met formally we reported on technical progress, resource allocation, implementation issues, and new evidence from the literature or the field.

We used semi-structured interviews and focus groups with three stakeholder groups: (1) Patients with high blood pressure and other chronic diseases (n = 35), (2) primary care health professionals (general practitioners, professional nurses, staff nurses, pharmacists, allied health professionals, reception staff) (n = 12), (3) health care system service providers and subcontractors (provincial health systems managers (n = 5), third party providers of off-site pre-packaged repeat prescription services (n = 3)).

South Africa is a middle-income country with high levels of income inequality and a quadruple burden of disease (HIV/AIDS, maternal and child, non-communicable diseases, violence.) [32, 33] Health care is provided for most South Africans (over 80%) by publicly funded state run facilities the foundation of which are primary care facilities. Medical doctors and nurses (some who have the right to prescribe medications) staff facilities and provide diagnostic, and monitoring services; treatment including all medications is free for patients attending primary care (user fees for primary care were abolished in 1997.) [34] National guidelines for the treatment of high blood pressure exist and are regularly updated [35].There is an essential drugs list and medicines for high blood pressure available in primary care include thiazide and other diuretics, calcium channel blockers, ace-inhibitors, and beta-blockers. Patients maybe prescribed other anti-hypertensive agents like ARBs by specialists. Statins and Aspirin are also available [36].

With the stakeholders described above we explored the problem of high blood pressure and poor control in busy and resource constrained publically-funded primary care facilities. A range of problems were identified that were seen as barriers to providing optimal care and potential targets for intervention. These included organisation of care (failure of systems for referral between primary and secondary care and medication access), service provision (failure of clinicians to adhere to management guidelines), and patient-level factors such as sub-optimal self-management and treatment adherence. From discussion with the various stakeholder groups it emerged that patient-level factors resulting in failure to attend clinic appointments and collect and take medication regularly was both a major concern and a feasible and acceptable potential target for developing an intervention to improve blood pressure control. The underlying hypothesis was that facilitating communication between patients and the health care system might lead to changes in treatment adherence behaviour and improve health outcomes.

Use of mobile devices for intervention delivery

We framed the use of mobile phones as contextual tools that could deliver support messages when and where needed i.e. at times and places outside of a health care visit (ecological momentary intervention) [6]. We focused on using widely available existing communication protocols (for example short message service or SMS text messages) that are back-compatible (even the most basic device can send and receive text messages), and adapting participants’ existing technical skills to health specific behaviours rather than focusing on acquisition of new technical skills (for example by giving participants smart phones and asking them to use an app-based intervention).

Behaviour change theory

We explored a range of social cognition models and selected the I-CHANGE model that integrated multiple different elements (awareness, motivation, and action) which have been shown to be important in adherence and persistence with chronic medications [22, 37].

Behaviour change techniques

We used behaviour change theory to identify areas of belief or behaviour that might contribute to problems in collecting or taking medication. We then developed and refined the message content and mapped the messages to a common taxonomy of evidence-based behaviour change techniques [38].

Modelling (phase I)

We tested assumptions about the clarity, perceived usefulness and importance of individual text messages with stakeholder groups. To decide on the most appropriate tone and style of content delivery we tested individual SMS text messages using three different communication styles (directive, narrative vignette, or request). Stakeholders were asked when and how frequently adherence support messages should be sent. Messages that were unclear or ambiguous were modified; messages that were perceived by both patients and providers as not being useful or important were discarded. Patients’ thoughts and comments were also used to generate new content for new messages which were then again mapped to the taxonomy of behaviour change techniques and added to the message library. In addition, we engaged with the two local Community Advisory Boards (made up of community members and clinic patients who act as elected liaisons between the health facility and the community) who provided additional guidance and feedback on the intervention components and other study materials.

Using evidence from the literature alongside the findings from the semi-structured interviews of clinic and pharmacy staff at four representative primary care facilities in Cape Town the group agreed that in order to change adherence-related behaviours the intervention would need to,

• Remind patients about up-coming scheduled clinic appointments

• Provide relevant health-related information

• Help participants plan and organise various treatment adherence behaviours including medication collection and taking, diet, and exercise

• Support positive adherence-related behaviours

• Help navigate the health care system (e.g. what to do if the patient ran out of medications)

Table 2 gives examples of the SMS texts that were developed, mapped to the taxonomy of behaviour change techniques (along with definitions and message timing) [38].

Table 2 Behaviour change techniques used in the SMS text-messaging intervention

Patients and providers reported their thought that all people with high blood pressure could benefit from an intervention. Stakeholder groups reported disliking the idea of trying to target the intervention to particular patient groups, for example those with poor blood pressure control or those who only attend the clinic infrequently. Providers and health system managers cited concerns over the logistics of identifying such groups while patients reported concerns over perceptions of favouritism unrelated to illness severity. Patient groups expressed the opinion that “everyone with high blood pressure” should be offered the intervention and that people who didn’t want the intervention should be allowed to opt out.

Health care providers, particularly front-line staff preferred individual texts presented in a directive-style, for example, “You must take your medicine even if you feel well”. Reasons for this included the need to convey to patients the importance of the information being presented. In contrast all of the patient groups strongly preferred messages that were styled as polite requests, for example, “Please keep taking all your medicine even if you feel well”. Both groups were ambivalent about the use of narrative vignettes (for example “Busi in Langa: I bring my empties to clinic, then they can see I eat my pills right”.) Contextual aspects of the messages were also important (information specific to the clinic) as was the perceived authority of the message – messages signed off by a named provider were valued more highly by participants who felt they would be more likely to respond to such a message. Participants also reported that this was more important than using their name at the start of a message. Providers reported that it would be acceptable for senior staff at the facility to be named (i.e. sign off) in an SMS text as long as the messages were in line with Department of Health guidelines.

Individual SMS text messages are typically limited to 160 characters including spaces. We found that using short simple words was more acceptable to stakeholders than “textese” (a form of text-based slang using non-standard spelling and grammar). We minimised the use of contractions, using only “pls” for “please” and “thnks” for “thank you” and an abbreviation for the clinic name. All stakeholders groups reported on the value of having messages available in a variety of local languages though they did acknowledge that most people text in English (in part because of ambiguities in meaning that can arise from informal word shortening).

Participants reported that they valued the idea of being able to choose the time at which a message was sent so that it would not interfere with other commitments e.g. work or religious-activities. All stakeholders reported valuing the idea of a follow-up text message in the event a participant missed a scheduled appointment. On the basis of these discussions we decided to send follow-up messages to all participants thanking those who had attended on time and encouraging those who had not attended to please rebook their appointment. However, concerns were raised by providers and participants about the appropriate length of time between reminder messages and appointment dates so that people could make changes to their schedule or get in touch with the clinic to change their appointment. As a result, the messages were sent 48 h before and after a scheduled appointment.

Concerns about the potential costs of the intervention to the user were raised by all stakeholder groups. Specific concerns were raised about how to deliver an interactive intervention at little or no cost to the end-user. Solutions which have been used in other settings such as providing small amounts of credit to end-users to engage with an interactive system were rejected by health systems managers and sub-contractors due to concerns that the intervention would be too costly to deliver sustainably at scale. As a result of the telecommunications market in South Africa at the time it was not possible to use free-to-user short codes for interactive SMS text messagss.

Final interventions

The final interventions consisted of an adherence support intervention delivered by a weekly information-only (unidirectional) or interactive (bidirectional) SMS text message delivered at a time and in a language of the user’s choice. Messages were endorsed (signed off by a named provider) and contained content that was credible to both providers and patients and addressed a broad range of barriers to treatment adherence common in the local context. Reminder prompt text messages were sent 48 h before a scheduled clinic appointment (for a follow-up visit or to collect medication) with a follow-up message 48 h later either to thank participants for attending their appointment or to encourage them to rebook in the event of a missed appointment. To enable the system to be interactive we developed a system using free-to-user “Please Call Me” (or Call Me Back Code which is a service available on all local networks which allows a user to prompt someone else to call them) or missed-calls that enabled users to generate automated responses that allowed them to cancel or change their appointment, and change the time and language of the SMS text-messages.

By designing an intervention that was perceived in user-testing to be sent suitably frequently to keep users engaged (but not annoy them), contained content that was useful and could be trusted, and was phrased using polite and respectful language we felt the intervention would increase awareness and support motivation and actions to improve adherence to treatment for high blood pressure.

Modelling process and outcomes

We used a causal model to link theoretically relevant behavioural determinants to specific adherence related behaviours. We linked these to health impacts and outcomes along a hypothesised casual pathway [7, 8]. We used validated measures to assess important variables along the causal pathway. (See Fig. 2).

Fig. 2

Hypothesised causal pathways and measures for evaluation for SMS text Adherence suppoRt (StAR) trial

Assessing feasibility and piloting methods

Availability and use of mobile phones among adults with chronic diseases attending primary care services in South Africa

To test assumptions about access to and use of mobile phones we conducted a cross-sectional survey among adult patients attending any one of five community health centres in the Western Cape Metro Health Districts for treatment of hypertension and other chronic diseases. These outpatient facilities provide comprehensive primary care services for people living in the surrounding areas.

At primary health care level, the service is based on prevention by educating people about the benefits of a healthy lifestyle. Every clinic has a staff member who has the skills to diagnose and manage chronic conditions, from young to elderly patients. Patients can see the same nurse for repeat visits if they come regularly on the hypertension, diabetes or asthma clinic day. Counselling, compliance, and health education are also part of usual care. The service is led by clinical nurse practitioners and supported by doctors.

Arrangements are made by the clinic to minimise patient travel (especially by the elderly) by prescribing supplies of drugs that last one to 3 months. Staff often facilitate the initiation of clubs and special support groups for people with chronic diseases. In this way, a patient can get more information on special care and health education pertaining to their condition.

These primary-level services are supported and strengthened by other levels of care, including acute and specialised referral hospitals. If complications arise, patients will be referred to the next level of care [39, 40].

The interviewer-administered questionnaire asked about socio-demographic factors, contact with the clinic, chronic diseases and treatment burdens and about access to and the use of mobile phones. We sampled consecutive consenting adults from outpatient services over a period of 6 weeks. A total of 127 willing and eligible adult patients completed the survey (see Table 3). Mean age (SD) was 53.3 (14) years, 73% were women, and two-thirds had at least some high-school education. Ninety percent of participants reported having regular (daily) access to a mobile phone and 80% reported that their phone was with them most or all of the time. Most participants did not share their phones (76%); women reported sharing more frequently than men (24% versus 13%). Most participants (76%) reported having registered their phone numbers in their name and that they had had the same mobile phone number for two or more years (63%).

Table 3 Selected characteristics of participants in the access to and use of mobile phones survey

70% of participants reported feeling very confident about using their phone to receive an SMS text messages, while fewer participants (55%) were as confident about sending SMS text messages. Most (70%) felt very confident about sending a “Please Call Me” a free service provided by South African telecommunications providers across all local networks. Fewer than 10% of participants reported knowing how to use unstructured supplementary service data (USSD) communication protocol services like mobile-phone banking.

When asked about preferred ways for the clinic to be in touch, more women (74%) than men (47%) preferred SMS text messages to phone calls or other methods like home visits. The majority of participants reported that they would find reminders to attend up-coming clinic appoints (92%), collect medications (94%), and take medications (87%) helpful.

Testing procedures

To optimise the intervention and test the technical systems responsible for message delivery we service tested the full intervention package with 19 patients recruited from patient-stakeholder focus groups. We tested the messages in the three languages most commonly used in Cape Town (English, Afrikaans, isiXhosa). Participants were contacted on a weekly basis by a researcher (experienced in qualitative methods) for a semi-structured interview on their experience of the intervention and the SMS text message delivery system. Suggestions were discussed with the intervention development team and changes were made where necessary.

Estimating recruitment and retention

In consultation with the local department of health we identified primary care health centres with high patient loads which might be suitable for a clinical trial to test the intervention. We visited each site to confirm the numbers of patients with high blood pressure using clinic registers, to map out patient flow through the clinic so we could operationalise trial procedures and identify potential challenges and barriers to implementation. One of the requirements for approval from the local department of health for research in public facilities is that normal activities are not interrupted. We therefore selected a health centre with a high caseload of patients with “chronic diseases of lifestyle” where we could recruit, screen, and enrol trial participants without interrupting the usual flow of patients through the clinic services.

We estimated we would be able to screen and recruit between 45 and 120 participants per week based on the functioning of the clinic and the experience of other local researchers [41]. We tested our capacity to recruit and screen participants using a clinical service offering blood pressure measurement to all patients attending the clinical service prior to the start of the trial. We tested trial registration and enrolment procedures including the receipt of an initial SMS text message at the time of enrolment. We collected detailed contact information on participants as well as the details of two next of kin (or similar) to maximise our chances of remaining in contact with participants for the duration of the trial. We monitored recruitment and retention on an ongoing basis.

Determining sample size

Adequately powered trials of the effects of m-health interventions on important clinical outcomes are required to develop the evidence base for these approaches [7, 8]. As blood pressure is strongly and directly related to mortality we selected change in mean systolic blood pressure at 12-months from baseline as our primary outcome (clinical). We selected medication adherence (behavioural) as a secondary outcome. We decided not to report these as co-primary outcomes. As there were no previous trials of the effect of adherence support delivered by SMS text on blood pressure measures we used data from published trials of behavioural interventions delivered using other methods to estimate sample size [42]. A decrease in systolic blood pressure of 5 mmHg is associated with clinically important reduction in the relative risk of stroke and coronary heart disease events [43]. Based on a study population similar to that expected for the trial population we used the standard deviation (SD) of systolic blood pressure (22.0 mmHg) to calculate the required sample size [44]. We proposed an intended target sample size of 1215 participants, allowing for 20% loss to follow-up, (at least 405 in each group) to detect an absolute mean difference in SBP of 5 mmHg (SD 22) at 12 months from baseline, with 90% power and 0.05 (two-sided) level of significance. We used an intention to treat (ITT) approach for all analyses.

Evaluating a complex intervention

Assessing effectiveness

We decided that the most appropriate design to evaluate the effectiveness of adherence support via SMS text message would be a large single blind (concealed outcome assessment), individually randomised controlled trial. As the effect on clinical outcomes of an informational versus interactive system of SMS text messages was unclear from the published literature we decided to include two interventions; information-only SMS texts, and interactive SMS texts [8, 45]. To try to assess the effects of the behavioural intervention beyond receipt of an SMS text message from the clinic, we decided the control group would receive simple, infrequent text messages (less than one per month) related to the importance of ongoing trial participation [46]. Details of the intervention can be found in the TIDieR checklist (Table 4).

Table 4 Structured checklist systematically detailing intervention

The trial is registered with the South African National Clinical Trials Register number (SANCTR DOH-27-1212-386; 28/12/2012); Pan Africa Trial Register (PACTR201411000724141; 14/12/2013); ClinicalTrials.gov (NCT02019823; 24/12/2013).

Understanding change processes

Implementation. Fidelity assessment

SMS text messages were sent using an automated system independent of trial and clinical staff. Participants were informed that not everyone would be receiving the exact same messages. Participants were also asked not to share the SMS text messages with others. Intervention fidelity was ensured by confirming the receipt at least of an initial “Welcome” SMS text message for all enrolled trial participants prior to randomisation. Message delivery reports were monitored throughout the trial to check the intervention was being delivered as planned. In addition, we also set up a system of sentinel-phones (using the five most common entry-level handsets in South Africa) registered and allocated to receive messages in the same way as trial participants.

The trial interventions were delivered separately from the health care workers providing usual clinical care for participants. For each anticipated study visit (enrolment, 6-month follow-up, 12-month follow-up) standardised protocols were used. Structured logs were used to record detailed information for any interactions between trial staff and participants outside of expected study visits.

Contextual factors

In the final stages of the trial we conducted an independent process evaluation to explore the implementation of the intervention, contextual factors, and potential mechanisms of action. We employed a qualitative design using focus groups and in-depth interviews. The findings from the evaluation have been reported separately [47].

Cost-effectiveness analyses

We collected information on the costs of developing and delivering the intervention. The findings from this analysis will be reported separately.

Implementation and beyond

Dissemination

The potential to accumulate evidence of effectiveness and to identify the “active components” in successful m-health interventions depends in part on replication of successful interventions across settings and refining interventions (adding or subtracting elements) using evidence of behaviour change. To facilitate use and adaptation of our intervention we have used recommendations for reporting intervention development to ensure we have described the intervention and its delivery in sufficient detail [13]. We have registered the trial and published the trial protocol [48], and we will publish the trial results (using CONSORT reporting guidelines) in an open access journal. We have also published the findings from the process evaluation [in press]. We have reported findings to participants, health care workers, policy makers, and funders.

Surveillance, monitoring, and long-term follow up

We obtained permission to collect routine health data (dispensing and adherence data) from trial participants for a period of 6 months after the trial ended to explore for persistence of effects of the intervention (if any).

Discussion

Main findings

Using the MRC Framework was feasible in a low-resource multi-lingual setting. The adoption of the framework enabled us to develop a theory- and evidence-based intervention; to specify a proposed causal pathway to modify adherence behaviour and clinical outcomes; to test and refine the intervention delivery system; to design a randomised evaluation of the intervention; and to test and evaluate proposed study procedures.

What is already known on this topic

Mobile devices are a promising approach for delivering health interventions [7, 8]. Replication of study findings is hampered by the lack of adequate description of specific intervention components and their theoretical basis [13,14,15]. A number of frameworks have been proposed in the health and technology fields to aid the design of technology-based interventions [16, 49,50,51]. The 2008 MRC Framework has been used to design and evaluate interventions across disciplines which suggest its flexible, comprehensive, non-linear, iterative approach may be applicable to the design and evaluation of m-health interventions [15, 17,18,19,20].

What this study adds

This paper shows how the framework can be operationalised for an m-health intervention by explicitly mapping the activities, development, and testing to the stages of the 2008 MRC framework. We have also included detailed descriptions of the various aspects of the intervention and its delivery, reported in-line with TIDieR guidelines, which will enable comparison with other m-health interventions and support development of new interventions. Lastly, we have demonstrated that it is feasible and beneficial to use this approach in a multi-lingual low-resource setting.

Limitations of this study/framework

Sufficient time and resources need to be available to apply the Framework and benefit from the iterative development process and from testing of study-related procedures. For example, it took us several months longer than anticipated to complete the intervention development and testing in part because in resource constrained settings like the public health facilities in South Africa it can be challenging for frontline service staff to find time to engage in intervention design activities (interviews, discussions, message library review.)

Whilst the intervention development work was carried out at several sites the clinical trial was at a single-site. In future, we will engage in both development and testing across sites to tease out factors that are common and unique for specific mHealth interventions.

Lastly, attention also needs to be given to field testing of recruitment and retention strategies as there are many instances where trials of mHealth interventions in similar settings are inconclusive because of poor recruitment and high rates of loss to follow-up [52, 53].

Conclusions

The MRC Framework can be successfully applied to develop and evaluate m-health interventions in a multi-lingual resource-constrained setting. Detailed descriptions of the development process, the intervention and its delivery may advance the evidence-base for m-health interventions, enabling comparison, adaption, and development of interventions.