Skip to main content

Pre/post evaluation of a pilot prevention with positives training program for healthcare providers in North West Province, Republic of South Africa

Abstract

Background

Prevention interventions for people living with HIV/AIDS are an important component of HIV programs. We report the results of a pilot evaluation of a four-hour, clinic-based training for healthcare providers in South Africa on HIV prevention assessments and messages. This pre/post pilot evaluation examined whether the training was associated with providers delivering more prevention messages.

Methods

Seventy providers were trained at four public primary care clinics with a high volume of HIV patients. Pre- and post-training patient exit surveys were conducted using Audio-Computer Assisted Structured Interviews. Seven provider appropriate messaging outcomes and one summary provider outcome were compared pre- and post-training using Poisson regression.

Results

Four hundred fifty-nine patients pre-training and 405 post-training with known HIV status were interviewed, including 175 and 176 HIV positive patients respectively. Among HIV positive patients, delivery of all appropriate messages by providers declined post-training. The summary outcome decreased from 56 to 50%; adjusted rate ratio 0.92 (95% CI = 0.87–0.97). Sensitivity analyses adjusting for training coverage and time since training detected fewer declines. Among HIV negative patients the summary score was stable at 32% pre- and post-training; adjusted rate ratio 1.05 (95% CI = 0.98–1.12).

Conclusions

Surprisingly, this training was associated with a decrease in prevention messages delivered to HIV positive patients by providers. Limited training coverage and delays between training and post-training survey may partially account for this apparent decrease. A more targeted approach to prevention messages may be more effective.

Peer Review reports

Background

Prevention interventions for people living with HIV/AIDS (PLHIV), known as “Prevention with Positives” (PWP), are an important component of comprehensive HIV programs. Recently, the President’s Emergency Plan for AIDS Relief (PEPFAR) defined a minimum package of PWP interventions that included five assessments and provision of condoms and lubricants at all healthcare encounters. Assessments were recommended on: 1) patients’ adherence to anti-retroviral therapy (ART), 2) signs and symptoms of sexually transmitted infections (STI) and other opportunistic infections, 3) partners’ status and disclosure, 4) reproductive health/family planning intentions, and 5) patients’ sexual risk-behavior, and alcohol and other substance use [1]. A subsequent systematic review reported that PWP interventions can bolster the impact of treatment programs on reducing morbidity and HIV transmission in low- and middle-income countries [2].

PWP interventions are particularly relevant in the Republic of South Africa, where an estimated 6.43 million people are living with HIV/AIDS, and HIV prevalence is 29.5% among pregnant women aged 15–49 attending antenatal clinics [3,4,5]. As people with HIV live longer with improved treatment, they need knowledge and support to protect their own health and avoid transmitting HIV to others [6]. One of the sub-objectives of South Africa’s National Strategic Plan for HIV, STI, and Tuberculosis is to “increase access to a package of sexual and reproductive health services” for PLHIV and young people [7].

Integrated prevention interventions that are delivered in healthcare settings and address medical, social and psychological factors have been shown to be particularly effective [8,9,10]. In the United States, there is evidence that provider-delivered PWP interventions significantly increase the number of prevention conversations, reduce the mean number of sexual partners, and decrease the prevalence of unprotected intercourse [11, 12]. A review of PWP trials concluded that the duration of effects of provider-delivered interventions is longer than that of other interventions [13]. Although it is clearly crucial that providers in South Africa be similarly trained to deliver PWP interventions, there is a lack of evidence of the effectiveness of training packages designed to support providers to deliver them in this context.

The United States Centers for Disease Control and Prevention (CDC), with support from the University of Washington’s International Training and Education Center for Health (I-TECH), developed a four-hour, clinic-based training to equip healthcare providers with standard HIV-prevention assessment questions and messages, adapted from Partnership for Health for South Africa [14]. The training introduces a job aid, “Five HIV Prevention Steps for People Living with HIV/AIDS: A Tool for Healthcare Providers,” with assessment questions and prevention messages for HIV positive patients.

The results of a pre/post evaluation conducted by I-TECH of a pilot training at public-sector primary healthcare (PHC) clinics in the North West Province of South Africa are reported below. We tested whether this training intervention increased patient-reported receipt of HIV-prevention messages during routine patient care.

Methods

PWP training intervention

Nurses and counselors were trained at four PHC clinics serving high volumes of patients receiving pre-ART and ART services in Bojanala Platinum District of North West Province. Clinic selection was conducted in collaboration with the District Management Team of the Department of Health. HIV prevalence in the district was 35.0% among pregnant women aged 15–49 attending antenatal clinics, compared to 29.5% nationally as noted above [4]. HIV fatalism, restrictive gender norms, HIV-related stigma, and general discomfort communicating about sex have been identified at the community and clinic levels in the district, and hamper progress in prevention and treatment [15].

The three training objectives were: 1) describe the importance of making recommendations to HIV positive patients about HIV prevention; 2) explain the importance of each step that makes up a comprehensive strategy for addressing prevention with HIV positive individuals; and 3) demonstrate use of the provider job aid for delivering key prevention recommendations and strategies to HIV positive patients.

The training focused on the Five HIV Prevention Steps for People Living with HIV/AIDS: A Tool for Health Care Providers. This job aid is presented in Additional file 1. Providers were taught to assess for risk and deliver prevention messages according to five themes in the job aid: 1) prevention recommendations on sexual behavior, safer sex, and alcohol and substance use, 2) adherence to ART and other medications, 3) signs and symptoms of STIs, 4) pregnancy status and intentions, and 5) condom demonstration.

I-TECH worked with clinic managers to develop a training implementation plan. The curriculum was the same in all four facilities and the same trainers conducted all sessions. Fidelity of trainings to methods and content were similar across facilities and sessions. The four-hour training session was delivered several times over one to four months, with a range of two to four training dates per clinic. All nurses at two of the clinics were trained (19 of 19 at clinic B, and 10 of 10 at clinic D), 90% at clinic A (9 of 10), and 66% at clinic C (14 of 21). 18 counsellors and other staff across the four clinics were also trained. As part of the training session, providers developed personal action plans for conducting the assessments and delivering the messages. Following the trainings, copies of the action plans were given to the providers and to a training coordinator. The coordinator contacted each trained provider by phone, every two weeks for eight total weeks, to review progress on and document revisions or updates to the action plans.

Design

We used patient exit surveys to collect data from a convenience sample of HIV positive patients pre- and post-training at four clinics. This survey was designed to avoid revealing the patients’ HIV status to the data collection team or to others. Patients responded to all questions anonymously via Audio Computer Assisted Self Interview (ACASI), including to the question about HIV status. ACASI has been shown to be a feasible and reliable data collection method in South Africa [16,17,18,19]. To avoid disclosure through participation, all patients were invited to complete the questionnaire, regardless of HIV status. All patients were asked about HIV prevention assessments conducted by the provider, and messages from the provider, though HIV negative patients skipped questions that were only appropriate for patients with HIV. Data from HIV negative patients served as a control for other pre/post secular trends and changes in provider behavior at these clinics. Patients were eligible to participate if they received care at the clinic on the date of survey, were aged 18 and above, and were fluent in English or Setswana.

Survey questions about HIV prevention assessments and messages varied across respondents depending on their self-reported risk behaviors and HIV status. For example, only patients who reported being sexually active in the previous three months were asked whether their provider discussed the HIV status of their sexual partner(s). The exit interview questions for HIV positive patients are presented in Additional file 2.

Eligible participants gave informed consent and received instruction on using an electronic tablet. The ACASI questionnaire was designed with the Open Data Kit and data were uploaded onto FormHub© each evening [20, 21]. The pre-test survey was conducted from December 2013 to February 2014, and the post-test was conducted from August to December 2014.

Sample-size calculations assumed that training would be associated with a 20% absolute increase in appropriate messaging among HIV positive patients, giving a sample size of 140 per time period for a two-sample test of proportions with a power of 0.90 and alpha of 0.05. This was increased to 175 to allow for 25% incomplete or missing data. Patient interviews continued until 175 HIV positive patients were interviewed during each time period.

Ethical considerations

The evaluation protocol was reviewed and approved by the North West Province Department of Health Research Committee and the Human Sciences Research Council of South Africa (REC 8/20/02/13). The Human Subjects Division at the University of Washington determined that the evaluation did not meet the regulatory definition of research under 45 CFR 46.102(d).

Informed consent was obtained from all interview participants. No identifying information was collected. Participants sat where no one could observe their answers, used headphones, and answered questions by tapping a tablet screen. Participants did not receive compensation.

Data analysis

Seven outcome variables were generated to measure provider messaging. Three were derived from the prevention theme of the PWP training package: sexual activity, safer sex, and drugs and alcohol. One outcome variable was generated for each of four remaining themes of the intervention: adherence to ART and other medications, signs and symptoms of STIs, pregnancy status and intentions, and condom demonstration. These were summed to calculate a summary provider messaging score.

Poisson regression was conducted with the patient as the unit of analysis. The outcome variables were the number of appropriate messages received, adjusting for the number of potential messages that should be delivered as the exposure. The number of potential messages varied by patients’ HIV status, behaviors, and responses to assessment questions. Skipped questions, as noted in Additional file 2, were not included in the denominator. Models adjusted for time period, HIV status, the interaction of the two, and seven additional potential confounders chosen a priori: 1) clinic, 2) profession of healthcare provider (nurse, counselor, doctor, other) 3) patient age (18–29, 30–39, 40–49, 50+), 4) gender, 5) education (no schooling/some primary/completed primary, some secondary or completed secondary, college/university/technical, or other, 6) race, and 7) language. All analyses used robust standard errors to adjust for over-dispersion, and were performed in Stata 13 [22].

The primary analyses were performed with complete cases. Those with missing data on provider assessment or messaging were excluded based on the assumption of data missing at random. Three sensitivity analyses were conducted to test alternative assumptions regarding missing data: 1) provider did not deliver the message, 2) provider did deliver the message, and 3) missing message could be excluded from the denominator.

Three additional sensitivity analyses were conducted. The first focused on nurses and counselors, excluding patients who saw doctors (n = 96) and other providers (n = 12), because nurses and counsellors were the intended audience for the training. The second focused on the three clinics with relatively high training coverage, excluding Clinic C (n = 332) at which only 14 of 21 nurses were trained. The third adjusted for the delay between training and post-training data collection among HIV positive patients. Observations were analyzed by quartiles from the shortest to the longest delay.

Results

Seven hundred forty-five patients initiated the interview at pre-training and 615 at post-training. Figure 1 documents sample sizes for each outcome pre- and post-training. After excluding individuals who did not report their HIV status, 459 observations remained at pre-training and 405 at post-training. These included 175 HIV positive patients pre-training and 176 HIV positive patients post-training.

Fig. 1
figure 1

Sample inclusion and exclusion pre- and post-training by outcome

Descriptive statistics on the included patient samples are presented in Table 1, stratified by HIV status and time period. More than 80% of patient visits were with nurses, with some patients seeing more than one provider in a single clinic visit. There were some differences between samples pre- and post-training. Pre-training, 63% of HIV positive patients and 46% of HIV negative patients chose to answer the questionnaire in Setswana, compared to 34 and 20% respectively post-training. Similarly, 25% of HIV positive patients and 55% of HIV negative patients fell into the 18–29 age range pre-training, compared to 34 and 72% respectively post-training.

Table 1 Descriptive statistics of subjects by HIV status and time period

Among HIV positive patients, the percentages who were women (73.7% pre-training and 81.8% post-training) and enrolled in ART (87.6% pre-training and 88.7% post-training) were higher than nationally (60.0 and 31.2%, respectively) [3]. This would be expected from a facility-based sample, given that nationally the percentage of women who have initiated ART is higher (34.7%) than men (25.7%), and patients on ART have regular clinic visits [3]. The percentages that were Black (96.6% pre-training and 94.4% post-training) were similar to the national percentage (97.3%) [3].

Appropriate provider messaging

Among HIV positive patients, mean percentage of appropriate messages reported was lower post-training for all seven outcomes. The summary score decreased from 56% pre-training to 50% post-training. Among HIV negative patients, the mean percentages increased post-training for sexual activity and pregnancy status and intentions, but decreased for drugs and alcohol, and signs and symptoms of STIs. The summary score for HIV negative patients was 32% at both time periods (Fig. 2).

Fig. 2
figure 2

Average proportion of appropriate messages by outcome and time period

Table 2 reports the regression results. Among HIV positive patients, the proportion of appropriate messages delivered was lower post-training than pre-training. For the total score, the adjusted rate ratio was 0.92 (95% CI = 0.87–0.97). Rate ratios were less than 1 for six of the seven outcomes, and statistically significant for three outcomes: 1) adherence to ART or other medications, 2) pregnancy status and intentions, and 3) condom distribution. The exception was drugs and alcohol, for which the proportion increased post-training, but the increase was not statistically significant; adjusted rate ratio 1.13 (95% CI = 0.94–1.36).

Table 2 Rate ratios for appropriate prevention messaging from Poisson models

Among HIV negative patients, the proportion of appropriate messages delivered was generally the same pre- and post-training. For the total score, the adjusted rate ratio was 1.05 (95% CI = 0.98–1.12). For sexual activity, the proportion of appropriate messages increased significantly post-training; adjusted rate ratio 1.52 (95% CI = 1.20–1.93).

We failed to reject the null hypothesis that the effect of the training program was equivalent among HIV positive and HIV negative patients. In the difference-in-difference analysis, the effect was smaller and negative among people who were HIV positive. For the total score, the adjusted ratio of rate ratios was 0.89 (95% CI = 0.81–0.95). The exception was drugs and alcohol, for which the adjusted ratio of rate ratios was 1.33 (95% CI = 1.01–1.75).

Results of the sensitivity analyses were substantially the same with regards to alternative assumptions for missing values and when excluding patients who saw providers other than nurses or counselors. However, results for the sensitivity analysis among the three clinics with relatively high training coverage (excluding Clinic C) differed substantially from the primary analysis. Among HIV positive patients, the total score post-training was the same as pre-training; adjusted rate ratio 1.00 (95% CI = 0.92, 1.07). The proportion of drug and alcohol messages increased significantly post-training; adjusted rate ratio 1.33 (95% CI = 1.03, 1.71), and the proportion of pregnancy status and intention messages decreased significantly; adjusted rate ratio 0.77 (95% CI = 0.60, 1.00). Results of the sensitivity analysis of the delay between training and post-test data collection also differed from the primary analysis. Results for all outcomes were more favorable among HIV positive patients interviewed immediately post-training. The summary score post-training was similar to pre-training in the first quartile of time delay; adjusted rate ratio 0.95 (95% CI = 0.87, 1.04). As the delay increased, training was associated with a decrease in the proportion of appropriate messages for the summary score and six of the seven outcomes.

Discussion

This evaluation reveals that the clinic-based PWP training was associated with a significant decrease in prevention messaging for HIV positive patients in the adjusted multivariate analysis, as measured by the summary of patient reports. This decrease was consistent across six of the seven primary outcomes, and statistically significant in three. Results of the sensitivity analyses indicate that some of the decrease in prevention messages after training may be attributed to one clinic with low training coverage, and to delays between training and post-test data collection.

The training emphasized asking all assessment questions and delivering all prevention messages at every patient encounter, alongside the importance of repetition in motivating change in patients’ behaviors. However, clinicians may be reluctant to repeat themselves. They may have asked some of the assessment questions and delivered some of the prevention messages immediately after the training, but did not repeat the questions or messages at later visits. In Kenya, nurses reported an increase in their assessments and messages immediately after training on PWP, and a subsequent decrease two months post-training [23].

A more targeted approach to prevention messages might be more effective and sustainable. ACASI has been used at sexual health clinics to conduct assessments [24,25,26]. Clinicians could deliver targeted messages based on assessment results, and prioritize concerns and devote time to a meaningful dialogue about one or two risk behaviors and risk-reduction strategies. Alternatively, an ACASI assessment could be coupled with computer-based counseling. In a recent trial in the United States, HIV positive patients in one arm received an ACASI assessment, computerized counseling, and standard clinic visit with a healthcare provider, and those in the other received no computerized counseling [27]. Computerized counseling was associated with lower HIV transmission risk-behaviors than assessment by ACASI and standard of care.

The PWP training program and evaluation had several strengths. The job aid was adapted for South Africa from an evidence-based intervention. Clinic-based training improved access to the training sessions and reduced the time that healthcare providers spent traveling to training sessions. The ACASI questionnaire focused on clinician messaging to minimize respondent burden. Audio recordings were available in two languages and expertly engineered. Sensitivity analyses indicated a positive effect on provider behavior regarding alcohol and drug messaging in the clinics with high training coverage; communities in this district consider alcohol abuse to be a significant problem [15].

This evaluation had several limitations. Convenience sampling of patients, along with the lack of pre- and post-training data collection on the same patients, meant that the samples were not the same across surveys. However, we adjusted for observed patient characteristics that may have differed pre- to post-training. The lack of an HIV positive control group restricts our ability to draw causal inference or account for secular trends that may have only affected HIV positive patients. However, the samples of HIV negative patients controlled for secular trends that affected all patients. Our limited timeframe prevented a pre-test of the questionnaire with a smaller sample of patients. Issues with the skip pattern for the sexual activity questions were not identified until after pre-training data were collected and analyzed, meaning some data on disclosure of HIV status and HIV testing for children could not be analyzed. Post-training data collection occurred up to eight months after-training, and may have missed the immediate effects of the training program. The survey did not distinguish between patients who saw trained providers from those who saw untrained providers.

Conclusions

Contrary to expectations, the clinic-based PWP training was associated with a decrease in prevention messages delivered to HIV positive patients by healthcare providers. Limited training coverage may have contributed to this overall decrease. Moreover, the delay between training and post-training interviews may have allowed the pilot evaluation to miss the short-term impact of the training. A more targeted approach to prevention messages may be more effective.

Abbreviations

ACASI:

Audio computer assisted self interview

ART:

Antiretroviral therapy

CDC:

Centers for disease control and prevention

I-TECH:

International training and education center for health

PEPFAR:

President’s emergency plan for AIDS relief

PHC:

Primary healthcare

PLHIV:

People living with HIV/AIDS

PWP:

Prevention with positives

STI:

Sexually transmitted infections

References

  1. PEPFAR. Guidance for the Prevention of Sexually Transmitted HIV Infections [Internet]. Washington DC; 2011. Available from: http://www.pepfar.gov/documents/organization/171303.pdf.

  2. Medley A, Bachanas P, Grillo M, Hasen N, Amanyeiwe U. Integrating prevention interventions for people living with HIV into care and treatment programs: a systematic review of the evidence. J Acquir Immune Defic Syndr. 2015;68 Suppl 3:S286–96. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/25768868 [cited 2015 Nov 8].

    Article  PubMed  PubMed Central  Google Scholar 

  3. Simbayi L, Shisana O, Rehle T, Onoya D, Jooste S, Zungu N, et al. South African National HIV Prevalence, Incidence and Behaviour Survey [Internet]. Cape Town; 2014. Available from: http://www.hsrc.ac.za/en/research-data/view/6871.

  4. National Department of Health. The 2012 national antenatal sentinel HIV and herpes simplex type-2 prevalence survey in South Africa. Pretoria: National Department of Health; 2014. Available from: http://www.health-e.org.za/wp-content/uploads/2014/05/ASHIVHerp_Report2014_22May2014.pdf.

    Google Scholar 

  5. National Department of Health. Republic of South Africa Global AIDS Response Progress Report. Pretoria: National Department of Health; 2014.

    Google Scholar 

  6. GNP+. Living 2008: The Positive Leadership Summit Report [Internet]. Amsterdam; 2009. Available from: http://www.who.int/hiv/pub/plhiv/living2008_summit_report.pdf.

  7. South African National AIDS Council. National strategic plan on HIV, STIs and TB: 2012–2016. Pretoria: South African National AIDS Council; 2012. Available from: http://www.gov.za/sites/www.gov.za/files/national%20strategic%20plan%20on%20hiv%20stis%20and%20tb_0.pdf.

    Google Scholar 

  8. Fisher JD, Smith L. Secondary prevention of HIV infection: the current state of prevention for positives. Curr Opin HIV AIDS. 2009;4:279–87. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pmc/articles/PMC2943375/ [cited 2015 Nov 8].

    Article  PubMed  PubMed Central  Google Scholar 

  9. Morin SF, Koester KA, Steward WT, Maiorana A, McLaughlin M, Myers JJ, et al. Missed opportunities: prevention with HIV-infected patients in clinical care settings. J Acquir Immune Defic Syndr. 2004;36:960–6. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/15220703 [cited 2015 Nov 8].

    Article  PubMed  Google Scholar 

  10. Bodenheimer T, Grumbach K. Improving primary care: strategies and tools for a better practice. New York: McGraw-Hill; 2007.

    Google Scholar 

  11. Rose CD, Courtenay-Quirk C, Knight K, Shade SB, Vittinghoff E, Gomez C, et al. HIV intervention for providers study: a randomized controlled trial of a clinician-delivered HIV risk-reduction intervention for HIV positive people. J Acquir Immune Defic Syndr. 2010;55:572–81. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/20827218 [cited 2015 Nov 8].

    Article  PubMed  Google Scholar 

  12. Gardner LI, Marks G, O’Daniels CM, Wilson TE, Golin C, Wright J, et al. Implementation and evaluation of a clinic-based behavioral intervention: positive steps for patients with HIV. AIDS Patient Care STDs. 2008;22:627–35. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/18627280 [cited 2015 Nov 8].

    Article  PubMed  Google Scholar 

  13. Myers JJ, Shade SB, Rose CD, Koester K, Maiorana A, Malitz FE, et al. Interventions delivered in clinical settings are effective in reducing risk of HIV transmission among people living with HIV: results from the Health Resources and Services Administration (HRSA)’s Special Projects of National Significance initiative. AIDS Behav. 2010;14:483–92. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/20229132 [cited 2015 Nov 8].

    Article  PubMed  PubMed Central  Google Scholar 

  14. Richardson JL, Milam J, McCutchan A, Stoyanoff S, Bolan R, Weiss J, et al. Effect of brief safer-sex counseling by medical providers to HIV-1 seropositive patients: a multi-clinic assessment. AIDS. 2004;18:1179–86. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/15166533 [cited 2015 Nov 9].

    Article  PubMed  Google Scholar 

  15. Lippman SA, Treves-Kagan S, Gilvydis JM, Naidoo E, Khumalo-Sakutukwa G, Darbes L, et al. Informing comprehensive HIV prevention: a situational analysis of the HIV prevention and care context, North West Province South Africa. PLoS One. 2014;9:e102904. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pmc/articles/PMC4100930/ [cited 2016 Jan 13].

    Article  PubMed  PubMed Central  Google Scholar 

  16. Beauclair R, Meng F, Deprez N, Temmerman M, Welte A, Hens N, et al. Evaluating audio computer assisted self-interviews in urban South African communities: evidence for good suitability and reduced social desirability bias of a cross-sectional survey on sexual behaviour. BMC Med Res Methodol. 2013;13:11. Available from: http://0-www-biomedcentral-com.brum.beds.ac.uk/1471-2288/13/11 [cited 2015 Nov 9].

    Article  PubMed  PubMed Central  Google Scholar 

  17. Jaspan HB, Flisher AJ, Myer L, Mathews C, Seebregts C, Berwick JR, et al. Brief report: methods for collecting sexual behaviour information from South African adolescents--a comparison of paper versus personal digital assistant questionnaires. J Adolesc. 2007;30:353–9. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/17187853 [cited 2015 Nov 9].

    Article  PubMed  Google Scholar 

  18. Delva W, Beauclair R, Welte A, Vansteelandt S, Hens N, Aerts M, et al. Age-disparity, sexual connectedness and HIV infection in disadvantaged communities around Cape Town, South Africa: a study protocol. BMC Public Health. 2011;11:616. Available from: http://0-www-biomedcentral-com.brum.beds.ac.uk/1471-2458/11/616 [cited 2015 Oct 19].

    Article  PubMed  PubMed Central  Google Scholar 

  19. Langhaug LF, Sherr L, Cowan FM. How to improve the validity of sexual behaviour reporting: systematic review of questionnaire delivery modes in developing countries. Trop Med Int Health. 2010;15:362–81. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/20409291 [cited 2015 Nov 9].

    Article  PubMed  PubMed Central  Google Scholar 

  20. Open Data Kit. Open Data Kit. Seattle: University of Washington; 2013.

  21. Modi Research Group. FormHub. New York: Modi Research Group; 2013.

    Google Scholar 

  22. StataCorp. Stata statistical software: release 13. College Station: StataCorp LP; 2013.

    Google Scholar 

  23. Kurth AE, McClelland L, Wanje G, Ghee AE, Peshu N, Mutunga E, et al. An integrated approach for antiretroviral adherence and secondary HIV transmission risk-reduction support by nurses in Kenya. J Assoc Nurses AIDS Care. 2012;23:146–54. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/21803605 [cited 2015 Nov 9].

    Article  PubMed  Google Scholar 

  24. Fairley CK, Sze JK, Vodstrcil LA, Chen MY. Computer-assisted self interviewing in sexual health clinics. Sex Transm Dis. 2010;37:665–8. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/20975481 [cited 2015 Sep 30].

    Article  PubMed  Google Scholar 

  25. Vodstrcil LA, Hocking JS, Cummings R, Chen MY, Bradshaw CS, Read TRH, et al. Computer assisted self interviewing in a sexual health clinic as part of routine clinical care; impact on service and patient and clinician views. PLoS One. 2011;6:e18456. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/21483799 [cited 2015 Sep 30].

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Kurth AE. Utilizing information and communication technology tools in STD clinics: has the time come to go digital? Sex Transm Dis. 2010;37:669–71. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/20975482 [cited 2015 Nov 9].

    Article  PubMed  Google Scholar 

  27. Kurth AE, Spielberg F, Cleland CM, Lambdin B, Bangsberg DR, Frick PA, et al. Computerized counseling reduces HIV-1 viral load and sexual transmission risk: findings from a randomized controlled trial. J Acquir Immune Defic Syndr. 2014;65:611–20. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/24384803 [cited 2015 Nov 9].

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the collaboration of the Bojanala Platinum District Department of Health and Rustenburg Sub-district Department of Health, as well as the support of clinic managers and clinic staff at four primary health care clinics in Rustenburg. We would also like to thank the data collection team for their dedication and hard work, as well as the technical expertise of Katrina Iiams-Hauser in designing the ACASI version of the questionnaire.

Funding

I-TECH/University of Washington received funds for this project from the Health Resources and Services Administration (HRSA) of the U.S. Department of Health and Human Services (HHS) under Cooperative Agreement U91HA06801. The content and conclusions are those of the authors and should not be construed as the official position or policy of, nor should any endorsements be inferred by HRSA, HHS or the U.S. Government.

Availability of data and materials

The dataset supporting the conclusions of this article is available from the corresponding author upon reasonable request.

Authors’ contributions

JK, EP, JGi, EN, JGr, and MW conceived of the study and implemented data collection. CK analyzed and interpreted the data. CK and MW drafted the manuscript, and all authors contributed to revisions. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The evaluation protocol was reviewed and approved by the North West Province Department of Health Research Committee and the Human Sciences Research Council of South Africa (REC 8/20/02/13). The Human Subjects Division at the University of Washington determined that the evaluation did not meet the regulatory definition of research under 45 CFR 46.102(d).

Informed consent was obtained from all interview participants. Interviews did not collect identifying information. Participants sat where no one could observe their answers, used headphones, and answered questions by tapping a tablet screen. Participants did not receive compensation.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christopher G. Kemp.

Additional files

Additional file 1:

Prevention with Positives Job Aid. This job aid, titled “Five HIV Prevention Steps for People Living with HIV/AIDS: A Tool for Health Care Providers,” helps providers target appropriate prevention messages for their patients living with HIV/AIDS. (PDF 229 kb)

Additional file 2:

HIV Positive Patient Exit Questionnaire. This is the questionnaire that was designed for our study and completed by HIV positive patients at health facilities. (DOCX 41 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kemp, C.G., de Kadt, J., Pillay, E. et al. Pre/post evaluation of a pilot prevention with positives training program for healthcare providers in North West Province, Republic of South Africa. BMC Health Serv Res 17, 316 (2017). https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-017-2263-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-017-2263-7

Keywords