Skip to main content
  • Research article
  • Open access
  • Published:

Trial and error: evaluating and refining a community model of HIV testing in Australia

Abstract

Background

The 2012 regulatory approval of HIV rapid point of care (RPOC) tests in Australia and a national strategic focus on HIV testing provided a catalyst for implementation of non-clinical HIV testing service models. PRONTO! opened in 2013 as a two-year trial delivering peer-led community-based HIV RPOC tests targeting gay, bisexual and other men who have sex with men (GBM), with the aim of increasing HIV testing frequency. Initial data suggested this aim was not achieved and, as part of a broader service evaluation, we sought to explore client acceptability and barriers to testing at PRONTO! to refine the service model.

Methods

We present descriptive and thematic analyses of data from two in-depth evaluation surveys and four focus groups with PRONTO! clients focused on service acceptability, client testing history, intentions to test and barriers to testing for HIV and other sexually transmitted infections (STIs).

Results

The three novel aspects of the PRONTO! model, testing environment, rapid-testing, peer-staff, were reported to be highly acceptable among survey and focus group participants. Focus group discussions revealed that the PRONTO! model reduced anxiety associated with HIV testing and created a comfortable environment conducive to discussing sexual risk and health. However, an absence of STI testing at PRONTO!, driven by restrictions on medical subsidies for STI testing and limited funds available at the service level created a barrier to HIV testing. An overwhelming majority of PRONTO! clients reported usually testing for STIs alongside HIV and most reported plans to seek STI testing after testing for HIV at PRONTO!. When deciding where, when and what to test for, clients reported balancing convenience and relative risk and consequences for each infection as guiding their decision-making.

Conclusions

A community-based and peer-led HIV testing model reduced previously reported barriers to HIV testing, while introducing new barriers. The absence of STI testing at PRONTO! and the need to access multiple services for comprehensive sexual health screening, created a significant service engagement barrier for some clients. Understanding client motivations to access testing and ensuring novel service models meet client needs is crucial for developing acceptable sexual health services for high-risk populations.

Peer Review reports

Background

In 2012 the Australian Therapeutic Goods Administration (TGA) approved the first HIV rapid point-of-care (RPOC) test device for use in Australia [1]. Alongside a renewed strategic emphasis on HIV testing [2], this approval provided a catalyst for change in HIV testing services locally, including testing in non-clinical settings and by people trained in use of the device. Gay, bisexual and other men who have sex with men (GBM) are the key HIV priority population in Australia, and based on previous research [3, 4] it was anticipated that peer-led RPOC testing undertaken in a community-based service would reduce barriers and encourage men to test more frequently.

HIV testing is an integral component of HIV prevention strategies globally. While HIV testing provides an opportunity for risk reduction counselling and prevention education, the strategic prevention emphasis on testing lies with its place as the essential first step in the treatment cascade [2]. Timely HIV diagnosis, a result of frequent testing, facilitates early access to HIV treatment and viral suppression, offering significant benefit both to an individual [5] and the community through the prevention of onward transmission [6]. HIV testing is emphasised in Australia’s National HIV Strategy [2] and in global HIV prevention advocacy [7]. Modelling suggests that HIV transmission is disproportionately driven by undiagnosed HIV [8,9,10]. Australian modelling has suggested that increased testing frequency to quarterly testing is likely to have the greatest (albeit modest) impact on reducing transmission [11].

Local and international HIV testing guidelines are risk-based [12,13,14]; in Australia all sexually active GBM are recommended to test for HIV and other sexually transmissible infections (STIs) annually, with testing up to four times per year recommended for men classified as ‘high-risk’ [14]. Clinic-level assessments of HIV testing patterns suggest sub-optimal HIV testing rates among the majority of Australian GBM [15, 16]. The majority of HIV testing in Australia occurs in primary care clinical settings and, prior to the approval of RPOC tests, GBM reported that more convenient forms of HIV testing, including rapid testing, community testing and home/self-testing, would increase their testing frequency [3, 11, 17, 18].

Although models of RPOC testing may reduce known barriers to testing, rigidity within the Australian universal healthcare system, Medicare, limit the expansion of testing for HIV and STIs through non-conventional service delivery models. Specifically, the majority of laboratory-based HIV and other STI tests are rebated through Medicare, however application for listing of a HIV RPOC test on the Medicare Benefits Schedule was unsuccessful, and thus no rebate is provided for HIV RPOC tests [19]. Secondly, whilst RPOC test device registration in Australia permits their use by trained peer staff outside traditional clinical settings [1], only registered medical professionals (and not trained peers) can request Medicare rebated pathology [20]. This regulatory environment limits the range of tests available in a peer delivered HIV RPOC testing service, specifically those related to confirmatory HIV serological tests and tests for other STIs.

In the context of restricted Federal funding and increased prevention efforts, a number of Australian jurisdictions provided funding for HIV RPOC testing services for GBM [21,22,23]. RPOC testing is currently offered within clinical services (as user-pays models), and in stand-alone fixed site and outreach/pop-up community services funded by jurisdictional governments, with services delivered ranging from comprehensive primary healthcare to stand-alone HIV RPOC tests. Internationally, it is well established that RPOC testing services are highly acceptable [24], but little Australian evidence of acceptability exists. Moreover, few studies have examined the impact of RPOC testing services on HIV and STI test frequency, and whether these services continue to present barriers to testing [24, 25].

As part of an evaluation of PRONTO!, a community-based and peer-led RPOC HIV testing service for GBM, we previously reported that during the first 18 months of operations the proportion of GBM returning for a HIV test within 6 months was no better than that observed at clinical services in Melbourne [26]. Here we use mixed-methods evaluation data to explore the acceptability of this service model and examine any continued barriers to HIV testing.

Method

The service

PRONTO! operations have been described in detail elsewhere [26]. Briefly, PRONTO! began operations on 15 August 2013 in an inner-city location in Melbourne under management of the Victorian AIDS Council and funding from the Victorian Department of Health and Human Services to provide free HIV RPOC tests to Victorian GBM. Novel aspects of PRONTO! (in the context of the Australian HIV testing models) include operating outside normal business hours, testing delivered by peer staff, a shop-front community-based setting and the use of a RPOC test. Funding barriers precluded the integration of STI testing, with symptomatic clients referred to clinical services.

During a 30-min appointment peer staff deliver pre- and post-test counselling and perform a HIV RPOC test using the Trinity Biotech Unigold HIV 1/2 test device as per manufacturer’s instructions [27]. During the 10 min test incubation clients remain in the room with the peer test facilitator, during which time clients are routinely engaged in a sexual health discussion. The RPOC test result is then delivered in the same consultation. Follow up is based on RPOC test result, including confirmatory testing for all reactive results.

The evaluation

A mixed-methods evaluation was employed to assess the trial aims; to reduce barriers to HIV testing, increase HIV testing frequency, and increase access to sexual health services among GBM. The evaluation included integration of PRONTO! as a participating site in an existing sentinel surveillance system of high HIV caseload clinics. Additionally, in-depth evaluation surveys, and client focus group discussions (FGD) were conducted periodically and key informant interviews were conducted at the mid trial point. PRONTO! managers and staff were consulted during the development of all data collection tools and evaluation reports were distributed to the program managers and funders annually [28, 29]. To explore model acceptability and factors contributing to decisions to test for HIV and STIs we present data from sentinel surveillance, two evaluation surveys and four FGDs.

Sentinel surveillance and evaluation surveys

Recruitment and data collection

Sentinel surveillance data collection has been described elsewhere [26]. Briefly, at each appointment clients complete a brief survey containing demographics, testing history and sexual risk characteristics. At the first appointment, clients are assigned a unique numerical identifier which facilitates the linking of survey and test data at each appointment and over time.

For PRONTO! evaluation surveys, a consecutive sampling method was employed. All clients testing between 12 November 2013 and 31 January 2014 (survey one) and between 15 May 2014 and 05 October 2014 (survey two) were invited to complete surveys by peer staff. No financial reimbursement was provided to clients completing survey one and clients completing survey two were compensated $20 for their time. The surveys contained sections on demographics, HIV and STI testing history, barriers and motivators to testing, acceptability of the PRONTO! model, sexual risk, and marketing and communications.

Data analysis

All clients who self-identified as male, reported any male-to-male sex and/or self-identified as gay or bisexual, and were aged 18 years and over were included in the analysis.

To assess the representativeness of the evaluation survey samples, selected items (age, country of birth, region of residence and sexual risk classification (high/not high risk based on national risk based testing guidelines, [14]) asked on both sentinel surveillance and evaluation surveys were compared using test of proportions. We describe the acceptability of the service model (accessibility, reception and physical environment, rapid testing process, and peer-led model), and compare these outcomes over time (surveys one and two) using a two sample z-test.

To explore HIV and STI testing behaviours and intentions we describe HIV and STI testing history (if ever tested for HIV, time since last HIV test, location of last HIV test, usually test for HIV and STIs together) and intentions to test (plans to seek STI testing following most recent test at PRONTO! and likeliness to return to PRONTO! for testing). Additional variables added to survey two were included in the descriptive analyses to explore preference for peer staff, barriers to HIV and STI testing and recent testing history (if tested for HIV or STI elsewhere since testing at PRONTO!, reason for test, and location of test).

Quantitative data were analysed using Stata Statistical Software: Release 13 (StataCorp, College Station, TX: StataCorp LP) and the cut-off for statistical significance was p < .05 for all analyses.

Focus group discussions

Recruitment and data collection

All evaluation survey participants were invited to provide contact details for participation in FGDs. All clients who provided contact details (survey one: n = 47, survey two: n = 189) were invited by email to participate in a FGD. Two FGDs were held at the Burnet Institute following each survey round (four in total) lasting approximately 90 min each. FGD themes included motivators and barriers to testing, acceptability of the service, structural, social and community benefits of the service, and service marketing; in this paper we include FGD data related to service acceptability and factors associated with decisions to test for HIV and STIs. FGDs were audio recorded and transcribed verbatim. Pseudonyms were assigned to all FGD participants.

Data analysis

Following the second round of FGDs, all focus group data were pooled and thematically analysed by KR. FGD analysis was performed using NVivo 11.

Ethics and consent

The Alfred Hospital Ethics approved the evaluation of the RPOC testing service (HREC 297/13) and use of the test device in a clinical trial (261/13). Inclusion of the service as a site in the sentinel surveillance system was approved by the Victorian Department of Health Ethics Committee (52/05).

For clients completing the behavioural sentinel surveillance survey, consent is implied with completion of the survey, as previously detailed elsewhere [30]. For clients completing the evaluation surveys and participating in any FGDs, all participants completed a participant’s informed consent form prior to participation.

Results

Evaluation surveys

Over the 24-month trial period, 1947 GBM attended PRONTO! and received 2998 RPOC HIV tests. During evaluation survey one and two recruitment periods, 229 and 737 clients, respectively, tested for HIV at PRONTO!, met the eligibility criteria and were invited to participate in surveys. Of these, 118 (52% response rate) and 298 (40% response rate) GBM completed survey one and two, respectively. There were no significant differences in the characteristics of clients attending PRONTO! during the trial period (as determined from sentinel surveillance surveys) and clients completing the evaluation surveys (Table 1).

Table 1 Characteristics of PRONTO! GBM clients completing sentinel surveillance, evaluation survey one, and survey two

Service acceptability

Clients completing survey one reported high acceptability across almost all aspects of the model, with an overwhelming majority of clients reporting that they were likely to return to PRONTO!. Acceptability of most aspects of the model remained high in survey two. While there were significant reductions in the proportion of the samples reporting they ‘preferred rapid testing to conventional HIV testing’, or ‘found the conversation [with peer test facilitators] useful in regards to my sexual health’ from survey one to two, these aspects of the model remained highly acceptable among survey two participants (>80% agreement with statements). A significant decline was observed in preferences for testing with a peer compared to sexual health doctor or nurse; peers were preferred by approximately three quarters of respondents in survey one, decreasing to under two thirds in survey two (Table 2).

Table 2 Acceptability of novel aspects of the PRONTO! model among PRONTO! GBM clients completing evaluation survey one and survey two

To explore factors contributing to a lower reported preference for peers relative to other acceptability indicators, survey two respondents could respond in free text to the question, ‘why you did or did not prefer testing with a peer compared to sexual health doctor or nurse’. Almost one third (n = 88) of respondents provided comment. Among those reporting no preference for peer (n = 119), 35 provided a free text response to describe their preference for peer or medical staff. Two reasons were provided by respondents for preferring a doctor or nurse; an increased comfort in receiving a positive result from a doctor or nurse and concern with confidentiality in a peer delivered service. However, comments most commonly (n = 16) highlighted the acceptability of HIV testing delivered by either peer staff or doctors nurses, with respondents preferring a service that was “professional and confidential” with preference depending on “the person, not their job title”.

HIV and STI testing within the PRONTO! Model

Most PRONTO! evaluation survey participants were already engaged in routine HIV testing in clinical settings prior to attending PRONTO!. Approximately two thirds of those with a HIV testing history reported frequent (previous test within 6 months) HIV testing and around half reported usually testing at a sexual health centre, with smaller proportions testing at high HIV caseload general practitioner (GP) clinics. Almost all of these participants reported usually testing for STIs at the same time as HIV. After testing at PRONTO!, three quarters of survey one respondents reported they ‘planned to seek STI testing following their most recent test at PRONTO!. This proportion declined to approximately half at survey two. There was no significant difference in the age, country of birth or high risk classification among those who did and did not plan to seek STI testing (data not shown). The most common location for planned STI testing was a sexual health centre or high HIV caseload clinic, consistent with participants’ usual HIV testing routine (Table 3).

Table 3 HIV and STI test history of PRONTO! GBM clients completing evaluation survey one and survey two

Additional questions were added to survey two to explore clients decision to test for HIV &/or STIs at other services since first testing at PRONTO!. One quarter of the survey two respondents reported testing for HIV elsewhere since first testing at PRONTO!, two thirds of whom reported that they did so to access comprehensive STI testing. Almost one third of survey two respondents reported testing for STIs at another clinic since first testing at PRONTO! (Table 3).

Focus group discussion

Twenty six men participated in one of four FGDs. The age range across the four FGDs was 20-46 years and most had tested for HIV before attending PRONTO! for the first time.

Focus group discussions covered a range of evaluation themes, however we have restricted analysis to acceptability of the PRONTO! model and factors that contributed to a clients’ decision to test for HIV &/or STIs.

Testing environment

The physical space at PRONTO! was described as “contemporary without being too medical” and this was reported as improving clients’ test experience. Participants referred specifically to certain physical and sensory elements of the PRONTO! reception space, such as the couch, low reception desk, large window and the music playing as an “inviting” environment compared to previous experiences at clinical services.

“I expected it to be like a doctors clinic, you walk in and get take a ticket, you’re told to sit on an uncomfortable chair, you sit there and wait for your name to be called out whereas like the guy was having a chat, gave me a clipboard, take a seat on the couch, help yourself to a drink, like, this is pretty cool” Paul, 28 years

Rapid testing process

Many participants discussed the rapid testing process and immediate results delivery as an improvement to the client experience. Participants spoke about their anxiety around testing for HIV which was somewhat allayed by the service at PRONTO!, in particular by the reduced time to receiving their HIV test result.

“I’m generally not ever that worried about it (HIV), as I said it’s only when I’ve just got the test done that you start… the mind starts ticking, and the rapid test reduces that to 10 minutes and it means that I’m quite happy to go far more rather than if I had to wait a week every time” Evan, 25 years

While some participants reported having concerns about rapid test device accuracy and performance compared to conventional testing prior to attending PRONTO!, all agreed that their confidence in the technology improved following their experience at the service. Nevertheless, some participants reported that they would maintain occasional testing at clinical services because of the higher sensitivity of laboratory testing and peace of mind in accessing what they felt was more reliable laboratory-based HIV testing.

“I guess I was reassured of, you know, I got to ask lots of questions about it and I felt reassured that it was just as effective as the standard test” Gabe, 25 years

Peer staff model

The benefits of the peer model largely centred around a feeling that clients could have meaningful conversation on sexual health and broader issues pertinent to GBM, rather than be “lectured” on sexual risk. The 10 minute device incubation offered structured time and the opportunity for discussion between client and peer staff, which was discussed by most participants as a useful time to ask questions they would normally not ask a doctor or nurse. Participants reported this opportunity was generally not available at clinical services due to time and staffing constraints. Many participants commented that testing with a peer and the increased opportunity for dialogue was something that they did not expect when first attending PRONTO!, while a few preferred to wait outside the room, most appreciated this aspect of the PRONTO! model.

“the fact that you’ve got that wait time where you’re having a conversation with them waiting for the test results… you certainly don’t do that with a GP, a GPs mostly just sitting at their computer typing … but there was greater structured time for an actual conversation” Lawrence, 44 years

The value ascribed to the peer discussion was enhanced by the relationship that clients built with the peer staff. Participants described the improved test experience with a more relatable person conducting the test compared to participants’ previous experience with doctors and/or sexual health nurses. Some men discussed feeling at ease knowing that it was a peer testing them, and felt that peer testers broke down barriers that existed in standard clinical dialogue, enabling them to be more open in discussion about their sexual health.

“(the peer environment) lightens the mood, that’s for sure… that brings down barriers to discuss things that maybe bothering you or at the back of your mind” Vinay, 36 years

A number of participants weren’t aware that PRONTO! was a peer-led service when they first attended, and concerns were raised by some participants about confidentiality and potentially being tested by someone they knew. These concerns seemed to be allayed by the level of professionalism displayed by peer test facilitators. The professional conduct of the peer staff, balanced with the general relaxed style of the service, was important to participants feeling confident in the RPOC test result.

“I didn’t feel at all uncomfortable with them not being professionals and they did explain that they have received the training to do this test” Evan, 25 years

Convenience of the PRONTO! Model

During FGDs, participants discussed factors that influenced their motivation and decision to test for both HIV and STIs, including convenience, and their perceived relative risk and seriousness of certain infections. During these discussions, many participants reflected on the importance of convenient models of testing offered by PRONTO!. Men described the model as conducive to fitting HIV testing into their life. The ability to book an appointment after business hours with minimal planning and to receiving their test result without a return visit was highlighted.

“It made it less of a chore, like I never thought getting a test could be that easy, I just made an appointment half an hour before I was meeting my friends to go get burgers at Fitzroy, and I got it done and walked down Smith St and met them and had dinner” Ben, 20 years

Testing for HIV contrasted with testing for other STIs

When discussing how well the services met the health needs of men, the lack of STI testing offered at PRONTO! was highlighted as a major barrier. In this context men highlighted the need to attend other services for comprehensive STI testing as a major inconvenience reducing the likelihood they would return to PRONTO!, regardless of perceiving the service model as otherwise highly acceptable service.

“Just because I don’t want to go to two places, I would probably just go to my one place and get everything done in one sitting” Hugo, 21 years

Participants differed in their perceptions of their need to access STI testing in addition to HIV testing; these perceptions appeared to influence their decision to return to PRONTO! or test for HIV and STIs elsewhere. Some participants discussed their perceived need for HIV and STI testing in the context of a hierarchy of consequence, with a HIV diagnosis having the most severe consequence and conferring the greatest need for testing. Participants making testing decisions on this basis would delay asymptomatic STI testing at other clinical services in preference for more convenient HIV testing at PRONTO!.

“HIV’s the big concern, but anything else there’s either symptoms or… depending on what’s going on, if you think you’ve had any exposure to anything, so that (no STI testing) wouldn’t affect my using the service” Ulric, 26 years

Other participants discussed their decision to test for HIV and STIs in the context of a hierarchy of perceived risk of infection. These participants generally spoke about the higher likelihood of acquiring an STI other than HIV resulting in a preference for comprehensive HIV and STI screening.

“I probably won’t use PRONTO!, for me, I’ll just go back to the (sexual health clinic) ‘cause, you know, HIV is just one test… it’s not something that bugs me, it’s the others that bug me more” Vinay, 36 years

Discussion

The key features of the PRONTO! service model, peer delivered RPOC testing in a non-clinical setting, were highly acceptable to clients, however the absence of STI testing in the model provided a major disincentive for clients to return to PRONTO! for HIV testing. Depending on client preferences and sexual health priorities, the inability to offer STI testing alongside convenient RPOC HIV testing has significant implications for HIV and STI prevention and care. Those electing to return and use PRONTO! as their routine access point to HIV testing will ultimately miss altogether or delay asymptomatic STI testing. Those reporting not returning because they are accessing STI testing elsewhere miss out on the otherwise acceptable and convenient aspects of the model and may not test for HIV any more frequently than they did before. In either case, primary aims of the service model are not achieved. Consistent with evaluations of community-based and/or RPOC testing services internationally [31], we found an overwhelmingly high level of acceptability across many defining aspects of the PRONTO! model. The high acceptability observed in this study is consistent with other Australian studies reporting high acceptability of RPOC testing in clinical settings [22, 32]. However, relative to PRONTO! testing environment and the provision of rapid testing, the peer staffing model was the least acceptable aspect of the three key domains. While we observed modest declines in acceptability ratings across some service domains between surveys one and two, reported preference for peer testers compared to a sexual health doctor or nurse declined more notably from 78% to 60%. We have previously reported that survey one respondents who did not prefer peers were more likely to report having a majority of gay friends, testing at PRONTO! for reasons other than it being a gay friendly service and reporting not learning anything new about HIV during their appointment [29]. As many of the benefits of the peer model reported in the FGDs centred around increased comfort with staff and opportunity for discussion and education, the peer model may offer fewer benefits for men who are gay community attached and well informed about sexual health. The high acceptability of specific components of the PRONTO! peer model (e.g., comfort with peer, professionalism of peers) is juxtaposed with a lower preference for peer testers compared to doctors or nurses. This may simply indicate that peer involvement is acceptable to clients but not a primary contributing factor for why some men to choose to test at or return to PRONTO!. Alternately, the findings presented in this paper suggest the benefits of a peer-led model may depreciate with multiple attendances at PRONTO! as clients’ perceived need for peer-led education and counselling diminishes with multiple exposures.

While the PRONTO! service model was acceptable to an overwhelming majority of clients, the lack of STI testing offered at PRONTO! meant that this model may have inadvertently introduced new barriers to testing that may to disrupt clients’ routine HIV/STI testing patterns and negatively impact their HIV and STI testing frequency. Prior to testing at PRONTO! an overwhelming majority (91%) of survey respondents reported usually accessing comprehensive STI testing alongside HIV testing, however, accessing comprehensive testing since attending PRONTO! was less commonly reported and diminished over time; only 50% of survey two respondents reported they planned to seek STI testing following their most recent HIV test at PRONTO!. This suggests that despite peer staff encouraging clients to access comprehensive testing elsewhere this was not a priority for a substantial proportion of clients. It was clear from focus group discussions that clients’ decision on where, when and what to test for were driven by multi-faceted individual hierarchies that included convenience, self-perceived risk of acquisition, and the consequence of specific infections. The influence of these factors on clients’ decision to test for HIV/STIs may contribute to delaying or not returning for HIV testing at PRONTO! or delaying accessing STI testing at a clinical service. In either case, by reducing men’s opportunity to access comprehensive HIV/STI testing at one service, the PRONTO! testing model appeared to work against the stated aims of the service to increase HIV testing frequency and increase access to sexual health services. This is of particular concern when considered in the context of a marked increase in syphilis and Neisseria gonorrhoea notifications among GBM locally over the same period [33]. A service that contributes, albeit unintentionally, to a reduced frequency of STI testing and misses opportunities for opportunistic screening is concerning. In the context of restrictive funding and regulatory barriers that maintain a central role for clinicians in HIV/STI testing, many benefits of patient-centred community-based models of health care may be undone.

The issues raised in this paper relate to broader regulatory barriers to the implementation of adapted and tailored models of care. For example, the lack of regulatory approval in Australia for point-of-care STI tests means that convenient and acceptable testing models for STIs are not readily delivered to high-risk populations in regional and remote Australia, such as those recently trialled in Northern Australia. The further development and funding for non-conventional models of care including point-of care tests, and hybrid community-based and clinical models is needed to offer clients highly acceptable and convenient models of comprehensive HIV and STI testing.

In response to the evaluation findings presented here, the Victorian AIDS Council (service managers) funded and implemented a Chlamydia trachomatis and Neisseria gonorrhoea testing pilot to explore the acceptability and feasibility of integrated STI testing at PRONTO!. Three-quarters of clients attending for HIV tests during the trial period opted to also receive STI testing and a high proportion of clients tested positive for STIs (19% tested positive for at least one STI). However, delays in result delivery, inability to prescribe treatment and absence of sustainable funding (partly driven but restrictions in public subsidies for clinician oversight) suggested that incorporating STI testing into the existing PRONTO! model was not feasible [34]. PRONTO! management have since amended the service model, including engaging general practitioners to work onsite, primarily in a trans and gender diverse clinic and HIV pre-exposure prophylaxis clinic, offering support to STI testing and treatment among PRONTO! clients. In this way, PRONTO! management has developed a model that maintains both the community-based features and the convenience of RPOC testing at PRONTO!, while enabling a sustainable funding structure for comprehensive STI testing. Preliminary analysis of repeat testing at PRONTO! following the introduction of STI testing shows a significant increase in 6 month repeat testing [35] and additional research into the impact of this change is ongoing.

There are a number of limitations in this study. Recruitment of participants to the evaluation surveys and the FGDs may be biased. To assess selection bias we compared demographics and sexual risk reported in each evaluation survey with that reported in PRONTO! behavioural sentinel surveillance and found no significant differences between the samples. Recruitment into the FGDs may have been biased as these participants went through two levels of self-selection. In addition, survey responses and FGDs may be influenced by social desirability bias. Previous work has shown a discrepancy between high self-reported frequent testing and lower objective testing data from clinics [16]; as such, self-reported data on typical HIV and STI testing frequencies may have been biased towards more frequent testing.

Conclusions

While free RPOC HIV testing in a community-based, peer-led service was highly acceptable to clients, this did not translate to increased HIV testing frequency during the trial period [26]. Evaluation data presented here suggests that the siloed HIV testing model employed at PRONTO! during the trial period was likely to have contributed to a lack of impact on HIV test frequency. Understanding the motivations and circumstances for why and when men seek HIV and STI testing and ensuring service models are implemented with these considerations in mind, is important to address the continued suboptimal test frequency among high risk GBM.

Abbreviations

FGD:

Focus group discussion

GBM:

Gay, bisexual and other men who have sex with men

RPOC:

Rapid point-of-care

STI:

Sexually transmissible infection

TGA:

Therapeutic Goods Administration

References

  1. Therapeutic Goods Administration. Conditions of approval on the ARTG for HIV POCT [Internet]. 2015 [cited 2015 Aug 4]. Available from: https://www.tga.gov.au/conditions-approval-artg-hiv-poct.

  2. Commonwealth of Australia. Seventh National HIV Strategy 2014-2017 [Internet]. 7th ed. Canberra: Commonwealth of Australia; 2014 [cited 2015 Aug 4]. p. 52. Available from: http://www.health.gov.au/internet/main/publishing.nsf/content/ohp-bbvs-hiv

  3. Bavinton BR, Brown G, Hurley M, Bradley J, Keen P, Conway DP, et al. Which gay men would increase their frequency of HIV testing with home self-testing? AIDS Behav. 2013;17(6):2084–92.

    Article  PubMed  Google Scholar 

  4. Yang M, Prestage G, Maycock B, Brown G, de Wit J, McKechnie M, et al. The acceptability of different HIV testing approaches: cross-sectional study among GMSM in Australia. Sex Transm Infect. 2014;90(8):592–5.

    Article  CAS  PubMed  Google Scholar 

  5. The INSIGHT START Study Group. Initiation of antiretroviral therapy in early asymptomatic HIV infection. N Engl J Med. 2015;373(9):1–13.

    Article  Google Scholar 

  6. Cohen MS, Chen YQ, McCauley M, Gamble T, MiC H, Kumarasamy N, et al. Prevention of HIV-1 infection with early antiretroviral therapy. N Engl J Med. 2011;365(6):493–505.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. UNAIDS. 90-90-90 An ambitious treatment target to help end the AIDS epidemic [Internet]. Geneva; 2014 [cited 2017 Jul 25]. p. 40. Available from: http://www.unaids.org/en/resources/documents/2017/90-90-90

  8. Wilson DP, Hoare A, Regan DG, Law MG. Importance of promoting HIV testing for preventing secondary transmissions : modelling the Australian HIV epidemic among men who have sex with men. Sex Health. 2009;6(1):19–33.

    Article  PubMed  Google Scholar 

  9. Punyacharoensin N, Edmunds WJ, De Angelis D, Delpech V, Hart G, Elford J, et al. Modelling the HIV epidemic among MSM in the United Kingdom: quantifying the contributions to HIV transmission to better infoprm prevention initiatives. AIDS. 2015;29:339–49.

    PubMed  Google Scholar 

  10. Phillips AN, Cambiano V, Nakagawa F, Brown AE, Lampe F, Rodger A, et al. Increased HIV incidence in men who have sex with men despite high levels of ART-induced viral suppression: analysis of an extensively documented epidemic. PLoS One. 2013;8(2):15–6.

    Google Scholar 

  11. Gray RT, Prestage GP. Down I, Ghaus MH, Hoare a, Bradley J, et al. increased HIV testing will modestly reduce HIV incidence among gay men in NSW and would be acceptable if HIV testing becomes convenient. PLoS One. 2013;8(2):e55449.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Gokengin D, Geretti AM, Begovac J, Palfreeman A, Stevanovic M, Tarasenko O, et al. 2014 European guideline on HIV testing. Int J STD AIDS. 2014;25(10):695–704.

    Article  PubMed  Google Scholar 

  13. Bernard M. B, S. Michele O, Laura G. W, Berry B, Barbara G. W, Kelly E. W, et al. Laboratory testing for the diagnosis of HIV infection : updated recommendations [Internet]. Atlanta, GA; 2014 [cited 2015 Jul 21]. p. 68. Available from: http://stacks.cdc.gov/view/cdc/23447

  14. STIGMA Group. Australian Sexually Transmitted Infection & HIV Testing Guidelines 2014 for Asymptomatic Men Who Have Sex With Men [Internet]. Sydney NSW; 2014 [cited 2016 Feb 1]. Available from: http://stipu.nsw.gov.au/wp-content/uploads/STIGMA_Testing_Guidelines_Final_v5.pdf

  15. Wilkinson AL, El-Hayek C, Spelman T, Fairley C, Leslie D, Mcbryde E, et al. “ Seek, test, treat ” lessons from Australia : a study of HIV testing patterns from a cohort of men who have sex with men. J Acquir Immune Defic Syndr 2015;69(4):460–465.

  16. Wilkinson AL, El-Hayek C, Spelman T, Fairley CK, Leslie D, McBryde ES, et al. A “test and treat” prevention strategy in Australia requires innovative HIV testing models: a cohort study of repeat testing among “high-risk” men who have sex with men: table 1. Sex Transm Infect. 2016;92(6):464–6.

    Article  PubMed  Google Scholar 

  17. Conway DP, Holt M, Couldwell DL, Smith DE, Davies SC, Mcnulty A, et al. Barriers to HIV testing and characteristics associated with never testing among gay and bisexual men attending sexual health clinics in Sydney. J Int AIDS Soc. 2015;18:1–8.

    Article  Google Scholar 

  18. Prestage G, Brown G, Keen P. Barriers to HIV testing among Australian gay men. Sex Health. 2012:453–8.

  19. Ghijben P, Zavarsek S, Yong K, Ip F. Rapid point-of-care combined antigen / antibody HIV test to aid in the diagnosis of HIV infection MSAC application 1391. Canberra: Assessment Report; 2015.

    Google Scholar 

  20. Commonwealth of Australia. Health insurance act 1973. Canberra: Commonwealth of Australia; 1973. p. 1–577.

    Google Scholar 

  21. Knight V, Gale M, Guy R, Parkhill N, Holden J, Leeman C, et al. A novel time-limited pop-up HIV testing service for gay men in Sydney, Australia, attracts high-risk men. Sex Health. 2014;11(4):345–50.

    Article  PubMed  Google Scholar 

  22. Debattista J, Gibson A, Scott M, Kelly M. Use of HIV point-of-care testing within a Queensland clinical setting. Aust N Z J Public Health. 2015;39(2):196–7.

    Article  PubMed  Google Scholar 

  23. Keen P, Conway DP, Cunningham P, Mcnulty A, Couldwell DL, Davies SC, et al. Multi-centre field evaluation of the performance of the trinity biotech Uni-gold HIV 1 / 2 rapid test as a first-line screening assay for gay and bisexual men compared with 4th generation laboratory immunoassays. J Clin Virol Elsevier BV. 2017;86:46–51.

    Article  CAS  Google Scholar 

  24. Thornton A, Delpech V, Kall MM, Nardone AHIV. Testing in community settings in resource-rich countries: a systematic review of the evidence. HIV Med. 2012;13(7):416–26.

    Article  CAS  PubMed  Google Scholar 

  25. Pottie K, Medu O, Welch V, Dahal GP, Tyndall M, Rader T, et al. Effect of rapid HIV testing on HIV incidence and services in populations at high risk for HIV exposure: an equity-focused systematic review. BMJ Open. 2014;4(12):e006859.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Ryan KE, Wilkinson AL, Leitinger D, El-Hayek C, Ryan C, Pedrana A, et al. Characteristics of gay, bisexual and other men who have sex with men testing and retesting at Australia’s first shop-front rapid point-of-care HIV testing service. Sex Health. 2016:13–5.

  27. Trinity biotech. Trinity biotech Uni-Gold Recombigen HIV test package insert [Internet]. Bray, Ireland; 2014 [cited 2016 Jun 1]. p. 1–18. Available from: http://www.trinitybiotech.com/products/uni-gold-hiv/.

  28. Ryan K, Wilkinson A, Leitinger D, Brown G, Pedrana A, Hellard M, et al. Acceptability and impact of a community-based rapid HIV testing service in Victoria, 24 month end-trial report. Melbourne; 2015.

  29. Ryan K, Leitinger D, Pedrana A, Hellard ME, Stoové M. Acceptability and impact of a community-based rapid HIV testing service in Victoria; 12 month mid-trial report. Melbourne; 2014.

  30. Goller JL, Guy RJ, Gold J, Lim MSC, El-Hayek C, Stoove MA, et al. Establishing a linked sentinel surveillance system for blood-borne viruses and sexually transmissible infections : methods, system attributes and early findings. Sex Health. 2010;7:425–33.

    Article  PubMed  Google Scholar 

  31. Lorenc T, Marrero-Guillamón I, Llewellyn A, Aggleton P, Cooper C, Lehmann A, et al. HIV testing among men who have sex with men (MSM): systematic review of qualitative evidence. Health Educ Res. 2011;26(5):834–46.

    Article  PubMed  Google Scholar 

  32. Conway DP, Guy R, Davies SC, Couldwell DL, McNulty A, Smith DE, et al. Rapid HIV testing is highly acceptable and preferred among high-risk gay and bisexual men after implementation in Sydney sexual health clinics. PLoS One. 2015;10(4):e0123814.

    Article  PubMed  PubMed Central  Google Scholar 

  33. The Kirby Institute. HIV, viral hepatitis and sexually transmissible infections in Australia. Annual Surveillance Reports 2016 [Internet]. Sydney, NSW; 2016 [cited 2017 Jul 25]. p. Available from: https://kirby.unsw.edu.au/report/annual-surveillance-report-hiv-viral-hepatitis-stis-2016

  34. Ryan K, Powell S, Leitinger D, Stoové M. P09.19 results from a prevalence study of neisseria gonorrhoea and chlamydia trachomatis in a community-based, peer-led hiv testing service. Sex Transm infect. Brisbane. QLD. 2015;91(Suppl 2):A155.1–A155.

    Google Scholar 

  35. Ryan K, Wilkinson A, Locke P, Leitinger D, Pedrana A, Hellard M, et al. The test of time: an interrupted time series analysis of HIV testing following service changes at a community-based rapid HIV testing service in Melbourne, Australia. In: 9th IAS conference on HIV science (IAS 2017). Paris, France; 2017.

Download references

Acknowledgements

The authors thank all PRONTO! staff and clients who contributed to this study. The authors gratefully thank the contribution to this work of Victorian Operational Infrastructure Support Program received by the Burnet Institute.

Funding

The Victorian Department of Health and Human Services funds the evaluation of PRONTO! and ongoing surveillance projects within the Burnet Institute. KR is a recipient of an Australian Postgraduate Award; AW, AP, MH, and MS receive funding from the National Health & Medical Research Council.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available due to ongoing research conducted within the evaluation team but are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

The study was designed by AP, AW, DL, MH, MS. KR analysed and interpreted the findings with support from AP and MS. PL and DL provided site information on service implementation. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kathleen E. Ryan.

Ethics declarations

Ethics approval and consent to participate

The Alfred Hospital Ethics approved the evaluation of the RPOCT service (HREC 297/13) and use of the test device in a clinical trial (261/13). Inclusion of the service as a site in the sentinel surveillance system was approved by the Victorian Department of Health Ethics Committee (52/05).

For clients completing the behavioural sentinel surveillance survey, consent is implied with completion of the survey. For clients completing the evaluation surveys and participating in any FGDs, all participants completed a participant’s informed consent form prior to participation.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ryan, K.E., Pedrana, A., Leitinger, D. et al. Trial and error: evaluating and refining a community model of HIV testing in Australia. BMC Health Serv Res 17, 692 (2017). https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-017-2635-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-017-2635-z

Keywords