Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Going virtual: youth attitudes toward and experiences of virtual mental health and substance use services during the COVID-19 pandemic

BMC Health Services Research volume 21, Article number: 340 (2021) Cite this article

Abstract

Background

During the COVID-19 pandemic, youth mental health and substance use services rapidly moved to virtual modalities to meet social distancing requirements. It is important to understand youth attitudes toward and experience of virtual services.

Objective

This study examined the attitudes toward and experiences of virtual mental health and substance use services among youth drawn from clinical and non-clinical samples.

Method

Four hundred nine youth completed a survey including questions about their attitudes toward and experience of virtual services. The survey included quantitative and open-ended questions on virtual care, as well as a mental health and substance use screener.

Results

The majority of youth with mental health or substance use challenges would be willing to consider individual virtual services, but fewer would consider group virtual services. However, many have not received virtual services. Youth are interested in accessing a wide variety of virtual services and other supportive wellness services. Advantages and disadvantages of virtual services are discussed, including accessibility benefits and technological barriers.

Discussion

As youth mental health and substance use services have rapidly gone virtual during the COVID-19 pandemic, it is essential that we hear the perspectives of youth to promote service utilization among those in need. Diverse, accessible, technologically stable virtual services are required to meet the needs of different youth, possibly with in-person options for some youth. Future research, engaging youth in the research process, is needed to evaluate the efficacy of virtual services to plan for the sustainability of some virtual service gains beyond the pandemic period.

Peer Review reports

Highlights

  • Youth mental health and substance use services moved rapidly to online service delivery modalities due to the COVID-19 pandemic.

  • Understanding youth perspectives on virtual service delivery is essential.

  • Most youth are willing to use individual virtual services, but fewer are willing to use group virtual services.

  • Virtual services have several advantages, such as accessibility, but also disadvantages, such as technological barriers.

  • Diverse, accessible, technologically stable virtual services are required to meet the needs of different youth.

Background

The COVID-19 pandemic has transformed the way mental health and substance use (MHSU) services are delivered around the world. Services moved rapidly into virtual formats, with little opportunity for thorough planning, to comply with social distancing requirements [1]. Individuals who were previously connected with in-person care have had to rapidly shift in the way they access services, while those who are newly accessing care have had to navigate a new virtual service system to access services for the first time.

Adolescence and emerging adulthood is a key developmental period for the emergence of MHSU challenges [2,3,4]. In Canada, about one in five youth had MHSU disorders prior to the COVID-19 pandemic [5]. This is a key developmental period, marked by developmental milestones such as progress and transitions in education, labor force integration, occupational development, social relationships, and autonomy [6]. However, public health pandemic guidelines have interrupted many milestones for youth. For example, educational progress and experiences, employment, and social interaction have been disrupted, which may constitute risk factors for emerging or worsening MHSU challenges. Indeed, youth are experiencing mental health challenges during the pandemic [7,8,9,10,11,12], including heighted symptoms of internalizing mental health challenges [7, 13], post-traumatic stress disorder [10, 13], and general stress and distress [10,11,12]. Behaviors associated with the maintenance of positive mental and physical health, such as physical activity and sleep, have also been disrupted for many youth [12, 14, 15].

Although the rates of MHSU service use have been increasing in recent years [16], many youth in need do not access services [17, 18]. Research conducted prior to COVID-19 has highlighted many service access barriers, such as long waitlists, uncoordinated services, age-based transition challenges, and stigma [19,20,21,22,23]. System transformation initiatives have been underway to address many of these barriers by creating integrated, youth-friendly service delivery models [24, 25]. However, none of those initiatives foresaw the rapid and systemic shift toward virtual services that occurred with the onset of the COVID-19 pandemic.

Delivering MHSU services virtually is not a new idea. A wide variety of virtual modalities of service delivery have been developed and tested over the past decades [26,27,28]. Some efficacy has been found, with benefits such as easier accessibility, greater flexibility, lower cost, and reduced stigma [26,27,28]. While these findings set the stage for transitioning to virtual services with optimism, the urgent nature of COVID-19 pandemic did not provide time to conduct reviews of evidence-based virtual service delivery models and paced implementation according to the implementation science literature [29]. This rapid shift in service modality provides a time-sensitive opportunity to generate new evidence to better understand virtual service delivery [30,31,32].

The Margaret and Wallace McCain Centre for Child, Youth and Family Mental Health at the Centre for Addiction and Mental Health works from a stakeholder-engaged standpoint to advance research with real-world implications for youth, caregivers, and the service delivery system [33]. Our community mental health partners identified virtual service acceptability among youth during COVID-19 as a priority area of inquiry. Specifically, youth-serving organizations wanted to hear how willing youth are to consider virtual services, what kinds of services they want, what their experience of virtual services has been, and why some youth are not willing to access virtual services. When developing new services, it is essential to understand service users’ experiences of and perspectives on these services [34, 35]. To promote access, services must be designed and delivered in manners that are responsive to service users’ preferences [30, 32].

Given the rapidity with which the transition to virtual models of service delivery occurred due to the physical distancing requirements of the COVID-19 pandemic, without the time required to rigorously follow the evidence base with regard to virtual service design and implementation, it is essential that we examine the success of virtual service delivery from diverse standpoints. An emerging literature has begun describing the transition to virtual care during the pandemic and discussing the successes and challenges [36,37,38,39,40]. However, there is a paucity of information on patient experiences in general, and particularly on the experiences of youth receiving virtual MHSU care during the pandemic. This study builds on pre-pandemic research on virtual service delivery and emerging literature on virtual services during the pandemic by examining youth preferences for and experiences of MHSU services delivered virtually during COVID-19 pandemic.

Objective

This paper examines youth preferences for and experiences of virtual MHSU services during the COVID-19 pandemic.

Method

As part of a larger longitudinal study examining youth MHSU during the COVID-19 pandemic in clinical and non-clinical samples, this paper analyzes data from the August 2020 wave of data collection. Youth were defined as young people aged 14 to 29 [41].

Participants

Four hundred nine participants completed the survey, including 164 drawn from a clinical sample and 245 from a non-clinical sample, representing 66% of the original sample. Details on the participant pools are described in Hawke et al. [7].

Procedure

Participants received an email message with a web link taking them to an online survey on REDCap software [42], specifying that the study was about COVID-19 and mental health. After electronic written informed consent, youth completed a 20–30 min survey about MHSU experiences during the COVID-19 pandemic. Repeat survey questions were not carried out. As per our Research Ethics Board approval, consent was sought from all participants regardless of age, and parental consent was not sought. Data collection took place between August 7 and August 30, 2020, i.e., approximately 5 months after COVID-19 was declared a pandemic by the World Health Organization [43] and a state of emergency was declared provincially [44], and therefore about 5 months after youth MHSU services began moving to virtual modalities. Centre for Addiction and Mental Health (CAMH) Research Ethics Board approval was obtained.

Youth engagement

Youth engagement is a core component of this study. As part of the CAMH McCain Centre Youth Engagement Initiative [45], youth co-researchers supported the study. In addition to regular consultations with youth during survey development, results were brought to youth co-researchers for discussion and interpretation purposes. The feedback of the youth co-researchers is presented in the Discussion section.

Measures

Questions were developed by the research team, in consultation with local service providing agencies, to understand youth virtual MHSU service experiences. These were embedded into the larger survey. Youth co-researchers also collaborated on survey development, in line with the McCain youth engagement model [45]. Participants were asked about their service experiences, including whether they would consider and had experienced virtual MHSU services individually and, separately, in group format, and if so, what type of technology they had used. Based on their responses, they provided qualitative feedback on the types of services they would be interested in, why they might not consider such services, what the optimal features would be, and what the advantages and disadvantages of virtual services were.

The GAIN-Short Screener (GAIN-SS) is a self-report screener that identifies the likelihood of meeting diagnostic criteria for internalizing, externalizing and substance use disorders, as well as crime/violence issues [46]. Items are rated on a time-based scale for each symptom, ranging from zero (never) to four (past month). Three or more items endorsed at the past-month level suggest a high likelihood of meeting diagnostic criteria or requiring services in that area [46, 47]. The GAIN-SS is validated among youth [46].

Analyses

Participants were included in the sample if they completed up to the end of the section querying about virtual services. Missing data was minimal, and frequencies are reported. The GAIN-SS Crime/Violence scale was not analyzed with service use preferences, given very low endorsement. Frequencies and chi-square tests were conducted to describe the sample and their virtual service experiences. After examining the demographics by clinical and non-clinical sample of origin, the two samples were merged to understand willingness to consider using virtual services and experience based on the presence of a MHSU concern. Willingness to consider and experience were then further examined across sample by age group (< 20, N = 134; vs. 20+, N = 271, 4 missing age) and pre-COVID-19 connection with services as reported by the participants at our first wave of data collection. The quantitative analysis was performed using the IBM SPSS statistics software (Version 25) [48].

A ‘conventional’ content analysis was conducted to analyze the qualitative data [49]. The limited research on youth perspectives of virtual care services during a pandemic made this approach most appropriate in analyzing the views of participants. The content analysis was performed by one of the authors (NYS), a female research analyst with a master’s degree in public health and training in health promotion. During the open coding process, a series of codes were identified, defined, and derived from data drawn from responses to each question [49]. In order to meaningfully group the codes, they were organized into categories based on similarities and differences. Confirmability of the results was established through team debriefings with NYS and the first author (LDH), a female scientist with a doctoral degree in psychology, to discuss the emergent categories. This process was repeated for each category until a team consensus was met. The qualitative analysis was performed on Microsoft Office Excel.

Results

Table 1 presents the demographic and clinical characteristics of participants by sample. The non-clinical sample consisted of 245 participants aged M = 20.88 years (SD = 1.39). The clinical sample included 164 participants aged M = 20.25 (SD = 3.04), t(206) = 2.501, p = .013. Age ranged from 15 to 28 years. The clinical sample consisted of marginally more girls/young women than boys/young men, χ2(1) = 3.987, p = .046, φ = .101), and participants who were less likely to be employed prior to COVID-19 χ2(1) = 12.776, p < .001, φ = .183). The clinical sample was more likely to screen positive for internalizing, externalizing, or substance use disorders (ps < .001). There were no significant differences between samples regarding ethnicity, or Canadian-born, English speaking, or student status (ps > .10). While the univariate majority of the sample was a girl/young woman, Caucasian, student, and born in Canada, with English as a first language, this multivariate profile accounted for 50 (12.2%) participants.

Table 1 Demographic and clinical characteristic of participants by sample
Full size table

Willingness to consider virtual services

The majority of participants screening positive for internalizing disorders (72.1%), externalizing disorders (62.7%) or substance use disorders (78.9%) would be willing to consider individual virtual services, but a minority would consider group virtual services (< 40% in each group, Fig. 1). Based on age (< 20, 20+), there was no difference in willingness for individual (62.8% for age < 20, 55.6% for age 20+, χ2(1) = 1.824, p = .177, φ = .068) or group virtual services (27.3% for age < 20, 29.3% for age 20+, χ2 = 0.158, p = .691, φ = .020). Among participants screening positive for at least one domain on the GAIN-SS, those who were already connected with MHSU services prior to the pandemic were significantly more likely to consider individual virtual services (77.4%) than those who were not already connected (63.0%, χ2(1) = 5.462, p = .019, φ = −.156). For group virtual services, these rates were 39.4 and 34.5% respectively, χ2(1) = 0.575, p = .448 φ = −.051.

Fig. 1
figure 1

Proportion of participants who would consider and who have experienced virtual mental health and substance use services, among those who screen positive for an internalizing, externalizing or substance use disorder

Full size image

Experience of virtual services

39.8% of youth screening positive for an internalizing disorder have experienced individual virtual services, while 41.2% of those screening positive for an externalizing disorder and 53.8% of those screening positive for a substance use disorder have experienced individual virtual services (Fig. 1). Few youth screening positive in any domain have received group virtual services.

Among participants who have experienced individual virtual services, video format was reported by 70.2% of participants, phone by 61.2%, and chat by 18.2%. For group virtual services, video format was reported by 80.8% of participants, phone by 23.1%, and chat by 23.1%. Youth qualitatively described that they were currently accessing virtual counselling and therapy, medical and psychiatric services, and supplemental supports.

Among the 121 youth receiving individual virtual services, 86 (71.1%) screen positive for concerns in at least one domain on the GAIN-SS from among internalizing, externalizing and substance use disorders. Among the 26 youth receiving group virtual services, 18 (69.2%) screen positive in at least one domain. Based on age, there was no difference in whether youth had experienced group virtual services (4.7% for < 20, 7.4% for 20+, χ2 = 1.107, p = .293, φ = −.053), although younger youth were marginally more likely to have experienced individual virtual services (37.2% for age < 20, 27.0% for age 20+, χ2 = 4.321, p = .038, φ = .104).

Perception of change

Among 144 participants who reported that MHSU services were in place for them prior to the pandemic, 67 (46.5%) reported that their services have changed for the worse during the pandemic. Another 25 (17.4%) considered their services to have not changed either for the better or for the worse. For 25 (17.4%), services are perceived to have changed for the better.

Kinds of virtual activities

Qualitative findings are presented in Table 2. Participants expressed a desire for various forms of counselling or therapy and mindfulness/meditation, online supportive activities such as fitness, nutrition, and educational activities, as well as awareness initiatives. Some further pointed to the wish for recreational and fun activities.

Table 2 Summary of qualitative findings with exemplar quotes and associated codes
Full size table

Optimal features of virtual care

For individual virtual care, video calls received the largest proportion of responses, followed by phone or voice calls and text or chat-based support. Some youth were accepting of any format. Technical features included smooth audio and video, good internet connection and lighting, good camera quality, a mute button and the ability to turn off the camera and share files. Youth wanted clear communication in a non-judgemental environment. Many youth valued anonymity and privacy. They wanted services to be free, continuous, convenient and accessible in terms of booking and availability.

In terms of group virtual services, the largest proportion of participants wanted video calls, followed by phone and chat/text. Technical features such as a mute button, good camera quality, the ability to turn off the camera and share files were also appreciated. Some youth specifically reported wanting to access group services, while others reported a preference for one-on-one services.

Reasons for not considering

Participants who were not willing to consider individual virtual services expressed a preference for in-person services, mostly for human connectedness and more personal care. Others expressed anxiety or discomfort with using virtual platforms, and security, privacy (e.g., living with at home), and technical concerns (e.g., poor internet connection). Many would not consider virtual services because they did not need them or already had supports in place. These findings were consistent across group virtual services, with one added finding for group virtual services: youth expressed that they preferred individual services.

Advantages and disadvantages of individual of virtual services

Participants who had received individual virtual services qualitatively reported service accessibility advantages including convenience, easy scheduling, and the lack of travel time. They appreciated being able to connect with a professional safely in a comfortable, socially distanced manner during COVID-19, and appreciated seeing the service provider’s face. Some participants further reported that virtual individual care was good for communication, an uncomplicated process, and helped their mental health.

Expressed disadvantages of individual virtual care included discomfort and problematic interaction factors: it was less personal and awkward, and it was difficult to read body language, establish rapport, and discuss sensitive issues. Participants mentioned privacy concerns and noted greater distractions and interruptions, with more challenges focusing. They expressed technological issues, including a poor internet connection and security concerns. Many did not like that it was not in person. Some further pointed to administrative challenges around scheduling.

Advantages and disadvantages of group virtual services

Participants who had received group virtual services qualitatively mentioned accessibility as an advantage, including convenience and simplicity of use. They appreciated the human connection. Some further appreciated the lack of travel time, comfort of remote services, and flexible scheduling. They appreciated the ability to receive care during the pandemic. Disadvantages were less reported on, although participants did state that there was less human connection, it was less personal, and it was harder to focus. They further noted privacy concerns and technological limitations, such as a poor internet connection. Some mentioned the fact that it is not in person as a disadvantage.

Discussion

This study examined youth attitudes toward and experiences of virtual services for MHSU during the COVID-19 pandemic, providing important youth perspectives on virtual MHSU services during an unprecedented rapid move toward virtual service delivery. The majority of youth screening positive for MHSU challenges would consider using individual virtual MHSU services, but fewer are willing to use group services. While some have experienced such services, using a variety of modalities, many youth with MHSU challenges have not. Overall, virtual service delivery has a number of advantages, but also multiple disadvantages.

Previous studies have shown that youth are willing to use virtual MHSU services and that some prefer virtual services [50]. Similar advantages and disadvantages of virtual care have been reported by youth and clinicians alike [26, 50,51,52,53,54,55]. For example, accessibility benefits have been identified [26, 50, 55], as has the value for interpersonal connectedness in virtual services [54]. Confidentiality concerns have been previously expressed [56,57,58,59], particularly when accessing services in the home [58]. Texting or chatting modalities might reduce this challenge for some youth [58]. Some youth expressed discomfort regarding virtual services as a whole; it may be that in-person services are required for a subset of youth, or it may be possible to work with these youth to understand how to increase comfort with virtual services. Importantly, different youth have different preferences, and diversity of service options should therefore be available.

The digital determinants of health are more important than ever as they appear to be exacerbating health problems during COVID-19 [60, 61]. Concerns have been raised around inequitable access to digital health services [32]. Although remote service provides physically distanced care during a pandemic, future research should consider strategies that may address the health inequities exacerbated by the shift to virtual MHSU services, for those without adequate technology and a safe, private space to use it.

From a stakeholder-engaged perspective, we worked directly with youth members of the McCain Centre Youth Engagement Initiative (YEI) [45] to develop the study and interpret the findings. Youth staff agreed that the findings resonated with them and the perspectives they are hearing from other Canadian youth. They highlighted the willingness to consider virtual services among youth who are already connected to MHSU services, but less so among those who are not already connected to services. They emphasized accessibility benefits and hoped that these benefits would persist after the pandemic. They also noted concerns around in-home confidentiality and technological barriers, especially for youth without easy access to technology. They added that cameras make some youth self-conscious and can provide a very personal look into a youth’s private space. They further indicated that virtual care does not provide a needed psychological separation between the therapeutic environment and the home environment. The youth importantly noted that youth are a heterogeneous group, emphasizing the importance of offering a variety of services and modalities to meet the needs of different youth.

While the move to virtual services was conducted as an urgent response to a public health emergency, it is likely that some of the changes will be sustained [53]. As a new paradigm of virtual MHSU service delivery emerges, it will be essential to rigorously evaluate virtual interventions for efficacy and effectiveness, to understand for whom virtual care has benefits, and examine virtual interventions that can be implemented effectively into existing clinical service systems. Adapting virtual services requires a clear understanding of youth experiences and preferences [62]. Sustained efforts to ensure the diverse needs of youth are met are thus essential in the era of digital health.

Limitations

The survey was limited to Ontario, Canada; a more diverse, representative sample collected over a broader geographical area would increase generalizability. Qualitative findings are derived from short survey answers rather than semi-structured interviews and are therefore limited in breadth. Since the survey was conducted online, it missed youth who do not use the internet regularly. Response rates may be differentially associated with level of MHSU challenges. Future research should connect with youth who are not regular internet users or who have limited technology access to understand their perspectives on virtual services, perhaps including telephone alternatives, and on possible means of mitigating technological barriers.

Conclusions

As the system continues expands on virtual models of MHSU service delivery, it is essential that researchers, service providers, and interventionists engage directly with youth, caregivers, and service providers [33, 34, 45, 63, 64] to understand their perspectives and experiences. While the majority of youth are willing to consider virtual services, many youth have not received virtual services despite willingness and clinical need. Diverse, identifiable, accessible, technologically stable virtual services are required to meet the needs of different youth, possibly with in-person options for some youth. Future research, engaging youth in the research process, is needed to evaluate the efficacy of the virtual service modalities.

Availability of data and materials

Data are available upon reasonable request to the corresponding author (Joanna.Henderson@camh.ca), with Research Ethics Board approval.

Abbreviations

MHSU:

Mental Health and Substance Use

GAIN-SS:

GAIN Short Screener

References

  1. Community-based measures to mitigate the spread of coronavirus disease (COVID-19) in Canada [https://www.canada.ca/en/public-health/services/diseases/2019-novel-coronavirus-infection/health-professionals/public-health-measures-mitigate-covid-19.html#_Physical_distancing].

  2. Kessler RC, Amminger GP, Aguilar-Gaxiola S, Alonso J, Lee S, Ustun TB. Age of onset of mental disorders: a review of recent literature. Curr Opinion in Psychiatry. 2007;20(4):359–64. https://0-doi-org.brum.beds.ac.uk/10.1097/YCO.0b013e32816ebc8c.

    Article  Google Scholar 

  3. Boak A, Elton-Marshall T, Mann RE, Hamilton HA. Drug use among Ontario students, 1977–2019: detailed findings from the Ontario student drug use and health survey (OSDUHS). In. Toronto: Centre for Addiction and Mental Health; 2020. http://www.camh.ca/-/media/files/pdf---osduhs/summary_drugusereport_2019osduhs-pdf.pdf.

  4. Young SE, Corley RP, Stallings MC, Rhee SH, Crowley TJ, Hewitt JK. Substance use, abuse and dependence in adolescence: prevalence, symptom profiles and correlates. Drug Alcohol Depend. 2002;68(3):309–22. https://0-doi-org.brum.beds.ac.uk/10.1016/S0376-8716(02)00225-9.

    Article  CAS  PubMed  Google Scholar 

  5. Boyle MH, Georgiades K: Disorders of childhood and adolescence. In: Mental disorders in Canada: An epidemiological perspective. Cairney J, Streiner D. Toronto: University of Toronto Press; 2009.

  6. Arnett JJ. Emerging adulthood: the winding road from the late teens through the twenties. New York: Oxford University Press; 2004.

    Google Scholar 

  7. Hawke LD, Barbic SP, Voineskos A, Szatmari P, Cleverley K, Hayes E, et al. Impacts of COVID-19 on youth mental health, substance use, and well-being: a rapid survey of clinical and community samples. Can J Psychiatr. 2020;65(10):701–9. https://0-doi-org.brum.beds.ac.uk/10.1177/0706743720940562.

    Article  Google Scholar 

  8. Hawke LD, Hayes E, Darnay K, Henderson J. Mental health among transgender and gender diverse youth: an exploration of effects during the COVID-19 pandemic. Psychology of Sexual Orientation and Gender Diversity. Advance online publication. 2021. https://0-doi-org.brum.beds.ac.uk/10.1037/sgd0000467.

  9. Hawke LD, Monga S, Korczak D, Hayes E, Relihan J, Darnay K, et al. Impacts of the COVID-19 pandemic on youth mental health among youth with physical health challenges. Early Interv Psychiatry. 2020. https://0-doi-org.brum.beds.ac.uk/10.1111/eip.13052.

  10. Liang L, Ren H, Cao R, Hu Y, Qin Z, Li C, et al. The effect of COVID-19 on youth mental health. Psychiatr Q. 2020;91(3):841–52. https://0-doi-org.brum.beds.ac.uk/10.1007/s11126-020-09744-3.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Shanahan L, Steinhoff A, Bechtiger L, Murray AL, Nivette A, Hepp U, et al. Emotional distress in young adults during the COVID-19 pandemic: evidence of risk and resilience from a longitudinal cohort study. Psychol Med. 2020:1–10. https://0-doi-org.brum.beds.ac.uk/10.1017/S003329172000241X.

  12. Son C, Hegde S, Smith A, Wang X, Sasangohar F. Effects of COVID-19 on college students’ mental health in the United States: interview survey study. J Med Internet Res. 2020;22(9):e21279. https://0-doi-org.brum.beds.ac.uk/10.2196/21279.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Liu CH, Zhang E, Wong GTF, Hyun S, Hahm HC. Factors associated with depression, anxiety, and PTSD symptomatology during the COVID-19 pandemic: Clinical implications for U.S. young adult mental health. Psychiatry Res. 2020;290:113172. https://0-doi-org.brum.beds.ac.uk/10.1016/j.psychres.2020.113172.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Moore SA, Faulkner G, Rhodes RE, Brussoni M, Chulak-Bozzer T, Ferguson LJ, et al. Impact of the COVID-19 virus outbreak on movement and play behaviours of Canadian children and youth: a national survey. Int J Behav Nutr Phys Act. 2020;17(1):85. https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-020-00987-8.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Zheng C, Huang WY, Sheridan S, Sit CH, Chen XK, Wong SH. Covid-19 pandemic brings a sedentary lifestyle in young adults: a cross-sectional and longitudinal study. Int J Environ Res Public Health. 2020;17:17. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17176035.

  16. Gandhi S, Chiu M, Lam K, Cairney JC, Guttmann A, Kurdyak P. Mental health service use among children and youth in Ontario: population-based trends over time. Can J Psychiatr. 2016;61(2):119–24. https://0-doi-org.brum.beds.ac.uk/10.1177/0706743715621254.

    Article  Google Scholar 

  17. Mojtabai R, Jorm AF. Trends in psychological distress, depressive episodes and mental health treatment-seeking in the United States: 2001–2012. J Affect Disord. 2015;174:556–61. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jad.2014.12.039.

    Article  PubMed  Google Scholar 

  18. Mackenzie CS, Reynolds K, Cairney J, Streiner DL, Sareen J. Disorder-specific mental health service use for mood and anxiety disorders: associations with age, sex, and psychiatric comorbidity. Depress Anxiety. 2012;29(3):234–42. https://0-doi-org.brum.beds.ac.uk/10.1002/da.20911.

    Article  PubMed  Google Scholar 

  19. Moroz N, Moroz I, Slovinec D'Angelo M. Mental health services in Canada: barriers and cost-effective solutions to increase access. Healthc Manage Forum. 2020;6:28. https://0-doi-org.brum.beds.ac.uk/10.1177/0840470420933911.

  20. Brown A, Rice SM, Rickwood DJ, Parker AG. Systematic review of barriers and facilitators to accessing and engaging with mental health care among at-risk young people. Asia Pac Psychiatry. 2016;8(1):3–22. https://0-doi-org.brum.beds.ac.uk/10.1111/appy.12199.

    Article  PubMed  Google Scholar 

  21. Reardon T, Harvey K, Baranowska M, O’Brien D, Smith L, Creswell C. What do parents perceive are the barriers and facilitators to accessing psychological treatment for mental health problems in children and adolescents? A systematic review of qualitative and quantitative studies. Eur Child Adolesc Psychiatry. 2017;26(6):623–47. https://0-doi-org.brum.beds.ac.uk/10.1007/s00787-016-0930-6.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Hawke LD, Mehra K, Settipani C, Relihan J, Darnay K, Chaim G, et al. What makes mental health and substance use services youth friendly? A scoping review of literature. BMC Health Serv Res. 2019;19(1):257. https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-019-4066-5.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Paul M, Street C, Wheeler N, Singh SP. Transition to adult services for young people with mental health needs: a systematic review. Clin Child Psychol Psychiatry. 2015;20(3):436–57. https://0-doi-org.brum.beds.ac.uk/10.1177/1359104514526603.

    Article  PubMed  Google Scholar 

  24. Settipani CA, Hawke LD, Cleverley K, Chaim G, Cheung A, Mehra K, et al. Key attributes of integrated community-based youth service hubs for mental health: a scoping review. Int J Ment Heal Syst. 2019;13(1):52. https://0-doi-org.brum.beds.ac.uk/10.1186/s13033-019-0306-7.

    Article  Google Scholar 

  25. Hetrick SE, Bailey AP, Smith KE, Malla A, Mathias S, Singh SP, et al. Integrated (one-stop shop) youth health care: best available evidence and future directions. Med J Aust. 2017;207(10):S5–s18. https://0-doi-org.brum.beds.ac.uk/10.5694/mja17.00694.

    Article  PubMed  Google Scholar 

  26. Kauer SD, Mangan C, Sanci L. Do online mental health services improve help-seeking for young people? A systematic review. J Med Internet Res. 2014;16(3):e66. https://0-doi-org.brum.beds.ac.uk/10.2196/jmir.3103.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Lal S, Adair CE. E-mental health: a rapid review of the literature. Psychiatr Serv. 2014;65(1):24–32. https://0-doi-org.brum.beds.ac.uk/10.1176/appi.ps.201300009.

    Article  PubMed  Google Scholar 

  28. Aboujaoude E, Salame W. Technology at the Service of pediatric mental health: review and assessment. J Pediatr. 2016;171:20–4. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jpeds.2015.12.009.

    Article  PubMed  Google Scholar 

  29. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://0-doi-org.brum.beds.ac.uk/10.1186/1748-5908-4-50.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Weinberg H. Online group psychotherapy: challenges and possibilities during COVID-19—a practice review. Group Dyn. 2020;24(3):201–11. https://0-doi-org.brum.beds.ac.uk/10.1037/gdn0000140.

    Article  Google Scholar 

  31. Malla A, Joober R. COVID-19 and the future with digital mental health: need for attention to complexities. Can J Psychiatr. 2021;66(1):14–16.https://0-doi-org.brum.beds.ac.uk/10.1177/0706743720957824.

  32. Badawy SM, Radovic A. Digital approaches to remote pediatric health care delivery during the COVID-19 pandemic: existing evidence and a call for further research. JMIR Pediatr Parent. 2020;3(1):e20049. https://0-doi-org.brum.beds.ac.uk/10.2196/20049.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Henderson J, Brownlie E, Rosenkranz S, Chaim G, Beitchman J. Integrated knowledge translation and grant development: addressing the research practice gap through stakeholder-informed research. J Can Acad Child Adolesc Psychiatry. 2013;22(4):268–74.

    PubMed  PubMed Central  Google Scholar 

  34. Brownlie EB, Chaim G, Heffernan O, Herzog T, Henderson J. Youth services system review: moving from knowledge gathering to implementation through collaboration, youth engagement, and exploring local community needs. Can J Commun Ment Health. 2017;36(2):133–49. https://0-doi-org.brum.beds.ac.uk/10.7870/cjcmh-2017-018.

    Article  Google Scholar 

  35. Harkness J. Patient involvement: a vital principle for patient-centred health care. World Hosp Health Serv J. 2005;41(2):12–6 40-13.

    Google Scholar 

  36. Kavoor AR, Chakravarthy K, John T. Remote consultations in the era of COVID-19 pandemic: preliminary experience in a regional Australian public acute mental health care setting. Asian J Psychiatr. 2020;51:102074. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ajp.2020.102074.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Percudani M, Corradin M, Moreno M, Indelicato A, Vita A. Mental health Services in Lombardy during COVID-19 outbreak. Psychiatry Res. 2020;288:112980. https://0-doi-org.brum.beds.ac.uk/10.1016/j.psychres.2020.112980.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Wright JH, Caudill R. Remote treatment delivery in response to the COVID-19 pandemic. Psychother Psychosom. 2020;89(3):130–2. https://0-doi-org.brum.beds.ac.uk/10.1159/000507376.

    Article  PubMed  Google Scholar 

  39. Jobes DA, Crumlish JA, Evans AD. The COVID-19 pandemic and treating suicidal risk: the telepsychotherapy use of CAMS. J Psychother Integr. 2020;30(2):226–37. https://0-doi-org.brum.beds.ac.uk/10.1037/int0000208.

    Article  Google Scholar 

  40. Nicholas J, Bell I, Thompson A, Valentine L, Simsir P, Sheppard H, et al. Implementation lessons from the transition to telehealth during COVID-19: a survey of clinicians and young people from youth mental health services. Psychiatry Res. 2021;2:113848. https://0-doi-org.brum.beds.ac.uk/10.1016/j.psychres.2021.113848.

  41. A portrait of Canadian youth: March 2019 updates [https://www150.statcan.gc.ca/n1/pub/11-631-x/11-631-x2019003-eng.htm].

  42. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jbi.2008.08.010.

    Article  PubMed  Google Scholar 

  43. WHO Timeline - COVID-19 [https://www.who.int/news/item/29-06-2020-covidtimeline].

  44. Ontario enacts declaration of emergency to protect the public [https://news.ontario.ca/opo/en/2020/03/ontario-enacts-declaration-of-emergency-to-protect-the-public.html].

  45. Heffernan OS, Herzog TM, Schiralli JE, Hawke LD, Chaim G, Henderson JL. Implementation of a youth-adult partnership model in youth mental health systems research: challenges and successes. Health Expect. 2017;20(6):1183–8. https://0-doi-org.brum.beds.ac.uk/10.1111/hex.12554.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Dennis ML, Chan YF, Funk RR. Development and validation of the GAIN short screener (GSS) for internalizing, externalizing and substance use disorders and crime/violence problems among adolescents and adults. Am J Addict. 2006;15(Suppl 1):80–91. https://0-doi-org.brum.beds.ac.uk/10.1080/10550490601006055.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Dennis ML, Feeney T, Hanes Stevens LV, Bedoya L. Global appraisal of individual needs–short screener (GAIN-SS):administration and scoring manual version 2.0.3. In. Bloomington: Chestnut Health Systems; 2008.

    Google Scholar 

  48. IBM Corp. IBM SPSS statistics for windows, version 25.0. In. Armonk: IBM Corp; 2017.

    Google Scholar 

  49. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. https://0-doi-org.brum.beds.ac.uk/10.1177/1049732305276687.

    Article  PubMed  Google Scholar 

  50. Sweeney GM, Donovan CL, March S, Forbes Y. Logging into therapy: adolescent perceptions of online therapies for mental health problems. Internet Interv. 2019;15:93–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.invent.2016.12.001.

    Article  PubMed  Google Scholar 

  51. Chen JA, Chung WJ, Young SK, Tuttle MC, Collins MB, Darghouth SL, et al. COVID-19 and telepsychiatry: early outpatient experiences and implications for the future. Gen Hosp Psychiatry. 2020;66:89–95. https://0-doi-org.brum.beds.ac.uk/10.1016/j.genhosppsych.2020.07.002.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Feijt M, de Kort Y, Bongers I, Bierbooms J, Westerink J, Ijsselsteijn W. Mental health care goes online: practitioners’ experiences of providing mental health care during the covid-19 pandemic. Cyberpsychol Behav Soc Netw. 2020;23(12):860. https://0-doi-org.brum.beds.ac.uk/10.1089/cyber.2020.0370.

  53. Bierbooms JJPA, van Haaren M, Ijsselsteijn WA, de Kort YAW, Feijt M, Bongers IMB. Integration of online treatment into the “new Normal” in mental health Care in Post–COVID-19 times: exploratory qualitative study. JMIR Formative Res. 2020;4(10):e21344. https://0-doi-org.brum.beds.ac.uk/10.2196/21344.

    Article  Google Scholar 

  54. Liverpool S, Mota CP, Sales CMD, Čuš A, Carletto S, Hancheva C, et al. Engaging children and Young people in digital mental health interventions: systematic review of modes of delivery, facilitators, and barriers. J Med Internet Res. 2020;22(6):e16317. https://0-doi-org.brum.beds.ac.uk/10.2196/16317.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Navarro P, Bambling M, Sheffield J, Edirippulige S. Exploring young people's perceptions of the effectiveness of text-based online counseling: mixed methods pilot study. JMIR Mental Health. 2019;6(7):e13152. https://0-doi-org.brum.beds.ac.uk/10.2196/13152.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Hubley S, Lynch SB, Schneck C, Thomas M, Shore J. Review of key telepsychiatry outcomes. World J Psychiatry. 2016;6(2):269–82. https://0-doi-org.brum.beds.ac.uk/10.5498/wjp.v6.i2.269.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Myers K, Valentine J, Morganthaler R, Melzer S. Telepsychiatry with incarcerated youth. J Adolesc Health. 2006;38(6):643–8. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jadohealth.2005.07.015.

    Article  PubMed  Google Scholar 

  58. Fish JN, McInroy LB, Paceley MS, Williams ND, Henderson S, Levine DS, et al. “I’m Kinda stuck at home with unsupportive parents right now”: LGBTQ Youths’ experiences with COVID-19 and the importance of online support. J Adolesc Health. 2020;67(3):450–2. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jadohealth.2020.06.002.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Boydell KM, Volpe T, Pignatiello A. A qualitative study of young people’s perspectives on receiving psychiatric services via televideo. J Can Acad Child Adolesc Psychiatry. 2010;19(1):5–11.

    PubMed  PubMed Central  Google Scholar 

  60. Crawford A, Serhal E. Digital health equity and COVID-19: the innovation curve cannot reinforce the social gradient of health. J Med Internet Res. 2020;22(6):e19361. https://0-doi-org.brum.beds.ac.uk/10.2196/19361.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Rashid M. Virtual inequity: do virtual visits risk leaving some people behind? In: Can Fam Physician; 2020.

    Google Scholar 

  62. Singh I, Pavarini G, Juma D, Farmer M. Multidisciplinary research priorities for the COVID-19 pandemic. Lancet Psychiatry. 2020;7(7):e36. https://0-doi-org.brum.beds.ac.uk/10.1016/S2215-0366(20)30228-5.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Mitchell PF. Evidence-based practice in real-world services for young people with complex needs: new opportunities suggested by recent implementation science. Child Youth Serv Rev. 2011;33(2):207–16. https://0-doi-org.brum.beds.ac.uk/10.1016/j.childyouth.2010.10.003.

    Article  Google Scholar 

  64. Harkness J. Patient involvement: a vital principle for patient-centred health care. World Hosp Health Serv. 2005;41(2):12–6 40-13.

    PubMed  Google Scholar 

Download references

Acknowledgements

We would like to thank the Mental Health and Addictions Youth Network (MAYN) for their insights into the pressing need to understand youth perspectives on virtual service during the COVID-19 pandemic. We further thank the members of the Youth Engagement Initiative at the Centre for Addiction and Mental Health for their insights into the findings. Lastly, we thank the youth participants in the study.

Funding

This study was funded by the Canadian Institutes of Health Research (CIHR). The authors have no conflicts of interest to declare.

Author information

Authors and Affiliations

  1. Centre for Addiction and Mental Health, 80 Workman Way, Toronto, Ontario, Canada

    Lisa D. Hawke, Natasha Y. Sheikhan, Karen MacCon & Joanna Henderson

  2. Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada

    Lisa D. Hawke & Joanna Henderson

Authors
  1. Lisa D. Hawke
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Natasha Y. Sheikhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Karen MacCon
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Joanna Henderson
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LDH: Secured funding; conceptualized, designed, and operationalized study; analyzed and interpreted data; drafted manuscript. NYS: Analyzed and interpreted data, supported drafting of the manuscript. KM: Interpreted data, edited manuscript. JH: Secured funding; provided project leadership; conceptualized and designed study; interpreted data; edited manuscript. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Joanna Henderson.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Research Ethics Board of the Centre for Addiction and Mental Health in Toronto, Canada. Electronic written informed consent was obtained from all participants. As per our research ethics board approval, consent was obtained from participants regardless of age and parental consent was not sought.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hawke, L.D., Sheikhan, N.Y., MacCon, K. et al. Going virtual: youth attitudes toward and experiences of virtual mental health and substance use services during the COVID-19 pandemic. BMC Health Serv Res 21, 340 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-021-06321-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-021-06321-7

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us