Skip to main content

Developing a measure to assess the quality of care transitions for older people

Abstract

Background

The transition of older patients (over 65 years of age) from hospital to their own home is a time when patients are at high risk. No measure currently exists to assess the experience, quality and safety of care transitions relevant to UK population. We aim to describe the development and initial testing of the Partners at Care Transitions Measure (PACT-M) as a patient-reported questionnaire for evaluation of the quality and safety of care transitions from hospital to home in older patients.

Methods

We used an established measure development procedure which includes conceptualising the components of care transitions, item development, conducting a modified Delphi process and pilot-testing of the PACT-M with patients over 65 years old using telephone administration.

Results

Pilot testing of the PACT-M suggests that the components identified cover the issues of most importance to patients. Face validity testing showed that the measure in its current form is acceptable to older patients.

Conclusions

The measure developed in this study shows promise for use by those involved in planning, implementing and evaluating discharge care, and could be used to inform interventions to improve the transition from hospital to home for older patients.

Peer Review reports

Background

Care transition is defined as a series of pre- and post-hospital discharge activities which aim to ensure the coordination and continuity of care for patients who transfer across healthcare settings [1]. The transition of patients from hospital to the post-hospital setting is particularly critical for older patients, especially those with complex care needs [2, 3]. There is an increased risk for health and care problems to occur in the immediate post-discharge period potentially leading to an unplanned readmission within 30 days [2]. The difference between planned and unplanned readmissions is that the latter has been associated with poor discharge care and could be preventable [4] even though some unplanned readmissions are justified by the treatment of a complication [5]. As many as one in five older patients experience an adverse event in the transition from hospital to home, of which 62% are preventable [6, 7].

Transition from hospital to home

In the United Kingdom, the transition of a patient from hospital to home is a highly variable and complex process that depends on the needs of the patient, their support network, levels of frailty and co-morbidities as well as access to health and social care resources [8]. Most transitions require coordination and communication between many different people: the hospital team, the General Practitioner (GP), community nurse, social worker, family and patient [9].

Transitions between hospital and home may be managed in different ways in different settings in the UK. Ideally, older people and their families will be prepared for transition with information on medicines, recommended care of their condition, action in the event of deterioration in discussion with discharge coordinators and nursing staff. A discharge letter will be sent to their primary care physician but may not arrive until one or two weeks post discharge. Then, contact is made with practitioners from the community or social care services before discharge, an ongoing care plan is agreed, and practitioners’ details are recorded on the discharge plan. After being discharged from hospital, the patient and/or their carer are supported by practitioners in their community multidisciplinary team to manage their condition [10].

Research has shown that patients and their caregivers often do not feel prepared to take on their own care after discharge [11] and struggle to understand key aspects of how to manage their condition and symptoms [12]. They may not know how to contact health professionals for advice [13, 14] and feel frustrated by poor preparation for their discharge home [11]. Care can be fragmented and patients may be uncertain about who is coordinating their care needs [15,16,17]. An international survey of patients with complex care needs reported that one in four did not receive instructions for follow-up nor did they receive clear medication directions [18].

Strategies to improve transitions have shown mixed results. Rennke and colleagues [18] identified a variety of different approaches to improve transitional care with no consistent evidence for the efficacy of any particular strategy. There is some evidence that interventions to improve transitions can lower readmissions rates, but no effect has been found on improvements to patients’ self-reported quality of life. Recent reviews [19,20,21,22,23] have suggested that interventions to increase patient involvement at transitions show most promise. As these interventions contain multiple components, however, it is not possible to identify which are the most effective aspects.

Existing measures of care transitions

The Care Transition Measure (CTM) [24] is currently the primary means of assessing the quality of the transition between hospital and home. The CTM, developed in the US, includes questions on information transfer, patient and caregiver preparation, self-managing medication and empowerment to assert preferences. Although the CTM is a valuable measure, we considered that it would be necessary to develop a new measure. The UK healthcare system is very different from the United States and it is likely that patients and families face different challenges. We also wished to explore whether there were other facets of the transitions, particularly safety related, that are not represented in the CTM. Finally, the CTM focusses on the immediate post-discharge period whereas we wished to examine both the immediate as well as the longer term experience of care after the patient returned home. Our own work identified that knowing and understanding things at the point of discharge does not necessarily translate into longer-term confidence in ‘self-care’ on returning home.

Other measures of care transitions have addressed care co-ordination, continuity, patient satisfaction and quality assurance [15, 25,26,27,28,29,30,31,32,33]. However, all these measures have a very specific focus on care delivered at a particular site – such as the hospital, nursing home, or primary care clinic – rather than the transition between hospital and home. Many of these authors call for further studies to explore the core factors underpinning quality of care transitions.

Aims of the present study

The purpose of the present study was to develop a measure of care transitions that could assess patient experience of the transition and thereby be a marker of quality of transitional care. The specific objectives of the study were:

  • To develop a framework of core components of the transition from hospital to home.

  • To develop a measure to evaluate the quality and safety of care transitions relevant to older patients.

  • To pilot this measure with older patients 65 years of age or older to make an initial assessment of usability and face validity.

This study is part of a larger programme of work (NIHR RP-PG-1214-20,017 PACT) which seeks to achieve a better understanding of both patient [34] and staff views [35] of care transitions and ultimately to develop an intervention to improve the transition process. This intervention will be evaluated in a randomised controlled trial and assessed by means of the measure currently in development.

Methods

Overview of the process of development

We conducted this study in four stages (Fig. 1) following the scale development procedure described by DeVellis [36]. Our first task was to (1) develop a conceptual model. We started by defining the time period of interest and the type of transition relevant to this particular programme and subsequent intervention. We then defined the core themes of transition in the sense of conceptualising the critical aspects of the experience of the transition process. We did this through a literature review on existing measures of care transitions, transition interventions, and emerging findings from qualitative studies of both patient and staff experience carried out in an earlier part of the PACT research programme. Secondly, we carried out a thorough process of (2) item generation followed by refinement and simplification of items using a (3) modified Delphi process and feedback from patients and their families. Finally, we refined the language of the measure and carried out (4) pilot testing with 15 patients. In this paper we report on initial data from the pilot questionnaire administration. The complete psychometric evaluation will be reported elsewhere.

Fig. 1
figure 1

Flowchart of the measure development process

Stage 1: Development of a conceptual model

For the purposes of this project, we defined care transitions as a patient’s journey from hospital to their own home. The PACT measure was designed to assess the discharge experience and how the person concerned, is managing at home at later time points. We excluded transfers from hospital to nursing or residential homes or any other setting in which the primary responsibility for care rests with healthcare professionals rather than the patient and family.

The planned intervention in the wider PACT research programme aims to improve the quality and experience of transition through increased patient involvement but also to support patients in the ongoing management of their care. We therefore decided to orient the PACT-M to address the below three time points of care:

  • What was the patient’s experience of preparation in hospital for their return home? This was to be assessed (1) within the first week of discharge when memories were fresh (Time 1).

  • How well is the patient managing their care once back at home? This was to be assessed at (2) one month (Time 2) and (3) three months post discharge (Time 3).

Literature review

We searched PubMed and EMBASE databases for relevant studies between 1995 and 2018 using search terms such as: ‘care transitions’, ‘continuity of care’, ‘measure’, ‘questionnaire’, ‘quality’, ‘safety’, ‘post-discharge’, ‘home care’, ‘patient experience’, ‘interventions’ and ‘adverse events’. The search encompassed studies of measures relevant to care transitions and intervention studies. In parallel with this, we carried out a brief literature review of adverse events in ambulatory settings to identify the most common adverse events encountered.

Preparatory qualitative studies

We reviewed findings from an earlier qualitative interview study exploring the experience of older people and their families during the transition from hospital to home [34]. Initial insights from qualitative accounts highlighted the key themes that relate to patient experience.

Patient and carer engagement and feedback

To gain insights into patients’ and carers’ transition experience we involved a Patient and Public Involvement (PPI) panel in the measure conceptualisation. Our PPI panel included patients and carers who use health services and have been through a transition process. We invited people to join two advisory groups and talk about their experiences with healthcare, review our research plans, and help refine the measure aims in ways that can be understood by everyone.

Identifying core components of a transitions measure

Once we had completed the steps outlined above, we then combined and triangulated evidence from the literature review, research findings of the wider PACT research programme and reflections from our patient panel to define the core components of a measure of patient experience of transition.

Stage 2: Item pool generation

Item generation proceeded in four phases. First, we used our previous literature review and input of the PPI panel to generate a long list of items relevant to components of care transitions. Second, duplicates were removed and items reviewed for relevance by the wider research team and refined to a shorter list. Third, items were reviewed by our PPI panel for language and level of comprehension. Finally, a modified Delphi process was employed to prioritise items based on relevance and content validity with input from experts in patient involvement, patient safety and transitions including psychologists, sociologists, healthcare researchers and gerontologists.

Stage 3: Prioritisation of items for inclusion in the measure; a modified Delphi method

We used a modified Delphi method (adapted from [26, 37] to review the item pool and reach consensus on the components and individual items. A ‘mainstream’ Delphi process includes face to face discussions between experts for two or more rounds. The process is stopped after an agreed criterion; for example, after a number of rounds or when consensus is reached [38]. Our modification included two round-table discussions with an expert panel and a web-based Delphi survey to examine content validity of the draft measure, run by the researcher EO. The combination of two review methods has been suggested as the optimal consensus process for item generation [37]. The expert panel was identified through the PACT team (psychologists, healthcare researchers, social scientists and clinicians) and regional networks and expertise was defined as having considerable clinical or managerial experience in acute geriatric care. A total of 25 experts were invited to participate in an on line survey of which, 15 provided feedback on the first round and 22 responded in the second round. Data collection from the on line Delphi survey was undertaken using the Qualtrics survey software.

Deciding on an appropriate scale

Considering the large burden of illness of the targeted population, as well as the mode of delivery (telephone), all items were designed to be brief and simple using a Likert scale. The ideal number of response options is widely recommended to be between 4 and 7 [39], with 4 or 5 being preferred for telephone administration [40]. We chose a 5-point Likert scale to retain a mid-point response.

Stage 4: Pilot testing of the PACT-M

Pilot size calculation

Survey guidelines suggest that an optimal pilot sample should be 10% of the sample projected for the larger parent study [41, 42] or between 10 and 30 participants for survey research in clinical settings [43,44,45,46]. We aim to run a companion study to establish the validity and reliability of the PACT-M for which we aim to recruit 150 participants. Thus, for this pilot study we sought to collect 15 (10% of the larger sample) completed questionnaires.

Piloting work was undertaken at a large National Health Service (NHS) Teaching Hospital. Participants were given a written information document and consent form. Participants were contacted by phone 3–7 days after discharge from hospital and the PACT-M Time 1 questionnaire (for administration within one week post discharge) was administered.

Participants and recruitment

Participants were 65 years of age or older who had spent at least one night in hospital and were due to be discharged to their own home. Participants had to be English speaking and able to provide informed consent. We excluded people with cognitive impairment.

We recruited 28 patients from medical, surgical, cardiovascular and complex medical care units using opportunistic sampling. Initial screening and eligibility assessment was performed by the clinical team that identified potential participants and introduced them to the researcher on the wards.

Patients that agreed to take part in the study, were contacted by a member of the research team within a week after they have been discharged and asked to complete the PACT-M over the phone.

Instrument administration

Participants were presented with the PACT-M1 pilot version (please see the Additional file 1) that contained; (a) eight statements participants were requested to rate on a 5-point Likert scale, (b) a list of adverse events to answer with yes or no and (c) two open ended questions. During the phone administration, the researcher prompted participants to comment on the questionnaire structure, duration of the phone call or individual item phrasing. During the administration of the PACT-M1, participants were asked to comment on any difficulties encountered and to make suggestions if they wished on the wording of the questions. After completing the questionnaire they were asked questions around perceived barriers to questionnaire completion and the researcher clarified any questions that may have arisen. These telephone calls lasted from 10 to 25 min and the researcher kept notes on participants’ feedback.

Results

Stage 1: Development of a conceptual model

Literature review

Data extraction of the relevant papers revealed the following themes: discharge planning, preparation for self-management, patient involvement with own care, information transfer between providers, information transfer to patients and their carers and patient experience across the transition.

We then extracted items from 10 existing measures relevant to our transitions approach [15, 25,26,27,28,29,30,31,32,33] to ensure that all relevant themes had been included.

Preparatory qualitative studies

After reviewing a qualitative interview study of the PACT research programme, exploring the transition experience of older people from hospital to home [34] the following key themes were extracted: caring of ward staff, disappointing discharge, difficulties in managing medicines, loss of autonomy and independence during the hospital stay, unmet communication and information needs and lack of receipt by services in the community. A common thread through these themes was lack of patient involvement, whether desired or otherwise.

This qualitative study also identified that one of the key contributing factors for people feeling safe was related to having enough information around medications as people often did not feel confident asking questions about new medication regimes or were reluctant to take them after they have returned home. Information about obtaining healthcare supplies emerged as another prevalent safety issue as patients felt confused around how to get essential equipment which impacted on both their independence and mobility.

Patient and carer engagement and feedback

Discussions with people participating in the study’s advisory groups emphasised that the PPI panel's experience and knowledge changed throughout the transition process. Dividing the measure into clearly labelled sections – ‘During my stay in hospital’ and ‘After I left hospital’ – was thought to be critical in capturing the transition process. PPI participants confirmed the importance of all themes previously identified, but added that the patient experience of safety should also be assessed. We had provisionally planned to administer the measure by telephone; the panel confirmed that this was acceptable provided that calls were reasonably short and people were informed of how long the phone call would last. Overall, the advisory groups highlighted the need for item phrasing to be clear and focussed on the needs and experience of older people.

Identifying core components of a transitions measure

Once we had completed the steps outlined above we then combined and triangulated evidence from the literature review, research findings of the wider PACT research programme and reflections from our patient panel to define the core components of a measure of patient experience of transition.

Defining core components

After consolidating evidence and findings from the review stages, we constructed a framework composed of 30 potential components (Fig. 2); by removing duplicates we were able to reduce the list to 11 overarching components. Three of these were eliminated because they were beyond the scope of a measure founded on the patient experience of transitions. These were: (i) quality of life assessment, which was important but best assessed using one of the many existing measures, (ii) clinical assessments and findings in hospital, which would not necessarily be available to patients and (iii) post-discharge monitoring of mortality as we aimed not to contact families where patients had died.

Fig. 2
figure 2

Flowchart of component classification

The remaining 8 components were conceptualised as:

  1. 1.

    Patient involvement

  2. 2.

    Medication management

  3. 3.

    Discharge arrangements

  4. 4.

    Coordination with other providers

  5. 5.

    Providing information and guidance to patient/family

  6. 6.

    Providing psychological and social support

  7. 7.

    Anticipation and preparation for emergencies/deterioration

  8. 8.

    Feeling of safety

Identifying adverse events and problems in care

We also sought to assess common adverse events and problems in care as an adjunct and expansion of patient ratings of the transition process. We derived these from an examination of relevant literature on adverse events in ambulatory care (e.g. [47]), discussion with clinicians and the PACT PPI panel. In the administration of the PACT-M we planned to ask about the presence or absence of these problems in the relevant time period and, if they had occurred, ask follow up questions to explore in more detail.

The final list of adverse events and problems in care was:

  1. 1.

    Having an infection (wound infection, catheter, bladder etc.)

  2. 2.

    Having experienced falls

  3. 3.

    Not being able to get a GP or other healthcare practitioner appointment

  4. 4.

    Problems with medication

  5. 5.

    Having to wait a long time for important healthcare supplies (pads, commodes, special diets etc.)

  6. 6.

    Having visited the emergency department or having been readmitted to hospital since their previous admission at the time of recruitment to the study

Stage 2: Item pool generation

Initial item pool

Four or five questionnaire items were developed for each of the 8 components and designed to be applicable for aspects of care transition. In total, 76 items were mapped to the eight components: half (n = 38) related to patient’s experience of care in hospital and the remaining items related to patient’s experience of managing care at home.

Item review and refinement

Members of the PACT team reviewed the original item pool of 76 items in roundtable discussions and ensured that the items spoke directly to the conceptual thinking that underpinned the intervention development particularly in relation to patient involvement. The team commented on the component suitability and representation of components by the measure items. The review team harmonised the item wording over time to ensure that phrasing of experience at the point of discharge at Time 1 (e.g. “Before leaving the hospital I was confident I understood how to manage my medication”) was consistent with management of care at home at Time 2 and Time 3 (e.g. “I know how to manage my medicines.”). We aimed to achieve some translation between versions of the measure in order to facilitate analysis of associations across the three time points of data collection.

Assessing language and comprehension

To verify the level of comprehension of the questionnaire items, instructions, suitability of question format and ease of questionnaire scoring on face value, we consulted 5 members of the PPI panel in person and by telephone. For all advisory groups and consultations we did not carry out full qualitative analysis but systematically reviewed the feedback we received. Panel members reported that, on the whole, wording of questions appropriately resonated with their own experience with transitions, the rating system was clear and they would be willing to complete the PACT-M. Participants identified some potential barriers to completion of the PACT-M such as people having experienced more than one admission since their last discussion with the researcher and added minor comments on the wording of individual items. They suggested that the duration of the phone call should not exceed 30 minutes with the maximum number of questions to be 15. This feedback led to changes to the PACT –M, including adaptations to some of the wording and where necessary, revisions to items.

Stage 3: Prioritisation of items for inclusion in the measure; a modified Delphi method

Delphi method and formal prioritisation of items

In each of the two successive rounds, experts reviewed the proposed items and rated them on a 4-point Likert scale ranging from ‘definitely exclude’ to ‘definitely include’. Participants could also suggest that an item be reworded, comment on the classification of items under components and recommend additional items for each component. Items that that received a “definitely Include” rating from 70% or more of the experts were accepted for inclusion in the measure and were not included in the following rounds.

Items that received a “Definitely Include” or “Probably Include’” rating from less than 50% of the experts were removed, with those higher than 50% retained for the second round. After each round, questions were modified and reworded based on the qualitative input from the experts. Recirculation ceased when the expert panel reach a general consensus.

Final form of the PACT-M for pilot testing

The final measure administered within a week of discharge (PACT-M1) and consistsed of: (i) eight items reflecting the eight measure components around information and support patients received before and at the point of discharge, (ii) six questions around potential issues with participants’ healthcare and (iii) two open ended questions prompting participants to provide any additional piece of information they wish to disclose. The six questions about health issues and the open ended questions are repeated across the three different time points.

In later studies we plan to administer a parallel measure (PACT-M2) at Times 2 and 3 (one month and three months post-discharge respectively) that contains eight items rated on 5-point Likert scales measuring patients’ perceptions of managing their care at home. Both PACT-M1 and PACT-M2 are shown in the Additional file 1 but only the initial pilot testing of usability and acceptance of PACT-M1 is reported here. Assessment of the measure at different time points will be described in a subsequent paper.

Stage 4: Pilot testing of the PACT-M

Of the twenty –eight recruited participants, thirteen dropped out and either became not eligible as they moved to care home/hospices, withdrew from the study or did not respond when we contacted their preferred telephone number (Fig. 3). Contact was made with 15 participants (4 female, 11 male) between three and seven days post discharge with 70% of participants having been contacted between three to five days post discharge. All participants identified themselves as of white British origin. Nine people were aged between 65 to 75, and 6 were over 75 years of age. The majority (13 people) had been discharged from the complex medical care unit and two from surgical services. Ten people lived with a spouse or partner, one with a family member and four lived alone.

Fig. 3
figure 3

Recruitment flowchart

Participants’ views on the PACT-M delivery and content

Analysis and results

Analyses of the PACT-M quantitative responses were undertaken using IBM SPSS Statistics 25 Software Package [48]. Descriptive statistics and frequencies were calculated for each questionnaire item as well as for demographic characteristics.

Simple analysis of the content of text-based responses was used to get a sense of the prevalence of particular types of problems when completing the questionnaire and with transitions. Responses were summarized and compared across respondents for each item, noting similarities, differences, and frequencies of types of responses. Recommendations were made for item revisions and/or adjustments to the administration process.

  1. (i)

    Experience of responding to the measure

Participants said they found the measure easy to respond to and “straightforward” in presentation with no difficulties reported in understanding individual items. Phone calls were shorter for people who had had an uncomplicated transition and longer for those with more complex problems or who were living alone.

  1. (ii)

    Experience of transition

Participants perceived the 5-point response scale as relatively easy to use and, once understood, mostly replied with a number e.g. ‘4’, rather than agreement scale e.g. ‘I agree’. Some participants requested the response scale options to be repeated and the difference between ‘agree’ and ‘strongly agree’ was often unclear.

As seen on Table 1, the great majority of people (80%) were satisfied with the preparation for discharge and 93% agreed that they knew what to do if their health deteriorated at home. A total of 14% of participants, reported feeling they were not able to ask questions about their care while in hospital and expressed concerns about being ready to manage medication on their return home. Participants with families or partners acting as carers rated questions on further support at home as not relevant, whereas the same questions were ranked high on the agreement scale by participants who lived alone.

Table 1 Frequencies of the PACT-M Time 1 responses

Problems experienced by patients

Six out of fifteen participants reported having some problems managing care since their return home. The most frequent problems were: experiencing delays receiving healthcare supplies (such as catheters), requiring additional care that they had not expected or been prepared for (such as using the emergency services), or being readmitted to hospital. Although participants were instructed to comment on potential adverse events since their latest admission to hospital, (e.g. “Thinking about the last time you have been into hospital, have you had an infection?) seven people replied with a story about a health issue without clarifying whether this was from their most recent admission or a past event. Table 2 shows illustrative quotes from participants’ views on their transitional care experiences as they elaborated while responding on the Likert scale. The quotations illustrate the fact that people may give high overall ratings of their experience of transition but still report some problems in their care and some experiences of loss of independence or dignity.

Table 2 Verbatim quotations from participants illustrating their experience of transition

Discussion

This paper has described the comprehensive development process and pilot testing of the PACT-M. The PACT-M is, to our knowledge, the first instrument to incorporate a broad range of care transition components across different points of discharge and provide a comprehensive assessment for the quality and safety of moving from hospital to home, relevant to UK population.

We developed the PACT-M to evaluate the quality of transitions from hospital to home from the perspective of older patients, across 3 time points of the discharge period to address key components of discharge and post-discharge care. We were particularly concerned to look beyond communication and information transfer [49] and also to capture patient experience of being prepared for discharge and their subsequent experience of managing at home with a focus on factors underpinning patient safety. We have focussed on developing a measure that will be suitable for use with the most vulnerable patient groups such as older people with multiple comorbidities [40].

We did not find any validated measures that assess transitional quality and safety at multiple time points post discharge. A recently developed measure by Boge et al. [50] assessed 3 components of transitional care for older patients; coping after discharge, participation in discharge planning and adherence to treatment. While this survey revealed insights into patient experience of transition 30 days post discharge, it is possible that older people might not accurately recall the experience of participating in their latest discharge. Onwards, this measure does not necessarily reflect patients’ views on their latest discharge as it is possible that people could have been readmitted to the hospital before the survey administration. A recent systematic review of transitional care tools conducted by val Melle et al. [51] found 14 different instruments measuring components of patient safety of transitions and assessed them against a methodological quality tool. They found that the most important step while developing a measure is establishing content validity [51]. We have established the PACT-M’s content validity by using a modified Delphi process and by further refining the items using the PPI panel’s feedback.

Pilot testing of the PACT-M suggests that it is acceptable to older patients and that it covers issues of relevance to them. People in our patient advisory panel and those in our initial pilot testing found the measure to be straightforward and the questions relevant to their experience of being discharged home from hospital. Capturing qualitative accounts of patients’ experiences further informed the measure components and highlighted areas that other measures overlooked, such as patient safety and patient involvement in their care, post discharge. Our iterative measure development process incorporating feedback from advisory groups with our PPI panel and patient feedback, ensured that the PACT –M addresses all key aspects of transition. We believe that the long and rigorous development process is justified precisely because transitions are times of particular vulnerability for patients. We need a valid and reliable measure of transition to ensure that interventions to improve transition can reliably capture the most critical features of transition as experienced by patients and families. This instrument could also be of particular use to health care organisations seeking a practical tool to assess patient involvement and preparation for managing their own care at home.

PACT-M has been developed in the context of the UK healthcare system and is designed to work effectively in that setting. The precise arrangements for transitions from hospital to home and the nature and extent of community care and support vary widely from country to country. However, we believe that the areas addressed in the PACT-M are generic and potentially relevant to any healthcare system. PACT-M would of course have to be piloted and tested if used in another country and might require adjustments to wording and language. However, in principle it could be used in any healthcare system that manages transitions between hospital and home.

This research has some limitations. Although we performed an exhaustive process of measure development, the sample we tested the PACT-M primarily consisted of patients of white British ethnicity, mostly living with their partners, and from surgical and complex medical care units. This implied that the pilot findings may not be applicable to a more diverse sample or to patients discharged from other units such as cardiothoracic, geriatric, vascular, etc. It is also important to note that the PACT-M is only appropriate for use by patients with cognitive capacity to consent. At the present time, we consider that the PACT-M shows promise but it cannot yet be recommended for routine use. However, sufficient information is provided in this paper so that other researchers can consider testing the PACT-M with a wider population.

Much remains to be done to assess the use of PACT-M in practice and to determine its reliability and validity as a measure of patient experience of care transitions. The next phase of this measure development will involve the recruitment of 150 patients over 65 years of age being discharged from various wards. The PACT-M will be administered over the phone or by post at three time points post discharge. This will provide additional information on the structure of the measure, the relationship between items and on the relationship between the scores at different time points. We will also gain a fuller understanding of the experience of transition for older patients discharged from English hospitals.

Developing an acceptable, valid and reliable measure is essential to the evaluation of interventions to improve transitions in care and this is more likely to be achieved if future studies consider testing the measure widely, involving different groups of clinicians and researchers.

Conclusion

We used an established four-stage procedure to develop a measure to assess the quality of care transitions from the perspective of older people. This is the first transitions measure developed specifically for UK population. The pilot testing of the PACT-M supports the usability and face validity of the PACT-M for measuring patient perceptions of factors central to safety of transitional care namely: patient involvement, information sharing and medication management. The measure components could be of value for identifying problems in the immediate post-discharge period as well as in the longer term. Such information could be useful to those involved in planning discharge care and for hospitals who want to improve the safety and continuity of care of their services for older patients. Further work is needed to explore the psychometric characteristics of the tool. We are currently testing the measure in large measure validation study which we will discuss in a future report.

Availability of data and materials

The datasets used and analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CTM:

Care Transitions Measure

GP:

General Practitioner

NHS:

National Health Service

PACT:

Partners at Care Transitions

PACT-M:

Partners at Care Transitions Measure

PPI:

Patient and Public Involvement

References

  1. Coleman EA, Boult C. Improving the quality of transitional care for persons with complex care needs. J Am Geriatr Soc. 2003;51(4):556–7 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1046/j.1532-5415.2003.51186.x.

    Article  Google Scholar 

  2. Zurlo A, Zuliani G. Management of care transition and hospital discharge. Aging Clin Exp Res. 2018;30(3):263–70 Available from: http://0-link-springer-com.brum.beds.ac.uk/10.1007/s40520-017-0885-6.

    Article  Google Scholar 

  3. McMullan M, Jones R, Lea S. Patient safety: numerical skills and drug calculation abilities of nursing students and registered nurses. J Adv Nurs. 2010;66(4):891–9 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1111/j.1365-2648.2010.05258.x.

    Article  Google Scholar 

  4. Friedman B, Jiang HJ, Elixhauser A. Costly hospital readmissions and complex chronic illness. Inq J Heal Care Organ Provision, Financ. 2008;45(4):408–21.

    Article  Google Scholar 

  5. Kossovsky MP, Perneger TV, Sarasin FP, Bolla F, Borst F, Gaspoz J-M. Comparison between planned and unplanned readmissions to a Department of Internal Medicine. J Clin Epidemiol. 1999;52(2):151–6 Available from: https://0-www-sciencedirect-com.brum.beds.ac.uk/science/article/pii/S0895435698001425.

    Article  CAS  Google Scholar 

  6. Buurman BM, Hoogerduijn JG, de Haan RJ, Abu-Hanna A, Lagaay AM, Verhaar HJ, et al. Geriatric conditions in acutely hospitalized older patients: prevalence and one-year survival and functional decline. PLoS One. 2011;6(11):e26951 Lama JR, editor. Available from: https://dx.plos.org/10.1371/journal.pone.0026951.

    Article  CAS  Google Scholar 

  7. Forster AJ, Asmis TR, Clark HD, Al Saied G, Code CC, Caughey SC, et al. Ottawa Hospital patient safety study: incidence and timing of adverse events in patients admitted to a Canadian teaching hospital. CMAJ. 2004;170(8):1235–40 Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/15078845.

    Article  Google Scholar 

  8. Lawton R, O’Hara JK, Sheard L, Armitage G, Cocks K, Buckley H, et al. Can patient involvement improve patient safety? A cluster randomised control trial of the patient reporting and action for a safe environment (PRASE) intervention. BMJ Qual Saf. 2017;26(8):622–31 Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/28159854.

    Article  Google Scholar 

  9. Waring J, Marshall F, Bishop S. Understanding the occupational and organizational boundaries to safe hospital discharge. J Health Serv Res Policy. 2015;20(1_suppl):35–44 Available from: http://0-journals-sagepub-com.brum.beds.ac.uk/doi/10.1177/1355819614552512.

    Article  Google Scholar 

  10. NICE Guideline. Transition between inpatient hospital settings and community or care home settings for adults with social care needs. 2015. Available from: https://www.nice.org.uk/guidance/ng27

  11. Harrison A, Verhoef M. Understanding coordination of care from the Consumer’s perspective in a regional health system. Health Serv Res. 2002;37(4):1031–54 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1034/j.1600-0560.2002.64.x.

    PubMed  PubMed Central  Google Scholar 

  12. Vom Eigen KA, Walker JD, Edgman-Levitan S, Cleary PD, Delbanco TL. Carepartner experiences with hospital care. Med Care. 1999;37 Available from: https://0-www-jstor-org.brum.beds.ac.uk/stable/pdf/3767205.pdf?refreqid=excelsior%3Ac3e831a867c769c76d6f8fd59bbf7061.

    Article  CAS  Google Scholar 

  13. Howard-Anderson J, Busuttil A, Lonowski S, Vangala S, Afsar-manesh N. From discharge to readmission: understanding the process from the patient perspective. J Hosp Med. 2016;11(6):407–12 Available from: http://www.journalofhospitalmedicine.com/jhospmed/article/127428/patients-perspective-readmissions.

    Article  Google Scholar 

  14. Weaver FM, Perloff L, Waters T. Patients’ and caregivers’ transition from hospital to home: needs and recommendations. Home Health Care Serv Q. 1999;17(3):27–48 Available from: http://0-www-tandfonline-com.brum.beds.ac.uk/doi/abs/10.1300/J027v17n03_03.

    Article  Google Scholar 

  15. Greysen SR, Harrison JD, Kripalani S, Vasilevskis E, Robinson E, Metlay J, et al. Understanding patient-centred readmission factors: a multi-site, mixed-methods study. BMJ Qual Saf. 2017;26(1):33–41 Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/26769841.

    Article  Google Scholar 

  16. Boult C, Green AF, Boult LB, Pacala JT, Snyder C, Leff B. Successful models of comprehensive care for older adults with chronic conditions: evidence for the Institute of Medicine’s “retooling for an aging America” report. J Am Geriatr Soc. 2009;57(12):2328–37 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1111/j.1532-5415.2009.02571.x.

    Article  Google Scholar 

  17. Schoen C, Osborn R, Squires D, Doty M, Pierson R, Applebaum S. New 2011 survey of patients with complex care needs in eleven countries finds that care is often poorly coordinated. Health Aff. 2011;30(12):2437–48 Available from: http://www.healthaffairs.org/doi/10.1377/hlthaff.2011.0923.

    Article  Google Scholar 

  18. Rennke S, Nguyen O, Shoeb M, Magan Y, Wachter R, Ranji S. Hospital-initiated transitional care interventions as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158:433 Available from: http://annals.org/data/journals/aim/926462/0000605-201303051-00011.pdf.

    Article  Google Scholar 

  19. Le Berre M, Maimon G, Sourial N, Guériton M, Vedel I. Impact of transitional care services for chronically ill older patients: a systematic evidence review. J Am Geriatr Soc. 2017;65(7):1597–608 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1111/jgs.14828.

    Article  Google Scholar 

  20. Kansagara D, Chiovaro JC, Kagen D, Jencks S, Rhyne K, O’Neil M, et al. So many options, where do we start? An overview of the care transitions literature. J Hosp Med. 2016;11(3):221–30 Available from: http://www.journalofhospitalmedicine.com/jhospmed/article/126974/care-transitions-hospital-home.

    Article  Google Scholar 

  21. Feltner C, Jones C, Cené C, Zheng Z, Sueta C, Coker-Schwimmer EJL, Arvanitis M, Lohr KN, Middleton JC, Jonas DE. Transitional care interventions to prevent readmissions for persons with heart failure: a systematic review and meta-analysis. Ann Intern Med. 2014;6(11):774 Available from: https://annals.org/aim/article-abstract/1874735.

    Article  Google Scholar 

  22. Burke RE, Guo R, Prochazka AV, Misky GJ. Identifying keys to success in reducing readmissions using the ideal transitions in care framework. BMC Health Serv Res. 2014;14(1):423. Available from: https://0-bmchealthservres-biomedcentral-com.brum.beds.ac.uk/articles/10.1186/1472-6963-14-423.

  23. Leppin AL, Gionfriddo MR, Kessler M, Brito JP, Mair FS, Gallacher K, Wang Z, Erwin PJ, Sylvester T, Boehmer K, Ting HH. Preventing 30-day hospital readmissions: a systematic review and meta-analysis of randomized trials. JAMA internal medicine. 2014;174(7):1095-107. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pmc/articles/PMC4249925/.

    Article  Google Scholar 

  24. Coleman EA, Mahoney E, Parry C. Assessing the quality of preparation for posthospital care from the patient’s perspective: the care transitions measure. Med Care. 2005;43(3):246–55 Available from: https://0-www-jstor-org.brum.beds.ac.uk/stable/3768223.

    Article  Google Scholar 

  25. Uittenbroek RJ, Reijneveld SA, Stewart RE, Spoorenberg SLW, Kremer HPH, Wynia K. Development and psychometric evaluation of a measure to evaluate the quality of integrated care: the patient assessment of integrated elderly care. Health Expect. 2016;19(4):962–72 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1111/hex.12391.

    Article  Google Scholar 

  26. Zlateva I, Anderson D, Coman E, Khatri K, Tian T, Fifield J. Development and validation of the medical home care coordination survey for assessing care coordination in the primary care setting from the patient and provider perspectives. BMC Health Serv Res. 2015;15(1):226 Available from: https://0-bmchealthservres-biomedcentral-com.brum.beds.ac.uk/articles/10.1186/s12913-015-0893-1.

    Article  Google Scholar 

  27. McLeod J, Stolee P, Walker J, Heckman G. Measuring care transition quality for older patients with musculoskeletal disorders. Musculoskeletal Care. 2014;12(1):13–21 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1002/msc.1043.

    Article  Google Scholar 

  28. Hadjistavropoulos H, Biem H, Sharpe D, Bourgault-Fagnou M, Janzen J. Patient perceptions of hospital discharge: reliability and validity of a patient continuity of care questionnaire. Int J Qual Heal Care. 2008;20(5):314–23 Available from: https://0-academic-oup-com.brum.beds.ac.uk/intqhc/article-abstract/20/5/314/1795431.

    Article  Google Scholar 

  29. Jenkinson C, Coulter A, Bruster S, Richards N, Chandola T. Patients’ experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care. 2002;11(4):335–9 Available from: https://0-qualitysafety-bmj-com.brum.beds.ac.uk/content/11/4/335?utm_source=TrendMD&utm_medium=cpc&utm_campaign=BMJ_Qual_Saf_TrendMD-0.

    Article  CAS  Google Scholar 

  30. Grimmer K, Moss J. The development, validity and application of a new instrument to assess the quality of discharge planning activities from the community perspective. Int J Qual Heal care J Int Soc Qual Heal Care. 2001;13(2):109–16 Available from: https://0-academic-oup-com.brum.beds.ac.uk/intqhc/article-abstract/13/2/109/1815707.

    Article  CAS  Google Scholar 

  31. Parry C, Mahoney E, Chalmers SA, Coleman EA. Assessing the quality of transitional care: further applications of the care transitions measure. Med Care. 2008;46(3):317–22 Available from: https://journals.lww.com/lww-medicalcare/Abstract/2008/03000/Assessing_the_Quality_of_Transitional_Care_.12.aspx.

    Article  Google Scholar 

  32. Teale EA, Young JB. A patient reported experience measure (PREM) for use by older people in community services. Age Ageing. 2015;44(4):667–72 Available from: https://0-academic-oup-com.brum.beds.ac.uk/ageing/article-abstract/44/4/667/66221.

    Article  CAS  Google Scholar 

  33. Baker R, Preston C, Cheater F, Hearnshaw H. Measuring patients’ attitudes to care across the primary/secondary interface: the development of the patient career diary. Qual Health Care. 1999;8(3):154–60 Available from: https://0-qualitysafety-bmj-com.brum.beds.ac.uk/content/8/3/154.short.

    Article  CAS  Google Scholar 

  34. Hardicre N, Birks Y, Murray J, Sheard L, Hughes L. Partners at Care Transitions (PACT)—exploring older peoples’ experiences of transitioning from hospital to home in the UK: protocol for an observation and. BMJ Open. 2017;7(11):e018054 Available from: https://0-bmjopen-bmj-com.brum.beds.ac.uk/content/7/11/e018054?int_source=trendmd&int_medium=trendmd&int_campaign=trendmd.

    Article  Google Scholar 

  35. Baxter R, O’Hara J, Murray J, Sheard L, Cracknell A. Partners at care transitions: exploring healthcare professionals’ perspectives of excellence at care transitions for older people. BMJ Open. 2018;8(9):e022468 Available from: https://bmjopen.bmj.com/content/8/9/e022468.abstract.

    Article  Google Scholar 

  36. DeVellis R. Scale development: theory and applications. 2016. Available from: https://books.google.co.uk/books?hl=en&lr=&id=231ZDwAAQBAJ&oi=fnd&pg=PT15&dq=Scale+development:+Theory+and+applications&ots=hE2TwwI6Ty&sig=kfuitgG2J_dP0i1IIUYmUdwxmlU.

    Google Scholar 

  37. Hernan AL, Giles SJ, O’Hara JK, Fuller J, Johnson JK, Dunbar JA. Developing a primary care patient measure of safety (PC PMOS): a modified Delphi process and face validity testing. BMJ Qual Saf. 2007;25(4):273–80 Available from: https://0-qualitysafety-bmj-com.brum.beds.ac.uk/content/25/4/273.short.

    Article  Google Scholar 

  38. Linstone HA, Turoff M. The Delphi method : techniques and applications. Reading: Addison-Wesley Pub. Co., Advanced Book Program; 1975. p. 620. Available from: https://web.njit.edu/~turoff/pubs/delphibook/delphibook.pdf.

  39. Lozano LM, García-Cueto E, Muñiz J. Effect of the number of response categories on the reliability and validity of rating scales. Methodology. 2008;4(2):73–9 Available from: https://econtent.hogrefe.com/doi/10.1027/1614-2241.4.2.73.

    Article  Google Scholar 

  40. Farnik M, aw Pierzchała W. Instrument development and evaluation for patient-related outcomes assessments. Patient related outcome measures. 2012;3:1. Available from: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pmc/articles/PMC3417934/.

  41. Connelly L. Pilot studies. Medsurg Nurs. 2008;17(6):411–2 Available from: https://0-search-proquest-com.brum.beds.ac.uk/openview/553d762f3224a627486acfbf1a7320e0/1?cbl=30764&pq-origsite=gscholar.

  42. Treece EW, Treece JW Jr. Elements of research in nursing. Nursing2019. 1977;7(6):12-3. Available from: https://journals.lww.com/nursing/Citation/1977/06000/Elements_of_Research_in_Nursing__Second_Edition.12.aspx?.

    Article  Google Scholar 

  43. Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharm Stat. 2005;4(4):287–91 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1002/pst.185.

    Article  Google Scholar 

  44. Van Belle G. Statistical rules of thumb: Wiley; 2011. Available from: http://vanbelle.org/presentations/CHSTalkNoPictures.pdf

  45. Hill R. What sample size is “enough” in internet survey research. Interpersonal Computing and Technology: An electronic journal for the 21st century. 1998;6(3-4):1-2.

  46. Isaac S, Michael W. Handbook in research and evaluation: a collection of principles, methods, and strategies useful in the planning, design, and evaluation of studies in education [internet]. San Diego: EdITS Publishers; 1995. Available from: https://psycnet.apa.org/record/1995-98981-000

    Google Scholar 

  47. Förster J, Rosenberg P. Revival of old local anesthetics for spinal anesthesia in ambulatory surgery. Curr Opin Anaesthesiol. 2011;24(6):633–7 Available from: https://journals.lww.com/co-anesthesiology/Abstract/2011/12000/Revival_of_old_local_anesthetics_for_spinal.10.aspx.

    Article  Google Scholar 

  48. IBM Corp. IBM SPSS statistics for windows, version 25.0. Armonk: IBM Corp Released; 2017.

    Google Scholar 

  49. Foss C, Askautrud M. Measuring the participation of elderly patients in the discharge process from hospital: a critical review of existing instruments. Scand J Caring Sci. 2010;24:46–55 Available from: http://0-doi-wiley-com.brum.beds.ac.uk/10.1111/j.1471-6712.2010.00788.x.

    Article  Google Scholar 

  50. Boge RM, Haugen AS, Nilsen RM, Harthug S. Elderly patients’ (≥65 years) experiences associated with discharge; development, validity and reliability of the discharge care experiences survey. PLoS One. 2018;13(11):e0206904. Sullivan P, editor [cited 2019 May 29]. Available from: http://dx.plos.org/10.1371/journal.pone.0206904.

    Article  Google Scholar 

  51. van Melle MA, van Stel HF, Poldervaart JM, de Wit NJ, Zwart DLM. Measurement tools and outcome measures used in transitional patient safety; a systematic review. PLoS One. 2018;13(6):e0197312 cited 2019 May 29. Available from: http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/29864119.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank our PPI panel; Jean Trueman, Patrick Murphy, David Swales; Bill Cameron, Jen Cameron, Tahira Ali, Mohammed Ali, and Sandy Bentley. The research is supported by the NIHR CLAHRC Yorkshire and Humber. www.clahrc-yh.nihr.ac.uk.

Disclaimer

The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health and Social Care.

Funding

This report is independent research funded by the National Institute for Health Research (National Institute for Health Research Programme Grants for Applied Health Research, Partners at Care Transitions (PACT): Improving patient experience and safety at transitions in care, Grant Reference number RP-PG-1214-20017). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health and Social Care.

Our representative from the funding body, the NIHR, attended steering groups occasionally but the funding body has no other direct involvement in any aspect of the study design; collection, analysis and interpretation of the data; in the writing of the report or in the decision to submit the paper for publication.

Author information

Authors and Affiliations

Authors

Contributions

CV and RL conceived the study and CV oversaw the scientific direction. EC contributed to the conception of the theoretical framework. EO contributed to the theoretical framework, designed the Delphi process, conducted the pilot work and drafted the paper. CV, EC, JM, RL and HH revised the paper. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Eirini Oikonomou.

Ethics declarations

Ethics approval and consent to participate

This study has received ethical approval from the NHS Research Ethics Committee: London - Chelsea Research Ethics Committee (ref: 18/LO/0568) and is currently recruiting participants. The aim of the study is to develop and validate a measure to assess quality and safety of transitions.

We obtained written informed consent from all study participants.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

PACT-M 1 Pilot Version. (pdf 166 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Oikonomou, E., Chatburn, E., Higham, H. et al. Developing a measure to assess the quality of care transitions for older people. BMC Health Serv Res 19, 505 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-019-4306-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-019-4306-8

Keywords