Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Measuring patient outcomes in chronic heart failure: psychometric properties of the Care-Related Quality of Life survey for Chronic Heart Failure (CaReQoL CHF)

BMC Health Services Research volume 17, Article number: 536 (2017) Cite this article

Abstract

Background

The Care-Related Quality of Life survey for Chronic Heart Failure (CaReQoL CHF) is a newly developed patient-reported outcome measure (PROM) that measures care-related quality of life in patients diagnosed with chronic heart failure. This study describes the psychometric properties of the questionnaire and its relationship with disease severity and global rating of quality of care.

Method

Insurance companies selected patients with a recorded diagnosis of chronic heart failure and for whom the hospital submitted a billing statement in the last year. Exploratory factor analysis, Cronbach’s alpha and item-rest correlation were used to construct the CaReQoL CHF. Construct validity was assessed by examining the mean values of the CaReQoL CHF scales for the categories of the widely-used New York Heart Association (NYHA) functional classification and by correlating the global rating of quality of care with the CaReQoL CHF scales.

Results

One thousand eighteen patients with chronic heart failure filled out the CaReQoL CHF (RR: 35.7%). The CaReQoL CHF consists of 20 items and three scales: social and emotional problems, physical limitations, and being in safe hands. The mean scores of the three scales differed significantly for the NYHA categories, particularly for the social-emotional problems and physical limitation scales. The ‘being in safe hands’ scale showed a moderate positive correlation with the global rating of quality of care.

Conclusions

The CaReQoL CHF is a concise and valid PROM that matches patients’ priorities in healthcare. It adds a new element to existing quality of life questionnaires for patients with chronic heart failure, that is ‘being in safe hands’ scale. This scale is relevant for patients because they experience anxiety and tension about their condition. Future research should determine whether the CaReQoL CHF can help healthcare providers in daily practice to focus treatment on outcomes of care that are relevant to individual patients.

Peer Review reports

Background

Healthcare providers have to take patients’ preferences and needs into account [1]. Accordingly, patient surveys are used to measure care outcomes as perceived by patients [2]. These surveys are called patient-reported outcome measures (PROMs).

An advantage of using PROMs in clinical practice is that the outcomes can help healthcare providers monitor individual patients in between consultations and evaluate and manage their treatment [3, 4]. In addition, group-level data of PROMs for different treatments may help patients and doctors choose between treatments [5]. Finally, PROMs are considered to provide an important method of measuring quality of care by comparing average PROM scores between providers [6].

In people with a chronic illness, measurements of physical, mental and/or social functioning and/or (health-related) quality of life are often used to monitor outcomes of care [7, 8]. Widely used generic quality of life measures such as SF-36 and EQ-5D [9, 10] are considered too generic to capture aspects of care that matter to chronic patients [11, 12]. Disease-specific quality of life measures on the other hand, are not always developed with patient involvement [13]. This can lead to inappropriate outcome selection and can result in unimportant or misleading information and wasted resources [14]. It is widely acknowledged that it is pivotal to involve patients in the selection of outcomes and the development and validation of patient surveys such as PROMs, because this helps to capture the full spectrum of the patient perspective [11, 14,15,16,17].

One such group with chronic disease is people with chronic heart failure. Patients with chronic heart failure suffer from shortness of breath, fatigue and swelling in the ankles and legs [18]. In the Netherlands, approximately 1% of the population (roughly 130,000 people) suffer from chronic heart failure, mostly over the age of 75 [19]. The lifetime prevalence is about 20-30% [19].

Kelkar et al. [20] identified 31 PROMs for chronic heart failure and reported several relevant measurement properties such as reliability, validity, responsiveness, diversity in performance, feasibility, interpretability and prognostic value of these questionnaires. The Minnesota Living with Heart Failure Questionnaire (MLHQ; [21]) and the Kansas City Cardiomyopathy Questionnaire (KCCQ; [22]) met these criteria best. These questionnaires have been developed and assessed in the United States. However, it is possible that differences exist between countries in the extent to which a PROM addresses the relevant and important aspects for patients, a phenomenon known as cross-cultural validity. Therefore, before implementing an existing PROM, it is important to evaluate the PROM and determine whether it captures the patient perspective in the designated country. If not, an existing PROM may be modified or a new PROM may be developed.

In the present paper we report on the development of a new PROM for chronic heart failure, which was deemed necessary as Dutch patients reported a key priority that was not captured in existing PROMs. This key priority was whether patients felt they were “safe”, that is, properly monitored such that they felt comfortable and confident to proceed with daily activities.

Based on focus groups with heart failure patients and inspired by the MLHQ and the KCCQ, we developed the Care-Related Quality of Life survey for Chronic Heart Failure (CaReQoL CHF). In the present paper, we examine the psychometric properties and construct validity of the CaReQoL CHF. Our research questions were:

  1. 1.

    Psychometric properties: what are the psychometric properties of the CaReQoL CHF in terms of dimensional structure and Cronbach’s alpha?

  2. 2.

    Validity: how are the reported outcomes measured by the CaReQoL CHF related to disease severity and global rating of quality of care?

Method

Development of the CaReQoL CHF

In the literature review, we found that the following themes were common in existing disease-specific PROMs for chronic heart failure: physical limitations, participation in society, and feelings of anxiety or tension [23,24,25,26]. We asked Dutch patients with heart failure what are important health outcomes for them in order to establish cross-cultural validity. We confirmed the common themes in two focus group discussions with a total of nine patients. Interestingly, ‘being in safe hands’ emerged as an additional theme that was not covered in the existing PROMs. Patients indicated that they were reminded of their condition on a regular basis and that they often feel anxious or tense given that their heart problems could deteriorate at any moment. Healthcare providers were able to reduce feelings of anxiety or tension by watching over the patients. For example, by telemonitoring constantly how the heart functions and by proactively contacting the patient when needed. As such, we decided to develop a new PROM to address these issues. Cognitive interviews were held to enhance the reliability and validity and to verify that the questions were concise, simple, and interpreted as intended [27,28,29,30]. Detailed results of the focus group discussions and cognitive interviews have been reported elsewhere in Dutch [31]. The initial CaReQoL CHF (before item reduction) consisted of 34 items on a five-point scale (never, seldom, sometimes, often, always and not applicable). The questions in this version focus on experiences of patients in the last 4 weeks.

Data collection

We selected 31 hospitals with a large number of declarations for heart failure. In each of these hospitals, insurance companies randomly selected roughly 100 patients with a recorded diagnosis of chronic heart failure and for whom the hospital submitted a billing statement in the last year (these were either outpatients or patients admitted to the hospital). We selected patients from several hospitals via insurance companies because we wanted to get more insight in possible differences between hospitals and, more pragmatically, insurance companies were willing to help us get access to patients. Patients were able to choose whether they wanted to fill in the questionnaire online or on paper (mixed-mode). In week 1 patients were sent an invitation to fill in the online version of the CaReQoL CHF. In week 2 patients were sent a thank you/reminder note. In the event of non-response, patients were sent a paper version of the CaReQoL CHF in week 5 and a final reminder in week 7. No ethical approval and consent for publication for the study was necessary, as research by a non-encroaching survey such as used in this study is not subject to the Dutch Medical Research Involving Human Subjects Act (WMO).

Analyses

In the present paper, the reliability and validity of the CaRe-QoL CHF will be addressed. Furthermore, the dimensional structure was assessed with exploratory factor analysis (promax rotation), including Bartlett’s test of sphericity and Kaiser-Meyer-Olkin as a measure of sampling adequacy. We used listwise deletion for the factor analysis, meaning that only respondents with no missing values were taken in account. This avoids imputation of missing items. As a rule of thumb, items with a factor loading higher than .6 were included in the CaReQoL CHF. Cronbach’s alpha and item-rest correlation gave insights into the test reliability of the scales and redundant items [32]. The self-reported New York Heart Association (NYHA) classification was used as a reference for assessing (criterion) validity by examining the means of the CaReQoL CHF scales for different NYHA categories using ANOVA. The NYHA classification is a measure of the severity of a patient’s heart failure in terms of dyspnoea and fatigue [33]. Respondents assigned themselves to one of four categories, ranging from no limitation in physical activity to severe limitations (see Table 1). A second aspect of criterion validity was the associations between the CaRe-QoL CHF and the global rating of quality of care. Patients were asked ‘How would you rate the healthcare you received in this hospital for chronic heart failure? A 0 means very bad and a 10 means excellent’ [34, 35]. We examined the associations with the scores on the CaRe-QoL CHF using Pearson’s correlations, which were also used to assess association between the CaReQoL CHF scales.

Table 1 Sample description in terms of age, sex and categories of the New York Heart Association functional classification
Full size table

Results

Research question 1: what are the psychometric properties of the CaReQoL CHF?

The CaReQoL CHF was filled out by 1018 respondents (RR: 35.7%). Table 1 describes the sample in terms of age, gender and NYHA classification. Bartlett’s test of sphericity was significant (p < .001), indicating that the variables correlated highly enough for factor analysis. The Kaiser-Meyer-Olkin value was high, with a score of .93, indicating factor analysis should yield distinct and reliable factors. Following factor analysis (N = 249, listwise deletion) and reliability analysis, 20 items were retained in the final version of the CaReQoL CHF. The results of the factor- and reliability analyses for those items are presented in Table 2.

Table 2 Factor and reliability analysis of items in the final version of the CaReQoL CHF
Full size table

Factor analyses resulted in three scales: (1) social and emotional problems, (2) physical limitations and (3) being in safe hands. One item about having contact with friends and family was retained despite the slightly lower factor loading (.59), because patients talked about the subject a lot in the focus group discussions. Table 3 shows which items were not included in the CaReQoL CHF and for what reason.

Table 3 Factor analysis of items excluded from the CaReQoL CHF
Full size table

Correlation between the scales ranged from −.08 to .63 (p-values <.05). Social and emotional problems were positively related to physical limitations (r = .63) and negatively related to ‘being in safe hands’ (r = −.24). Physical limitations were negatively associated with being in safe hands (r = −.08).

Research question 2: relationship with disease severity and patient satisfaction

There were significant differences (p < .05) for every scale of the CaReQoL CHF between the four NYHA categories (Fig. 1). Patients in higher classification scales (meaning more symptoms) had higher scores on the social and emotional limitation and physical limitation scales. The (significant) differences for the ‘being in safe hands’ scale on the NYHA classification were not large, suggesting that this scale is largely independent of the severity of the disease.

Fig. 1
figure 1

Mean scores (and 95% confidence interval) on the CaReQoL CHF scales for different NYHA classification categories. Social and emotional limitations, F=74.64, df=847, η2=0.21, p<0.001, Physical limitations, F=214.27, df=878, η2=0.42, p<.001, Being in safe hands, F=5.77, df=900, η2=0.02, p<0.001

Full size image

Correlation with patient satisfaction

The scales social and emotional problems and physical limitations showed a small negative association with global rating of quality of care (r = −.16 and −.10 respectively, p-values < .05). This means that the more social and emotional problems and physical limitations a patient experiences, the lower their global rating of quality of care. Being in safe hands was positively associated with global rating of care (r = .43, p-value < .05). Therefore, the more they felt they were in safe hands, the higher the global rating of quality of care.

Discussion

In the present study we developed a PROM that measures care-related quality of life in patients diagnosed with chronic heart failure. The study resulted in a concise (20-item; see Table 2) and valid questionnaire that matches patients’ priorities in healthcare, the Care-Related Quality of Life survey for Chronic Heart Failure (CaReQoL CHF). Twenty items is shorter than most other questionnaires and the content of the CaReQoL CHF is comparable with the MHLF and KCCQ. The CaReQoL CHF consists of three scales: social and emotional problems, physical limitations and being in safe hands. In this study, we established the reliability and construct validity of the CaReQoL CHF. Cronbach’s alphas of the scales were sufficiently high [32]. The scales for social and emotional problems and for physical limitations were positively associated with severity of the disease, whereas the ‘being in safe hands’ scale was moderately and positively associated with global rating of quality of care. The combination of these associations suggest that the CaReQoL CHF is a valid instrument for measuring relevant outcomes of care from a patient’s perspective. The CaReQoL CHF provides the field of heart failure with a promising instrument to evaluate perceived outcomes of healthcare in this patient group.

The scale ‘being in safe hands’ is an element not measured with existing quality of life questionnaires for patients with chronic heart failure. Being in safe hands was mentioned as an important outcome in focus groups with Dutch patients with heart failure [31]. This raises the question whether being in safe hands is something typical Dutch or if this aspect is relevant to patients in other countries too. Regardless of the severity of their symptoms, patients should be able to feel they are safe – and in safe hands - thanks to the healthcare provided. This is particularly relevant because heart failure is a progressive disease that cannot be cured.

Anxiety and tension in patients (e.g. in anticipation of sudden events such as a myocardial infarction) can be alleviated by knowing that healthcare providers are watching over them. This is also found in a meta-analysis [36] and a study by Renzi et al. ([37], pp. 716-717) which stated that a good doctor-patient relationship can improve healthcare outcomes and the patients’ health-related quality of life. For heart failure, the health-related quality of life can be improved by monitoring patients at home, using the CaReQoL CHF between consultations.

We regarded ‘being in safe hands’ as an outcome of care. However, it could also be argued that it is a process aspect of care because it comprises aspects of care delivery and care coordination [38]. In addition, being in safe hands falls outside the range of domains of health-related quality of life that are common to existing questionnaires (which are social, emotional and physical domains) [39]. Associated with the global rating of care, the ‘being in safe hands’ scale is an interesting new aspect in the area where the process and the outcome of care intersect.

A limitation of this study was that the (self-reported) NYHA classification was used for criterion validation, although we concede of course that there are no real gold standards in the validation of outcome measurements [40, 41]. Furthermore, this study was performed in a cohort of patients receiving hospital care, whilst some patients with chronic heart failure (in the Netherlands) only receive care from their general practitioner. This latter group probably includes patients with less severe complaints and therefore their answers on the CaReQoL CHF might differ from the answers of patients receiving hospital care. However, given that our population comprises all of the four NYHA categories, we expect no significant differences for instrument validation purposes.

This study is to be considered a starting point in the development of the CaReQoL CHF. It would be valuable to perform confirmatory factor analysis and to assess the convergent validity of the CaReQoL CHF by comparing scores with those on questionnaires such as the MLHQ and KCCQ. Future research may also employ longitudinal measurement with the CaReQoL CHF to assess the responsiveness of the CaReQoL CHF. Responsiveness addresses the ability of a PROM to detect change over time in the construct measured [42]. The present study is based on a single measurement in order to validate the CaReQoL CHF. More measurement points over time with the same patients would provide insight into the way the CaReQoL CHF responds to the effects of a treatment and whether these effects differ between patient groups, treatment options or healthcare providers. Finally, it would be relevant to determine whether the CaReQoL CHF can be used to monitor and adjust treatments, and whether incorporating results of the CaReQoL CHF into clinical daily practice would help improve the quality of care.

Conclusion

We developed a new instrument for measuring care-related outcomes in patients suffering from chronic heart failure, the CaReQoL CHF. It is a concise and valid PROM that matches patients’ priorities in healthcare. The instrument requires further validation, but possesses at least one promising feature that may be relevant for chronic heart failure patients in general, which is that it covers the theme ‘feeling in safe hands’. This theme was identified as being very important by the patients, but lacking in existing PROMs. In addition, the instrument is rather short compared to other existing instruments which is generally considered desirable. Future research should further establish the validity and reliability of the instrument by comparing scores with those on other questionnaires and possibly confirmatory factor analysis.

Abbreviations

CaReQoL CHF:

Care-Related Quality of Life survey for Chronic Heart Failure

NYHA:

New York Heart Association

PROM:

Patient-Reported Outcome Measure

References

  1. World Health Organization. Quality of care: a process for making strategic choices in health systems. Geneva: WHO; 2006.

    Google Scholar 

  2. U.S. Food and Drug Administration. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. Health Qual Life Outcomes. 2006;4(1):79.

    Article  Google Scholar 

  3. Bausewein C, Simon ST, Benalia H, Downing J, Mwangi-Powell FN, Daveson BA, Harding R, Higginson IJ. Implementing patient reported outcome measures (PROMs) in palliative care–users’ cry for help. Health Qual Life Outcomes. 2011;9(27):11.

    Google Scholar 

  4. Greenhalgh J, Long A, Brettle AJ, Grant MJ. Reviewing and selecting outcome measures for use in routine practice. J Eval Clin Pract. 1998;4(4):339–50.

    Article  CAS  PubMed  Google Scholar 

  5. Basch E, Torda P, Adams K. Standards for patient-reported outcomeΓÇôBased performance MeasuresStandards for patient-reported outcomeΓÇôBased performance MeasuresViewpoint. JAMA. 2013;310(2):139–40.

    Article  CAS  PubMed  Google Scholar 

  6. Devlin NJ, Appleby J. Getting the most out of PROMS. London: The King's Fund; 2010.

    Google Scholar 

  7. Wilson IB, Cleary PD. Linking clinical variables with health-related quality of life. JAMA. 1995;273(1):59–65.

    Article  CAS  PubMed  Google Scholar 

  8. Guyatt GH, Feeny DH, Patrick DL. Measuring health-related quality of life. Ann Intern Med. 1993;118(8):622–9.

    Article  CAS  PubMed  Google Scholar 

  9. The EuroQol Group. EuroQol - a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208.

    Article  Google Scholar 

  10. Ware JE, Kosinski M, Dewey JE, Gandek B. SF-36 health survey: manual and interpretation guide. Boston: New England Medical Center; 1993.

    Google Scholar 

  11. McKenna SP. Measuring patient-reported outcomes: moving beyond misplaced common sense to hard science. BMC Med. 2011;9(1):86.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Guyatt GH. Measurement of health-related quality of life in heart failure. Irish J Psychol. 1994;15(1):148–63.

    Article  Google Scholar 

  13. Wiering B, De Boer D, Delnoij D. Patient involvement in the development of patient reported outcome measures: a scoping review. Health Expect. 2016. doi:10.1111/hex.12573.

  14. Chang S, Newton PJ, Inglis S, Luckett T, Krum H, Macdonald P, Davidson PM. Are all outcomes in chronic heart failure rated equally? An argument for a patient-centred approach to outcome assessment. Heart Fail Rev. 2014;19(2):153–62.

    Article  PubMed  Google Scholar 

  15. Fitzpatrick R, Davey C, Buxton M, Jones D. Evaluating patient based outcome measures for use in clinical trial. Health Technol Assess. 1998;2(14):1–74.

    CAS  PubMed  Google Scholar 

  16. Kirwan JR, Fries JF, Hewlett S, Osborne RH. Patient perspective: choosing or developing instruments. J Rheumatol. 2011;38(8):1716–9.

    Article  PubMed  Google Scholar 

  17. Rose D, Evans J, Sweeney A, Wykes T. A model for developing outcome measures from the perspectives of mental health service users. Int Rev Psychiatry. 2011;23(1):41–6.

    Article  PubMed  Google Scholar 

  18. Dickstein K, Cohen-Solal A, Filippatos G, McMurray JJ, Ponikowski P, Poole-Wilson PA, Strömberg A, Veldhuisen DJ, Atar D, Hoes AW. ESC guidelines for the diagnosis and treatment of acute and chronic heart failure 2008‡. Eur J Heart Fail. 2008;10(10):933–89.

    Article  PubMed  Google Scholar 

  19. Engelfriet P, Hoogenveen R, Poos M, Blokstra A, van Baal P, Verschuren W: Heart failure: epidemiology, risk factors and future (In Dutch: Hartfalen: epidemiologie, risicofactoren en toekomst). RIVM report 260401006 2012.

    Google Scholar 

  20. Kelkar AA, Spertus J, Pang P, Pierson RF, Cody RJ, Pina IL, Hernandez A, Butler J. Utility of patient-reported outcome instruments in heart failure. JACC Heart Fail. 2016;4(3):165–75.

    Article  PubMed  Google Scholar 

  21. Rector TS, Cohn JN. Assessment of patient outcome with the Minnesota Living with Heart Failure questionnaire: reliability and validity during a randomized, double-blind, placebo-controlled trial of pimobendan. Am Heart J. 1992;124(4):1017–25.

    Article  CAS  PubMed  Google Scholar 

  22. Green CP, Porter CB, Bresnahan DR, Spertus JA. Development and evaluation of the Kansas City Cardiomyopathy Questionnaire: a new health status measure for heart failure. J Am Coll Cardiol. 2000;35(5):1245–55.

    Article  CAS  PubMed  Google Scholar 

  23. Brod M, Tesler LE, Christensen TL. Qualitative research and content validity: developing best practices based on science and experience. Qual Life Res. 2009;18(9):1263–78.

    Article  PubMed  Google Scholar 

  24. Brédart A, Marrel A, Abetz-Webb L, Lasch K, Acquadro C. Interviewing to develop patient-reported outcome (PRO) measures for clinical research: eliciting patients’ experience. Health Qual Life Outcomes. 2014;12(1):15.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Lehoux P, Poland B, Daudelin G. Focus group research and “the patient's view”. Soc Sci Med. 2006;63(8):2091–104.

    Article  PubMed  Google Scholar 

  26. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, Ring L. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2—assessing respondent understanding. Value Health. 2011;14(8):978–88.

    Article  PubMed  Google Scholar 

  27. Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opin Quart. 2007;71(2):287–311.

    Article  Google Scholar 

  28. Buers C, Triemstra M, Bloemendal E, Zwijnenberg NC, Hendriks M, Delnoij DM. The value of cognitive interviewing for optimizing a patient experience survey. Int J Soc Res Methodol. 2014;17(4):15.

    Article  Google Scholar 

  29. Drennan J. Cognitive interviewing: verbal data in the design and pretesting of questionnaires. J Adv Nurs. 2003;42(1):57–63.

    Article  PubMed  Google Scholar 

  30. Knafl K, Deatrick J, Gallo A, Holcombe G, Bakitas M, Dixon J, Grey M. The analysis and interpretation of cognitive interviews for instrument development. Res Nurs Health. 2007;30(2):224–34.

    Article  PubMed  Google Scholar 

  31. Van Kessel P, Hendriks M, Van der Hoek L, Plass AM. Development of the Care-Related Quality of life Measure for Chronic Heart Failure (CaReQoL CHF) (In Dutch: Ontwikkeling van de Care Related Quality of Life voor Chronisch Hartfalen (CaReQoL CHF)). Utrecht: NIVEL; 2015.

    Google Scholar 

  32. Scientific Advisory Committee of the Medical Outcomes Trust. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11(3):193–205.

    Article  Google Scholar 

  33. The Criteria Committee of the New York Heart Association: Nomenclature and criteria for diagnosis of diseases of the heart and great vessels. Boston: Little, Brown Medical Division; 1979.

  34. Sixma H, Kerssens JJ, Campen C, Peters L. Quality of care from the patients’ perspective: from theoretical concept to a new measuring instrument. Health Expect. 1998;1(2):82–95.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Van Kessel P, Hendriks M, Hoek L, Plass A. Chronic heart failure: questionnaire development and CHF patients’ experiences with hospital care (In Dutch: CQ-index Chronisch Hartfalen: ontwikkeling van de vragenlijst en de ervaringen van mensen met chronisch hartfalen met de ziekenhuiszorg). Utrecht: NIVEL; 2015.

    Google Scholar 

  36. Kelley JM, Kraft-Todd G, Schapira L, Kossowsky J, Riess H. The influence of the patient-clinician relationship on healthcare outcomes: a systematic review and meta-analysis of randomized controlled trials. PLoS One. 2014;9(4):e94207.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Renzi C, Tabolli S, Picardi A, Abeni D, Puddu P, Braga M. Effects of patient satisfaction with care on health-related quality of life: a prospective study. J Eur Acad Dermatol Venereol. 2005;19(6):712–8.

    Article  CAS  PubMed  Google Scholar 

  38. Donabedian A. The quality of care: How can it be assessed? JAMA. 1988;260(12):1743–8.

    Article  CAS  Google Scholar 

  39. Testa MA, Simonson DC. Assessment of quality-of-life outcomes. N Engl J Med. 1996;334(13):835–40.

    Article  CAS  PubMed  Google Scholar 

  40. Reeve BB, Wyrwich KW, Wu AW, Velikova G, Terwee CB, Snyder CF, Schwartz C, Revicki DA, Moinpour CM, McLeod LD. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013;22(8):1889–905. doi:10.1007/s11136-012-0344-y.

  41. Frost MH, Reeve BB, Liepa AM, Stauffer JW, Hays RD. What is sufficient evidence for the reliability and validity of patient-reported outcome measures? Value Health. 2007;10:S94–S105.

    Article  PubMed  Google Scholar 

  42. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank all the patients for participating in this study. Several representatives of health care providers, a patient organization, health care insurances and Stichting Miletus were member of an advisory committee. We would like to thank the members for their comments and recommendations during the project.

Funding

Stichting Miletus was the main funder in this research project. This organisation represents Dutch health care insurers regarding the development and measurement of PROMs and patient-reported experience measures (PREMs).

Availability of data and materials

NIVEL is not owner of the data used in this study. Therefore, we are not authorized to share this data. The data supporting findings of this study can be requested through Stichting Miletus, owner of the data.

Author information

Authors and Affiliations

  1. Netherlands Institute for Health Services Research (NIVEL), Utrecht, Netherlands

    Paul van Kessel, Dolf de Boer, Michelle Hendriks & Anne Marie Plass

  2. University Medical Center Göttingen (UMG)/ Georg-August-University, Institute of Medical Psychology and Medical Sociology, Göttingen, Germany

    Anne Marie Plass

Authors
  1. Paul van Kessel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dolf de Boer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michelle Hendriks
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anne Marie Plass
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have read and approved the final manuscript. PVK, MH and AMP were leading the research project and were responsible for making decisions regarding design of the study and collection, analysis, and interpretation of data. PVK wrote the first version of the manuscript, incorporated all suggestions from the co-authors into the manuscript and prepared the final manuscript for submission. PVK and MH did the data analysis. DDB, MH and AMP reviewed the manuscript critically.

Corresponding author

Correspondence to Michelle Hendriks.

Ethics declarations

Ethics approval and consent to participate

No ethical approval and formal consent for participation was necessary, as research by a non-encroaching survey such as used in this study is not subject to the Dutch Medical Research Involving Human Subjects Act (WMO).

Consent for publication

No consent for publication was requested since the manuscript does not contain any data that can be related to an individual participant.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

van Kessel, P., de Boer, D., Hendriks, M. et al. Measuring patient outcomes in chronic heart failure: psychometric properties of the Care-Related Quality of Life survey for Chronic Heart Failure (CaReQoL CHF). BMC Health Serv Res 17, 536 (2017). https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-017-2452-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-017-2452-4

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us