This article has Open Peer Review reports available.
How to promote, improve and test adherence to scientific evidence in clinical practice
© Caminiti et al; licensee BioMed Central Ltd. 2005
Received: 09 May 2005
Accepted: 19 September 2005
Published: 19 September 2005
Negative variation in the management of patients with the same clinical condition is frequent, and affects quality of care. Recent studies indicate that single interventions are not an effective solution. We aim to demonstrate that a multifaceted strategy can favor the introduction of research into practice, and to assess its long-term effects on a set of common medical conditions exhibiting significant negative variation at our institution.
The strategy, devised and agreed upon by a multidisciplinary group, was first applied to one relevant medical condition – cerebral ischemic stroke. To test its effectiveness a quasi-experimental study was conducted, comparing an intervention group with historical controls. After validation the strategy was extended to other pathologies, and its long-term effect measured using evidence-based quality indicators. Adherence to each indicator was determined prospectively on a six-month basis for a period of at least two consecutive years. Measures are expressed as proportions with 95% confidence intervals.
Validation findings demonstrated that the strategy improved compliance with scientific evidence: the percentage of patients who received a CT scan within 24 hours of hospital presentation rose from 56% to 75%, (χ2 = 7.43 p < 0.01); admissions to selected wards increased from 45% to 64%, (χ2 = 7.81 p < 0.01); the number of physical medicine visits within 24 hours of the request grew from 59% to 91% (χ2 = 14,40 p < 0.001). Over a four-year period the program was gradually applied to 14 medical conditions. Except for 3 cases, compliance with the pathway, i.e. number of eligible patients for whom data on the care process is collected, was above the minimum requirement of 75%. Indicator adherence generally exhibited a positive trend, though variability was observed both among different conditions and between different semesters for the same pathology.
According to our experience, incorporation of research into practice can be favored by systematically applying a shared, multifaceted strategy, involving multidisciplinary teams supported by central coordination. Institutions should device a tailor-made approach, should train personnel on implementation strategies, and create cultural acceptance of change. Just like for experimental trials, human and economic resources should be allocated within health care services to allow the achievement of this objective.
A large variance in the utilization of health technology (concerning both drugs, equipment, and medical/surgical procedures as well as the organizational and support framework for such performances) is increasingly evident, putting patients at risk of receiving unnecessary care, or of being deprived of performances already proven effective [1–3]. This awareness has made quality of care a central issue . In the past few years various approaches to this phenomenon have been developed, suggesting alternative methodological solutions involving different professional groups. Quality assurance (QA), technology assessment (TA), clinical epidemiology (CE), and continuous quality improvement (CQI), are just a few of the disciplines involved in the critical and constructive evaluation of clinical practice. The main and widely accepted indications suggested by research in this field [5, 6] are the following: 1) in order to ensure effectiveness, organizational, socio-cultural, and structural aspects must be taken into account; 2) in order to improve clinical practice the sources of problems must be identified, and all parties must be actively involved; 3) in order to verify and improve the quality of care, accurate local data must be readily available. Following the above-mentioned indications, we have decided to develop and implement at our hospital a multifaceted strategy, comprising the creation and application of integrated care pathways (ICPs), and the monitoring of quality indicators (QIs).
In this article we first describe this strategy and aim to demonstrate that it improves adherence to scientific evidence and consequently reduces negative deviations in patients with stroke. We then describe our experience over a four-year period with the gradual extension of the strategy to other eligible medical conditions and the testing of its long-term effect.
The study began in June 2000 and was implemented at one of the largest Italian health care facilities, with 1420 beds (of which 330 for out-patients and 90 for long-term care), and over 60,000 admissions per year.
This initiative was carried out as part of a project sponsored by the Italian Ministry of Health, and was designed in order to provide health planners with indications on factors which favor or hinder the routine use of clinical "best practice", in a natural context of a health care facility, and to suggest the rationale for new intervention studies.
Strategy's definition and validation
The strategy comprises a sequence of interventions, each designed to remove barriers which have been demonstrated by preceding studies to hinder EBM practice . It was developed with the involvement of various professionals: clinicians, nurses, administrators, epidemiologist, sociologist, patients' representative; this factor has made it possible to devise a shared program, suited to our local reality. Integrated care pathways, quality indicators and relative audit were chosen as tools necessary to health care workers to define the best process in the workplace and monitor variation.
ICPs' creation and application
1. Multidisciplinary team (MT) creation
Motivated clinicians and nurses involved with the condition join the MT voluntarily. While the MT should not be too large, it is important that all departments involved with the pathology be represented. The members will then appoint the coordinator – a key figure for the success of the pathway.
2. Agreement on objectives and actions
The MT meets regularly to identify key aspects and discuss local problems of the process of care. The team's discussion is based on the evidence gathered through a careful literature analysis. This will eventually lead to the creation of a document which contains the ICP's objectives, required interventions, the description of the pathway through time-task matrices, and the data collection sheet used for the analysis of the care process. This document will be subject to periodical reviews and modified when appropriate. The document is disseminated to all professionals involved with the pathology in question, in order to build consensus and favor its application.
3. Implementation phase
It's a sort of experimental stage, necessary to educate health care professionals on the use of the ICP; during this phase the data, gathered with an ad hoc data collection sheet, will be used to describe the care process, and MT compliance, i.e. the number of eligible patients for whom the data collection sheet is filled out, will be verified; this value is considered acceptable if greater than 75% .
Development of indicators and analysis through audit
Based on the analysis of the information collected with paper forms, during the implementation phase, and on detected variation, each member of the MT will suggest possible quality indicators. The MT will discuss them and assess them against criteria such as validity (strength of evidence), reliability and feasibility of data collection (they should be easy to retrieve, calculate and interpret), and sensitivity to change . The indicators which best meet the criteria, about 3–6, will be chosen, and form the minimum set of QIs, gathered prospectively using an electronic record  and monitored to measure adherence to scientific evidence. To ensure the correct interpretation of observed variations, inclusion and exclusion criteria for each QI are explicitly defined and considered during data processing.
Multiprofessional audit is performed regularly (approximately every 3 months) in order to discuss any negative deviations, to determine the causes, and act upon them if needed [7, 9–13]. This should ensure that improvement is gradually achieved and maintained.
Study design and statistical analysis for validation
The above-mentioned strategy was first applied to one relevant medical condition – cerebral ischemic stroke – in order to test its effectiveness. We opted for a quasi-experimental design, a controlled study in which an intervention is assigned without the use of randomization . To determine whether the introduction of the intervention had changed behavior in terms of improved adherence to scientific evidence, we compared clinical records of all patients with cerebral ischemic stroke consecutively hospitalized during 2 homogeneous periods, preceding and following the strategy's introduction. The size of the considered sample, about 100 cases per group, was adequate to detect a difference of at least 20%, with significance level α = 0.05 and power 1-β = 0.80. The comparison between proportions was examined using the χ2 test . We considered P values < 0.05 to be significant, P values < 0.01 strongly significant and P values < 0.001 extremely significant. Data were processed using the SAS System (version 8.1).
Strategy's extension and long-term effects
Following the validation phase, the strategy was gradually applied to other medical conditions chosen according to the following criteria: high admission frequency (at least 100 admissions/year), large variations in clinical practice affecting patient outcome, and high level of interest among local staff. Frequency and variation are verified through the analysis of discharge summaries, clinical records, or studies conducted at a local level for other purposes.
The activity of the MTs is coordinated by the Support Panel (SP). This group – made up of 1 epidemiologist, 1 professional nurse, 1 data manager, and 1 bibliographic researcher – verifies that the chosen medical conditions meet the selection criteria, tests compliance with the program, intervenes in the case of conflict, and provides support to the management in the collection and analysis of data and literature.
For the medical conditions which completed all the steps required by the multifaceted strategy, we recorded a minimum set of quality indicators to monitor the strategy's long-term effect. Data analysis was carried out following the methodology commonly applied in descriptive observational studies . The analysis consisted in the prospective collection of specific indicators, which must be gathered for all eligible patients (following the inclusion criteria established by the multidisciplinary team) consecutively admitted to hospital in a given period (the same dynamic target population). The analysis of such data enables to assess adherence to key aspects of the care process, both in terms of constant improvement and maintenance of improvement overtime once it has been achieved. We determined adherence to each indicator on a six-month basis for a period of at least 2 consecutive years (long-term effect). Each measure is expressed as a proportion with relative 95% confidence interval.
Performance of a CT scan within 24 hours of hospital presentation;
Patient admission to dedicated wards;
Timely involvement of the rehabilitation team
Pre-post comparison of compliance with QIs for Cerebral Ischemic Stroke
N. patients assessed
N. patients assessed
Performance of CT scan within 24 h of hospital presentation
75% ++ (67–83)
Admission to a dedicated ward
64% ++ (55–73)
Early intervention of the rehabilitation team *
91% +++ (84–98)
Cerebral CT scan is crucial to determining the type of stroke and consequently planning the correct therapy . Earlier, patients with suspected stroke usually underwent CT scan in the admission ward, often experiencing important delays, while in some cases the test was not performed. It was therefore decided to provide CT scans for suspected stroke in the emergency department. After the intervention the percentage of patients who received a CT scan within 24 hours of hospital presentation rose from 56% to 75%, (χ2 = 7.43 p < 0.01).
At our institution, stroke patients used to be hospitalized according to bed availability, which resulted in high dispersion. Considering the great importance of specialized stroke care, as demonstrated in the literature , the ICP requires that all subjects presenting to the ER with suspected stroke be reported by telephone to one of the referring physicians who will be in charge of the patient. Consequently, admissions of stroke patients to selected wards increased from 45% to 64%, (χ2 = 7.81 p < 0.01).
Prior to the intervention, physical medicine evaluation and rehabilitation were not always promptly initiated, mostly due to a lack of communication between the wards and the physical medicine department. Since early intervention is central in improving disability and quality of life , a referring physical medicine physician was chosen who is immediately informed via fax when a new stroke patient is admitted to hospital. This will enable the rapid provision of an individualized evaluation and rehabilitation program. After the introduction of this measure the number of patients with rehabilitative indication seen by the rehabilitation team within 24 hours grew from 59% to 91% (χ2 = 14,40 p < 0.001).
Strategy's extension and long-term effects
Over a four-year period the strategy was gradually applied to 14 medical conditions, involving nearly 150 health care workers, and allowing the hospital management of over 7000 patients/year to be verified.
Integrated care pathways in use at our institution
MT Compliance ++
Cerebral Ischemic Stroke
2 emergency medicine physicians, 1 geriatrist, 1 physical medicine physician, 1 neurologist, 1 neuroradiologist, 2 internists, 1 psychiatrist, 1 physiotherapist, 2 nurses.
Pediatric Head Injury
1 neuropsychiatrist, 2 pediatricians, 1 radiologist, 2 nurses.
3 cardiologists, 1 cardiosurgeon, 2 emergency medicine physicians, 2 internists, 3 nurses.
3 pulmonologists, 1 emergency medicine physician, 1 geriatrist, 1 physical medicine physician, 2 nurses.
3 gynecologists, 1 pediatrician, 1 obstetrician, 1 nurse.
3 pulmonologists, 2 thoracic surgeons, 1 oncologist, 1 radiologist, 1 radiotherapist, 1 physical medicine physician, 1 pathologist, 2 nurses.
2 oncologists, 3 surgeons, 1 plastic surgeon, 1 radiologist, 1 radiotherapist, 1 pathologist, 1 biologist, 1 nurse.
6 pediatricians, 1 neonatologist, 1 radiologist, 2 nurses.
2 gastroenterologists, 3 infective disease physicians, 2 nurses.
3 cardiologists, 4 internists, 2 emergency medicine physicians, 1 nurse.
4 orthopedists, 1 radiologist, 1 physical medicine physician, 1 anesthetist, 1 hematologist, 2 nurses.
3 dermatologists, 2 plastic surgeons, 1 nuclear medicine physician, 2 oncologists, 1 general surgeon, 1 pathologist, 1 nurse.
1 oncologist, 1 radiotherapist, 1 radiologist, 2 hematologist, 1 nuclear medicine physician, 1 surgeon, 2 internists, 1 nurse
1 emergency medicine physician, 2 pulmonologists, 1 nuclear medicine physician, 2 internists, 1 geriatrist, 1 cardiologist, 1 radiologist
By June 2004, indicators had been defined for 7 conditions. For 5 of those (Stroke, Chest Pain, COPD, Child Delivery, Lung Cancer) the effect of the strategy has been monitored for at least 2 years; for the remaining two (Liver Cirrhosis and Pediatric Pneumonia) indicators have been monitored since the second semester of 2003, and thus are not included in our long-term analysis. For three conditions (Supraventricular Tachiarrhythmias, Breast Cancer and Pediatric Head Injury) the minimum set of indicators had not been measured. Hip Arthroplasty, Melanoma and Non-Hodgkin Lymphomas had completed their implementation phase, and the MTs were working on defining the quality indicators to begin monitoring.
Trend of adherence to each indicator by semester
1st semester 2002 Percentage (95%CI)
2nd semester 2002 Percentage (95%CI)
1st semester 2003 Percentage (95%CI)
2nd semester 2003 Percentage (95%CI)
1st semester 2004 Percentage (95%CI)
CT scan performed within 24 hours of hospital presentation
Patients admitted to a dedicated ward
Visits by the physical medicine specialist within 24 hours of request for patients with rehabilitative indication 
Patients transferred to a post-acute care facility according to their clinical indications 
Psychiatric tests (GDS) administered to patients eligible for the test 
Patients discharged alive who underwent 1 follow-up visit 1–3 months after the onset of stroke 
Patients discharged from the ED and readmitted to hospital within 1 month 
Hospitalized patients admitted to the appropriate ward according to pain characteristics 
Patients with AMI admitted to the coronary ICU within 60 minutes of hospital presentation 
Diagnoses of AMI in the discharge summaries inconsistent with clinical records 
Patients hospitalized in the appropriate ward according to severity 
Patients eligible for spirometry who underwent spirometry 
Patients with MRC dyspnea grade >= 3 on admission who improved on discharge 
Patients hospitalized for the appropriate number of days according to clinical severity 
Cesarean sections on the total number of child deliveries 
Elective cesarean sections for women with previous cesarean section without contraindications to vaginal delivery 
Cesarean sections performed because of the woman's psychological refusal of vaginal delivery 
Patients included in the ICP within 2 weeks of the first X-ray 
Patients diagnosed within 4 weeks since ICP inclusion 
Staged patients 
Patients transferred to the intensive care unit for the first 24 hours after surgery 
Patients who underwent surgery according to eligibility criteria 
Borderline cases discussed by the multidisciplinary group 
Some indicators exhibit extremely high adherence, constant through time; for instance, percentage of borderline lung cancer cases discussed by the multidisciplinary team, performance of a CT scan in stroke patients, and appropriate length of stay (LOS) for COPD patients according to severity, have never fallen below 90% in the observed semesters.
Other indicators began with a low, or fairly low adherence and then exhibited considerable improvements; for instance, the percentage of eligible patients receiving spirometry rose from 56% to 96%. The same positive trend was observed for indicators relating to the appropriateness of admission: stroke patients admitted to a dedicated ward (63%–82%); patients with chest pain hospitalized in the appropriate ward according to pain characteristics (64%–77%); and COPD patients hospitalized in the appropriate ward according to severity (64%–86%).
Finally, for some indicators adherence rates are still low compared to the standards found in the literature; for example, the percentage of cesarean sections (CSs) (39% in the last semester) remains far above the WHO recommendation of a 15% rate. Analogously, the percentage of lung cancer patients included in the ICP within 2 weeks of the first X-ray, on which suspicion is based, remains fairly poor in the 4 analyzed semesters.
In order to improve adherence to evidence-based medicine at our hospital, we applied a planned strategy comprising a combination of interventions, each addressing specific barriers to change (from professional, socio-cultural, and organizational viewpoints); we have demonstrated through a quasi-experimental study the effectiveness of this strategy. The improvement trend we demonstrate is consistent with the findings reported by Kwan et al in a very recent before-after study on the application of a Stroke pathway, concerning the indicators on timely CT scan performance and early involvement of the rehabilitation team .
The execution of the program we propose is complex (it requires meetings, debates, data collection, etc.), but so is the process of incorporation of evidence into practice; in fact, despite publication of several management guidelines in virtually any medical field, the literature shows that adherence to EBM indications is often poor [2, 20–22]. The biggest obstacle seems to be the perception of guidelines as tools distant from the reality in which one operates, and the large amount of information often contained in guidelines, which clinicians have no time to digest [20, 23]. The picture is complicated by the gap between those who practice and those who manage health care, whereby the introduction of new technologies/tests and the implementation of change is sometimes left to the initiative of individual professionals, or, conversely, allows administrators to activate or cancel procedures without assessing the effects of their decisions at a local level with those directly involved (health care workers and users). We tried solving these problems by creating a constant debate between administrators and health care workers, from the initial stages of the improvement strategy's definition.
We have demonstrated the strategy's capability to improve adherence to scientific evidence through a quasi-experimental study with historical controls, and not a randomized trial. RCTs are the gold standard for testing effectiveness, however in our case this design would have posed a number of methodological issues. For complex interventions aiming to change behavior, like ours, randomization by individual patients is not feasible and cluster randomization, by doctor or practice, is usually advised . This approach, however, would have been extremely complex to take in our study, because the strategy in question involves multiple organizational levels (Emergency Department, Internal Medicine wards, Neurology, Rehabilitation, Radiology service). Furthermore, since the intervention's effectiveness depends on the subjects' active participation and on their choices, random allocation may lessen its effect, and a clinical trial would in fact be inappropriate [25, 26].
The analysis of clinical records as a means of validating the program also has some well-known limitations (exhaustivity, accuracy, etc.), however it offers the great advantage of allowing timely access to the information needed to documenting an intervention's impact using a historical control. A possible bias may exist in the interpretation of the measured effect, which may be due to greater accuracy of documentation rather than to a real change in care. However, since a pathway's success is strictly related to the quality and quantity of available information on the patients' characteristics and the tests they undergo, the appropriate management of clinical information is part of our work's objective.
Our work concerns the adoption of an improvement strategy in a large hospital involving a set of common medical conditions, and its long-term effectiveness. Studies on the subject generally focus on a single condition, or on a few easy-to-standardized pathologies [27–34]. Instead, our work concerns the use of 14 ICPs, of which 77% exhibit good compliance with the strategy. Noteworthy is also the number of patients, approximately 7000/year, whose hospital management is verified through: the analysis of data prospectively collected, the comparison with the most recent scientific indications, and the discussion of deviations by a group of experts directly involved in the management of the condition. What makes our experience different is that it focuses on the strategy's effectiveness in the long-run, while research on ICPs found in the literature generally reports on short-term findings. A very recent Australian study  does focus on the long-term effect of ICP use, but the number of patients included in the analysis is quite small.
Despite some variability, data generally demonstrate a positive trend, showing improvements for most indicators with fairly frequent drops in both second semesters, which most probably reflect the greater difficulties encountered during the summer holiday season, when personnel is reduced, thus affecting the provision of services. The measures we adopted to achieve change in behavior were both educational (critical literature analysis, sharing and dissemination of the ICP, systematic clinical audits, etc.), and organizational/managerial (performance of CT scans in the emergency department, rapid involvement of the rehabilitation team via fax, use of a portable spirometer for bedridden patients, etc.). As also noted by Panella et al in a recent Italian experience with the application of an ICP program , constant dialogue within MTs and between managers and clinicians, based on variance analysis, is essential to ensure best clinical practice.
The employment of this strategy is not easy, and some medical conditions have encountered greater difficulties than others. The ICP on Breast Cancer has been inactive since September 2002; though it was initiated in December 2001, it has not yet completed its implementation phase, and indicators have not yet been defined. This pathway's problems are mostly caused by the instability consequent to the change of the director of the Oncology Department, which led to the lack of a leading figure in the multidisciplinary group, an essential aspect for improvement of clinical practice . The ICP on Pediatric Head Injury was also inactive since January 2002. Indicators have been defined but never applied. The main obstacle for this ICP seems to be the concern of many physicians of losing their professional freedom, also fearing possible ethical and legal implications in the care of children . The ICP on Supraventricular tachiarrhythmias, which was in its implementation phase, shows the lowest MT compliance, 55%. The difficulty seems to lie mainly in the large amount of data to be collected, since the MT had not identified the most interesting key aspects, and in the fact that this group of patients is managed in several different wards. Finally, the ICP on Child Delivery has proven very ineffective, exhibiting very low adherence with the selected QIs. Various major obstacles have been identified for this ICP: first of all, the lack of sound scientific evidence supporting the pathway's indications, which were derived from authoritative sources (WHO) but are mostly based on expert opinion and remain controversial. Furthermore, it is believed that the high and rising cesarean section rates in most countries may be due in part to physician attitudes of defensive medicine. Legal suits are very frequent when a vaginal delivery has a bad outcome, but they are unlikely when an unnecessary cesarean section is performed . Protection against legal litigation would thus be required to enhance compliance with indications aiming to reduce unnecessary cesarean section rates. Other actions which could help achieve WHO goals are the provision of epidural anesthesia free of charge (in most Italian institutions it is rather costly for patients), and the equalization of financial compensation for CS and vaginal delivery, since in Italy the former is much higher and this might encourage some gynecologists to support the performance of unnecessary CSs.
This research highlights the importance of multidisciplinary involvement in the creation and application of a strategy to favor EBM introduction into practice. We believe hospitals should ensure the incorporation of research into routine practice by systematically applying a shared, multifaceted strategy, as single interventions cannot be effective in all situations . Our experience confirms what recently emphasized in the literature, i.e. that multiple approaches are the most effective, and that the choice of interventions should be guided by the analysis of determinants of professional behavior and by specific clinical and organizational circumstances . Health care institutions willing to adopt analogous tools should first assess local characteristics carefully and develop a tailor-made approach.
The presence of central coordination, competent in scientific methodology and implementation techniques, is necessary to support the work of individual multidisciplinary teams, to favor agreement between health care professionals and managers, and to constantly remind all parties involved of the importance of the program, as motivation is likely to decrease with time. A far-reaching change in culture is essential to favor the acceptance of change in an organization. Institutions should offer their professionals adequate training on implementation strategies and on the nature and importance of clinical practice improvement .
The main down side of this program, as emphasized in the literature on quality improvement strategies  is its high costs in terms of staff time. This can be a cause of reluctance for some clinicians and managers. However, the introduction of scientific evidence into practice does necessarily require time and money. We therefore believe that, just like for experimental trials, economic and professional resources should be allocated to allow the achievement of this objective.
The idea of this project was first conceived by our hospital's former Managing Director, Dr. Gianni Giorgi. This work would never have been completed without his creativity, competence and enthusiasm. We thank Giacomo Annaloro, Maria Cristina Cornelli, Simona Fontechiari, Adriana Gelmini, Maria Grazia Ollari, and Maria Rosaria Pieri Nerli, for their precious contribution to the definition of the strategy. We are grateful to all the clinicians and nurses of each multidisciplinary team, who dedicated so much time and effort to this work. Our special thanks go to the following MT coordinators, for their high motivation and commitment: Diego Ardissino (Chest Pain and Supraventricular Tachiarrhythmias), Gianfranco Cervellin (Pulmonary Thromboembolism), Giuseppe De Panfilis (Melanoma), Carlo Ferrari (Liver Cirrhosis), Alessandro Grignaffini (Child Delivery), Dario Olivieri (COPD), Bruno Panno (Hip arthroplasty), Giovanna Pisi (Childhood Pneumonia), Vittorio Rizzoli (Non Hodgkin Lymphomas), Michele Rusca (Lung Cancer). We thank Davide Romano and Renata Todeschini for their precious help with editing. Finally, we are very thankful to our Managing Director, Sergio Venturi, and Medical Superintendent, Gianbattista Spagnoli, for their essential support to the initiative.
- Jencks SF, Cuerdon T, Burwen DR, Fleming B, Houck PM, Kussmaul AE, Nilasena DS, Ordin DL, Arday DR: Quality of medical care delivered to Medicare beneficiaries: A profile at state and national levels. JAMA. 2000, 284: 1670-1676. 10.1001/jama.284.13.1670.View ArticlePubMedGoogle Scholar
- Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362 (9391): 1225-1230. 10.1016/S0140-6736(03)14546-1.View ArticlePubMedGoogle Scholar
- Shortell SM, Bennett CL, Byck GR: Assessing the impact of continuous quality improvement on clinical practice: what it will take to accelerate progress. Milbank Q. 1998, 76 (4): 593-624. 10.1111/1468-0009.00107. 510View ArticlePubMedPubMed CentralGoogle Scholar
- Bodenheimer T: The American health care system–the movement for improved quality in health care. N Engl J Med. 1999, 340 (6): 488-492. 10.1056/NEJM199902113400621.View ArticlePubMedGoogle Scholar
- McDonald IG: Quality assurance and technology assessment: pieces of a larger puzzle. J Qual Clin Pract. 2000, 20: 87-94. 10.1046/j.1440-1762.2000.00372.x.View ArticlePubMedGoogle Scholar
- Smith TJ, Hillner BE: Ensuring quality cancer care by the use of clinical practice guidelines and critical pathways. J Clin Oncol. 2001, 19: 2886-2897.PubMedGoogle Scholar
- Campbell H, Hotchkiss R, Bradshaw N, Porteous M: Integrated care pathways. BMJ. 1998, 316: 133-137.View ArticlePubMedPubMed CentralGoogle Scholar
- Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. BMJ. 2003, 326 (7393): 816-9. 10.1136/bmj.326.7393.816.View ArticlePubMedPubMed CentralGoogle Scholar
- Kaltenthaler E, McDonnell A, Peters J: Monitoring the care of lung cancer patients: linking audit and care pathways. J Eval Clin Pract. 2001, 7 (1): 13-20. 10.1046/j.1365-2753.2001.00275.x.View ArticlePubMedGoogle Scholar
- Kitchiner D, Davidson C, Bundred P: Integrated care pathways: effective tools for continuous evaluation of clinical practice. J Eval Clin Pract. 1996, 2 (1): 65-69.View ArticlePubMedGoogle Scholar
- Kitchiner D, Bundred P: Integrated care pathways increase use of guidelines. BMJ. 1998, 317: 147-148.View ArticlePubMedPubMed CentralGoogle Scholar
- Dalton P, Macintosh DJ, Pearson B: Variance analysis in clinical pathways for total hip and knee joint arthroplasty. J Qual Clin Pract. 2000, 20: 145-149. 10.1046/j.1440-1762.2000.00382.x.View ArticlePubMedGoogle Scholar
- Sweeney AB, Flora HS, Chaloner EJ, Buckland J, Morrice C, Barker SG: Integrated care pathways for vascular surgery: an analysis of the first 18 months. Postgrad Med J. 2002, 78 (917): 175-177. 10.1136/pmj.78.917.175.View ArticlePubMedPubMed CentralGoogle Scholar
- Kleinbaum DG, Kupper LL, Morgenstern H: Epidemiologic research: principles and quantitative methods. 1982, New York: Van Nostrand Reinhold, 44-5.Google Scholar
- Fleiss JL: Statistical Methods for Rates and Proportions. 1981, John Wiley & Sons. New York, 2Google Scholar
- Measuring and improving quality of care: a report from the American Heart Association/American College of Cardiology First Scientific Forum on Assessment of Healthcare Quality in Cardiovascular Disease and Stroke. Circulation. 2000, 101: 1483-1493.Google Scholar
- Adams HP, Adams RJ, Brott T, del Zoppo GJ, Furlan A, Goldstein LB, Grubb RL, Higashida R, Kidwell C, Kwiatkowski TG, Marler JR, Hademenos GJ, Stroke Council of the American Stroke Association: Guidelines for the early management of patients with ischemic stroke: A scientific statement from the Stroke Council of the American Stroke Association. Stroke. 2003, 34 (4): 1056-1083. 10.1161/01.STR.0000064841.47697.22.View ArticlePubMedGoogle Scholar
- Stroke Unit Trialists' Collaboration: Organised inpatient (stroke unit) care for stroke (Cochrane Review). The Cochrane Library. 2004, Chichester, UK: John Wiley & Sons, Ltd, 2Google Scholar
- Kwan J, Hand P, Dennis M, Sandercock P: Effects of introducing an integrated care pathway in an acute stroke unit. Age Ageing. 2004, 33 (4): 362-7. 10.1093/ageing/afh104.View ArticlePubMedGoogle Scholar
- Gallagher EJ: How well do clinical practice guidelines guide clinical practice?. Ann Emerg Med. 2002, 40 (4): 394-398. 10.1016/S0196-0644(02)00059-8.View ArticlePubMedGoogle Scholar
- Roberts CM, Ryland I, Lowe D, Kelly Y, Bucknall CE, Pearson MG, Audit Sub-committee of the Standards of Care Committee, British Thoracic Society: Clinical Effectiveness and Evaluation Unit, Royal College of Physicians: Audit of acute admissions of COPD: standards of care and management in the hospital setting. Eur Respir J. 2001, 17 (3): 343-349. 10.1183/09031936.01.17303430.View ArticlePubMedGoogle Scholar
- Barnard J, Siriwardena AK: Variations in implementation of current national guidelines for the treatment of acute pancreatitis: implications for acute surgical service provision. Ann R Coll Surg Engl. 2002, 84 (2): 79-81.PubMedPubMed CentralGoogle Scholar
- Shaneyfelt TM: Building bridges to quality. JAMA. 2001, 286 (20): 2600-2601. 10.1001/jama.286.20.2600.View ArticlePubMedGoogle Scholar
- Medical Research Council: A framework for development and evaluation of RCTs for complex interventions to improve health. 2001, [http://www.mrc.ac.uk/pdf-mrc_cpr.pdf]Google Scholar
- Grimshaw J, Freemantle N, Wallace S, Russell I, Hurwitz B, Watt I, Long A, Sheldon T: Developing and implementing clinical practice guidelines. Qual Health Care. 1995, 4 (1): 55-64.View ArticlePubMedPubMed CentralGoogle Scholar
- Black N: Why we need observational studies to evaluate the effectiveness of health care. BMJ. 1996, 312 (7040): 1215-1218.View ArticlePubMedPubMed CentralGoogle Scholar
- Johnson KB, Blaisdell CJ, Walker A, Eggleston P: Effectiveness of a clinical pathway for inpatient asthma management. Pediatrics. 2000, 106: 1006-1012. 10.1542/peds.106.5.1006.View ArticlePubMedGoogle Scholar
- Dowsey MM, Kilgour ML, Santamaria NM, Choong PF: Clinical pathways in hip and knee arthroplasty: a prospective randomised controlled study. Med J Aust. 1999, 170: 59-62.PubMedGoogle Scholar
- Pitt HA, Murray KP, Bowman HM, Coleman J, Gordon TA, Yeo CJ, Lillemoe KD, Cameron JL: Clinical pathway implementation improves outcomes for complex biliary surgery. Surgery. 1999, 126: 751-756. 10.1067/msy.2099.100672.View ArticlePubMedGoogle Scholar
- Miller PR, Fabian TC, Croce MA, Magnotti LJ, Elizabeth Pritchard F, Minard G, Stewart RM: Improving outcomes following penetrating colon wounds: application of a clinical pathway. Ann Surg. 2002, 235: 775-781. 10.1097/00000658-200206000-00004.View ArticlePubMedPubMed CentralGoogle Scholar
- Chang SS, Smith JA, Girasole C, Baumgartner RG, Roth BJ, Cookson MS: Beneficial impact of a clinical care pathway in patients with testicular cancer undergoing retroperitoneal lymph node dissection. J Urol. 2002, 168 (1): 87-92. 10.1097/00005392-200207000-00021.View ArticlePubMedGoogle Scholar
- Marrie TJ, Lau CY, Wheeler SL, Wong CJ, Vandervoort MK, Feagan BG: A controlled trial of a critical pathway for treatment of community-acquired pneumonia. JAMA. 2000, 283: 749-755. 10.1001/jama.283.6.749.View ArticlePubMedGoogle Scholar
- Choong PF, Langford AK, Dowsey MM, Santamaria NM: Clinical pathway for fractured neck of femur: a prospective, controlled study. Med J Aust. 2000, 172: 423-426.PubMedGoogle Scholar
- Feagan BG: A controlled trial of a critical pathway for treating community-acquired pneumonia: the CAPITAL study. Community-Acquired Pneumonia Intervention Trial Assessing Levofloxacin. Pharmacotherapy. 2001, 21 (7 Pt 2): 89S-94S. 10.1592/phco.21.10.89S.34535.View ArticlePubMedGoogle Scholar
- Wolff AM, Taylor SA, McCabe JF: Using checklists and reminders in clinical pathways to improve hospital inpatient care. Med J Aust. 2004, 181 (8): 428-31.PubMedGoogle Scholar
- Panella M, Marchisio S, Di Stanislao F: Reducing clinical variations with clinical pathways: do pathways work?. Int J Qual Health Care. 2003, 15 (6): 509-21. 10.1093/intqhc/mzg057.View ArticlePubMedGoogle Scholar
- Every NR, Hochman J, Becker R, Kopecky S, Cannon CP: Critical pathways: a review. Circulation. 2000, 101 (4): 461-5.View ArticlePubMedGoogle Scholar
- Wagner M: Choosing caesarean section. Lancet. 2000, 356 (9242): 1677-80. 10.1016/S0140-6736(00)03169-X.View ArticlePubMedGoogle Scholar
- Grilli R, Ballini L: Evidence-based medicine e miglioramento della pratica clinica. Etica, conoscenza e sanità. Edited by: Il Pensiero Sceintifico Editore. 2005, Roma: Liberati A, 229-257.Google Scholar
- Horne MK, Monash CSSP Consortium: The Monash University Consortium: factors involved in the local implementation of clinical evidence into practice. Med J Aust. 2004, 180 (10 Suppl): S89-91.PubMedGoogle Scholar
- Chiu L, Shyu WC, Liu YH: Comparisons of the cost-effectiveness among hospital chronic care, nursing home placement, home nursing care and family care for severe stroke patients. J Adv Nurs. 2001, 33: 380-386. 10.1046/j.1365-2648.2001.01703.x.View ArticlePubMedGoogle Scholar
- Johnson G, Burvill PW, Anderson CS, Jamrozik K, Stewart-Wynne EG, Chakera TM: Screening instruments for depression and anxiety following stroke: experience in the Perth community stroke study. Acta Psychiatr Scand. 1995, 91: 252-257.View ArticlePubMedGoogle Scholar
- Pope JH, Aufderheide TP, Ruthazer R, Woolard RH, Feldman JA, Beshansky JR, Griffith JL, Selker HP: Missed diagnoses of acute cardiac ischemia in the emergency department. N Engl J Med. 2000, 342: 1163-1170. 10.1056/NEJM200004203421603.View ArticlePubMedGoogle Scholar
- Lee TH, Goldman L: Evaluation of the patient with acute chest pain. N Engl J Med. 2000, 342: 1187-1195. 10.1056/NEJM200004203421607.View ArticlePubMedGoogle Scholar
- Van de Werf F, Ardissino D, Betriu A, Cokkinos DV, Falk E, Fox KA, Julian D, Lengyel M, Neumann FJ, Ruzyllo W, Thygesen C, Underwood SR, Vahanian A, Verheugt FW, Wijns W, Task Force on the Management of Acute Myocardial Infarction of the European Society of Cardiology: Management of acute myocardial infarction in patients presenting with ST-segment elevation. The Task Force on the Management of Acute Myocardial Infarction of the European Society of Cardiology. Eur Heart J. 2003, 24 (1): 28-66. 10.1016/S0195-668X(02)00618-8.View ArticlePubMedGoogle Scholar
- Cannon CP, Battler A, Brindis RG, Cox JL, Ellis SG, Every NR, Flaherty JT, Harrington RA, Krumholz HM, Simoons ML, Van De Werf FJ, Weintraub WS, Mitchell KR, Morrisson SL, Brindis RG, Anderson HV, Cannom DS, Chitwood WR, Cigarroa JE, Collins-Nakai RL, Ellis SG, Gibbons RJ, Grover FL, Heidenreich PA, Khandheria BK, Knoebel SB, Krumholz HL, Malenka DJ, Mark DB, Mckay CR, Passamani ER, Radford MJ, Riner RN, Schwartz JB, Shaw RE, Shemin RJ, Van Fossen DB, Verrier ED, Watkins MW, Phoubandith DR, Furnelli T: American College of Cardiology key data elements and definitions for measuring the clinical management and outcomes of patients with acute coronary syndromes. A report of the American College of Cardiology Task Force on Clinical Data Standards (Acute Coronary Syndromes Writing Committee). J Am Coll Cardiol. 2001, 38 (7): 2114-2130. 10.1016/S0735-1097(01)01702-8.View ArticlePubMedGoogle Scholar
- Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Pulmonary Disease. NHLBI/WHO Global Initiative for Chronic Obstructive Lung Disease (GOLD). Workshop Summary. Am J Respir Crit Care Med. 2001, 163: 1256-1276.Google Scholar
- MacNee W, Calverley PM: Chronic obstructive pulmonary disease. 7: Management of COPD. Thorax. 2003, 58 (3): 261-265. 10.1136/thorax.58.3.261.View ArticlePubMedPubMed CentralGoogle Scholar
- Bestall JC, Paul EA, Garrod R, Garnham R, Jones PW, Wedzicha JA: Usefulness of the Medical Research Council (MRC) dyspnoea scale as a measure of disability in patients with chronic obstructive pulmonary disease. Thorax. 1999, 54: 581-586.View ArticlePubMedPubMed CentralGoogle Scholar
- Cotton MM, Bucknall CE, Dagg KD, Johnson MK, MacGregor G, Stewart C, Stevenson RD: Early discharge for patients with exacerbations of chronic obstructive pulmonary disease: a randomized controlled trial. Thorax. 2000, 55: 902-906. 10.1136/thorax.55.11.902.View ArticlePubMedPubMed CentralGoogle Scholar
- World Health Organization: Appropriate technology for birth. Lancet. 1985, 2 (8452): 436-437.Google Scholar
- Brill Y, Windrim R: Vaginal birth after Caesarean section: review of antenatal predictors of success. J Obstet Gynaecol Can. 2003, 25 (4): 275-286.View ArticlePubMedGoogle Scholar
- Saisto T, Halmesmaki E: Fear of childbirth: a neglected dilemma. Acta Obstet Gynecol Scand. 2003, 82 (3): 201-208. 10.1034/j.1600-0412.2003.00114.x.View ArticlePubMedGoogle Scholar
- "Programma Nazionale linee guida" PNLG. [http://www.pnlg.it]
- British Thoracic Society, Society of Cardiothoracic Surgeons of Great Britain and Ireland Working Party: BTS guidelines: guidelines on the selection of patients with lung cancer for surgery. Thorax. 2001, 56 (2): 89-108. 10.1136/thorax.56.2.89.View ArticleGoogle Scholar
- The EACTS/ESTS Working Group on Structures in Thoracic Surgery: Structure of General Thoracic surgery in Europe. [http://www.akh-wien.ac.at/Herz-Thorax-Chirurgie/GTS/proposal/finaldocument.html]
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1472-6963/5/62/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.