- Research article
- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
Functional status decline as a measure of adverse events in home health care: an observational study
© Scharpf et al; licensee BioMed Central Ltd. 2006
Received: 07 May 2006
Accepted: 20 December 2006
Published: 20 December 2006
Research that examines the quality of home health care is complex because no gold standard exists for measuring adverse outcomes, and because the patient and clinician populations are highly heterogeneous. The objectives in this study are to develop models to predict functional decline for three indices of functional status as measures of adverse events in home health care and determine which index is most appropriate for risk-adjusting for future quality research.
Data come from the Outcomes and Assessment Information Set (OASIS) from a large urban home health care agency and other agency data. Prognostic data yields 49,437 episodes, while follow-up data yields 47,684 episodes. We tested three indices defined as substantial decline in three or more (gt3_ADLs), two or more (gt2_ADLs), and one or more (gt1_ADLs) ADLs. Multivariate logistic regression determines the performance of the models for each index as measured by the c-statistic and Hosmer-Lemeshow chi square (χ2).
Frequencies for gt3_ADLs, gt2_ADLs, and gt1_ADLs are 212 (0.43%), 783 (1.58%), and 4,271 (8.64%) respectively. Follow-up results are comparable with frequencies of 218 (0.46%), 763 (1.60%), and 3,949 (8.28%) for each index. Gt3_ADLs does not produce valid models. The model for gt2_ADLs consistently yields a higher c-statistic compared to gt1_ADLs (0.754 vs. 0.679, respectively). Both indices' models yield non-significant Hosmer-Lemeshow chi square indicating reasonable model fit. Findings for gt2_ADLs and gt1_ADLs are consistent over time as indicated by follow-up data results.
Gt2_ADLs yields the best models as indicated by a high c-statistic and a non-significant Hosmer-Lemeshow χ2, both of which exhibit exceptional consistency. We conclude that gt2_ADLs may be preferable in defining ADL adverse events in the context of home health care.
Research that examines the quality of home health care is complex because no gold standard exists for measuring adverse events, and because the patient and clinician populations are highly heterogeneous. In 1999, the Center for Medicare and Medicaid Services (CMS) instituted the use of the Outcomes and Assessment Information Set (OASIS) for all home health care agencies to be used for internal and external quality assessment. In October of 2000, OASIS measures also became the basis for case-mix adjustment in a new home health care prospective payment system. Shaughnessy et al. developed a comprehensive framework using a two-stage process for assessing the quality of home health care which separates the effects of natural disease progression from the effects of substandard care. The process and the measures they developed were used by CMS as the model on which to base home health care quality improvement [1, 2]. As part of its outcomes based quality initiative, CMS identifies 13 potential adverse events for patients in home health care. Adverse events are considered to be both rare and potentially preventable through provision of appropriate skilled care. The adverse events cover four main areas: emergency care, serious unexpected events, unmet care needs, and declines in health or physical functioning .
Definition of Individual ADLs and ADL Scales on OASIS
Definition of Values
0 = Able to groom self unaided, with or without use of assistive devices
1 = Grooming utensils must be placed within reach
2 = Someone must assist the patient to groom self
3 = Patient depends entirely upon someone else
ADL: Ability to dress upper body
0 = Able to obtain, put on, and remove clothing
1 = Able to dress upper body without assistance
2 = Someone must help patient
3 = Patient depends entirely on someone else
ADL: Ability to dress lower body
0 = Able to obtain, put on and remove clothing
1 = Able to dress lower body without assistance
2 = Someone must help the patient
3 = Patient depends entirely on someone else
0 = Able to bathe self in shower or tub independently
1 = With the use of devices, is able to bathe
2 = Able to bathe with the assistance of a person
3 = Participates in bathing in shower or tub
4 = Unable to use the shower or tub, but able to assist
5 = Unable to effectively participate in bathing, totally bathed by another person
0 = Able to get to and from the toilet independently
1 = When reminded assisted or supervised
2 = Unable to get to and from toilet; can use bedside commode
3 = Unable to get to from the toilet or bedside commode; can use a bedpan
4 = Is totally dependent for toileting
0 = Able to independently transfer
1 = Transfers with minimal human assistance
2 = Unable to transfer self but is able to bear weight
3 = Unable to transfer self and is unable to bear weight
4 = Bedfast, unable to transfer but is able to turn
5 = Bedfast, unable to transfer and is unable to turn
0 = Able to independently walk
1 = Requires use of a device
2 = Able to walk only with the supervision
3 = Chairfast, unable to ambulate but can use wheelchair
4 = Chairfast, unable to ambulate and or use wheelchair
5 = Bedfast
ADL: Feeding or eating
0 = Able to independently feed self
1 = Able to feed self but requires help in setup
2 = Unable to feed self and requires human assistance
3 = Able to take in nutrients orally and tube fed
4 = Unable to take in nutrients orally; tube fed
5 = Unable to take in nutrients orally or by tube feeding
In this paper, we evaluate three indices of ADL decline among home health patient episodes of care at a large metropolitan home health care agency. One index is calculated in a comparable fashion to the one currently used by CMS, described above. Based on empirical and theoretical considerations, two additional indices are developed. The main question is whether the CMS definition is the most appropriate ADL index for defining adverse events in the context of home health care. A secondary question is the degree to which the indices may be affected by floor effects that may lead to biased results .
The data consist of episodes of patient care derived from two separate six-month periods, the first of which is used to derive the analysis sample, with the second providing a follow-up sample for evaluating consistency over time. The same six months from adjacent years are used to minimize any seasonal bias across samples. This study is based on deidentified data and as such was granted exemption from ethical review by Case Western Reserve University.
The start of any given episode of care is defined as the first recorded OASIS assessment during the sample time frame for start of care or resumption of care. Resumption of care occurs when patients are returning to home health care after a transfer to an institutional setting. The end of a given episode of care is defined as the first discharge OASIS assessment occurring on or before 60 days following the start of the episode; if no discharge has occurred by 60 days, the closest OASIS assessment available at or before 60 days is used. Following the implementation of the home health prospective payment system for Medicare home health, CMS required agencies to conduct OASIS assessments every 60 days for patients still in care. Thus, the maximum length for an individual episode is 60 days. Because the time frames for each sample is 6 months, patients may experience multiple episodes within a sample.
As a first step to developing alternatives to the conservative CMS-based index, we evaluate two-unit change frequencies for each individual ADL (e.g., minimum two-unit declines in each category: grooming, toileting, bathing, transferring, and bathing). Incremental change for a one-unit decline for the five ADLs and for a three-unit decline for the five ADLs are also evaluated. These univariate analyses are done for two reasons:
to determine which ADLs are driving the indices (i.e., comprising the largest frequency);
to evaluate the frequencies of the magnitude of functional decline (e.g., to determine if most of the declines were one unit, two-unit, or three unit changes).
The univariate analyses provide additional information. The nature of home health care agencies allows for many nurses and practitioners to provide care. Therefore, a one-unit change is not considered enough of a difference since it may be attributable to different clinicians' views of dependency and hence may lead to more measurement error. While physical functioning skills are considered among the most reliable outcome measures in the OASIS [7–9], a one-unit change may be attributable to measurement error based on clinical judgment and the methods by which the data are coded (i.e. observation versus interview).
When evaluating declines in three or more ADLs exhibiting a three-unit change, the frequencies are extremely low (less than 0.20 percent). Declines in two or more ADLs exhibiting a three-unit decline are more frequent (more than 0.50 percent) but, still very small and incapable of providing meaningful statistical analyses. A three-unit decline is considered to be too large of a change, resulting in even fewer episodes experiencing ADL declines. Consequently, for all three indices, substantial indicates a minimum two-unit decline.
In addition to the incremental change issues aforementioned, another issue is the number of ADLs which need to have a substantial decline, where substantial is a minimum two-unit decline. One of the alternative indices is defined as substantial decline in two or more ADLs and is referred to as gt2_ADLs. A second alternative index is defined as substantial decline in one or more ADLs and is referred to as gt1_ADLs.
There were 112 available covariates (including referent categories) between OASIS and other agency administrative data. These covariates fall into seventeen main categories. The number in parentheses indicates the number of covariates for each category. The constructs are: demographics (11), physician availability (2), financial factors (4), language (3), payment source (5), referral and personal health at baseline (16), pain assessment (4), integumentary status (3), respiratory status (1), sensory status (3), elimination status (5), housing and living arrangements (4), support and assistance in the home (8), neurological/behavioral/emotional status (5), medication assessment (7), ICD-9 primary diagnosis codes (22), ICD-9 primary diagnosis codes for the main diagnoses for this particular home health care agency (9). Physician availability is defined as the number of physicians available per 100,000 people per zip code and is divided into quintiles.
Because it is unclear which of the five ADLs is most appropriate, it is not desirable to use an individual ADL outcome [10, 11]. However, incremental changes in ADLs are evaluated to determine if any specific ADL is a major contributor for declines experienced in the indices. An additional concern when examining ADL outcomes is the number of cases excluded due to 'floor' effects. If an ADL as measured at the start of an episode is already at a level of functioning such that it is impossible for a decline to be identified by an index, it is dropped from consideration. However, this introduces a potential bias in excluding from the calculation of the respective indices those episodes beginning with greater severity in ADL functioning. Thus, gt3_ADLs can only be calculated for episodes that begin with the possibility of worsening in three of the five ADLs; therefore, episodes at the 'floor' for gt3_ADLs are those unable to worsen in three or more ADLs. Likewise, for gt2_ADLs, 'floor' episodes are unable to worsen in at least four ADLs; and 'floor' episodes for gt1_ADLs are unable to decline in any of the ADLs.
We estimate a series of multivariate logistic regression models using SAS version 8.0 . Variables included in the initial models are selected among the full set of independent measures, using three criteria: 1) a minimum of 5% frequency criterion; 2) risk factors with a correlation of 0.80 or higher presumably measure the same item  and when this occurs, one of the variables is randomly eliminated; and 3) bivariate analyses including the weighted baseline ADL status  due to its well documented association with functional decline [15–17], with p < 0.10 used as the selection criterion because the association between functional decline and many risk factors is unclear. Baseline ADL scores are weighted by dividing the score for each individual ADL by the total possible and then the five weighted scores are summed . In the final step, forward stepwise multivariate logistic regression is configured to use a selection criterion of p < 0.05 .
For the multivariate logistic regression analyses, the c-statistic and the Hosmer-Lemeshow Goodness of Fit test are compared for each model. The c-statistic, calculated as the area under the Receiver Operating Characteristic (ROC) curve, represents the concordance between predicted probabilities and observed outcomes for all possible pairs of patients [20, 21]. A c-statistic of 1.0 indicates perfect predictive discrimination while a value of 0.50 indicates the model performs no better than chance alone. A c-statistic over 0.70 is considered acceptable while values higher than 0.80 are considered excellent .
The Hosmer-Lemeshow Goodness of Fit test examines model calibration across a range of predicted probabilities , producing a single summary measure of the match between predicted and actual outcomes within deciles of the data. Within each decile, deviations between observed and expected number of declines in functional status are observed and expected numbers of episodes not experiencing functional decline are measured. In order to determine whether these deviations are larger than expected, these deviations are summed over the ten groups and compared to a χ2 with 8 degrees of freedom . For the Hosmer-Lemeshow test, a p-value that is not statistically significant is indicative of reasonable model fit. Consistency over time is assessed by comparing the models' results from the prognostic and follow-up datasets.
For the prognostic data, the population of episodes averages 71 years of age with 68% being female. The population is highly diverse: 36% white, 26% black, 26% Hispanic, 5% Asian, and 7% some other ethnicity. Clinical diagnoses cover a wide spectrum of conditions, with the most common being dyspnea (48%), circulatory diseases (28%), and skin lesions (24%). In general, compared to the entire dataset, the subsets of episodes experiencing substantial functional decline tend to have a larger proportion of the following: women, older patients, Black patients, low physician availability, low income, more comorbidities, and episodes covered by both Medicare and Medicaid health insurance. The follow-up data has similar demographic characteristics.
Descriptive Statistics for Individual ADLs, ADL Indices, and 'Floors'
Prognostic Total n*
Follow-Up Total n*
We conclude that we have no 'floor' effects for gt1_ADLs or gt2_ADLs because the results are comparable with and without 'floor' covariates. Interaction is assessed and determined not to be present. Gt3_ADLs models do not converge, resulting in spurious results that are not shown.
Summary of Analytical Measures
# significant covariates
H-L Χ2 (8 d.f.)*
The c-statistics from models of gt1_ADLs are substantially lower at 0.679 and 0.683 for the prognostic and follow-up datasets, respectively (see Table 3). The Hosmer-Lemeshow χ2 is 9.781 with a p-value of 0.281, indicating reasonable model fit. The follow-up data results are comparable (χ2statistic with 8 degrees of freedom is 10.090 with a p-value of 0.259). The models for gt1_ADLs have 32 and 26 significant covariates for the prognostic and follow-up datasets, respectively.
Prognostic and Follow-Up Model Results for Gt2_ADLs and Gt1_ADLs
Only Significant Odds Ratios (OR) Reported
Age 75 to 84
Age 85 and over
Highest quintile of availability
Lowest quintile of availability
Highest quintile of income
Lowest quintile of income
Spanish speaking only
Medicare and Medicaid
Private or other payer
Lives with spouse
Lives with Family
Assistance in place of residence
Assistance, out of residence
Caregiver is spouse
Discharged from hospital within two weeks prior to admittance
Discharged from other facility within two weeks prior
Referral from a public hospital
Medical regimen change within two weeks prior
Primary Diagnosis Severity
High Risk Factor Summary Score
Weighted ADL Summary Score
Cognitive impairment, mild
Cognitive impairment, high
unique number of drugs (mean)
number of drug classes (mean)
Psychotropic drug usage
Caregiver knowledgeable of Medications
ICD9 Codes of Primary Diagnosis
Circulatory without COPD
nervous system diseases
Among top ICD9 codes for agency
Congestive Heart Failure
Across the prognostic and follow-up datasets, simple frequencies of ADL adverse events were similar for all three indices. All three indices are most influenced by the substantial decline in the ADL for bathing. Declines in bathing may be most frequent due to the difficulty of independent use of showers and bathtubs for elderly, infirm patients.
Gt3_ADLs, which is based on the current CMS definition of an ADL adverse event, was too conservative, yielding few episodes experiencing functional decline and numerous 'floor' episodes as compared to the alternative indices. However, there are also benefits to using gt3_ADLs. Continuing to use the implementation of the CMS defined ADL index promotes consistency in process of care investigations across the home health care industry. Furthermore, this index is infrequent enough to be considered rare, a caveat of being an adverse event. However, when events are very rare, determining the root cause of problems is difficult. Likewise, it is difficult to evaluate if implemented solutions have been effective with rare events.
The proposed indices gt1_ADLs and gt2_ADLs offer advantages of their own. The gt1_ADLs models adhere to the '×10' guideline and is consistent with the high part of the range (4–8%) often found in the hospital literature [23–26]. However, gt1_ADLs may be too frequent to be considered rare, a necessary attribute of adverse events with ~10% of patients experiencing such an event. Gt2_ADLs adheres to the '×10 rule' , a statistical guideline advising a dichotomous outcome to be, at minimum, ten times as large as the number of covariates being analyzed. The entire dataset has 112 covariates; prognostic and follow-up data result in 783 and 763 episodes respectively, just slightly under this recommendation.
There may be several important policy and clinical implications of implementing the use of gt2_ADLs as an ADL index for defining adverse events in the context of home health care. While still considered rare (less than 2% of the entire population), gt2_ADLs is more frequent and by definition, less restrictive. Requiring the decline of only two ADLs compared to three (e.g. gt3_ADLs), gt2_ADLs encompasses both a larger frequency of episodes and a population experiencing slightly less functional decline and hence, one less likely to have episodes at the "floor" at baseline. A slightly larger and less incapacitated population may provide more valid results for both case-mix and for evaluating changes in clinical and/or policy practices.
The OASIS dataset utilized in this study represents the population of episodes for the largest not-for-profit home health care agency in the United States, but is not necessarily representative of the vast majority of home health care agencies nationwide. For this reason, these results are not generalizable to other home health care agencies. As well, the size of this one agency, as compared to smaller agencies, may mean that our results are more stable in comparison to smaller agencies. A second limitation is the use of a different calculation from CMS in developing the indices. The CMS definition does not include any time restriction in comparison to our 60-day limit. We would anticipate our definition to capture declines in functional status more quickly as episodes are reassessed in shorter time periods. Therefore, we may be increasing the number of episodes considered "floors".
Another limitation is the way in which the information is compiled; the datasets used are unable to be linked, making it impossible to know whether patients in the prognostic data are also in the follow-up data. The assumption was that these are independent samples for analytical purposes. Furthermore, patients within each dataset may have been represented more than one time. The unit of analysis was episode of care defined as a maximum of sixty days. This could bias results as patient health characteristics could be correlated from one episode to another . However, 67% of the patients were on their first episode. There was an average 1.5 episodes per patient making correlated episodes an unlikely source of bias.
From an analytical standpoint, it may have been advantageous to use a multinomial model to deal with the issue of competing risks (i.e. more episodes were excluded due to admittance to a hospital or other inpatient facility than experienced the functional decline). However, a multi-nomial model was developed and failed to converge.
The models for gt2_ADLs provide the most valid index for predicting patients that will experience functional decline. This conclusion is based on criteria of c-statistics above 0.70; non-significant Hosmer-Lemeshow χ2 indicating reasonable model fit, and the requirement of fewer covariates to produce valid models indicative of greater efficiency as compared to gt1_ADLs. These results are proven reliable with comparable follow-up data results.
The use of gt2_ADLs for defining ADL adverse events in home health care results in a slightly larger and less incapacitated population which may be more appropriate for case-mix adjustment and evaluating changes implemented in clinical and/or policy practices. However, this study provides only a first step in evaluating these adverse event indicators. Further research is necessary to assess the ability of these indices to be used in case-mix adjustment for evaluating quality in home health care. As well, the larger question of the quality of care in home health care using these measures remains unanswered–comparisons of these functional status measures with other external appraisals of quality would contribute valuable information in home health care quality research.
Research partially funded through a grant to the Visiting Nurse Service of New York titled 'Working Conditions & Adverse Events in Home Health Care', Feldman PI, from AHRQ (Grant Number R01 HS11962).
- Shaughnessy PW, Crisler KS, Schlenker RE, Arnold AG, Kramer AM, Powell MC, Hittle DF: Measuring and Assuring the Quality of Home Health Care. Health Care Financing Review. 1994, 16 (1): 35-67.PubMedPubMed CentralGoogle Scholar
- Shaughnessy PW, Sclenker RE, Hittle DF: Home Health Care Outcomes Under Capitated and Fee-for-Service Payment. Health Care Financing Review. 1994, 16 (1): 187-222.PubMedPubMed CentralGoogle Scholar
- Quality Monitoring Using Casemix and Adverse Event Outcome Reports: Implementing Outcome-Based Quality Improvement at a Home Health Agency. [http://www.cms.hhs.gov/apps/hha/obqm1.pdf]
- Katz S, Ford AB, Moskowitz RW, Jackson BA, Jaffee MW: Studies of illness in the aged. The index of ADL: a standardized measure of biological and psychosocial function. Journal of the American Medical Association. 1963, 185 (12): 914-919.View ArticlePubMedGoogle Scholar
- Feldman PH, Kane RL: Strengthening research to improve the practice and management of long-term care. The Milbank Quarterly. 2003, 81 (2): 179-220. 10.1111/1468-0009.t01-1-00051.View ArticlePubMedPubMed CentralGoogle Scholar
- Austin PC, Escobar M, Kopec JA: The use of the Tobit model for analyzing measures of health status. Quality of Life Research. 2000, 9: 901-10. 10.1023/A:1008938326604.View ArticlePubMedGoogle Scholar
- Madigan EA, Fortinsky RH: Interrater reliability of the outcomes and assessment information set: results from the field. Gerontologist. 2004, 44 (5): 689-92.View ArticlePubMedGoogle Scholar
- Madigan EA, Fortinsky RH: Additional psychometric evaluation of the Outcomes and Assessment Information Set (OASIS). Home Health Care Services Quarterly. 2000, 18 (4): 49-62. 10.1300/J027v18n04_02.View ArticlePubMedGoogle Scholar
- Hittle DF, Shaughnessy PW, Crisler KS, Powell MC, Richard AA, Conway KS, Stearns PM, Engle K: A study of reliability and burden of home health assessment using OASIS. Home Health Care Services Quarterly. 2003, 22 (4): 43-63. 10.1300/J027v22n04_03.View ArticlePubMedGoogle Scholar
- Covinsky KE, Palmer RM, Fortinsky RH, Counsell SR, Stewart AL, Kresevic D, Burant CJ, Landefeld CS: Loss of independence in activities of daily living in older adults hospitalized with medical illnesses: increased vulnerability with age. Journal of the American Geriatrics Society. 2003, 51 (4): 451-8. 10.1046/j.1532-5415.2003.51152.x.View ArticlePubMedGoogle Scholar
- Schlenker RE, Powell MC, Goodrich GK: Home health outcome patterns. Health Care Services Quarterly. 2004, 23 (3): 69-85. 10.1300/J027v23n03_05.View ArticleGoogle Scholar
- SAS Institute, Inc: SAS user's guide: statistics, version 6.03. 1987, Cary, NC: SAS Institute, IncGoogle Scholar
- Daley J, Iezzoni L, Shwartz M: Conceptual and Practical Issues in Developing Risk-Adjustment Methods. Risk Adjustment for Measuring Health Care Outcomes. Edited by: Iezzoni LI. 2003, Chicago: Health Administration Press, 202-3Google Scholar
- Schwilk B, Muche R, Treiber H, Brinkmann A, Georgieff M, Bothner U: A Cross-Validated Multifactorial Index of Perioperative Risks in Adults Undergoing Anaesthesia for Non-Cardiac Surgery. Journal of Clinical Monitoring and Computing. 1998, 14: 283-94. 10.1023/A:1009916822005.View ArticlePubMedGoogle Scholar
- Miller E, Weissert W: Incidence of Four Adverse Outcomes in the Elderly Population: Implications for Home Care Policy and Research. Home Health Care Services Quarterly. 2001, 20 (4): 17-47. 10.1300/J027v20n04_02.View ArticlePubMedGoogle Scholar
- Rubenstein LZ, Wieland D, English P, Josephson K, Sayre JA, Abrass IB: The Sepulveda VA Geriatric Evaluation Unit: data on four-year outcomes and predictors of improved patient outcomes. Journal of the American Geriatric Society. 1984, 32: 503-12.View ArticleGoogle Scholar
- Wu AW, Damiano AM, Lynn J, Alzola C, Teno J, Landefeld CS, Desbiens N, Tsevat J, Mayer-Oakes A, Harrell FE, Knaus WA: Predicting Future Functional Status for Seriously Ill Hospitalized Adults: The SUPPORT Prognostic Model. Annals of Internal Medicine. 1995, 122: 342-50.View ArticlePubMedGoogle Scholar
- Fortinsky RH, Garcia RI, Sheehan TJ, Madigan EA, Tullai-McGuinness S: Measuring disability in Medicare home care patients: Application of Rasch modeling to the Outcomes and Assessment Information Set (OASIS). Medical Care. 2003, 41 (5): 601-15. 10.1097/00005650-200305000-00008.PubMedGoogle Scholar
- Aiken LH, Clarke SP, Sloane DM, Sochalski JA, Silber JH: Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. Journal of the American Medical Association. 2002, 288 (16): 1987-93. 10.1001/jama.288.16.1987.View ArticlePubMedGoogle Scholar
- Hanley JA, McNeil BJ: The meaning and use of the area under the receiver operating characteristic (ROC) curve. Radiology. 1982, 143: 29-36.View ArticlePubMedGoogle Scholar
- Shwartz M, Ash A: Conceptual and Practical Issues in Developing Risk-Adjustment Methods. Risk Adjustment for Measuring Health Care Outcomes. Edited by: Iezzoni LI. 2003, Chicago: Health Administration Press, 253-3Google Scholar
- Hosmer DW, Lemeshow S: Applied Logistic Regression. 2000, John Wiley & Sons, Inc., New York, 2View ArticleGoogle Scholar
- Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hebert P, Majumdar SR, O'Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R: The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ: Canadian Medical Association Journal. 2004, 170 (11): 1678-86. 10.1503/cmaj.1040498.View ArticlePubMedPubMed CentralGoogle Scholar
- Brennan TA, Hebert LE, Laird NM, Lawthers A, Thorpe KE, Leape LL, Localio AR, Lipsitz SR, Newhouse JP, Weiler PC: Hospital Characteristics Associated with Adverse Events and Substandard Care. Journal of the American Medical Association. 1991, 265: 3265-9. 10.1001/jama.265.24.3265.View ArticlePubMedGoogle Scholar
- Leape LL, Brennan TA, Laird NM, Lawthers AG, Localio AR, Barnes BA, Hebert L, Newhouse JP, Weiler PC, Hiatt H: The Nature of Adverse Events in Hospitalized Patients: Results from the Harvard Medical Practice Study II. The New England Journal of Medicine. 1991, 324 (6): 377-84.View ArticlePubMedGoogle Scholar
- Gurwitz JH: Suboptimal Medication Use in the Elderly. The Tip of the Iceberg. Journal of the American Medical Association. 1994, 272 (4): 316-7. 10.1001/jama.272.4.316.View ArticlePubMedGoogle Scholar
- Iezzoni LI: Final Observations. Risk Adjustment for Measuring Health Care Outcomes. Edited by: Iezzoni LI. 2003, Chicago: Health Administration Press, 3Google Scholar
- Heckman J: Varieties of Selection Bias. American Economic Review. 1990, 80: 313-318.Google Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1472-6963/6/162/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.