- Research article
- Open Access
The effect of electronic medical record adoption on outcomes in US hospitals
BMC Health Services Research volume 13, Article number: 39 (2013)
The electronic medical record (EMR) is one of the most promising components of health information technology. However, the overall impact of EMR adoption on outcomes at US hospitals remains unknown. This study examined the relationship between basic EMR adoption and 30-day rehospitalization, 30-day mortality, inpatient mortality and length of stay.
Our overall approach was to compare outcomes for the two years before and two years after the year of EMR adoption, at 708 acute-care hospitals in the US from 2000 to 2007. We looked at the effect of EMR on outcomes using two methods. First, we compared the outcomes by quarter for the period before and after EMR adoption among hospitals that adopted EMR. Second, we compared hospitals that adopted EMR to those that did not, before and after EMR adoption, using a generalized linear model.
Hospitals adopting EMR experienced 0.11 (95% CI: -0.218 to −0.002) days’ shorter length of stay and 0.182 percent lower 30-day mortality, but a 0.19 (95% CI: 0.0006 to 0.0033) percent increase in 30-day rehospitalization in the two years after EMR adoption. The association of EMR adoption with outcomes also varied by type of admission (medical vs. surgical).
Previous studies using observational data from large samples of hospitals have produced conflicting results. However, using different methods, we found a small but statistically significant association of EMR adoption with outcomes of hospitalization.
The electronic medical record (EMR) is designed to improve communication among providers within and between organizations by automating the collection, use and storage of patient information. Moreover, EMR may facilitate guideline compliance and decision support . Numerous single site studies at academic hospitals provide evidence that specific functions of the EMR, such as clinical decision support or computerized physician order entry, may improve quality by reducing errors [2–4]. Other studies using large samples of hospitals have found evidence that overall spending on health information technology (IT) is associated with improved patient safety, higher quality of care and reduced costs [5–9]. The Institute of Medicine (IOM) has encouraged adopting EMR to reduce medical errors, and the American Recovery and Reinvestment Act (ARRA) of 2009 established financial incentives for hospitals to promote the adoption and meaningful use of health IT.
Despite efforts to encourage the adoption of EMR, the impact of EMR on outcomes at US hospitals remains unknown. In particular, the effects of EMR on 30-day rehospitalization, 30-day mortality, inpatient mortality and length of stay have not been well characterized at community hospitals. Understanding how EMR affects hospital care outcomes can help policy makers promote its effective use.
This study examines the relationship between basic EMR adoption and 30-day rehospitalization, 30-day mortality, inpatient mortality and length of stay at 708 acute-care hospitals in the US. We used the Healthcare Information and Management Systems Society (HIMSS) data merged to 5% Medicare data from 2000 to 2007. We used two approaches to control for time-varying unobservable events that may have occurred concurrently with EMR adoption. First, we compared the slope of change in outcomes before and after EMR adoption among hospitals that adopted EMR. Second, we compared difference in outcomes before and after EMR adoption between EMR and non-EMR adopted hospitals. Further, we examined how the effect of EMR on outcomes varied by type of admission and by hospital characteristics.
Source of data
There were four primary sources of data: Healthcare Information and Management Systems Society (HIMSS) data, Medicare enrollment files, Provider of Service files and the 5% Medicare Provider Analysis and Review (MEDPAR) data from 2000 to 2007. HIMSS provides information on IT applications in approximately 3,000 hospitals in the US. The HIMSS sample comes from the American Hospital Association (AHA) survey and includes nearly all general hospitals. Medicare enrollment files include patient characteristics such as age, sex, race and Medicare and health maintenance organization (HMO) enrollment information. The Provider of Service file gives provider number, name, and address and characteristics of participating institutional providers. The MEDPAR file contains data from claims for services provided to beneficiaries admitted to Medicare certified inpatient hospitals and skilled nursing facilities. The study protocol was approved by the institutional review board at the University of Texas Medical Branch (IRB#: 09–054).
Establishment of the study cohort
We identified around 2,600 unique and 20,565 pooled acute-care hospitals with at least 100 beds in HIMSS data from 2000 to 2007. With these data, we kept only hospitals which could be observed during all eight years from 2000 to 2007 and which had a Medicare provider number. The remaining sample was 1,710 unique and 13,680 pooled hospitals from 2000 to 2007. We excluded the 1,002 hospitals which had adopted some component of a basic EMR before 2002. Thus, the final sample comprised 708 acute care hospitals: 425 that adopted basic EMR in 2002–2005 and 283 that did not adopt basic EMR during this period. We used HIMSS data to identify the year of implementation of a basic EMR, defined as a computerized patient record supported by a clinical data repository and providing clinical decision-support capabilities [10, 11].
We explored four outcomes: 30-day rehospitalization, 30-day mortality, inpatient mortality and length of stay. The sample included beneficiaries age 66 or older not enrolled in HMOs and with both Medicare Parts A and B for the entire 12 months before admission. For the hospitals that adopted EMR, admissions before EMR adoption accounted for 38% of all admissions in the sample, while those after EMR adoption accounted 41%. Another 21% of admissions occurred within the EMR adoption year.
The accumulation of claims from a beneficiary’s date of hospital admission until discharge represents one stay in the MEDPAR file. We included only stays shorter than 365 days and those from which the patient was discharged alive. We defined the rate of rehospitalization by dividing the number of patients discharged from an acute hospital and readmitted to any acute hospital within 30 days by the total number of patients discharged alive. For enrollees with multiple admissions, we randomly selected one admission per year. Our final sample size was 237,081.
In-patient mortality and 30-day mortality
We included only stays shorter than 365 days and all patients, including those who died in the hospital or were discharged alive. We defined the rate of in-patient mortality by dividing the number of patients who died during their stay by the total number of patients admitted. Also, we defined the rate of 30-day mortality by dividing the number of patients who died within 30 days after admission by the total number of patients admitted. Our final sample size was 403,566.
Length of stay
We included only stays shorter than 365 days and those from which the patient was discharged alive. To reduce skew, we excluded admissions in which length of stay was more than three standard deviations above the mean. Our final sample was 360,105 admissions.
Medicare enrollment files were used to categorize patients according to age, sex and race (White, Black or Other). Information on discharge DRG and DRG weight were obtained from the MEDPAR files and Center for Medicare and Medicaid Service (CMS), respectively. Elixhauser co morbidity  measures were generated for the 12 months before admission using inpatient and physician claims from MEDPAR, Outpatient Statistical Analysis files, and Carrier files.
Hospital characteristics were obtained from the Provider of Service files, including teaching status, number of beds and ownership type. Teaching status was categorized as none and any. Hospital size was grouped into quartiles based on the number of beds (100–170; 171–260; 261–390; and over 390) and ownership type of hospitals was grouped as not-for-profit, for-profit and public.
Methodology and statistical analysis
Our approach was to compare outcomes for the two years before and two years after the year of EMR adoption. Four hundred twenty-five hospitals adopted EMR from 2002 to 2005 (159 hospitals in 2002, 77 in 2003, 46 in 2004 and 143 in 2005). Hospitals were assigned a “-2” value at two years before their EMR adoption, “-1” for one year before EMR adoption, “0” for the year of EMR adoption, “1” for the year after EMR adoption and “2” for the period two years after EMR adoption. For example, the 159 hospitals that adopted EMR in 2002 were assigned −2, -1, 0, 1 and 2 in the years 2000, 2001, 2002, 2003 and 2004, respectively. We then stacked the data by EMR adoption year.
We examined the effect of EMR on outcomes two different ways. First, we compared the slope of change in outcomes, by quarter, before and after EMR adoption among hospitals that adopted EMR by using piecewise linear regression. We can capture any cut point if there is any slope change in outcomes.
Second, we compared difference in outcomes before and after EMR adoption between EMR and non-EMR adopted hospitals. In these analyses, the study year “0” for hospitals without EMR adoption was assigned randomly to match the distribution for the year of adoption for hospitals the adopted EMR (106 in 2002, 51 in 2003, 30 in 2004 and 96 in 2005).
We used generalized linear models (GLM) and adjusted the four outcomes (30-day rehospitalization, 30-day mortality, inpatient mortality and length of stay) by patient characteristics (gender, age and race), disease characteristics (DRG weight and comorbidities) and year. For 30-day rehospitalization, 30-day mortality and inpatient mortality, GLM with binomial distribution and logit link function was used. For length of stay, GLM with gammaa distribution and log link function were used. All of these models accounted for the clustering of patients within hospitals. STATA statistical software, version 11.1 (STATA Corp., College Station, TX) was used for all analyses.
The study cohort consisted of patients admitted to 425 hospitals that adopted EMR during the period 2002 to 2005, and 283 hospitals that did not adopt EMR over the eight years from 2000 to 2007. Table 1 presents patient and disease characteristics in the EMR and non-EMR hospitals. We found that patients were slightly more likely to be male, be Black and have higher DRG weight in EMR hospitals than in non-EMR hospitals. However, age and comorbidity were higher in non-EMR hospitals than in EMR hospitals. Also, because of the large sample size, all other variables were statistically different between EMR and non-EMR hospitals (all p < 0.01). Thus, it is more important to focus on the magnitude of any differences rather than their level of statistical significance.
First, we examined changes in outcomes before (8 quarters) and after (12 quarters) EMR adoption in the 425 hospitals that adopted EMR during the period 2002 to 2005 (Figure 1). For each hospital, the year of EMR adoption was designated as year 0. We used piecewise linear regression to assess if there was a change in slope in any of the outcomes over the entire 20 quarters. For 30-day rehospitalization rate and 30-day mortality, there was a significant change in slope over time (p < 0.001 for each). In both cases, the cutpoint was in the first quarter of the year of EMR implementation. As shown in Table 2, the odds of 30-day rehospitalization was stable in the eight quarters prior to EMR adoption and increased at 0.00037 odds per quarter after. Similarly, the odds of 30-day mortality was stable in the eight quarters prior to EMR adoption and decreased at 0.00062 odds per quarter after. There were no significant changes in slope for length of stay or inpatient mortality over the 20 quarters. We used a similar approach with piecewise linear regression to determine the temporal changes in outcomes in the 283 hospitals that did not adopt EMR over the 2000–2007 period. For length of stay, inpatient mortality and rehospitalization rate, there were underlying temporal trends noted in the hospitals that did not adopt EMR within the 2002–2005 window. To address the concern of underline temporal trend, we conducted further analyses focusing on the differences in changes in outcomes over time between EMR adopted and non-EMR adopted hospitals.
Accordingly, we compared changes over time in the outcomes for hospitals that adopted EMR compared to those that did not. Once again, hospitals that adopted EMR during 2002–2005 were stacked so that the year of EMR adoption was year 0. We randomly assigned hospitals that did not adopt EMR to the same years and stacked them in similar fashion. We calculated the difference in each outcome between the EMR and non-EMR hospitals in the eight quarters before and the eight quarters after the year of EMR adoption (Table 3). For example, in Table 3, the rate of 30-day rehospitalization in EMR hospitals in the eight quarters prior to EMR adoption was 0.46 percent less than in non-EMR hospitals. In the two years after EMR adoption, this difference decreased to −0.26 percent. Thus, relative to non-EMR hospitals, patients in hospitals that adopted EMR had a 0.19 percent higher rate of rehospitalization in the two years after EMR adoption (p < 0.01). We also found that EMR was associated with shorter length of stay and lower 30-day mortality, even though the outcome changes associated with EMR adoption were small. Hospitals that adopted the EMR system experienced a 0.11 decrease in length of stay (P < 0.05) and 0.18 percent decrease in 30-day mortality (P < 0.01).
However, there were no significant changes in inpatient mortality before and after EMR implementation. For inpatient mortality, length of stay may be an important factor because patients with critical conditions are more likely to both stay longer and die during hospitalization . Thus, we also compared the inpatient mortality rate after adjusting length of stay with other variables mentioned above, but found no significant difference in outcomes between EMR and non-EMR adopted hospitals.
Moreover, we stratified DRGs into surgical and medical based on the DRG  and compared outcomes between EMR and non-EMR adopting hospitals (Table 4). We found that the effect of EMR on outcomes differed by DRG type. EMR reduced the inpatient morality rate in surgical DRGs, but it increased 30-day mortality. In medical DRGs, however, EMR increased length of stay and 30-day rehospitalization but reduced 30-day mortality.
We also compared outcomes of all DRGs across hospital characteristics including number of beds, teaching status and ownership (Table 4). Thus, each outcome was analyzed for four stratified sizes (by number of beds), two teaching states and three types of ownership. Across hospital characteristics, we found that the hospitals with large bed size, teaching and profit ownership status are more likely adopt EMR. However, we did not find any association between hospital characteristics and outcomes before and after EMR adoption (all p > 0.1), except for ownership and 30-day rehospitalization.
We found that EMR adoption was associated with a small but significant reduction in length of stay and 30-day mortality, as well as an increase in 30-day rehospitalization. The reduced length of stay associated with EMR suggests that EMR might allows faster physician ordering of tests, procedures, and medications, speed the process/scheduling of discharge, and reduce delays in the service ordering process. Also, through faster and accurate communication and coordination among providers, EMR may contribute to reduced length of stay .
However, shorter length of stay may increase the 30-day rehospitalization rate because patients with a critical condition may return if they are discharged early, a problem which EMR may catch. For example, Cram et al. examine demographics and outcomes of patients undergoing primary and revision total hip arthroplasty using Medicare Data. They found that length of stay decreased but the readmission rate increased . Lin et al. used a nationwide population based dataset and found an increased adjusted odds ratio for 30-day readmission rate with shorter length of stay for patients with schizophrenia . Moreover, Kuo and Goodwin used Medicare Data and found that reduced length of stay resulted in more readmissions within 30 days of discharge .
Reduced mortality may be a byproduct of better oversight. EMR can improve the continuum of care, alert physicians and nurses to when time-sensitive care processes are imminent and improve accurate communication to minimize complications from preventable errors .
Moreover, we found that EMR was associated with different DRGs across outcomes. However, the direction of outcome changes associated with EMR was not consistent across surgical and medical DRGs. Further, we did not find evidence of the effect of hospital characteristics on outcomes before and after EMR adoption because the different settings in hospitals may not capture the small outcome difference we observed.
These findings are comparable with most recent studies. Prior studies using observational data from large samples of hospitals have produced conflicting results. DesRoches et al.  used cross sectional data from 2,953 national hospitals and did not find any significant relationship between the existence of an EMR and 30-day mortality, length of stay and 30-day readmission rate. Furukawa et al.  used longitudinal data from 326 California hospitals and found that EMR was associated with longer length of stay and lower rates of in-hospital mortality. Amarasingham et al.  examined the cross sectional relationship between the level of automation and inpatient mortality in 41 Texas hospitals. They found that having an automation system was associated with fewer complications, lower mortality rates, and lower costs, but with no difference in length of stay. Compared to previous studies of hospitals throughout the US, our study results may be more representative because we used longitudinal data analysis of 708 acute care hospitals from 2000 to 2007 with different methods.
Small changes in outcomes associated with EMR might reflect the fact that the hospital may still be working to implement the system, because we focused on the short-term effects of EMR adoption during the first two years of implementation and did not consider the long-term effects of EMR use over time. This partial automation processes may delay the patient information transfer or induce workarounds, errors, and dissatisfaction from providers .
There may be unobserved confounding factors that might have impacted our results. For example, organizational and management strategies may be correlated with EMR adoption . In particular, if the manager or CEO adopted more IT systems with EMR to improve their worst outcomes, then our estimated coefficient may be underestimated. Another concern is the physician’s perception of EMR use. EMR was considered to be adopted if the hospitals adopt EMR, not the physician. Thus, if physicians are resistant to using EMR after EMR adoption in hospitals, our estimate may be underestimated. Although we controlled for the characteristics of patients and hospitals, EMR adoption behavior may differ in some factors that we could not observe in our data (i.e. changes in reimbursement, policy, etc.). Thus, our estimates may remain biased.
We used the operational definition of EMR as the computerized patient record supported by a clinical data repository and clinical decision-support capabilities [10, 11]. Our definition of EMR adoption is less restrictive than that used in other studies [25–27]. For example, Tucker and Miller  used HIMSS data but defined EMR adoption as complete adoption of four components including computerized practitioner order entry, clinical data repositories, clinical decision making support software, and systems designed to digitize physician documentation. Also, other studies have used a more restrictive definition of EMR [26, 27] which included such IT systems as Nursing Documentation and Electronic Medication Administration Records. We used a less restrictive EMR definition because HIMSS data did not follow up on some IT systems (i.e., physician documents) adopted before 2005.
Also, we focused only on the availability of EMR. However, what is important is meaningful use, which is increasingly emphasized in federal policy. We did not have information on more relevant variables. Thus, future work needs to examine how EMR is effectively used.
In summary, we found evidence for small but clinical significant changes in reduction of length of stay and 30-day mortality but an increase in 30-day rehospitalization with no changed in inpatient mortality with the introduction of a basic EMR in US hospitals.
aWe selected gamma distribution after modified park test.
Institute of Medicine: Crossing the quality chasm: a new health system for the 21st century. 2001, National Academies Press, Washington (DC)
Kuperman G, Gibson R: CPOE: benefits, costs, and issues. Ann Intern Med. 2003, 139 (1): 31-39.
Garg A, Adhikari N, McDonald H, et al: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293 (10): 1223-1238. 10.1001/jama.293.10.1223.
Chaudhry B, Wang J, Wu S, et al: Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006, 144 (10): 742-752.
Parente S, Horn RV: Valuing hospital investment in information technology: Does government make a difference?. Health Care Financ Rev. 2007, 28 (2): 31-43.
Borzekowski R: Measuring the cost impact of hospital information systems: 1987–1994. J Health Econ. 2009, 28: 938-949. 10.1016/j.jhealeco.2009.06.004.
Parente S, McCullough J: Health information technology and patient safety: Evidence from panel data. Health Aff. 2009, 28: 357-360. 10.1377/hlthaff.28.2.357.
Yu FB, Menachemi N, Berner ES, et al: Full implementation of computerized physician order entry and medication-related quality outcomes: a study of 3,364 hospitals. Am J Med Qual. 2009, 24 (4): 278-286. 10.1177/1062860609333626.
Himmelstein DU, Wright A, Woolhandler S: Hospital computing and the costs and quality of care: a national study. Am J Med. 2010, 123 (1): 40-46. 10.1016/j.amjmed.2009.09.004.
McCullough J, Casey M, Moscovice I, et al: The effect of health information technology on quality in us hospitals. Health Aff. 2010, 29: 647-654. 10.1377/hlthaff.2010.0155.
Fonkych K, Taylor R: The state and pattern of health information technology adoption. 2005, RAND Corporation, Santa Monica
Elixhauser A, Steiner C, Harris RD, et al: Comorbidity measures for use with administrative data. Med Care. 1998, 36: 8-27. 10.1097/00005650-199801000-00004.
Elizabeth ED, Normand SL, Wang Y, et al: Comparison of Hospital Risk-Standardized Mortality Rates Calculated by Using In-Hospital and 30-Day Models: An Observational Study With Implications for Hospital Profiling. 2012, Anna, Intern Med, 19-26.
DRG Expert: A comprehensive guidebook to the DRG classification system. 2007, Elsevier Health Sciences, Amsterdam
Sharon SC, Jennifer NE, Diana R: Health management associates using electronic health records to improve quality and efficiency: the experiences of leading hospitals. 2012, http://www.commonwealthfund.org/~/media/Files/Publications/Issue%20Brief/2012/Jul/1608_SilowCarroll_using_EHRs_improve_quality.pdf.
Cram P, Lu X, Jaboli PJ, Vaughan-Sarrazin MS, Cai X, Wlod B, Li Y: Clinical characteristics and outcomes of medicare patients undergoing total hip arthroplasty, 1991–2008. JAMA. 2011, 305 (15): 1560-1567. 10.1001/jama.2011.478.
Lin HC, Tian WH, Chen CS, Liu TC, Tsai SY, Lee HC: The association between readmission rates and length of stay for schizophrenia: A 3-year population-based study. Schizophr Res. 2006, 83 (2): 211-214. 10.1016/j.schres.2006.01.012.
Kuo Y, Goodwin J: Association of hospitalist care with medical utilization after discharge: evidence of cost shift from a cohort study. Ann Intern Med. 2011, 155 (3): 152-159.
Longhurst CA, Parast L, Sandborg CI, Widen E, Sullivan J, Hahn JS, Dawes CG, Sharek PJ: Decrease in hospital-wide mortality rate after implementation of a commercially sold computerized physician order entry system pediatrics. Pedriatrics. 2010, 126 (1): 14-21.
DesRoches CM, Campbell EG, Vogeli C, et al: Electronic health records’ limited successes suggest more targeted uses. Health Affair. 2010, 29 (4): 639-646. 10.1377/hlthaff.2009.1086.
Furukawa MF, Raghu TS, Shao BB: Electronic medical records, nurse staffing, and nurse-sensitive patient outcomes: evidence from California hospitals, 1998–2007. Health Serv Res. 2010, 45 (4): 941-62. 10.1111/j.1475-6773.2010.01110.x.
Amarasingham R, Plantinga L, Diener-West M, et al: Clinical information technologies and inpatient outcomes: a multiple hospital study. Arch Intern Med. 2009, 169 (2): 108-14. 10.1001/archinternmed.2008.520.
Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE, Strom BL: Role of computerized physician order entry systems in facilitating medication errors. J Am Med Inform Assoc. 2005, 293: 1197-1203. 10.1001/jama.293.10.1197.
Moskop JC, Sklar DP, Geiderman JM, Schears RM, Bookman KJ: Emergency department crowding, Part 2—Barriers to reform and strategies to overcome them. Annals of Emergency Medicin. 2009, 53: 612-617. 10.1016/j.annemergmed.2008.09.024.
Tucker C, Miller A: Can healthcare IT save babies?. J Polit Econ. 2011, 119: 289-324. 10.1086/660083.
Rosko MD: Performance of US teaching hospitals: a panel analysis of cost inefficiency. Health Care Manag Sci. 2004, 7: 7-16.
Koenig L, Dobson A, Book R, Leapfrog Group, et al: Comparing hospital costs: Adjusting for differences in teaching status and other hospital characteristics. 2005, http://www.leapfroggroup.org/media/file/Hospital_efficiency_adjustment_factors.pdf.
The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1472-6963/13/39/prepub
We appreciate the assistance of Sarah Toombs Smith, PhD, ELS in editing this paper. This work was supported by grant K05-CA134923 from the National Cancer Institute. This funder had no role in the design and conduct of study; the collection, management, analysis and interpretation of the data; or the preparation, review, or approval of the manuscript. The authors disclose no relationship with companies that make products relevant to the manuscript.
The authors declare that they have no competing interests
JL was involved in research concept and design, collection and/or assembly of data, data analysis and interpretation and writing the article. YK was involved in research design, data interpretation and helped to draft the manuscript. JG was involved in research design, data interpretation and helped to write and review this work. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Lee, J., Kuo, Y. & Goodwin, J.S. The effect of electronic medical record adoption on outcomes in US hospitals. BMC Health Serv Res 13, 39 (2013). https://0-doi-org.brum.beds.ac.uk/10.1186/1472-6963-13-39
- Electronic medical record (EMR)
- Length of stay
- Rehospitalization rates
- Diagnosis related groups (DRG)