Abstract
Purpose
The effect of reduced hospital staffing during weekends on in-hospital mortality is not known. We compared mortality rates between patients admitted on weekends and weekdays and whether weekend-weekday variation in rates differed between patients admitted to teaching and nonteaching hospitals in California.
Methods
The sample comprised patients admitted to hospitals from the emergency department with any of 50 common diagnoses (N = 641,860). Mortality between patients admitted on weekends and those admitted on weekdays (the “weekend effect”) was compared. The magnitude of the weekend effect was also compared among patients admitted to major teaching, minor teaching, and nonteaching hospitals.
Results
The adjusted odds of death for patients admitted on weekends when compared with weekdays was 1.03 (95% confidence interval [CI]: 1.01 to 1.06; P = 0.0050). Three diagnoses (cancer of the ovary/uterus, duodenal ulcer, and cardiovascular symptoms) were associated with a statistically significant weekend effect. None of the 50 diagnoses demonstrated a statistically significant reduction in mortality for weekend admissions as compared with weekday admissions. Mortality was similar among patients admitted to major (odds ratio [OR] = 1.06; 95% CI: 0.94 to 1.19) and minor (OR = 1.03; 95% CI: 0.97 to 1.09) teaching hospitals, compared with nonteaching hospitals. However, the weekend effect was larger in major teaching hospitals compared with nonteaching hospitals (OR =1.13 vs. 1.03, P = 0.03) and minor teaching hospitals (OR = 1.05, P = 0.11).
Conclusion
Patients admitted to hospitals on weekends experienced slightly higher risk-adjusted mortality than did patients admitted on weekdays. While overall mortality was similar for patients admitted to all hospital categories, the weekend effect was larger in major teaching hospitals and is cause for concern.
Despite relatively constant demand for acute care, hospitals faced with economic constraints and problems of employee satisfaction generally reduce staffing and availability of services during weekends (
1- Hughes K.
- Kuffner L.
- Dean B.
Effect of weekend physical therapy treatment on postoperative length of stay following total hip and total knee arthroplasty.
). While anecdotes about the potential consequences of reductions in weekend service abound, information on the effects of weekend admission on in-hospital mortality is limited.
Earlier studies suggested that weekend admission was associated with increased resource utilization and slightly higher perinatal mortality when compared with weekdays (
2Variations in number of births and perinatal mortality by day of week in England and Wales.
,
3The weekend—a dangerous time to be born?.
,
4- Dowding V.M.
- Duignan N.M.
- Genry G.R.
- MacDonald D.W.
Induction of labor, birthweight and perinatal mortality by day of the week.
,
5- Gould J.B.
- Qin C.
- Marks A.R.
- Chavez G.
Neonatal mortality in weekend vs weekday births.
). Only recently, however, have researchers begun to examine the effects of weekend admission on in-hospital mortality among more diverse patient groups. Bell et al found that Canadian patients who were admitted on weekends to acute care hospitals from emergency departments had higher risk-adjusted mortality than patients admitted on weekdays (the “weekend effect”) (
6- Bell C.M.
- Redelmeier D.A.
Mortality among patients admitted to hospitals on weekends as compared with weekdays.
). Barnett et al found a 9% increase in risk-adjusted mortality among patients admitted to intensive care units on weekends when compared with weekdays (
7- Barnett M.J.
- Kaboli P.J.
- Sirio C.A.
- Rosenthal G.E.
Day of the week of intensive care admission and patient outcomes.
).
While these results are concerning, the generalizability of these findings to the broad array of patients admitted to hospitals in the United States remains unclear. Furthermore, prior studies have not examined whether the weekend effect might vary with hospital teaching status, even though teaching status has been associated with more rapid evaluation of unstable patients and potentially better outcomes (
8- Taylor D.H.
- Whellan D.J.
- Sloan F.A.
Effects of admission to a teaching hospital on the cost and quality of care for Medicare beneficiaries.
,
9- Ayanian J.Z.
- Weissman J.S.
Teaching hospitals and quality of care a review of the literature.
,
10- Young M.P.
- Gooder V.J.
- McBride K.
- et al.
Inpatient transfers to the intensive care unit; delays are associated with increased mortality and morbidity.
,
11- Arbabi S.
- Jurkovich G.J.
- Rivara F.P.
- et al.
Patient outcomes in academic medical centers.
).
The current study used a database of all 1998 admissions to acute care hospitals in California to examine the effects of weekend admission on in-hospital mortality among patients with any of 50 common diagnoses, and to assess whether these effects varied by hospital teaching status. We hypothesized that the weekend effect previously demonstrated in limited patient samples would also exist among a diverse sample from California. Furthermore, we suspected that major teaching hospitals would demonstrate a smaller weekend effect.
Methods
Data source
We used the 1998 California Office of Statewide Health Planning and Development Discharge Data File, which was developed as part of the Healthcare Cost and Utilization Project conducted by the Agency for Healthcare Research and Quality (AHRQ) (
). The dataset contains detailed administrative data for all admissions during 1998 to all licensed acute care hospitals (excluding Veterans Administration hospitals) in California. Trained abstractors working on site collected demographic and clinical data on each patient at the time of discharge from the hospital, such as age, race, sex, nature of the admission (variable “admission type” categorized as scheduled, unscheduled, infant, or unknown), source of admission (e.g., home, interhospital transfer, emergency department), name of the hospital to which the patient was admitted, the principle diagnosis deemed responsible for admission as identified at the time of discharge (according to the
International Classification of Diseases, Ninth Revision, Clinical Modification [ICD-9-CM] code), and up to 24 secondary diagnoses present at admission. The California Office of Statewide Health Planning periodically reviews the data to assess accuracy and coding errors; hospitals that exceed prespecified thresholds are required to repeat their abstractions (
).
For each admission, the ICD-9-CM code was collapsed to the 3-digit code, then ranked according to the total number of in-hospital deaths that occurred for each diagnosis during 1998. The 50 ICD-9-CM codes with the greatest number of deaths were included in subsequent analyses so as to maximize the number of events (and therefore statistical power) for the study.
It was recognized that a potentially important source of bias in the study would be that scheduled admissions would be more likely to take place on weekdays and that such patients would likely have better outcomes than those admitted on weekends when scheduled admissions would be unlikely. To examine the effect of this potential bias (and identify a similar cohort of patients admitted on weekdays and weekends), analyses were conducted in three progressively restricted cohorts: all admissions, unscheduled admissions, and unscheduled admissions from the emergency department.
Weekend admission
Patients were considered weekend admissions if they were admitted between 12:00 am on Saturday and 11:59 pm on Sunday. Patients admitted on all other days were considered weekday admissions.
Teaching status
The dataset was linked to the American Hospital Association 1998 Hospital Survey, which contains detailed hospital characteristics for most acute care hospitals in the United States. The linkage was performed first by matching the names of hospitals on the California list to those in the American Hospital Association dataset. In cases where the names did not match precisely, the addresses and telephone numbers provided by the American Hospital Association were used to re-evaluate the name of the hospital located at the specified address. Once the exact name was identified, the linkage was performed, provided that the numbers of admissions listed in the two datasets were similar. We were able to match 441 (85%) of the 518 hospitals in the California dataset to the American Hospital Association Survey data. Hospitals that were members of the Council of Teaching Hospitals of the Association of American Medical Colleges were categorized as “major teaching” (
14- Rosenthal G.E.
- Harper D.L.
- Quinn L.M.
- Cooper G.S.
Severity-adjusted mortality and length of stay in teaching and nonteaching hospitals results of a regional study.
). Hospitals that were not members, but had one or more accredited residency training programs, were categorized as “minor teaching.” Other hospitals were categorized as “nonteaching.”
Risk adjustment
Comorbidity was assessed using secondary ICD-9-CM codes to define 30 specific comorbid conditions (
15- Elixhauser A.
- Steiner C.
- Harris D.R.
- Coffey R.M.
Comorbidity measures for use with administrative data.
). This approach was designed to be conservative and excludes comorbid conditions that may represent complications of care or that are related to the primary reason for hospitalization. Algorithms for defining each condition were obtained from the AHRQ website (
). Charlson comorbidity index scores were calculated for each patient using the Dartmouth-Manitoba approach, which considers 16 comorbid conditions (
17- Deyo R.A.
- Cherkin D.C.
- Ciol M.A.
Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases.
).
Statistical analysis
Differences in demographic characteristics, comorbidity, and mortality between patients admitted on weekends and weekdays were compared using the chi-square test or t test. The proportion of patients who were admitted on weekends as compared with weekdays was calculated for each of the progressively more restricted cohorts. It was anticipated that as the restrictions were applied, the ratio of weekend to weekday admissions would approach 40%, reflecting the expectation that a similar number of “emergency” admissions should occur on each day of the week.
For each of the 50 conditions, mortality among weekend and weekday admissions was compared using logistic regression fitted by generalized estimating equations that account for clustering of patients within hospitals and for variations in the weekend effect across hospitals. This approach provides identical parameter estimates to ordinary logistic regression, but more robust confidence intervals (
18Longitudinal data analysis using generalized linear models.
). Unadjusted analyses included only an indicator variable for weekend admission; the coefficient associated with this variable was used to estimate the odds of death for weekend admissions as compared with weekday admissions (the weekend effect odds ratio). Separate analyses were conducted by admission cohort.
Additional analyses adjusted for demographic characteristics (age, sex, and race) and comorbidity using indicator variables to represent each of the individual conditions considered by Elixhauser et al (
15- Elixhauser A.
- Steiner C.
- Harris D.R.
- Coffey R.M.
Comorbidity measures for use with administrative data.
). These models also included an indicator variable for weekend admission.
To estimate the weekend effect for all 50 diagnoses in aggregate, we employed a two-stage modeling strategy. The first stage involved determining a predicted risk of death for each patient from disease-specific logistic regression models that included variables for demographic factors and comorbidity, but not a variable for weekend admission. The second-stage model included all patients as well as the logit of the predicted risk of death for each patient and an indicator variable for weekend admission. We chose this two-stage approach (in lieu of developing an aggregate model with individual risk variables) to allow the effect of the risk variables to vary across diagnoses. Lastly, we determined the magnitude of the weekend effect in teaching and nonteaching hospitals by adding indicator variables for major and minor teaching hospitals and interaction terms between teaching status and weekend admission.
P values <0.05 (two-tailed) were considered statistically significant. All statistical analyses were performed using Stata 8.0 (Stata Corp., College Station, Texas) and SAS 9.0 (SAS Institute Inc., Cary, North Carolina).
Results
During 1998 there were 3,725,373 admissions to acute care hospitals in California and 86,557 deaths. The 50 study diagnoses were responsible for 1,100,984 admissions (30% of all admissions) and 64,840 deaths (75% of all deaths). Exclusion of scheduled admissions (n = 191,153) and patients who had not been admitted from the emergency department (n = 267,971) resulted in a final cohort of 641,860 patients and 41,702 deaths. An additional 71,700 patients were excluded from the teaching status analysis because they had been admitted to facilities that could not be linked to the American Hospital Association Survey data.
The mean age of patients in the final cohort was 67 years and 52% were women (
Table 1). Overall, 461,102 patients (72%) were admitted on weekdays and 180,758 (28%) were admitted on weekends. Differences between the 570,160 admissions who were successfully matched to the American Hospital Association Survey data and the 71,700 patients who could not be matched, as well as for patients admitted on weekends versus weekdays, were generally minimal. However, patients who were not successfully matched were slightly older, more likely to be black, and had higher in-hospital mortality compared with those who were matched.
Table 1Demographic Data for Unscheduled Patients Admitted with 50 Selected Diagnoses on Weekdays and Weekends
Mortality among all diagnoses
As the cohort was progressively restricted, the ratio of weekend to weekday admissions increased from 0.26 among all admissions to 0.39 among admissions from the emergency department (
Table 2). This increase in the weekend/weekday ratio corresponded to a reduction in the unadjusted weekend effect odds ratio from 1.20 among all admissions to 1.03 among admissions from the emergency department; a similar trend was observed in the adjusted analysis. After adjustment for differences in demographic characteristics and comorbidity, mortality was 3% higher (odds ratio [OR] = 1.03; 95% confidence interval [CI]: 1.01 to 1.06;
P = 0.005) with weekend admissions, compared with weekday admissions, among patients admitted from the emergency department.
Table 2Effect of Progressive Cohort Restriction on Ratio of Weekend/Weekday Admissions and Weekend Effect
Mortality among individual diagnoses
Among the 50 study diagnoses, the total number of emergency department admissions available for analysis ranged from 390 for ovarian cancer to 58,807 for pneumonia (
Table 3). As the cohort was progressively restricted from all admissions to emergency department admissions only, the number of diagnoses with a weekend effect odds ratio indicating decreased mortality among weekend admissions as compared with weekday admissions (OR <1.0) increased from 8 to 15. Among patients admitted from the emergency department, only three diagnoses—cancer of the ovary/uterus, duodenal ulcer, and cardiovascular symptoms—had adjusted weekend effect odds ratios that were associated with significantly increased mortality among weekend admissions.
Table 3Number of Admissions and the Risk-Adjusted Weekend Effect for Each of the Selected Diagnoses as the Cohort was Progressively Restricted
ICD-9-CM = International Classification of Diseases, Ninth Revision, Clinical Modification.
Influence of hospital teaching status
Patients admitted from the emergency department were admitted to 333 different hospitals: 17 major teaching hospitals, 61 minor teaching hospitals, and 255 nonteaching hospitals. Overall, 10% of patients (n = 60,775) were admitted to major teaching hospitals, 25% (n = 140,418) to minor teaching hospitals, and 65% (n = 368,967) to nonteaching hospitals (
Table 4). In analyses of admissions from the emergency department, unadjusted mortality rates were lower for patients admitted to major teaching hospitals compared with nonteaching hospitals on weekdays (5.7% vs. 6.7%,
P = 0.01) but were similar for patients admitted on weekends (6.6% vs. 6.8%,
P = 0.71). After adjusting for demographic factors and comorbidity, the odds of death were similar in major (OR = 1.06; 95% CI: 0.94 to 1.19;
P = 0.36) and minor (OR = 1.03; 95% CI: 0.97 to 1.09;
P = 0.31) teaching hospitals, as compared with nonteaching hospitals. In analyses that included interaction effects between weekend admission and teaching status, the magnitude of the weekend effect was greater in major teaching hospitals (OR = 1.13) than in nonteaching (OR = 1.03,
P = 0.03) and minor teaching (OR = 1.05,
P = 0.11) hospitals, but similar between minor teaching and nonteaching hospitals (
P = 0.42).
Table 4Number of Admissions and Risk-Adjusted In-Hospital Mortality among Patients Admitted to Major Teaching, Minor Teaching, and Nonteaching Hospitals
Discussion
This study demonstrates that patients admitted to hospitals in California from the emergency department on weekends had a minimally increased odds of dying during hospitalization when compared with patients admitted on weekdays. The study also demonstrates the potential influence of selection bias on studies measuring the weekend effect. Analyzing three progressively restrictive cohorts, the weekend effect declined as selection criteria increased, and, importantly, as the proportion of weekend admissions increased. We also found that major teaching hospitals had greater weekend-weekday variations in mortality (a larger weekend effect) than did minor teaching or nonteaching hospitals, which is in contrast to our initial hypothesis.
Our finding of a 3% increase in risk-adjusted mortality among the aggregate data and that 6% (3/50) of specific diagnoses demonstrated a statistically significant weekend effect suggests that the weekend effect is smaller than reported in previous studies. Barnett et al reported a 9% increase in mortality for patients admitted on weekends, but this difference may have been due to unmeasured differences in severity of illness (
7- Barnett M.J.
- Kaboli P.J.
- Sirio C.A.
- Rosenthal G.E.
Day of the week of intensive care admission and patient outcomes.
). Bell and Redelmeier (
6- Bell C.M.
- Redelmeier D.A.
Mortality among patients admitted to hospitals on weekends as compared with weekdays.
), in their study of patients in Canada, found that weekend admission was associated with a 4% increase in mortality among their aggregate dataset and that 23% of diagnoses were associated with a statistically significant weekend effect. The smaller weekend effect observed in our study is likely due to several factors. The proportion of all patients admitted on weekends versus weekdays was 37% in the Canadian study compared with 39% in ours, suggesting that the weekend effect in the former study may have been magnified by unmeasured differences between patients admitted on weekends and weekdays. Further, there may be actual differences in care between Canada and the United States (
19- Verilli D.K.
- Berenson R.
- Katz S.J.
A comparison of cardiovascular procedure use between the United States and Canada.
,
20- Katz S.J.
- Hofer T.P.
- Manning W.G.
Hospital utilization in Ontario and the United States the impact of socioeconomic status and health status.
,
21- Rouleau J.L.
- Moye L.A.
- Pfeffer M.A.
- et al.
A comparison of management patterns after acute myocardial infarction in Canada and the United States.
).
The progressive reduction in the weekend effect as the cohort was progressively restricted from all admissions to admissions from the emergency department highlights both the limitations of risk adjustment and the importance of selecting an appropriate cohort for observational studies. Despite the use of a well-validated risk-adjustment methodology for administrative data, conducting the analysis on all unscheduled admissions would give the appearance of a clinically important 10% increase in mortality for patients admitted on the weekends; however, the fact that the ratio of weekend to weekday admissions in this cohort was 31% rather than 40% as expected, hints at the possibility of unadjusted differences between the weekend and weekday admissions (e.g., many weekday admissions referred from providers' offices, but not weekend admissions because offices are closed). Such an assumption is supported by the subsequent finding that when the cohort was further restricted to patients admitted from the emergency department, the ratio of weekend to weekday admissions increased to 39% while the weekend effect was reduced to 3%.
Our finding that the magnitude of the weekend effect in major teaching hospitals was larger than in nonteaching hospitals was unexpected. We had expected that the relatively constant level of staffing provided by residents and fellows would result in a smaller weekend effect in major teaching hospitals. In retrospect, it is likely that our hypothesis was overly simplistic. The weekend effect reflects more than physician availability on weekends. The observed weekend effect more likely represents a confluence of factors that ultimately result in reduced quality of care, such as discontinuity of care, reduced levels of staffing, reduced availability of certain procedures, and an overall reduction in patient supervision when hospital staffing decreases during the weekend.
Our study has several limitations. While we used an established method for adjusting for comorbidity, it is possible that patients admitted on weekends had more severe disease and inherently worse prognoses than did those admitted on weekdays. We attempted to limit this potential bias by limiting our analysis to the cohort of emergency admissions, but confounding by unadjusted severity remains a possibility. Furthermore, the study was conducted using administrative data. While quality control measures are in place to monitor the data abstraction process, errors in data abstraction remain a possibility. However, there would be no obvious reason why sporadic abstraction errors would systematically vary between weekend and weekday admissions. Finally, it is possible that our measurement of the influence of weekend admission on patient mortality underestimates the adverse effect of weekend care because patients admitted on weekends may “crossover” to receive weekday care and vice versa.
In light of prior research, our findings confirm the presence of the weekend effect but suggest that it may be smaller than previously determined. The finding that the weekend effect may be larger in major teaching hospitals is cause for concern and requires confirmation.
Acknowledgements
The authors would like to express their thanks to Sanjay Saint, Tim Hofer, and A. Mark Fendrick for their assistance with a closely related project.
References
- Hughes K.
- Kuffner L.
- Dean B.
Effect of weekend physical therapy treatment on postoperative length of stay following total hip and total knee arthroplasty.
Physiother Can. 1993; 45: 245-249Variations in number of births and perinatal mortality by day of week in England and Wales.
BMJ. 1978; 2: 1670-1673The weekend—a dangerous time to be born?.
Br J Ob Gyn. 1981; 88: 1200-1203- Dowding V.M.
- Duignan N.M.
- Genry G.R.
- MacDonald D.W.
Induction of labor, birthweight and perinatal mortality by day of the week.
Br J Ob Gyn. 1987; 94: 413-419- Gould J.B.
- Qin C.
- Marks A.R.
- Chavez G.
Neonatal mortality in weekend vs weekday births.
JAMA. 2003; 289: 2958-2962- Bell C.M.
- Redelmeier D.A.
Mortality among patients admitted to hospitals on weekends as compared with weekdays.
N Engl J Med. 2001; 345: 663-668- Barnett M.J.
- Kaboli P.J.
- Sirio C.A.
- Rosenthal G.E.
Day of the week of intensive care admission and patient outcomes.
Med Care. 2002; 40: 530-539- Taylor D.H.
- Whellan D.J.
- Sloan F.A.
Effects of admission to a teaching hospital on the cost and quality of care for Medicare beneficiaries.
N Engl J Med. 1999; 340: 293-299- Ayanian J.Z.
- Weissman J.S.
Teaching hospitals and quality of care.
Milbank Q. 2002; 80: 569-593- Young M.P.
- Gooder V.J.
- McBride K.
- et al.
Inpatient transfers to the intensive care unit; delays are associated with increased mortality and morbidity.
J Gen Intern Med. 2003; 18: 77-83- Arbabi S.
- Jurkovich G.J.
- Rivara F.P.
- et al.
Patient outcomes in academic medical centers.
Arch Surg. 2003; 138: 47-51Agency for Healthcare Research and Quality. Healthcare cost and utilization project. Available at: http://www.ahrq.gov/data/hcup/. Accessed June 2, 2003
California Healthcare Cost and Utilization Project. California Patient Discharge Data Reporting Manual. 3rd ed. Available at: http://www.oshpd.state.ca.us/hid/HID/patient/discharges/patmanuals/pd3/intro.pdf. Accessed June 2, 2003
- Rosenthal G.E.
- Harper D.L.
- Quinn L.M.
- Cooper G.S.
Severity-adjusted mortality and length of stay in teaching and nonteaching hospitals.
JAMA. 1997; 278: 485-490- Elixhauser A.
- Steiner C.
- Harris D.R.
- Coffey R.M.
Comorbidity measures for use with administrative data.
Med Care. 1998; 36: 8-27Elixhauser Comorbidity Software. Available at: http://www.ahrq.gov/data/hcup/comorbid.htm. Accessed June 2, 2003
- Deyo R.A.
- Cherkin D.C.
- Ciol M.A.
Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases.
J Clin Epidemiol. 1992; 45: 613-619Longitudinal data analysis using generalized linear models.
Biometrika. 1986; 73: 13-22- Verilli D.K.
- Berenson R.
- Katz S.J.
A comparison of cardiovascular procedure use between the United States and Canada.
Health Serv Res. 1998; 33: 467-487- Katz S.J.
- Hofer T.P.
- Manning W.G.
Hospital utilization in Ontario and the United States.
Can J Public Health. 1996; 87: 253-256- Rouleau J.L.
- Moye L.A.
- Pfeffer M.A.
- et al.
A comparison of management patterns after acute myocardial infarction in Canada and the United States.
N Engl J Med. 1993; 328: 779-784
Article info
Publication history
Accepted:
February 3,
2004
Received:
June 18,
2003
Footnotes
☆Funded in part by a Research Enhancement Award (01-094) from the Health Services Research and Development Service, Veterans Health Administration, Department of Veterans Affairs. Dr. Rosenthal is a Senior Quality Scholar, Office of Academic Affiliations, Veterans Health Administration.
Copyright
© 2004 Elsevier Inc. Published by Elsevier Inc. All rights reserved.