Many studies have identified factors associated with mortality from community-acquired pneumonia in adults, and a few have developed prognostic staging systems based on such factors (
6- Fang G.D
- Fine M
- Orloff J
- et al.
New and emerging etiologies for community-acquired pneumonia with implications for therapy.
,
7- Fine M.J
- Orloff J.J
- Arisumi D
- et al.
Prognosis of patients hospitalized with community-acquired pneumonia.
,
8- Fine M.J
- Singer D.E
- Hanusa B.H
- et al.
Validation of a pneumonia prognostic index using the medisgroups comparative hospital database.
,
9- Fine M.J
- Auble T.E
- Yealy D.M
- et al.
A prediction rule to identify low-risk patients with community-acquired pneumonia.
,
10- Farr B.M
- Sloman A.J
- Fisch M.J
Predicting death in patients hospitalized for community-acquired pneumonia.
,
11British Thoracic Society and Public Health Laboratory Service
Community-acquired pneumonia in adults in British hospitals in 1982–1983 a survey of aetiology, mortality, prognostic factors and outcome.
,
12- Fine M.J
- Smith M.A
- Carson C.A
- et al.
Prognosis and outcomes of patients with community-acquired pneumonia.
). For example, Farr et al (
10- Farr B.M
- Sloman A.J
- Fisch M.J
Predicting death in patients hospitalized for community-acquired pneumonia.
,
11British Thoracic Society and Public Health Laboratory Service
Community-acquired pneumonia in adults in British hospitals in 1982–1983 a survey of aetiology, mortality, prognostic factors and outcome.
) retrospectively validated a discriminant rule for hospital mortality developed in a prospective study of 453 adults with community-acquired pneumonia. Fine et al (
7- Fine M.J
- Orloff J.J
- Arisumi D
- et al.
Prognosis of patients hospitalized with community-acquired pneumonia.
,
8- Fine M.J
- Singer D.E
- Hanusa B.H
- et al.
Validation of a pneumonia prognostic index using the medisgroups comparative hospital database.
,
9- Fine M.J
- Auble T.E
- Yealy D.M
- et al.
A prediction rule to identify low-risk patients with community-acquired pneumonia.
) prospectively developed a pneumonia-specific prognostic index for adults that successfully identified patients with a low risk of mortality. Although these indexes are useful for determining prognosis in the general adult population, they might be less useful when applied to subsets of patients, such as the elderly. Indeed, elderly patients with community-acquired pneumonia have a different spectrum of causative agents, a more subtle clinical presentation, and a different response to therapy than do younger patients (
5Bacterial pneumonia in the elderly.
,
13Bacterial pneumonia in the elderly.
,
14- Riquelme R
- Torres A
- El-Ebiary M
- et al.
Community-acquired pneumonia in the elderly. Clinical and nutritional aspects.
).
We analyzed data from a large cohort of elderly patients hospitalized with community-acquired pneumonia to identify clinical characteristics at presentation that were predictive of hospital mortality. These characteristics were used to develop a prognostic staging system for identifying patients at low, intermediate, and high risk for hospital mortality. Furthermore, we derived and validated a simple discriminant rule for predicting hospital mortality and compared its accuracy with that of a discriminant rule formulated from a heterogeneous adult population with community-acquired pneumonia.
Patients and methods
Description of database
Data were analyzed from a regional and national pilot test of the Pneumonia Module of the Medicare Quality Indicator System. The pilot test is a retrospective compilation of medical records of patients with community-acquired pneumonia discharged from acute care hospitals in the United States and Puerto Rico between January 1, 1993, and January 31, 1994. The regional sample was defined by randomly identifying patients from four states (Massachusetts, Maryland, New Hampshire, West Virginia) from Medicare’s National Claims History File who had a principal discharge diagnosis of pneumonia [International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) codes 480.0–480.9, 481, 482.0–482.9, 483.0–483.8, 485, 486, 487.0, 507.0] or a principal discharge diagnosis of respiratory failure (ICD-9-CM code 518.81) and a secondary diagnosis of pneumonia. The national random sample was generated by selecting a number of similarly defined cases from each state or territory. The records of these patients were forwarded to one of two clinical data abstraction centers, where trained medical abstractors collected data using an electronic data collection instrument, including several historical and clinical characteristics of the patients. The accuracy of the abstractors was monitored by both a clinical supervisor and an internal quality control process.
For this study, a diagnosis of pneumonia required that a patient have a chest radiograph performed within the first 48 hours of admission that was consistent with pneumonia (new air bronchogram, air space disease, consolidation, infiltrate, inflammation, opacity, pneumonia, or pneumonitis), and whose admitting clinician documented pneumonia as the initial working diagnosis. In addition, patients were excluded from further analysis if they met any of the following criteria: age <65 years, serologic evidence of infection with human immunodeficiency virus, history of organ transplant, receiving chemotherapy within previous 2 months, transfer from another acute care hospital, readmission within 10 days from a prior acute care hospitalization, or discharge or death on date of admission. Comprehensive historical and clinical parameters recorded within 24 hours of admission were available on the remaining patients.
Identification of predictor variables
For the derivation of our staging system and discriminant rule, patients from the four-state random sample (n = 1,000) were used as the derivation cohort; patients from the national sample (n = 1,356) were used as the validation cohort. Bivariate analyses were performed to identify variables that were associated with hospital mortality. Candidate predictor variables included demographic variables (age, sex, race, pre-arrival setting), functional variables (urinary continence, physical mobility), vital signs (temperature, systolic and diastolic blood pressure, respiratory rate, heart rate), measures of consciousness (eye opening, verbal response, motor response), and laboratory values (hematocrit, white blood cell count, and serum sodium, blood urea nitrogen, creatinine, and glucose levels). An impaired motor response was defined as failure to exhibit a motor response to verbal stimuli (localization of painful stimuli alone, flexion withdrawal, decorticate/decerebrate posturing, or no response). In addition, we considered patients to have a comorbid condition if there was documentation of acute or chronic leukemia, Hodgkin’s or non-Hodgkin’s lymphoma, multiple myeloma, any cancer with local or distant metastases, hepatic failure, cirrhosis, chemotherapy or radiotherapy within the last year (but not 2 months before admission), or a collagen vascular disease.
A multivariable logistic regression analysis was performed using significant variables identified in the bivariate analyses. Those variables found to have significant independent association with hospital mortality in the multivariable analyses were used to construct both a prognostic staging system and a discriminant rule for hospital mortality. To avoid overfitting of logistic regression models (
15SAS Institute. SAS User’s Guide: Statistics. Version 6.12. Cary, NC: SAS Institute, 1996.
,
16- Concato J
- Feinstein A.R
- Holford T.R
The risk of determining risk with multivariable models.
,
17- Harrell F.E
- Lee K.L
- Matchar D.B
- Reichert T.A
Regression models for prognostic prediction advantages, problems, and suggested solutions.
), variables were organized into groups delineated by category as well as anticipated clinical interrelatedness. Thus, demographic variables (including comorbid conditions) were tested together. Next, functional variables and measures of consciousness were tested, followed by vital signs. Finally, the laboratory values were tested. The independent variables identified by these grouped analyses were then entered into a logistic regression model.
Derivation and validation of the prognostic staging system
Using these variables, a clinically useful prognostic staging system was formulated for hospital mortality. We assigned each predictor variable an integer value, or “risk score,” based on the relative magnitude of its multivariate association with hospital mortality. The mortality gradients that were achieved by partitioning the derivation cohort (four-state sample) based on total risk score were examined. A four-staged ranking of total risk scores was developed. This system was then applied to the validation cohort (national sample), and the risk gradients of hospital mortality in the four stages of the validation cohort were compared to the risk gradients occurring in the same stages in the derivation cohort.
Derivation and validation of the discriminant rule
To define further the utility of the predictor variables, we used them to construct a discriminant rule for hospital mortality. The discriminant rule was established by examining the sensitivity, specificity, positive and negative predictive values, and overall accuracy of each potential rule employing an incrementally increasing sum of risk scores in the derivation cohort. We chose the rule achieving the best combination of sensitivity and specificity for clinical decision making in the derivation cohort (four-state sample). Our discriminant rule was applied to the validation cohort (national sample), and its sensitivity, specificity, positive and negative predictive values, and overall accuracy were examined. Finally, we compared our discriminant rule to a previous discriminant rule developed from a heterogeneous adult population by the British Thoracic Society, and validated by Farr et al (
10- Farr B.M
- Sloman A.J
- Fisch M.J
Predicting death in patients hospitalized for community-acquired pneumonia.
,
11British Thoracic Society and Public Health Laboratory Service
Community-acquired pneumonia in adults in British hospitals in 1982–1983 a survey of aetiology, mortality, prognostic factors and outcome.
) in an independent sample of adults. This system classified patients into a high-risk or low-risk category for hospital mortality, with high-risk patients having any two of the following characteristics on admission: blood urea nitrogen level >7 mmol/L (19.6 mg/dL), respiratory rate ≥30 breaths per minute, and diastolic blood pressure ≤60 mm Hg, while low-risk patients had one or none of these characteristics. We applied this discriminant rule to the validation cohort and compared its sensitivity, specificity, positive and negative predictive values, and overall accuracy with the discriminant rule derived from the derivation cohort of exclusively elderly patients.
Statistical analysis
In bivariate analyses, differences in proportions were tested with the chi-square or Fisher’s exact tests, and differences in means of dimensional variables with the Student’s
t test. Missing values for dimensional or binary variables were coded as unknown, and “dummy” variables were created for “unknown” categories. In the multivariable analyses, candidate predictor variables were first selected within each domain, then entered into a final model using stepwise logistic regression analysis. A significance level of less than 0.10 was required for inclusion in the models and a significance level of greater than 0.05 was required for exclusion. All analyses were performed using PC-SAS 6.12 (
18- Harrell F.E
- Lee K.L
- Califf R.M
- et al.
Regression modelling strategies for improved prognostic prediction.
).
Discussion
We derived a prognostic staging system and a discriminant rule for elderly patients with community-acquired pneumonia that utilized well defined variables at presentation. Both the staging system and the discriminant rule were successfully validated in a large independent cohort of elderly patients. We identified five demographic and clinical variables that were independently associated with hospital mortality: age 85 years or older, presence of a comorbid condition, lack of motor response to verbal commands, an abnormal vital sign, and serum creatinine level of 1.5 mg/dL or greater. A discriminant rule formulated from these variables performed well in both the derivation and validation cohorts of elderly patients with community-acquired pneumonia and had better accuracy than a discriminant rule developed from a heterogeneous group of adults with community-acquired pneumonia.
Our study had several advantages over previous work. First, we explicitly defined the potential predictors and the outcome, and neither the data abstraction personnel nor those responsible for identifying patients were aware of our analyses, minimizing the potential for bias (
19- Wasson J.H
- Sox H.C
- Neff R.K
- Goldman L
Clinical prediction rules.
). Second, to avoid spurious associations, we selected a limited number of variables for analysis based on clinical experience and the previous literature. Third, the large size of the derivation sample led to a sufficient number of patients who had the outcome of hospital mortality (n = 87), which reduced the risk of model overfitting (
16- Concato J
- Feinstein A.R
- Holford T.R
The risk of determining risk with multivariable models.
,
17- Harrell F.E
- Lee K.L
- Matchar D.B
- Reichert T.A
Regression models for prognostic prediction advantages, problems, and suggested solutions.
,
18- Harrell F.E
- Lee K.L
- Califf R.M
- et al.
Regression modelling strategies for improved prognostic prediction.
). Finally, we had two independent samples of elderly patients with community-acquired pneumonia, allowing for validation of our discriminant rule and prognostic staging system (
19- Wasson J.H
- Sox H.C
- Neff R.K
- Goldman L
Clinical prediction rules.
).
Other studies examining prognostic factors of pneumonia in the elderly have also identified several of our predictor variables. These studies, however, were limited by imprecise variable definitions, lack of multivariable analysis or prognostic staging, or failure to validate a staging system in an independent cohort. For example, Venkatesan et al (
20- Venkatesan P
- Gladman J
- Macfarlane J.T
- et al.
A hospital study of community acquired pneumonia in the elderly.
) prospectively followed 73 patients aged greater than 65 years with pneumonia and identified four predictors of mortality by univariate analysis: apyrexia, systolic hypotension, increasing hypoxemia, and new urinary incontinence. Janssens et al (
21- Janssens J.P
- Gauthey L
- Herrmann F
- et al.
Community-acquired pneumonia in older patients.
) prospectively followed a similar group of 99 patients aged 79 to 91 years and identified apyrexia, admission from a nursing home, and elevated blood urea nitrogen level as predictors of mortality. Hedlund et al (
22- Hedlund J
- Hansson L.O
- Ortqvist A
Short and long term prognosis for middle aged and elderly patients hospitalized with community acquired pneumonia impact of nutritional and inflammatory factors.
) prospectively followed 97 patients aged 50 to 85 years with pneumonia and evaluated several predictors of mortality, including APACHE II score, body mass index, and triceps skin fold measurement. In all of these studies, multivariable analyses were not performed, and no prognostic staging systems were derived or validated. Starczewski et al(
23- Starczewski A.R
- Allen S.C
- Vargas E
- Lye M
Clinical prognostic indices of fatality in elderly patients admitted to the hospital with acute pneumonia.
) prospectively followed 100 patients aged greater than 70 years and identified four multivariable predictors of mortality: acute confusion, respiratory rate >26 breaths per minute, history of dementia, and bronchial breathing. Houston et al (
24- Houston M.S
- Silverstein M.D
- Suman V.J
Risk factors for 30-day mortality in elderly patients with lower respiratory tract infection.
) retrospectively evaluated 413 patients aged 65 years or greater with community-acquired pneumonia or bronchitis and found that atypical symptoms, neurologic illness, current diagnosis of cancer, and recent or current use of antibiotics were predictors of 30-day mortality. These authors, however, did not derive or validate a prognostic index based on these predictors. Finally, Zweig et al (
25- Zweig S
- Lawhorne L
- Post R
Factors predicting mortality in rural elderly hospitalized for pneumonia.
) retrospectively reviewed the course of 133 elderly patients with pneumonia and identified five predictors of mortality by multivariable analysis: impaired consciousness, tachypnea, subnormal temperature, elevated white blood cell count, and cyanosis. However, this study was limited because the prognostic index was validated in a small sample from the same group from which it was derived, and two of the predictor variables (level of consciousness and cyanosis) lacked clearly stated definitions.
Our study identified some unique predictors of hospital mortality in elderly patients with community-acquired pneumonia. First, we found that within the subgroup of patients aged 65 years or older, those aged 85 years or greater had a higher likelihood of hospital mortality. While advanced age (>65 years) is a risk factor for mortality in community-acquired pneumonia among the general population, the importance of extreme advanced age (ie, ≥85 years) has not been demonstrated previously. Since several studies have identified an altered level of consciousness on presentation as an important predictor of mortality in elderly patients with community-acquired pneumonia (
22- Hedlund J
- Hansson L.O
- Ortqvist A
Short and long term prognosis for middle aged and elderly patients hospitalized with community acquired pneumonia impact of nutritional and inflammatory factors.
,
23- Starczewski A.R
- Allen S.C
- Vargas E
- Lye M
Clinical prognostic indices of fatality in elderly patients admitted to the hospital with acute pneumonia.
,
24- Houston M.S
- Silverstein M.D
- Suman V.J
Risk factors for 30-day mortality in elderly patients with lower respiratory tract infection.
,
25- Zweig S
- Lawhorne L
- Post R
Factors predicting mortality in rural elderly hospitalized for pneumonia.
), we evaluated several well defined measures of consciousness. Of these, we identified an impaired motor response, defined as failure to exhibit a motor response to verbal stimuli, as an independent risk factor.
Our independent predictor variables and discriminant rule compared well with those derived by the British Thoracic Society (BTS) and confirmed by Farr et al (
10- Farr B.M
- Sloman A.J
- Fisch M.J
Predicting death in patients hospitalized for community-acquired pneumonia.
,
11British Thoracic Society and Public Health Laboratory Service
Community-acquired pneumonia in adults in British hospitals in 1982–1983 a survey of aetiology, mortality, prognostic factors and outcome.
). Our discriminant rule had comparable sensitivity, specificity, positive and negative predictive values, as well as superior overall accuracy.
Our prognostic staging system may be useful to investigators for comparing the mortality rates of elderly patients with community-acquired pneumonia among hospitals and for stratifying elderly patients according to mortality risk in the evaluation of new therapeutic agents. The discriminant rule is simple and easy to apply, can quickly stratify elderly patients into high- and low-risk groups, and can identify elderly patients who have a threefold increased risk of hospital mortality from community-acquired pneumonia.
There were several limitations to our study. First, it was limited to elderly patients hospitalized with community-acquired pneumonia, and our prognostic staging system and discriminant rule may not apply to elderly patients treated as outpatients. Second, the retrospective design of our study limited the choice of potential predictor variables, such as arterial oxygen saturation, arterial blood gas results (
9- Fine M.J
- Auble T.E
- Yealy D.M
- et al.
A prediction rule to identify low-risk patients with community-acquired pneumonia.
), and cyanosis (
25- Zweig S
- Lawhorne L
- Post R
Factors predicting mortality in rural elderly hospitalized for pneumonia.
), which might be associated with hospital mortality. Variables related to process and quality of care during hospitalization might also be associated with mortality in elderly patients with community-acquired pneumonia. Recently, Meehan et al (
26- Meehan T.P
- Fine M.J
- Krumholz H.M
- et al.
Quality of care, process, and outcomes in elderly patients with pneumonia.
) evaluated provider-amenable risk factors for 30-day mortality and found that initial administration of antibiotics after 8 hours and failure to obtain blood cultures within 24 hours of admission were associated with poor outcomes. Finally, hospital mortality is not the only outcome of interest. Other outcomes, such as need for intensive-care-unit transfer, change in mobility status, development of incontinence, 30-day mortality (
9- Fine M.J
- Auble T.E
- Yealy D.M
- et al.
A prediction rule to identify low-risk patients with community-acquired pneumonia.
,
24- Houston M.S
- Silverstein M.D
- Suman V.J
Risk factors for 30-day mortality in elderly patients with lower respiratory tract infection.
,
26- Meehan T.P
- Fine M.J
- Krumholz H.M
- et al.
Quality of care, process, and outcomes in elderly patients with pneumonia.
), and discharge disposition other than to home, are also relevant.
Community-acquired pneumonia is a common and severe disease in elderly patients. Our prognostic staging system and discriminant rule for hospital mortality, derived and validated in a cohort of elderly patients with community-acquired pneumonia, clarifies the risk factors for hospital mortality in these patients.
Article info
Publication history
Published online: August 16, 2004
Accepted:
August 27,
1998
Received:
March 13,
1998
Footnotes
☆The analyses on which this publication is based were performed under Contract Number 500-96-P549, entitled “Utilization and Quality Control Peer Review Organization for the State of Connecticut” sponsored by the Health Care Financing Administration, Department of Health and Human Services. The content of this publication does not necessarily reflect the views or policies of the Department of Health and Human Services, nor does mention of trade names, commercial products, or organizations imply endorsement by the US government.
Copyright
© 1999 Excerpta Medica Inc. Published by Elsevier Inc.