Publications

2024

Gray, Bradley M, Jonathan L Vandergrift, Jennifer P Stevens, Rebecca S Lipner, Furman S McDonald, and Bruce E Landon. (2024) 2024. “Associations of Internal Medicine Residency Milestone Ratings and Certification Examination Scores With Patient Outcomes.”. JAMA 332 (4): 300-309. https://doi.org/10.1001/jama.2024.5268.

IMPORTANCE: Despite its importance to medical education and competency assessment for internal medicine trainees, evidence about the relationship between physicians' milestone residency ratings or the American Board of Internal Medicine's initial certification examination and their hospitalized patients' outcomes is sparse.

OBJECTIVE: To examine the association between physicians' milestone ratings and certification examination scores and hospital outcomes for their patients.

DESIGN, SETTING, AND PARTICIPANTS: Retrospective cohort analyses of 6898 hospitalists completing training in 2016 to 2018 and caring for Medicare fee-for-service beneficiaries during hospitalizations in 2017 to 2019 at US hospitals.

MAIN OUTCOMES AND MEASURES: Primary outcome measures included 7-day mortality and readmission rates. Thirty-day mortality and readmission rates, length of stay, and subspecialist consultation frequency were also assessed. Analyses accounted for hospital fixed effects and adjusted for patient characteristics, physician years of experience, and year.

EXPOSURES: Certification examination score quartile and milestone ratings, including an overall core competency rating measure equaling the mean of the end of residency milestone subcompetency ratings categorized as low, medium, or high, and a knowledge core competency measure categorized similarly.

RESULTS: Among 455 120 hospitalizations, median patient age was 79 years (IQR, 73-86 years), 56.5% of patients were female, 1.9% were Asian, 9.8% were Black, 4.6% were Hispanic, and 81.9% were White. The 7-day mortality and readmission rates were 3.5% (95% CI, 3.4%-3.6%) and 5.6% (95% CI, 5.5%-5.6%), respectively, and were 8.8% (95% CI, 8.7%-8.9%) and 16.6% (95% CI, 16.5%-16.7%) for mortality and readmission at 30 days. Mean length of stay and number of specialty consultations were 3.6 days (95% CI, 3.6-3.6 days) and 1.01 (95% CI, 1.00-1.03), respectively. A high vs low overall or knowledge milestone core competency rating was associated with none of the outcome measures assessed. For example, a high vs low overall core competency rating was associated with a nonsignificant 2.7% increase in 7-day mortality rates (95% CI, -5.2% to 10.6%; P = .51). In contrast, top vs bottom examination score quartile was associated with a significant 8.0% reduction in 7-day mortality rates (95% CI, -13.0% to -3.1%; P = .002) and a 9.3% reduction in 7-day readmission rates (95% CI, -13.0% to -5.7%; P < .001). For 30-day mortality, this association was -3.5% (95% CI, -6.7% to -0.4%; P = .03). Top vs bottom examination score quartile was associated with 2.4% more consultations (95% CI, 0.8%-3.9%; P < .003) but was not associated with length of stay or 30-day readmission rates.

CONCLUSIONS AND RELEVANCE: Among newly trained hospitalists, certification examination score, but not residency milestone ratings, was associated with improved outcomes among hospitalized Medicare beneficiaries.

Sokol-Hessner, Lauge, Tenzin Dechen, Patricia Folcarelli, Patricia McGaffigan, Jennifer P Stevens, Eric J Thomas, and Sigall Bell. (2024) 2024. “Associations Between Organizational Communication and Patients’ Experience of Prolonged Emotional Impact Following Medical Errors.”. Joint Commission Journal on Quality and Patient Safety 50 (9): 620-29. https://doi.org/10.1016/j.jcjq.2024.03.002.

BACKGROUND: The emotional impact of medical errors on patients may be long-lasting. Factors associated with prolonged emotional impacts are poorly understood.

METHODS: The authors conducted a subanalysis of a 2017 survey (response rate 36.8% [2,536/6,891]) of US adults to assess emotional impact of medical error. Patients reporting a medical error were included if the error occurred ≥ 1 year prior. Duration of emotional impact was categorized into no/short-term impact (impact lasting < 1 month), prolonged impact (> 1 month), and especially prolonged impact (> 1 year). Based on their reported experience with communication about the error, patients' experience was categorized as consistent with national disclosure guidelines, contrary to guidelines, mixed, or neither. Multinomial regression was used to examine associations between patient factors, event characteristics, and organizational communication with prolonged emotional impact (> 1 month, > 1 year).

RESULTS: Of all survey respondents, 17.8% (451/2,536) reported an error occurring ≥ 1 year prior. Of these, 51.2% (231/451) reported prolonged/especially prolonged emotional impact (30.8% prolonged, 20.4% especially prolonged). Factors associated with prolonged emotional impact included female gender (adjusted odds ratio 2.1 [95% confidence interval 1.5-2.9]); low socioeconomic status (SES; 1.7 [1.1-2.7]); physical impact (7.3 [4.3-12.3]); no organizational disclosure and no patient/family error reporting (1.5 [1.03-2.3]); communication contrary to guidelines (4.0 [2.1-7.5]); and mixed communication (2.2 [1.3-3.7]). The same factors were significantly associated with especially prolonged emotional impact (female, 1.7 [1.2-2.5]; low SES, 2.2 [1.3-3.6]; physical impact, 6.8 [3.8-12.5]; no disclosure/reporting, 1.9 [1.2-3.2]; communication contrary to guidelines, 4.6 [2.2-9.4]; mixed communication, 2.1 [1.1-3.9]).

CONCLUSION: Prolonged emotional impact affected more than half of Americans self-reporting a medical error. Organizational failure to communicate according to disclosure guidelines after patient-perceived errors may exacerbate harm, particularly for patients at risk of health care disparities.

Myers, Laura C, Nicholas A Bosch, Lauren Soltesz, Kathleen A Daly, Cynthia I Campbell, Emma Schwager, Emmanuele Salvati, et al. (2024) 2024. “Opioid Administration Practice Patterns in Patients With Acute Respiratory Failure Who Undergo Invasive Mechanical Ventilation.”. Critical Care Explorations 6 (7): e1123. https://doi.org/10.1097/CCE.0000000000001123.

IMPORTANCE: The opioid crisis is impacting people across the country and deserves attention to be able to curb the rise in opioid-related deaths.

OBJECTIVES: To evaluate practice patterns in opioid infusion administration and dosing for patients with acute respiratory failure receiving invasive mechanical ventilation.

DESIGN: Retrospective cohort study.

SETTING AND PARTICIPANTS: Patients from 21 hospitals in Kaiser Permanente Northern California and 96 hospitals in Philips electronic ICU Research Institute.

MAIN OUTCOMES AND MEASURES: We assessed whether patients received opioid infusion and the dose of said opioid infusion.

RESULTS: We identified patients with a diagnosis of acute respiratory failure who were initiated on invasive mechanical ventilation. From each patient, we determined if opioid infusions were administered and, among those who received an opioid infusion, the median daily dose of fentanyl infusion. We used hierarchical regression models to quantify variation in opioid infusion use and the median daily dose of fentanyl equivalents across hospitals. We included 13,140 patients in the KPNC cohort and 52,033 patients in the eRI cohort. A total of 7,023 (53.4%) and 16,311 (31.1%) patients received an opioid infusion in the first 21 days of mechanical ventilation in the KPNC and eRI cohorts, respectively. After accounting for patient- and hospital-level fixed effects, the hospital that a patient was admitted to explained 7% (95% CI, 3-11%) and 39% (95% CI, 28-49%) of the variation in opioid infusion use in the KPNC and eRI cohorts, respectively. Among patients who received an opioid infusion, the median daily fentanyl equivalent dose was 692 µg (interquartile range [IQR], 129-1341 µg) in the KPNC cohort and 200 µg (IQR, 0-1050 µg) in the eRI cohort. Hospital explained 4% (95% CI, 1-7%) and 20% (95% CI, 15-26%) of the variation in median daily fentanyl equivalent dose in the KPNC and eRI cohorts, respectively.

CONCLUSIONS AND RELEVANCE: In the context of efforts to limit healthcare-associated opioid exposure, our findings highlight the considerable opioid exposure that accompanies mechanical ventilation and suggest potential under and over-treatment with analgesia. Our results facilitate benchmarking of hospitals' analgesia practices against risk-adjusted averages and can be used to inform usual care control arms of analgesia and sedation clinical trials.

2023

Rawson, James, V, and Jennifer P Stevens. (2023) 2023. “Scenario Planning Approach to Adapting in the COVID Era.”. Academic Radiology 30 (4): 572-78. https://doi.org/10.1016/j.acra.2022.11.032.

RATIONALE AND OBJECTIVES: The COVID-19 pandemic has caused much uncertainty and disruption in healthcare resulting in many challenges for strategic planning. Scenario planning is a tool that allows healthcare leaders to plan healthcare delivery strategies by incorporating the uncertainties into the analysis and planning process.

MATERIALS AND METHODS: Variables were identified which will have major impact on the future, but whose future direction is uncertain. The extremes of these drivers were used to generate multiple scenarios. A subset of scenarios was used to evaluate potential tactics to determine which may be high yield in the face of uncertainty.

RESULTS: Unlike traditional strategic planning, scenario planning does not develop a single future with a path to that future. Scenario planning evaluates tactics to determine which would be helpful in specific scenarios, multiple different futures or under specific conditions.

CONCLUSION: We present a scenario planning model which can be used to determine specific tactics to accommodate the uncertainty due to variable healthcare delivery needs in the COVID-19 era.

Siddiqui, Shahla, Diana Bouhassira, Lauren Kelly, Margaret Hayes, Austin Herbst, Sarah Ohnigian, Luke Hedrick, Kimberly Ona Ayala, Daniel S Talmor, and Jennifer P Stevens. (2023) 2023. “Examining the Role of Race in End-of-Life Care in the Intensive Care Unit: A Single-Center Observational Study.”. Palliative Medicine Reports 4 (1): 264-73. https://doi.org/10.1089/pmr.2023.0037.

BACKGROUND: Prior studies have shown variation in the intensity of end-of-life care in intensive care units (ICUs) among patients of different races.

OBJECTIVE: We sought to identify variation in the levels of care at the end of life in the ICU and to assess for any association with race and ethnicity.

DESIGN: An observational, retrospective cohort study.

SETTINGS: A tertiary care center in Boston, MA.

PARTICIPANTS: All critically ill patients admitted to medical and surgical ICUs between June 2019 and December 2020.

EXPOSURE: Self-identified race and ethnicity.

MAIN OUTCOME AND MEASURE: The primary outcome was death. Secondary outcomes included "code status," markers of intensity of care, consultation by the Palliative care service, and consultation by the Ethics service.

RESULTS: A total of 9083 ICU patient encounters were analyzed. One thousand two hundred fifty-nine patients (14%) died in the ICU; the mean age of patients was 64 years (standard deviation 16.8), and 44% of patients were women. A large number of decedents (22.7%) did not have their race identified. These patients had a high rate of interventions at death. Code status varied by race, with more White patients designated as "Comfort Measures Only" (CMO) (74%) whereas more Black patients were designated as "Do Not Resuscitate/Do Not Intubate (DNR/DNI) and DNR/ok to intubate" (12.1% and 15.7%) at the end of life; after adjustment for age and severity of illness, there were no statistical differences by race for the use of the CMO code status. Use of dialysis at the end of life varied by self-identified race. Specifically, Black and Unknown patients were more likely to receive renal replacement therapy, even after adjustment for age and severity of illness (24% and 20%, p = 0.003).

CONCLUSIONS: Our data describe a gap in identification of race and ethnicity, as well as differences at the end of life in the ICU, especially with respect to code status and certain markers of intensity.

Law, Anica C, Nicholas A Bosch, Yang Song, Archana Tale, Robert W Yeh, Jeremy M Kahn, Jennifer P Stevens, and Allan J Walkey. (2023) 2023. “Patient Outcomes After Long-Term Acute Care Hospital Closures.”. JAMA Network Open 6 (11): e2344377. https://doi.org/10.1001/jamanetworkopen.2023.44377.

IMPORTANCE: Long-term acute care hospitals (LTCHs) are common sites of postacute care for patients recovering from severe respiratory failure requiring mechanical ventilation (MV). However, federal payment reform led to the closure of many LTCHs in the US, and it is unclear how closure of LTCHs may have affected upstream care patterns at short-stay hospitals and overall patient outcomes.

OBJECTIVE: To estimate the association between LTCH closures and short-stay hospital care patterns and patient outcomes.

DESIGN, SETTING, AND PARTICIPANTS: This retrospective, national, matched cohort study used difference-in-differences analysis to compare outcomes at short-stay hospitals reliant on LTCHs that closed during 2012 to 2018 with outcomes at control hospitals. Data were obtained from the Medicare Provider Analysis and Review File, 2011 to 2019. Participants included Medicare fee-for-service beneficiaries aged 66 years and older receiving MV for at least 96 hours in an intensive care unit (ie, patients at-risk for prolonged MV) and the subgroup also receiving a tracheostomy (ie, receiving prolonged MV). Data were analyzed from October 2022 to June 2023.

EXPOSURE: Admission to closure-affected hospitals, defined as those discharging at least 60% of patients receiving a tracheostomy to LTCHs that subsequently closed, vs control hospitals.

MAIN OUTCOMES AND MEASURES: Upstream hospital care pattern outcomes were short-stay hospital do-not-resuscitate orders, palliative care delivery, tracheostomy placement, and discharge disposition. Patient outcomes included hospital length of stay, days alive and institution free within 90 days, spending per days alive within 90 days, and 90-day mortality.

RESULTS: Between 2011 and 2019, 99 454 patients receiving MV for at least 96 hours at 1261 hospitals were discharged to 459 LTCHs; 84 LTCHs closed. Difference-in-differences analysis included 8404 patients (mean age, 76.2 [7.2] years; 4419 [52.6%] men) admitted to 45 closure-affected hospitals and 45 matched-control hospitals. LTCH closure was associated with decreased LTCH transfer rates (difference, -5.1 [95% CI -8.2 to -2.0] percentage points) and decreased spending-per-days-alive (difference, -$8701.58 [95% CI, -$13 323.56 to -$4079.60]). In the subgroup of patients receiving a tracheostomy, there was additionally an increase in do-not-resuscitate rates (difference, 10.3 [95% CI, 4.2 to 16.3] percentage points) and transfer to skilled nursing facilities (difference, 10.0 [95% CI, 4.2 to 15.8] percentage points). There was no significant association of closure with 90-day mortality.

CONCLUSIONS AND RELEVANCE: In this cohort study, LTCH closure was associated with changes in discharge patterns in patients receiving mechanical ventilation for at least 96 hours and advanced directive decisions in the subgroup receiving a tracheostomy, without change in mortality. Further studies are needed to understand how LTCH availability may be associated with other important outcomes, including functional outcomes and patient and family satisfaction.

O’Donoghue, Ashley L, Alyse Reichheld, Timothy S Anderson, Chloe A Zera, Tenzin Dechen, and Jennifer P Stevens. (2023) 2023. “Decline in Prenatal Buprenorphine/Naloxone Fills During the COVID-19 Pandemic in the United States.”. Journal of Addiction Medicine 17 (6): e399-e402. https://doi.org/10.1097/ADM.0000000000001228.

OBJECTIVES: Pregnancy provides a critical opportunity to engage individuals with opioid use disorder in care. However, before the COVID-19 pandemic, there were multiple barriers to accessing buprenorphine/naloxone during pregnancy. Care disruptions during the pandemic may have further exacerbated these existing barriers. To quantify these changes, we examined trends in the number of individuals filling buprenorphine/naloxone prescriptions during the COVID-19 pandemic.

METHODS: We estimated an interrupted time series model using linked national pharmacy claims and medical claims data from prepandemic (May 2019 to February 2020) to the pandemic period (April 2020 to December 2020). We estimated changes in the growth rate in the monthly number of individuals filling buprenorphine/naloxone prescriptions in the 6 months preceding a delivery claim, per 100,000 pregnancies, during the COVID-19 pandemic.

RESULTS: We identified 2947 pregnant individuals filling buprenorphine/naloxone prescriptions. Before the pandemic, there was positive growth in the monthly number of individuals filling buprenorphine/naloxone prescriptions (4.83%; 95% confidence interval [CI], 3.82-5.84%). During the pandemic, this monthly growth rate declined for both individuals on commercial insurance and individuals on Medicaid (all payers: -5.53% [95% CI, -6.65% to -4.41%]; Medicaid: -7.66% [95% CI, -10.14% to -5.18%]; Commercial: -3.59% [95% CI, -5.32% to -1.87%]).

CONCLUSION: The number of pregnant individuals filling buprenorphine/naloxone prescriptions was increasing, but this growth has been lost during the pandemic.