Publications

2019

Hu, Szu-Yeu, Enrico Santus, Alexander W Forsyth, Devvrat Malhotra, Josh Haimson, Neal A Chatterjee, Daniel B Kramer, Regina Barzilay, James A Tulsky, and Charlotta Lindvall. (2019) 2019. “Can Machine Learning Improve Patient Selection for Cardiac Resynchronization Therapy?”. PloS One 14 (10): e0222397. https://doi.org/10.1371/journal.pone.0222397.

RATIONALE: Multiple clinical trials support the effectiveness of cardiac resynchronization therapy (CRT); however, optimal patient selection remains challenging due to substantial treatment heterogeneity among patients who meet the clinical practice guidelines.

OBJECTIVE: To apply machine learning to create an algorithm that predicts CRT outcome using electronic health record (EHR) data avaible before the procedure.

METHODS AND RESULTS: We applied machine learning and natural language processing to the EHR of 990 patients who received CRT at two academic hospitals between 2004-2015. The primary outcome was reduced CRT benefit, defined as <0% improvement in left ventricular ejection fraction (LVEF) 6-18 months post-procedure or death by 18 months. Data regarding demographics, laboratory values, medications, clinical characteristics, and past health services utilization were extracted from the EHR available before the CRT procedure. Bigrams (i.e., two-word sequences) were also extracted from the clinical notes using natural language processing. Patients accrued on average 75 clinical notes (SD, 29) before the procedure including data not captured anywhere else in the EHR. A machine learning model was built using 80% of the patient sample (training and validation dataset), and tested on a held-out 20% patient sample (test dataset). Among 990 patients receiving CRT the mean age was 71.6 (SD, 11.8), 78.1% were male, 87.2% non-Hispanic white, and the mean baseline LVEF was 24.8% (SD, 7.69). Out of 990 patients, 403 (40.7%) were identified as having a reduced benefit from the CRT device (<0% LVEF improvement in 25.2%, death by 18 months in 15.6%). The final model identified 26% of these patients at a positive predictive value of 79% (model performance: Fβ (β = 0.1): 77%; recall 0.26; precision 0.79; accuracy 0.65).

CONCLUSIONS: A machine learning model that leveraged readily available EHR data and clinical notes identified a subset of CRT patients who may not benefit from CRT before the procedure.

Rajan, Prashant, V, Jessica N Holtzman, Aaron S Kesselheim, Robert W Yeh, and Daniel B Kramer. (2019) 2019. “Landscape of Cardiovascular Device Registries in the United States.”. Journal of the American Heart Association 8 (11): e012756. https://doi.org/10.1161/JAHA.119.012756.

Background Regulators increasingly rely on registries for decision making related to high-risk medical devices in the United States. However, the limited uniform standards for registries may create substantial variability in registry implementation and utility to regulators. We surveyed the current landscape of US cardiovascular device registries and chart the extent of inconsistency in goals, administration, enrollment procedures, and approach to data access. Methods and Results A systematic review using Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines identified studies (1995-2017) referencing cardiovascular device registries with a US-based institution. Registries were then evaluated by reviewing associated articles and websites. Extracted data included device type, primary scientific aim(s), funding, stewardship (eg, administration of registry procedures), enrollment procedures, informed consent process, and mechanisms to access data for research. The 138 cardiovascular device registries in the cohort covered devices addressing interventional cardiology (65.9%), arrhythmias (15.2%), heart failure (10.1%), and valvular disease (10.1%). While the majority (55.8%) were industry-funded, stewardship was predominantly overseen by academic centers (74.0%). Most registry participation was voluntary (77.5%), but a substantial minority (19.7%) were required as a condition of device implantation. Informed consent requirements varied widely, with written consent required in only 55.1% of registries. Registry data were primarily accessible only to stewards (84.1%), with 13.8% providing pathways for external applications. Conclusions The majority of cardiovascular device registries were funded privately under the auspices of academic institutions, which set the rules for data access. The substantial variation between cardiovascular device registries suggests a role for regulators to further strengthen guidelines to improve quality, consistency, and ethical standards.

Reeder, Harrison T, Changyu Shen, Alfred E Buxton, Sebastien J Haneuse, and Daniel B Kramer. (2019) 2019. “Joint Shock/Death Risk Prediction Model for Patients Considering Implantable Cardioverter-Defibrillators.”. Circulation. Cardiovascular Quality and Outcomes 12 (8): e005675. https://doi.org/10.1161/CIRCOUTCOMES.119.005675.

BACKGROUND: The risk of death or appropriate therapy varies widely among recipients of implantable cardioverter-defibrillators (ICDs). The goals of this study were to develop a risk prediction tool that jointly considers future outcome probabilities of ICD shock and death.

METHODS AND RESULTS: We performed a secondary analysis of patients receiving ICDs as part of the SCD-HeFT trial (Sudden Cardiac Death in Heart Failure Trial). We applied an illness-death regression model to jointly model both ICD shocks and death under the semi-competing risks framework, which predicts for each patient their probability of having received ICD shocks, dying, or both at any given point in time. Among 803 ICD recipients (mean age, 60 years; 23% women) followed for a median of 41.1 months, 430 (53.5%) patients completed the study without dying or receiving an ICD shock, 206 (25.7%) received at least 1 shock but survived, 113 (14.1%) died before experiencing a shock, and 54 (6.7%) received at least 1 shock and subsequently died. Predicted outcome probabilities based on baseline demographic and clinical variables reveal substantial heterogeneity in joint shock and death risks, both between patients at each time point and for each single patient across time. Overall, predictive performance for ICD shock and death individually was adequate, based on area under the curve at 5 years of 0.65 for shocks and of 0.79 for death.

CONCLUSIONS: Our analysis of outcomes after ICD implantation provides an alternative predictive model for individual risk of death or ICD shocks. If validated, this may provide a useful tool for individualized counseling regarding likely outcomes after device implantation, while also informing the design of further studies to focus the clinical effectiveness and cost-effectiveness of ICD therapy.

CLINICAL TRIAL REGISTRATION: URL: https://www.clinicaltrials.gov. Unique identifier: NCT00000609.

2018

Kramer, Daniel B, Sharon-Lise T Normand, Rita Volya, and Laura A Hatfield. (2018) 2018. “Facility-Level Variation and Clinical Outcomes in Use of Cardiac Resynchronization Therapy With and Without an Implantable Cardioverter-Defibrillator.”. Circulation. Cardiovascular Quality and Outcomes 11 (12): e004763. https://doi.org/10.1161/CIRCOUTCOMES.118.004763.

BACKGROUND: Little is known about real-world facility-level preferences for cardiac resynchronization therapy devices with (CRT-D) and without (CRT-P) defibrillator backup. We quantify this variation at the facility level and exploit this variation to compare outcomes of patients receiving these 2 devices.

METHODS AND RESULTS: Claims data from fee-for-service Medicare beneficiaries were used to identify new CRT-P and CRT-D implants, 2006 to 2012. We modeled factors associated with receipt of each device, and compared mortality, hospitalizations, and reoperations for patients receiving each using both logistic regression and instrumental variable analysis to account for confounding. Among 71 459 device recipients (CRT-P, 11 925; CRT-D, 59 534; 31% women), CRT-P recipients were older, more likely to be women, and had more comorbidities. Variation in device selection among facilities was substantial: After adjustment for patient characteristics, the odds of receiving a CRT-P (versus CRT-D) device were 7.6× higher for a patient treated at a facility in the highest CRT-P use quartile versus a facility in the lowest CRT-P use quartile. Logistic modeling suggested a survival advantage for CRT-D devices but with falsification end points indicating residual confounding. By contrast, in the instrumental variable analysis using facility variability as the proposed instrument, clinical characteristics and falsification end points were well balanced, and 1-year mortality in patients who received CRT-P versus CRT-D implants did not differ, while CRT-P patients had a lower probability of hospitalizations and reoperations in the year following implant.

CONCLUSIONS: CRT-P versus CRT-D selection varies substantially among facilities, adjusted for clinical factors. After instrumental variable adjustment for clinical covariates and facility preference, survival was no different between the devices. Therefore, CRT-P may be preferred for Medicare beneficiaries considering new CRT implantation.

Wann, Daniel, Jonathan W Waks, and Daniel B Kramer. (2018) 2018. “Clinical and Regulatory Considerations for Novel Electrophysiology Mapping Systems: Lessons from FIRM.”. Pacing and Clinical Electrophysiology : PACE 41 (12): 1669-80. https://doi.org/10.1111/pace.13509.

Atrial fibrillation (AF) presents a growing clinical and public health burden for which better rhythm control therapies are needed. Focal impulse and rotor mapping (FIRM), currently marketed as a part of the Topera Rotor Mapping system (Abbott Laboratories, Austin, TX, USA), represents a potentially transformational approach to guide the invasive treatment of AF. However, many years after its initial marketing clearance, the clinical utility of this technology remains uncertain. In this article, we review the scientific rationale for this novel approach to AF ablation, evaluate the current clinical evidence for FIRM-guided ablation, and characterize its premarket regulatory assessment. Lessons for clinicians considering adoption of newly marketed mapping systems are presented.

Witt, Chance M, Jonathan W Waks, Ramila A Mehta, Paul A Friedman, Daniel B Kramer, Alfred E Buxton, Siva K Mulpuru, et al. (2018) 2018. “Risk of Appropriate Therapy and Death Before Therapy After Implantable Cardioverter-Defibrillator Generator Replacement.”. Circulation. Arrhythmia and Electrophysiology 11 (8): e006155. https://doi.org/10.1161/CIRCEP.117.006155.

Background The decision to initially implant an implantable cardioverter-defibrillator (ICD) is informed by robust randomized controlled trials, but no such data exist to guide the decision to replace an ICD generator. In this study, we aimed to determine outcomes after ICD generator replacement. Methods All patients with ischemic or nonischemic cardiomyopathy who underwent ICD generator replacement from 2001 to 2011 at Mayo Clinic, MN, or Beth Israel Deaconess Medical Center, MA, were included. Outcomes included (1) appropriate therapy after generator replacement and (2) death before appropriate therapy after generator replacement. Cox proportional hazards modeling was used to determine the associations between patient characteristics and outcomes. Results In 1421 patients undergoing ICD generator replacement (mean±SD age 69.6±12.1 years, 81% male), appropriate therapy occurred after replacement in 435 patients (30.6%) over a mean follow-up of 2.7±2.6 years. Associated factors included lower left ventricular ejection fraction and history of appropriate therapy before generator replacement. Death before appropriate ICD therapy occurred in 336 (23.7%) patients. Older age, lower left ventricular ejection fraction, and noncardiac comorbidities, including diabetes mellitus, chronic lung disease, peripheral vascular disease, lower hemoglobin, and lower glomerular filtration rate, were associated with greater risk of death before appropriate therapy. A progressive increase in mortality was observed with aggregation of these noncardiac comorbidities. Conclusions The decision to replace the ICD should take into consideration not only left ventricular ejection fraction and history of ventricular arrhythmias, but also comorbid illnesses that may impact the duration and the quality of life.