Publications

2024

Labkoff, Steven, Bilikis Oladimeji, Joseph Kannry, Anthony Solomonides, Russell Leftwich, Eileen Koski, Amanda L Joseph, et al. (2024) 2024. “Toward a Responsible Future: Recommendations for AI-Enabled Clinical Decision Support.”. Journal of the American Medical Informatics Association : JAMIA 31 (11): 2730-39. https://doi.org/10.1093/jamia/ocae209.

BACKGROUND: Integrating artificial intelligence (AI) in healthcare settings has the potential to benefit clinical decision-making. Addressing challenges such as ensuring trustworthiness, mitigating bias, and maintaining safety is paramount. The lack of established methodologies for pre- and post-deployment evaluation of AI tools regarding crucial attributes such as transparency, performance monitoring, and adverse event reporting makes this situation challenging.

OBJECTIVES: This paper aims to make practical suggestions for creating methods, rules, and guidelines to ensure that the development, testing, supervision, and use of AI in clinical decision support (CDS) systems are done well and safely for patients.

MATERIALS AND METHODS: In May 2023, the Division of Clinical Informatics at Beth Israel Deaconess Medical Center and the American Medical Informatics Association co-sponsored a working group on AI in healthcare. In August 2023, there were 4 webinars on AI topics and a 2-day workshop in September 2023 for consensus-building. The event included over 200 industry stakeholders, including clinicians, software developers, academics, ethicists, attorneys, government policy experts, scientists, and patients. The goal was to identify challenges associated with the trusted use of AI-enabled CDS in medical practice. Key issues were identified, and solutions were proposed through qualitative analysis and a 4-month iterative consensus process.

RESULTS: Our work culminated in several key recommendations: (1) building safe and trustworthy systems; (2) developing validation, verification, and certification processes for AI-CDS systems; (3) providing a means of safety monitoring and reporting at the national level; and (4) ensuring that appropriate documentation and end-user training are provided.

DISCUSSION: AI-enabled Clinical Decision Support (AI-CDS) systems promise to revolutionize healthcare decision-making, necessitating a comprehensive framework for their development, implementation, and regulation that emphasizes trustworthiness, transparency, and safety. This framework encompasses various aspects including model training, explainability, validation, certification, monitoring, and continuous evaluation, while also addressing challenges such as data privacy, fairness, and the need for regulatory oversight to ensure responsible integration of AI into clinical workflow.

CONCLUSIONS: Achieving responsible AI-CDS systems requires a collective effort from many healthcare stakeholders. This involves implementing robust safety, monitoring, and transparency measures while fostering innovation. Future steps include testing and piloting proposed trust mechanisms, such as safety reporting protocols, and establishing best practice guidelines.

Molina-Vicenty, Irma L, Isabel C Borras-Fernández, Yuri Quintana, Elimichelle Robles-Gierbolini, Camila I Canales-Emanuelli, Gyana Srivastava, Marleni Pagán-Ramos, et al. (2024) 2024. “Enhancing Access Through Language-Tailored Approach in Telehealth and Veterans Video Connect: Traumatic Brain Injury (TBI) Veterans Satisfaction Assessment.”. Military Medicine 189 (Suppl 3): 211-20. https://doi.org/10.1093/milmed/usae077.

INTRODUCTION: Traumatic brain injury (TBI) can impact language processing, necessitating language-tailored approaches. Telehealth may expand rural Veterans' access but has unknown feasibility for language preferences. This study explored telehealth/Veterans Video Connect satisfaction for Spanish/English TBI screening.

MATERIALS AND METHODS: The study was approved by the VA Caribbean Healthcare System Institutional Review Board and the Research and Development Committee. Mixed methods evaluated telehealth satisfaction in Veterans receiving TBI assessments from October 2021 to October 2023. Surveys included the 16-item Clinical Video Telehealth (CVT) questionnaire on communication, technical factors, coordination, and overall satisfaction, and the 21-item Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) examining usefulness, ease of use, manners, quality, and satisfaction. Mean domain/item scores were calculated among 57 Veterans, 12 English, and 45 Spanish-speaking. Semi-structured interviews also elicited user experiences from 4 providers and 5 Veterans. Transcripts underwent qualitative coding for themes using Atlas.ti.8.

RESULTS: On CVT (0-5 scale), overall satisfaction averaged 4.50 (English) and 4.69 (Spanish). Lowest scoring item for English users was easy video connection (4.25), while unclear expectations had the lowest Spanish score (3.60). For TSUQ, overall mean scores were 4.50 (English) and 4.67 (Spanish), with improved health post-telehealth having the lowest average (English 3.33, Spanish 3.67). Qualitatively, Veterans and providers noted strengths like access and communication but weaknesses around connectivity, care delays, and privacy. Differences emerged regarding convenience (Veterans) versus operational barriers (providers). There was a strong positive correlation for Spanish surveys and a moderate correlation for English surveys (r = 0.71 Spanish surveys, r = 0.69 English surveys) between TSUQ and CVT for individual respondents.

CONCLUSIONS: Patients conveyed positive experiences, but qualitative data revealed actionable targets for optimization like infrastructure and coordination improvements. Key limitations include small samples and lack of comparison to in-person care. Still, high satisfaction coupled with specific user feedback highlights telehealth's potential while directing enhancements. The results found high Veteran satisfaction with Spanish/English TBI telehealth, but mixed methods illuminated salient domains for better accommodating user needs, particularly regarding logistics and technology. Rigorously integrating experiences with metrics over expanded diverse samples and modalities can further guide refinements to enhance telehealth with a language-tailored approach.

Turuba, Roxanne, Willow Cormier, Rae Zimmerman, Nikki Ow, Marco Zenone, Yuri Quintana, Emily Jenkins, et al. (2024) 2024. “Exploring How Youth Use TikTok for Mental Health Information in British Columbia: Semistructured Interview Study With Youth.”. JMIR Infodemiology 4: e53233. https://doi.org/10.2196/53233.

BACKGROUND: TikTok (ByteDance) experienced a surge in popularity during the COVID-19 pandemic as a way for people to interact with others, share experiences and thoughts related to the pandemic, and cope with ongoing mental health challenges. However, few studies have explored how youth use TikTok to learn about mental health.

OBJECTIVE: This study aims to understand how youth used TikTok during the COVID-19 pandemic to learn about mental health and mental health support.

METHODS: Semistructured interviews were conducted with 21 youths (aged 12-24 years) living in British Columbia, Canada, who had accessed TikTok for mental health information during the COVID-19 pandemic. Interviews were audio-recorded, transcribed verbatim, coded, and analyzed using an inductive, data-driven approach.

RESULTS: A total of 3 overarching themes were identified describing youth's experiences. The first theme centered on how TikTok gave youth easy access to mental health information and support, which was particularly helpful during the COVID-19 pandemic to curb the effects of social isolation and the additional challenges of accessing mental health services. The second theme described how the platform provided youth with connection, as it gave youth a safe space to talk about mental health and allowed them to feel seen by others going through similar experiences. This helped normalize and destigmatize conversations about mental health and brought awareness to various mental health conditions. Finally, the last theme focused on how this information led to action, such as trying different coping strategies, discussing mental health with peers and family, accessing mental health services, and advocating for themselves during medical appointments. Across the 3 themes, youth expressed having to be mindful of bias and misinformation, highlighting the barriers to identifying and reporting misinformation and providing individualized advice on the platform.

CONCLUSIONS: Findings suggest that TikTok can be a useful tool to increase mental health awareness, reduce stigma, and encourage youth to learn and address their mental health challenges while providing a source of peer connection and support. Simultaneously, TikTok can adversely impact mental health through repetitive exposure to mentally distressing content and misleading diagnosis and treatment information. Regulations against harmful content are needed to mitigate these risks and make TikTok safer for youth. Efforts should also be made to increase media and health literacy among youth so that they can better assess the information they consume online.

2023

Godinho, Myron Anthony, Siaw-Teng Liaw, Chipo Kanjo, Heimar F Marin, Henrique Martins, and Yuri Quintana. (2023) 2023. “Digital Vaccine Passports and Digital Health Diplomacy: An Online Model WHO Simulation.”. Journal of the American Medical Informatics Association : JAMIA 30 (4): 712-17. https://doi.org/10.1093/jamia/ocac126.

In the wake of Coronavirus disease 2019 (COVID-19), several nations have sought to implement digital vaccine passports (DVPs) to enable the resumption of international travel. Comprising a minimum dataset for each unique individual, DVPs have the makings of a global electronic health record, broaching key issues involved in building a global digital health ecosystem. Debate simulations offer a safe, interactive space to foster participatory policy discussions for advancing digital health diplomacy. This study used an online simulation of a Model World Health Assembly to critically analyze the sociotechnical issues associated with the global implementation of DVPs, and to generate useful insights and questions about the role of diplomacy in global digital health. The debate arguments addressed and provided insights into the technological, scientific, ethical, legal, policy, and societal aspects of DVPs. Reflecting on the simulation, we discuss its opportunities and challenges for the digitalization, decolonization, decentralization, and democratization of participatory policymaking.

Joseph, Amanda L, Helen Monkman, Andre Kushniruk, and Yuri Quintana. (2023) 2023. “Exploring Patient Journey Mapping and the Learning Health System: Scoping Review.”. JMIR Human Factors 10: e43966. https://doi.org/10.2196/43966.

BACKGROUND: Journey maps are visualization tools that can facilitate the diagrammatical representation of stakeholder groups by interest or function for comparative visual analysis. Therefore, journey maps can illustrate intersections and relationships between organizations and consumers using products or services. We propose that some synergies may exist between journey maps and the concept of a learning health system (LHS). The overarching goal of an LHS is to use health care data to inform clinical practice and improve service delivery processes and patient outcomes.

OBJECTIVE: The purpose of this review was to assess the literature and establish a relationship between journey mapping techniques and LHSs. Specifically, in this study, we explored the current state of the literature to answer the following research questions: (1) Is there a relationship between journey mapping techniques and an LHS in the literature? (2) Is there a way to integrate the data from journey mapping activities into an LHS? (3) How can the data gleaned from journey map activities be used to inform an LHS?

METHODS: A scoping review was conducted by querying the following electronic databases: Cochrane Database of Systematic Reviews (Ovid), IEEE Xplore, PubMed, Web of Science, Academic Search Complete (EBSCOhost), APA PsycInfo (EBSCOhost), CINAHL (EBSCOhost), and MEDLINE (EBSCOhost). Two researchers applied the inclusion criteria and assessed all articles by title and abstract in the first screen, using Covidence. Following this, a full-text review of included articles was done, with relevant data extracted, tabulated, and assessed thematically.

RESULTS: The initial search yielded 694 studies. Of those, 179 duplicates were removed. Following this, 515 articles were assessed during the first screening phase, and 412 were excluded, as they did not meet the inclusion criteria. Next, 103 articles were read in full, and 95 were excluded, resulting in a final sample of 8 articles that satisfied the inclusion criteria. The article sample can be subsumed into 2 overarching themes: (1) the need to evolve service delivery models in health care, and (2) the potential value of using patient journey data in an LHS.

CONCLUSIONS: This scoping review demonstrated the gap in knowledge regarding integrating the data from journey mapping activities into an LHS. Our findings highlighted the importance of using the data from patient experiences to enrich an LHS and provide holistic care. To satisfy this gap, the authors intend to continue this investigation to establish the relationship between journey mapping and the concept of LHSs. This scoping review will serve as phase 1 of an investigative series. Phase 2 will entail the creation of a holistic framework to guide and streamline data integration from journey mapping activities into an LHS. Lastly, phase 3 will provide a proof of concept to demonstrate how patient journey mapping activities could be integrated into an LHS.

Quintana, Yasmín, Friedrich Wolfgang Keppeler, and Kirk O Winemiller. (2023) 2023. “Does Invasion by Armored Catfish Shift Trophic Ecology of Native Fishes? Evidence from Stable Isotope Analysis.”. Ecology 104 (5): e4024. https://doi.org/10.1002/ecy.4024.

Popular as aquarium fish, armored catfishes from South America (Pterygoplichthys spp.) have been introduced and become invasive in tropical and subtropical regions worldwide. These ecosystem engineers can deplete basal resources (e.g., periphyton and detritus), with potential negative effects for native fauna. We studied the trophic ecology of fishes in the Usumacinta River Basin, Guatemala, where Pterygoplichthys is now widespread and locally abundant. We analyzed stable isotopes (δ13 C, δ15 N) in fish tissues and basal resources to assess the potential impact of Pterygoplichthys on the trophic ecology of six co-occurring native fishes that feed at a similar trophic level (Astyanax aeneus, Dorosoma petenense, Thorichthys pasionis, Oscura heterospila, Poecilia mexicana, and Gambusia sexradiata). The study was conducted during the dry season in the La Pasion (LPR; high invasion) and San Pedro (SPR; low invasion) rivers. We compared isotopic spaces occupied by native fish and Pterygoplichthys, estimated isotopic overlap, and evaluated the trophic displacement of native species. We also evaluated the relationships of environmental factors, including the relative biomass of the invasive catfish, with δ13 C and δ15 N signatures. Except for P. mexicana, native species had lower isotopic overlap with the catfish in LPR. Native fish isotopic spaces were compressed and shifted toward higher trophic positions in LPR relative to SPR. Benthic food resources were important for Pterygoplichthys in both rivers, and water-column resources had greater relative importance (RI) for native species in LPR. Native fish δ13 C was significantly associated with Pterygoplichthys biomass, conductivity, and water flow velocity; and water depth and sedimentation had a significant association with native fish δ15 N. Findings provide evidence that invasive Pterygoplichthys, along with environmental factors, impact the trophic ecology of native fish in the Usumacinta Basin. Additional field research conducted over longer time periods and mesocosm experiments that account for fish assemblage and environmental variation could elucidate Pterygoplichthys impacts via food resource depletion or habitat alteration.

Perakslis, Eric, and Yuri Quintana. (2023) 2023. “Social Media Is Addictive and Influences Behavior: Should It Be Regulated As a Digital Therapeutic?”. Journal of Medical Internet Research 25: e43174. https://doi.org/10.2196/43174.

Recently, we were deeply saddened by the findings of the coroner investigating the death of 14-year-old Molly Russell. Deeply saddened and angry but not surprised. This case should be seen as a sentinel event, given that this is the first time social media was directly implicated as a cause of death. We should use this opportunity to advance proposals for the regulations of the health effects of social media.

Joseph, Amanda L, Lisa M Shah, Andre Kushniruk, and Yuri Quintana. (2023) 2023. “A Human-Centered Physician Journey.”. Studies in Health Technology and Informatics 304: 76-77. https://doi.org/10.3233/SHTI230374.

The COVID-19 pandemic has placed unprecedented strain on global health systems, and the ability to safely and effectively deliver care. Further, it has impacted the mental health of global populations, in particular healthcare providers (i.e., physicians, nurses). In a service delivery context, much can be learned about empathy both from a provider and patient lens. Thus, the literature was explored to see if the concept of journey mapping was used to illustrate the intersections and pain points of the clinical workflow along the physician journey.