LLM monitoring via the the Impact Monitoring Platform for AI in Clinical Care (IMPACC) program

Session Description

Join Dr. Murray and Dr. Yazdany for an insightful discussion on the governance of AI implementations at UCSF and the Impact Monitoring Platform for AI in Clinical Care (IMPACC)—a new initiative designed to oversee AI deployments in the health system. IMPACC is a collaborative effort between UCSF’s health system and university researchers, leveraging cutting-edge methods to ensure that AI tools are trustworthy, effective, and deliver real value in clinical practice. This session will explore how UCSF is setting standards for AI oversight, integrating AI monitoring, and addressing challenges in AI trustworthiness, equity, and safety.

Video

view slide deck

Speakers

Dr. Sara Murray, MD, MAS | Vice President & Chief Health AI Officer, UCSF Health; Associate Chief Medical Information Officer, Inpatient Care, UCSF Health

Dr. Sara Murray, MD, MAS, is Vice President, Chief Health AI Officer for UCSF Health. She also serves as Associate Chief Medical Information Officer for Inpatient Care at UCSF Health. She is Associate Professor of Clinical Medicine and Associate Chief for Health System Partnerships in the Division of Clinical Informatics and Digital Transformation (DoC-IT).

Dr. Murray is a strategic health system leader for informatics, digital health, and data science. Her team builds infrastructure and governance processes to ensure the deployment of impactful and ethical AI, evaluates commercially available tools and algorithms for trustworthiness prior to implementation, and develops new machine learning models to address pressing health system problems. She is responsible for the overall vision and strategy for the use of AI at scale to transform healthcare delivery at UCSF Health and beyond. She spends her clinical time attending on the hospital medicine service.

Dr. Jinoos Yazdany, MD, MPH | Chief of the Division of Rheumatology, Zuckerberg San Francisco General Hospital; Alice Betts Endowed Professor of Medicine, UCSF

Dr. Yazdany is Chief of the Division of Rheumatology at Zuckerberg San Francisco General Hospital and the Alice Betts Endowed Professor of Medicine at UCSF. She received her undergraduate degree from Stanford, her MD from UCLA, her MPH from Harvard, and completed her internal medicine and rheumatology training at UCSF. Dr. Yazdany’s scholarship focuses on improving health care quality, safety, and outcomes for individuals with chronic rheumatic diseases. She serves as Director of the NIAMS and AHRQ-funded UCSF Quality and Informatics Lab, Director of the NIAMS-funded UCSF Clinical Data and Informatics Core, and Executive Director of AI Monitoring in Clinical Care at UCSF.

Dr. Julia Adler-Milstein, PhD | Professor of Medicine & Chief of the Division of Clinical Informatics & Digital Transformation (DoC-IT), UCSF School of Medicine

Dr. Adler-Milstein is a leading researcher in health IT policy, with a specific focus on electronic health records and interoperability. She has examined policies and organizational strategies that enable effective use of electronic health records and promote interoperability. She is also an expert in EHR audit log data and its application to studying clinician behavior. Her research – used by researchers, health systems, and policymakers – identifies obstacles to progress and ways to overcome them.

She has published over 250 influential papers, testified before the US Senate Health, Education, Labor and Pensions Committee, is a member of the National Academy of Medicine, been named one of the top 10 influential women in health IT, and won numerous awards, including the New Investigator Award from the American Medical Informatics Association and the Alice S. Hersh New Investigator Award from AcademyHealth. She has served on an array of influential committees and boards, including the NHS National Advisory Group on Health Information Technology, the Health Care Advisory Board for Politico, and the Interoperability Committee of the National Quality Forum.

Dr. Adler-Milstein holds a PhD in Health Policy from Harvard and spent six years on the faculty at University of Michigan prior to joining UCSF as a Professor in the Department of Medicine and the inaugural director of the Center for Clinical Informatics and Improvement Research in 2017. She became the inaugural Chief of the Division of Clinical Informatics and Digital Transformation in 2023.

other health AI hubs