PHILADELPHIA – Many cancer patients do not get the opportunity to discuss their wishes for treatment until their illness has progressed too far, when it may be too late to have those discussions with loved ones or physicians. Now, a Penn Medicine-led team has developed an algorithm that flags patients who would benefit most from a timely conversation about their end-of-life goals and wishes, in an effort to begin that dialogue sooner. In a new study—published today in JAMA Network Open and simultaneously presented at the American Society of Clinical Oncology (ASCO) Supportive Care in Oncology Symposium in San Francisco, CA—researchers found that 51 percent of the patients the algorithm flagged as “high priority” for these conversations subsequently died within six months of their evaluation, compared to less than four percent in the “lower priority” group. These findings suggest the algorithm accurately captures those patients who would benefit most from timely discussions about their goals, values, and preferences for care.
This study is believed to be one of, if not the first, to look into the application of a machine learning algorithm for oncology patients.
“On any given day, it’s actually pretty difficult to identify which patients in my clinic would benefit most from a proactive advanced care planning conversation,” said the study’s lead author Ravi Parikh, MD, an instructor of Medical Ethics and Health Policy at the University of Pennsylvania and a staff physician at the Corporal Michael J. Crescenz VA Medical Center. “Patients oftentimes don’t bring up their wishes and goals unless they are prompted, and doctors may not have the time to do so in a busy clinic. Having an algorithm like this may make doctors in clinic stop and think, ‘Is this the right time to talk about this patient’s preferences?’”
The researchers applied three different predictive models to 26,525 patients receiving outpatient oncology care at two hospitals within the University of Pennsylvania Health System. Each used information commonly available in patients’ electronic health records: demographic characteristics such as gender and age, standard comorbidity data such as whether a patient has high blood pressure, and laboratory and electrocardiogram data.
Compared to other machine learning techniques, such as “gradient boosting” and “logistic regression,” the “random forest model” the team built in this study led to the best predictive results: Roughly half of the high-risk patients died within six months and almost 65 percent died approximately a year-and-a-half later (compared to 7.6 percent of low-risk patients). When 15 oncologists were surveyed, they agreed that 60 percent of those identified by the algorithm as “high risk” were definitely appropriate for immediate conversations about their wishes.
This algorithm was created with help from a team of Penn Medicine researchers who also developed a different algorithm for similar purposes, called Palliative Connect. That system is used to trigger consultations with Palliative Care staff, and was recently found to be particularly effective, increasing consultations by 74 percent. But the study led by Parikh is different in that it is targeted at increasing conversations between patients and the oncologists themselves in the outpatient setting.
“We’re excited about the scalability of this decision support method for providers, and not just in oncology,” Parikh said. “Our process of using machine learning to flag high-risk patients in real time is broadly applicable, and our approach risk-stratifies patients in a usable way that just hasn’t been available to us before.”
Now that the algorithm has shown promise, Parikh said that it is being implemented at a medical center that was not part of the original pilot for this study. There, researchers are testing whether identifying the best patients for conversations actually does prompt the doctors to initiate those discussions. The researchers are currently working on a randomized controlled trial involving around 100 clinicians that will last between three and six months.
“Initial data from our pilot suggest that using the algorithm can boost these conversations,” Parikh said.
The study was supported by the National Institutes for Health (grant numbers 5-T32-CA009615 and T32-GM075766-14).
Other Penn authors on this study include Christopher Manz, Corey Chivers, Susan H Regli, Jennifer Braun, Michael Draugelis, Lynn M. Schuchter, Lawrence M. Shulman, Amol S. Navathe, Mitesh S. Patel, and Nina O’Connor.
Penn Medicine is one of the world’s leading academic medical centers, dedicated to the related missions of medical education, biomedical research, and excellence in patient care. Penn Medicine consists of the Raymond and Ruth Perelman School of Medicine at the University of Pennsylvania (founded in 1765 as the nation’s first medical school) and the University of Pennsylvania Health System, which together form a $8.9 billion enterprise.
The Perelman School of Medicine has been ranked among the top medical schools in the United States for more than 20 years, according to U.S. News & World Report's survey of research-oriented medical schools. The School is consistently among the nation's top recipients of funding from the National Institutes of Health, with $496 million awarded in the 2020 fiscal year.
The University of Pennsylvania Health System’s patient care facilities include: the Hospital of the University of Pennsylvania and Penn Presbyterian Medical Center—which are recognized as one of the nation’s top “Honor Roll” hospitals by U.S. News & World Report—Chester County Hospital; Lancaster General Health; Penn Medicine Princeton Health; and Pennsylvania Hospital, the nation’s first hospital, founded in 1751. Additional facilities and enterprises include Good Shepherd Penn Partners, Penn Medicine at Home, Lancaster Behavioral Health Hospital, and Princeton House Behavioral Health, among others.
Penn Medicine is powered by a talented and dedicated workforce of more than 44,000 people. The organization also has alliances with top community health systems across both Southeastern Pennsylvania and Southern New Jersey, creating more options for patients no matter where they live.
Penn Medicine is committed to improving lives and health through a variety of community-based programs and activities. In fiscal year 2020, Penn Medicine provided more than $563 million to benefit our community.