AI predicts cancer patient survival by reading doctor’s notes


the health strategist

research institute for continuous transformation
– of health & care


Joaquim Cardoso MSc
Chief Researcher & Editor
March 20, 2023



EXECUTIVE SUMMARY


Researchers from the University of British Columbia and BC Cancer have developed an artificial intelligence (AI) model that can predict cancer patient survival more accurately and with more readily available data than previous tools. 


  • The AI model uses natural language processing (NLP) to analyze oncologist notes following a patient’s initial consultation visit.

  • By identifying characteristics unique to each patient, the model can predict six-month, 36-month and 60-month survival with over 80% accuracy. 

  • The AI model can provide a more nuanced assessment and is applicable to all cancers, unlike previous models that were limited to certain cancer types.

  • The technology could be applied in cancer clinics across Canada and around the world, and the researchers believe AI could help improve patient care by acting as a virtual assistant for physicians.





DEEP DIVE






AI predicts cancer patient survival by reading doctor’s notes


The University of British Columbia
Mar 2, 2023 
Information: Brett Goldhawk

A team of researchers from the University of British Columbia and BC Cancer have developed an artificial intelligence (AI) model that predicts cancer patient survival more accurately and with more readily available data than previous tools.


The model uses natural language processing (NLP) — a branch of AI that understands complex human language — to analyze oncologist notes following a patient’s initial consultation visit-the first step in the cancer journey after diagnosis. By identifying characteristics unique to each patient, the model was shown to predict six-month, 36-month and 60-month survival with greater than 80 per cent accuracy. The findings were published today in JAMA Network Open.


“Predicting cancer survival is an important factor that can be used to improve cancer care,” said lead author Dr. John-Jose Nunez, a psychiatrist and clinical research fellow with the UBC Mood Disorders Centre and BC Cancer. “It might suggest health providers make an earlier referral to support services or offer a more aggressive treatment option upfront. Our hope is that a tool like this could be used to personalize and optimize the care a patient receives right away, giving them the best outcome possible.”


Traditionally, cancer survival rates have been calculated retrospectively and categorized by only a few generic factors such as cancer site and tissue type. Despite familiarity with these rates, it can be challenging for oncologists to accurately predict an individual patient’s survival due to the many complex factors that influence patient outcomes.


The model developed by Dr. Nunez and his collaborators, which includes researchers from BC Cancer and UBC’s departments of computer science and psychiatry, is able to pick up on unique clues within a patient’s initial consultation document to provide a more nuanced assessment. It is also applicable to all cancers, whereas previous models have been limited to certain cancer types.


“The AI essentially reads the consultation document similar to how a human would read it,” said Dr. Nunez. “These documents have many details like the age of the patient, the type of cancer, underlying health conditions, past substance use, and family histories. The AI brings all of this together to paint a more complete picture of patient outcomes.”


The researchers trained and tested the model using data from 47,625 patients across all six BC Cancer sites located across British Columbia. To protect privacy, all patient data remained stored securely at BC Cancer and was presented anonymously. Unlike chart reviews by human research assistants, the new AI approach has the added benefit of maintaining complete confidentiality of patient records.


“Because the model is trained on B.C. data, that makes it a potentially powerful tool for predicting cancer survival here in the province,” said Dr. Nunez.


In the future, the technology could be applied in cancer clinics across Canada and around the world.


“The great thing about neural NLP models is that they are highly scalable, portable and don’t require structured data sets,” said Dr. Nunez. “We can quickly train these models using local data to improve performance in a new region. I would suspect that these models provide a good foundation anywhere in the world where patients are able to see an oncologist.”


Dr. Nunez is a recipient of the 2022/23 UBC Institute of Mental Health Marshall Fellowship, and is also supported by funding from the BC Cancer Foundation. In another stream of work, Dr. Nunez is examining how to facilitate the best possible psychiatric and counselling care for cancer patients using advanced AI techniques. He envisions a future where AI is integrated into many aspects of the health system to improve patient care.


“I see AI acting almost like a virtual assistant for physicians,” said Dr. Nunez. “As medicine gets more and more advanced, having AI to help sort through and make sense of all the data will help inform physician decisions. Ultimately, this will help improve quality of life and outcomes for patients.”

Originally published at https://news.ubc.ca on March 2, 2023.


ORIGINAL PUBLICATION



Predicting the Survival of Patients With Cancer From Their Initial Oncology Consultation Document Using Natural Language Processing

John-Jose Nunez, MD, MSc1,2,3; Bonnie Leung, MN-NP(F)1; Cheryl Ho, MD1; et alAlan T. Bates, MD, PhD1,3; Raymond T. Ng, PhD2

Author Affiliations Article Information

JAMA Netw Open. 2023;6(2):e230813. doi:10.1001/jamanetworkopen.2023.0813

Key Points

Question Can natural language processing be used to predict the survival of patients with cancer from their initial oncologist consultation document?

Findings In this prognostic study of 47 625 patients with cancer, 6-, 36-, and 60-month survival were predicted using both traditional and neural language models with performance similar to or better than that found in prior work.

Meaning These findings suggest it is feasible to predict survival of patients with cancer using a common cancer document without additional data and without training separate models for specific types of cancer.

Abstract

Importance Predicting short- and long-term survival of patients with cancer may improve their care. Prior predictive models either use data with limited availability or predict the outcome of only 1 type of cancer.

Objective To investigate whether natural language processing can predict survival of patients with general cancer from a patient’s initial oncologist consultation document.

Design, Setting, and Participants This retrospective prognostic study used data from 47 625 of 59 800 patients who started cancer care at any of the 6 BC Cancer sites located in the province of British Columbia between April 1, 2011, and December 31, 2016. Mortality data were updated until April 6, 2022, and data were analyzed from update until September 30, 2022. All patients with a medical or radiation oncologist consultation document generated within 180 days of diagnosis were included; patients seen for multiple cancers were excluded.

Exposures Initial oncologist consultation documents were analyzed using traditional and neural language models.

Main Outcomes and Measures The primary outcome was the performance of the predictive models, including balanced accuracy and receiver operating characteristics area under the curve (AUC). The secondary outcome was investigating what words the models used.

Results Of the 47 625 patients in the sample, 25 428 (53.4%) were female and 22 197 (46.6%) were male, with a mean (SD) age of 64.9 (13.7) years. A total of 41 447 patients (87.0%) survived 6 months, 31 143 (65.4%) survived 36 months, and 27 880 (58.5%) survived 60 months, calculated from their initial oncologist consultation. The best models achieved a balanced accuracy of 0.856 (AUC, 0.928) for predicting 6-month survival, 0.842 (AUC, 0.918) for 36-month survival, and 0.837 (AUC, 0.918) for 60-month survival, on a holdout test set. Differences in what words were important for predicting 6- vs 60-month survival were found.

Conclusions and Relevance These findings suggest that models performed comparably with or better than previous models predicting cancer survival and that they may be able to predict survival using readily available data without focusing on 1 cancer type.


Names mentioned


John-Jose Nunez, MD, MSc1,2,3; Bonnie Leung, MN-NP(F)1; Cheryl Ho, MD1; et alAlan T. Bates, MD, PhD1,3; Raymond T. Ng, PhD2

Total
0
Shares
Deixe um comentário

O seu endereço de e-mail não será publicado. Campos obrigatórios são marcados com *

Related Posts

Subscribe

PortugueseSpanishEnglish
Total
0
Share