P777 Deployment of an artificial intelligence tool for precision medicine in ulcerative colitis: Preliminary data from 8 globally distributed clinical sites
Peyrin-Biroulet, L.(1)*;Rubin, D.(2);Weber, C.(3);Adsul, S.(4);Freire, M.(4);Biedermann, L.(5);Koelzer, V.(6);Bressler, B.(7);Xiong, W.(8);Niess, J.(9);Matthias Matter, M.M.(9);Kopylov, U.(10);Barshack, I.(11);Mayer, C.(11);Magro, F.(12);Carneiro, F.(13);Maharshak, N.(14);Greenberg, A.(15);Hart, S.(16);Dehmeshki, J.(17);Kubassova, O.(16);
(1)Nancy University Hospital, Gastroenterology, Nancy, France;(2)University of Chicago Medicine, Section of Gastroenterology- Hepatology and Nutrition, Chicago- IL, United States;(3)University of Chicago Medicine, Department of Pathology, Chicago- IL, United States;(4)Takeda, Takeda, Zurich, Switzerland;(5)University Hospital of Zurich, University of Zürich, Zurich, Switzerland;(6)University Hospital Zürich, Institute of Pathology and Molecular Pathology, Zurich, Switzerland;(7)University of British Columbia, Division of Gastroenterology, Vancouver- BC, Canada;(8)University of British Columbia, Department of Pathology and Laboratory Medicine, Vancouver- BC, Canada;(9)University of Basel, University Hospital Basel, Basel, Switzerland;(10)Chaim Sheba Medical Center, Department of Gastroenterology, Ramat Gan, Israel;(11)Chaim Sheba Medical Center, Institute of Pathology, Ramat Gan, Israel;(12)Centro Hospitalar Universitário de São João, Faculdade de Medicina da Universidade do Porto, Porto, Portugal;(13)Centro Hospitalar Universitário de São João, Department of Pathology, Porto, Portugal;(14)Tel Aviv Medical Center, Department of Gastroenterology and Liver Diseases, Tel Aviv, Israel;(15)Tel Aviv Medical Center, Institute of Pathology, Tel Aviv, Israel;(16)Image Analysis Group, Image Analysis Group, London, United Kingdom;(17)Image Analysis Group, Kingston University, London, United Kingdom;
Background
Histological remission is an important target for Ulcerative Colitis (UC) treatment; however, scoring of histological images is time-consuming and prone to inter and intra-observer variability. Thus, a need exists for an accurate, reproducible, and reliable automated method. Previously, we demonstrated an Artificial Intelligence (AI) Tool using image processing and machine learning algorithms to measure histological disease activity using the Nancy index consistently and accurately.1 Here, we aim to enhance the capabilities of the AI Tool, by adding substantially more population-diversified training data while maintaining accuracy and robustness of results.
Methods
Eight global sites submitted 600 UC histological images. These were added to the 200 images previously used to train and validate the AI Tool. The 800-image dataset was divided into 2 groups: 90% used for training, 10% for testing. The novel AI algorithms were trained using state-of-the-art image processing and machine learning techniques based on deep learning and feature extraction. Cell and tissue regions of each training image were manually annotated, measured, and assigned a Nancy Index independently by 3 histopathologists, and used to further train the AI using over 43,000 characterisations. The AI Tool fully characterises histological images, identifying tissue types, cell types, cell numbers and locations, and automatically measures the Nancy Index for each image. Intra Class Correlation (ICC) and Confusion Matrix analyses were performed to evaluate the AI Tool and assess accuracy.
Results
The average ICC was 92.1% among the histopathologists and 91.1% between histopathologists and AI Tool, compared with 88.3% and 87.2% in the previous study.1 Confusion matrix analysis (Table 1) demonstrated the strongest correlation at the extremes of the Nancy Index, with 80% correlation between predicted and true labels for Nancy Scores of 0 or 4. When 2 adjacent scores were combined, correlations were stronger: 96% for a true Nancy score of 0 being predicted as 0 or 1, and 100% for a true Nancy score of 2 being predicted as 2 or 3.
Conclusion
By adding a larger number of images to the AI Tool training data, the robustness of the AI Tool was substantially improved while maintaining accuracy. The continued high correlation of AI Tool performance with the histopathologists reinforces the potential role for the AI Tool for IBD clinical applications. Fully characterising whole slides could standardise and validate an AI-driven scoring system for histology slides in IBD, eliminating the subjectivity of the human pathologist in assessment of disease activity.
References
1. Peyrin-Biroulet L, et al. J Crohn's and Colitis. 2022;16(Suppl 1):i105.