CanvOI, an Oncology Intelligence Foundation Model: Scaling FLOPS Differently

  • 2024-09-04 18:15:44
  • Jonathan Zalach, Inbal Gazy, Assaf Avinoam, Ron Sinai, Eran Shmuel, Inbar Gilboa, Christine Swisher, Naim Matasci, Reva Basho, David B. Agus
  • 0

Abstract

The rapidly evolving field of digital oncopathology faces significantchallenges, including the need to address diverse and complex clinicalquestions, often involving rare conditions, with limited availability oflabeled data. These limitations hinder the development of robust AI-driventools in the biomedical space, where accuracy in probabilistic determinationsis of utmost importance. To address this, digital pathology foundation modelshave begun to emerge, typically developed with the size and diversity of thepre-training dataset and model parameters in mind. Here, we present CanvOI, aViT-g/10-based foundation model designed to enhance the capabilities of digitalpathology by addressing these challenges through a different approach.Considering the unique nature of oncologic histopathological images and therequirements from the embeddings to provide meaningful representations forMultiple Instance Learning (MIL) downstream models, we chose to modify theinput image characteristics. By introducing larger tile sizes (380 x 380pixels) and smaller patch sizes (10 x 10 pixels), we were able to optimize themodel's performance, pushing computational resources in a new direction andachieving state-of-the-art performance on cancer-related benchmarks. CanvOIdemonstrated a 1.5-7.4% improvement in averaged AUC compared to other leadingfoundation models built for digital pathology. Moreover, our resultsdemonstrate that CanvOI significantly outperformed the other models, with theperformance gap widening substantially when trained on just 10% of the initialcohort. This work highlights an alternative approach that, if integrated withtraditional development approaches, has the potential to advance OncologyIntelligence (OI), overcome some of the current barriers and ultimately improvethe clinical outcome of cancer patients.

 

Quick Read (beta)

loading the full paper ...