When is a Foundation Model a Foundation Model

• DOI: 10.48550/arxiv.2309.11510
• Publication Date: 2023-01-01
• Authors: Saghir Alfasly; Peyman Nejat; Sobhan Hemati; Jibran Khan; Isaiah Lahr; Areej Alsaafin; Abubakr Shafique; Nneka I. Comfere; Dennis H. Murphree; Chady Meroueh; Saba Yasir; Aaron R. Mangold; Lisa A. Boardman; Vijay H. Shah; Joaquín J. García; Hamid R. Tizhoosh
• Keywords: Foundation (evidence)

Recently, several studies have reported on the fine-tuning of foundation models for image-text modeling in field medicine, utilizing images from online data sources such as Twitter and PubMed. Foundation are large, deep artificial neural networks capable learning context a specific domain through training exceptionally extensive datasets. Through validation, we observed that representations generated by exhibit inferior performance retrieval tasks within digital pathology when compared to those significantly smaller, conventional networks.