This repository maintains a collection of state-of-the-art Foundation model research in the field of bioimage, especially for Microscopy and Pathology. Also contains some interesting research related to Medical (Radiology: CT, MRI...) and Bio Informatics (Genomics, Proteomics, etc...).
- BioImage+Medical: Towards Generalist Biomedical AI (Google)
- Medical: Foundational Models in Medical Imaging: A Comprehensive Survey and Future Vision (SDSU)
- Medical: Foundation Models for Generalist Medical Artificial Intelligence (Stanford)
-
Microscopy: μ-Bench: Vision-Language Benchmark for Microscopy Understanding (Stanford)
-
BioImage: Benchmarking Large Language Models for Bio-Image Analysis Code Generation (Leipzig University, ScaDS.AI, EMBL)
-
BioImage+Medical: PMC-15M from BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs Note: No Public Dataset!!
-
Pathology: OpenPath from A visual–language foundation model for pathology image analysis using medical twitter (Nature)
(download)
-
Medical: PMC-VQA from PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering
, website
-
Histopathology: Quilt-1M One Million Image-Text Pairs for Histopathology (University of Washington, NeurIPS 2023)
, Zenodo, website,
- [12.06.2024] Pathology: A Multimodal Generative AI Copilot for Human Pathology (Nature)
- [22.05.2024] Pathology: GigaPath: A whole-slide foundation model for digital pathology from real-world data (Nature)
- [21.05.2024] BioImage+Medical: BiomedParse: a biomedical foundation model for biomedical image parsing (Microsoft)
- [06.05.2024] Medical: Advancing Multimodal Medical Capabilities of Gemini (Google)
- [16.01.2024] BioImage+Medical: BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs (Microsoft, University of Washington)
- [17.08.2023] Pathology: A visual–language foundation model for pathology image analysis using medical twitter (Nature)
