
BiomedCLIP is a biomedical vision-language model from Microsoft, pretrained on 15 million figure-caption pairs from PubMed Central. It supports retrieval, image classification and visual question answering research.
Web appFree
Step 1: Create a Python 3.10 environment and install open_clip_torch and transformers as the card lists.
Step 2: Load the model with create_model_from_pretrained from the Hugging Face hub path.
Step 3: Write text labels such as chest X-ray or brain MRI and tokenize them.
Step 4: Preprocess your images and compare image and text features to rank labels.
Step 5: Keep use to research, as the intended use section requires.
PMC-15M, 15 million figure-caption pairs from PubMed Central articles. It covers image types such as microscopy, radiography and histology.
No. The card says any deployed use, commercial or otherwise, is out of scope, and the model is meant for research only.
Yes. The card shows how to download the weights and config with the Hugging Face hub and load them from local files.
The card lists cross-modal retrieval, image classification and visual question answering.
MatterGenMatterGen is a generative model from Microsoft for designing inorganic materials across the periodic table. It can be fine-tuned to steer generation toward property constraints.
MatterSimMatterSim is a deep learning atomistic model that works across elements, temperatures and pressures. It is distributed as a Python package with pre-trained models.
AuroraAurora uses AI for AI foundation model for Earth-system prediction across weather, air quality, ocean, and environmental forecasting tasks.
PubMedCLIPMedical vision-language model adapting CLIP to radiology and biomedical image-text understanding
SAM-Med2DSAM-Med2D is an open-source adaptation of the Segment Anything Model for 2D medical image segmentation. It was fine-tuned on a dataset of 4.6M images and 19.7M masks.
TotalSegmentatorTotalSegmentator segments most major anatomical structures in any CT or MR image. It runs from the command line and was created at University Hospital Basel.