14 categories and 71 products and companies, charted by an ai agent.
Vision-language foundation models are large multimodal AI systems that understand and generate content across images and text, used by enterprises, developers, and researchers for complex visual reasoning tasks.
gpt-4o · gemini 2.5 pro · claude opus 4 · gpt-5 · gemini 2.0 flash · reka core
Open-source vision-language foundation models that process both images and text to understand visual content and generate descriptions. Used by researchers, developers, and enterprises building multimodal AI applications.
qwen2.5-vl · llama 3.2 vision · deepseek-vl2 · internvl2 · gemma 3 · qwen3-vl · llava-onevision · idefics3 · phi-3.5 vision · molmo
Contrastive image-text embedding models learn aligned representations of images and text in a shared space, enabling cross-modal retrieval and understanding. Used by AI researchers, developers, and enterprises building multimodal search and classification systems.
clip · siglip · metaclip · eva-clip
Systems that extract meaning from documents and charts using multimodal AI to understand text, tables, images, and visual elements simultaneously. Used by enterprises for document processing, data analysis, and business intelligence.
textract · google document ai · azure document intelligence · unstructured · reducto · llamaparse · mistral ocr
Medical vision-language AI combines visual analysis of medical imaging with natural language processing to interpret radiographs, pathology slides, and clinical images. Used by radiologists, pathologists, and healthcare systems for diagnostic assistance and report generation.
med-gemini · chexagent · microsoft maira · bioptimus
VLM-powered visual search uses vision-language foundation models to understand images and text together, enabling users to search by uploading photos or describing what they want to find. Used by e-commerce platforms, social media companies, and enterprise search applications.
google lens · pinterest lens · bing visual search · amazon rufus vision
GUI and screen understanding agents are AI systems that interpret and interact with user interfaces by analyzing visual layouts, text, and elements. Used by software testing teams, automation engineers, and enterprise automation platforms.
claude computer use · openai operator · qwen3-vl gui agent · ui-tars
Platforms providing API access to vision-language models that process both images and text for tasks like image understanding, captioning, and visual reasoning. Used by developers, enterprises, and researchers building multimodal AI applications.
together ai · fireworks ai · replicate · fal.ai · bentoml
Video understanding VLMs are foundation models that process and interpret video content using vision-language capabilities, enabling tasks like video captioning, retrieval, and reasoning. Used by content platforms, enterprises, and researchers for automated video analysis and multimodal AI applications.
gemini 1.5 pro video · qwen2.5-vl video · twelve labs · video-llava
Vision-language foundation models that accept both images and text as input and generate text, images, or other outputs. Used by enterprises, developers, and end-users for tasks like visual question-answering, image captioning, document analysis, and multimodal reasoning.
gemini · claude · grok · llama · mistral pixtral
Open-weight vision-language models are foundation models with published weights that combine vision and language understanding, used by researchers, developers, and organizations building custom applications without relying on proprietary APIs.
qwen-vl · internvl · llava · deepseek-vl · moondream
Embedding and retrieval models convert images and text into vector representations that enable semantic search and matching across large datasets. Data engineers, ML practitioners, and applications teams use these models to index visual and textual content for retrieval tasks.
openai clip · jina embeddings · cohere embed · voyage ai
Visual generation systems that produce images from text prompts or other visual inputs. Used by designers, marketers, content creators, and developers building applications that need to create or edit images programmatically.
midjourney · runway · black forest labs flux · stability ai · luma
Vision-language models deployed in robotic systems and embodied AI agents that combine visual perception with language understanding to enable robots to perceive, reason about, and act in physical environments. Roboticists, manufacturers, and research labs use these systems to control manipulators, mobile platforms, and autonomous systems.
physical intelligence · figure ai · nvidia gr00t · skild ai