PART 1 · MODULE 5Beyond text
Multimodal LLMs
AI that can see, hear, and understand multiple formats
Loading module...
AI that can see, hear, and understand multiple formats
Early LLMs could only process text. Multimodal LLMscan understand multiple types of input — text, images, audio, and even video — all at once. It's like giving AI more senses.
MULTIMODAL = MULTIPLE INPUT TYPES
Upload any image and ask questions about it. A real vision model (BLIP VQA) analyzes the image directly in your browser.
Upload an image to ask questions about it
JPG, PNG, or WebP — processed by a vision model in your browser
A text-only LLM is like talking to someone on the phone. A multimodal LLM is like a video call — they can see what you're showing them and respond to it.