Plugin Task: Vision-Language

Image Captioning

Generate & store captions for samples using state-of-the-art captioning models

Semantically search emojis and copy to clipboard

Navigate concept space with CLIP, vector search, and FiftyOne

Find images that best interpolate between two text-based extremes

Ask (and answer) open-ended visual questions about your images

Analyze a single image or multiple images at once with GPT-4 Vision

Use Twelve Labs to search your videos with natural language

Run zero-shot (open vocabulary) prediction on your data

Create your own AI Art Gallery with Text-to-image models and FiftyOne

An AI assistant that can query visual datasets, search the FiftyOne docs, and answer general computer vision…