What is an object-level embedding?
An object-level embedding, sometimes called an instance or region embedding, is a vector computed for one object rather than a whole image. The object is isolated first, by a detection box or segmentation mask, and that region is embedded on its own. A street scene with a dozen vehicles then yields a dozen object embeddings, each searchable independently.
This granularity answers questions whole-image embeddings cannot, such as finding every visually similar object across a dataset regardless of what else appears around it.
Key takeaways
- Object-level embeddings represent individual detected objects.
- They enable per-object similarity search across a dataset.
- They power re-identification and fine-grained curation.
How it works
A detector or segmentation model localizes objects, each region is cropped or masked, and an embedding model encodes it. The vectors are indexed with references to their source image and box, so matches point to exact objects. Re-identification systems train these embeddings specifically so the same individual object scores high similarity across viewpoints and times.
Why it matters
Many real questions are about objects, not images: find every instance that looks like this defect, this product, this vehicle. Object-level embeddings make those queries possible and precise, and they underpin multi-camera re-identification and object-centric dataset curation.
Frequently asked questions
How is this different from an image embedding?
An image embedding mixes everything in the frame together, while an object embedding isolates one object, so its neighbors are similar objects rather than similar scenes.
Do I need labels to compute object embeddings?
You need localization, from ground-truth boxes or a detector's predictions, but the embedding itself requires no class labels.
Related terms
Go deeper