What is the ego vehicle?
The ego vehicle is simply the vehicle that a driving system belongs to and sees the world from. The word ego here means "self," so the ego vehicle is the self vehicle, the one carrying the sensors and running the software, as opposed to all the other vehicles and actors it observes. When an autonomous driving or driver-assistance system builds its understanding of a scene, it does so from the vantage point of the ego vehicle, and it describes everything else, other cars, pedestrians, cyclists, lane markings, in relation to that vantage point.
This may sound like a small piece of terminology, but it provides an essential anchor. Perception and planning are fundamentally about relationships, such as how far the car ahead is, whether a pedestrian is crossing the ego vehicle's path, or which lane the ego vehicle occupies. Having a clear, named reference point, the ego vehicle, lets all of these relationships be expressed unambiguously. Positions, velocities, and trajectories of other actors are naturally given relative to the ego vehicle, and the coordinate frame in which the system reasons is usually centered on it.
Key takeaways
- The ego vehicle is the vehicle from whose perspective a driving system perceives and reasons about the world.
- All other actors and features are described relative to the ego vehicle, which serves as the scene's reference point.
- The term cleanly separates "our" sensor-carrying vehicle from the other actors it observes.
How it works
In a driving system, the coordinate frame used for perception and planning is typically anchored to the ego vehicle, so that the positions and motions of surrounding objects are expressed relative to it. Sensors are mounted on the ego vehicle and calibrated with respect to its frame, and their measurements are combined into a view of the world centered on the vehicle itself. Predictions and plans, such as where other actors will go and how the vehicle should move, are all reasoned about in this ego-centered frame. This keeps the representation consistent, since the reference point moves with the vehicle and everything is always described from where the vehicle currently is.
Why it matters
The ego vehicle concept matters because clear, shared terminology is the foundation of clear thinking about driving scenes, and the distinction between the ego vehicle and other actors comes up constantly. For anyone working with autonomous driving or driver-assistance data, it removes ambiguity about whose perspective a measurement or trajectory is expressed from. It is a small term that does a lot of work, underpinning how perception, prediction, and planning are all framed relative to a single, well-defined point of view.
Frequently asked questions
Why is it called the ego vehicle?
Because ego means "self," so the ego vehicle is the system's own vehicle, distinguished from the other vehicles and actors it perceives. The term makes explicit whose point of view the scene is described from.
How are other objects described relative to the ego vehicle?
Their positions, velocities, and trajectories are typically expressed in a coordinate frame centered on the ego vehicle, so distances and directions are measured from it. This gives a consistent, unambiguous way to represent everything in the scene.
Is the ego vehicle always autonomous?
Not necessarily. The term applies to any vehicle carrying the perceiving system, including one running only driver-assistance features. What matters is that it is the reference vehicle from whose perspective the system senses and reasons.
Related terms