Policy

A policy is the decision-making core of a system that acts. Formally, it is a function that takes in an observation, such as camera images together with the robot's current state, and returns an action, such as how to move a joint or a gripper. In everyday robotics conversation, when someone refers to "the model" that controls a robot, they usually mean the policy, because it is the component responsible for turning what the system perceives into what it does.

The term comes from reinforcement learning and control, where a policy is precisely the strategy an agent follows to choose actions. What makes the idea powerful is how general it is. A policy might be a hand-written rule, a classical controller, or a large neural network trained on data, and it might act one step at a time or plan a short sequence of moves. A vision-language-action model, for instance, is one modern way of implementing a policy, distinguished by the fact that it grounds its decisions in vision and language. Whatever its form, the policy is the answer to the question "given what I see, what should I do next."

A policy is defined by how it maps observations to actions, and that mapping is what gets learned or designed. In learning-based robotics, a policy is usually a neural network whose parameters are adjusted so that its actions lead to good outcomes, whether that means imitating expert demonstrations or maximizing a reward over time. At each step, the current observation is fed in, and the policy produces the next action, which changes the world and yields a new observation, and so the loop continues. How the policy represents actions, and whether it commits to one step or a short sequence at a time, are design choices that shape how smoothly and reliably it controls the system.

The policy is where perception becomes behavior, which makes it central to any physical AI system. Understanding that "the model" in robotics usually means the policy helps clarify a lot of discussion in the field, since debates about architectures, training methods, and data are ultimately debates about how to build a better policy. For anyone working on embodied systems, the quality of the policy, and the data and methods used to learn it, is what determines whether a machine acts capably and safely in the real world.

In a control or robotics context, yes, the policy is usually what people mean by "the model," because it is the component that decides on actions. The word policy emphasizes that its job is specifically to map observations to actions.

A policy can be learned by imitating expert demonstrations, known as imitation learning, or by trial and error to maximize a reward, known as reinforcement learning. In both cases, the goal is to adjust the policy so its actions lead to good outcomes.

A vision-language-action model is one way to implement a policy. It is a policy that grounds its decisions in visual observations and language instructions, using knowledge inherited from a vision-language model.

Vision-Language-Action model (VLA), Action head / action decoder, Imitation learning / behavior cloning, Action chunking, Embodiment.