Before and after grasping a cup
Imagine picking up a cup. Before contact, location and approach space matter; afterward, the grip, tilt and possible slip become important. The information changes within one task. Asking which sense is superior can obscure that transition. Divide the action over time and identify the question each stage needs answered.
What vision makes available
A camera can show an object together with its surroundings, helping choose an approach. The hand-object interface may then become hidden. That is a consequence of viewpoint, not a dismissal of vision. Imagine a finger on the far side of a cup: the visible outline and actual contact surface are different information. The next question is how to fill that gap.
Touch can also be read with a camera
Touch need not arrive as one force number. GelSight studies optical observation of an elastic contact surface, including deformation and relative motion for slip detection. DIGIT examines compact optical sensing for multi-fingered in-hand manipulation. The camera observes the interface rather than the distant scene, so the distinction between vision and touch is not simply whether a camera exists.
Information still needs an action
A possible-slip signal does not complete the task. The controller must choose whether to tighten, reorient or put the object down and retry. A response useful for one object may not suit another. Read both the detected condition and the action it changed. Many sensors and an appropriate response at the right moment describe different capabilities.
An imagined box and a soft pouch
Imagine alternating an opaque box and a soft pouch at the same location. The target position stays fixed while deformation and contact can differ. Write down what a camera reveals, then which decision fingertip information might change. This does not establish a sensor ranking; it connects differences in tasks with differences in needed information.
A good sensing explanation includes what changed
Insert one sentence between a sensing video and its action: what did the robot notice, and what did it consequently do differently? Reading tiny surface details and reliably transporting an object can require different evaluations. A sensing capability becomes concrete when connected to the uncertainty it reduces in the work someone wants done.
THE QUESTION THAT REMAINS
What to look for next
In the next demonstration, can you identify one action that changed because of a particular signal?
SOURCE & CONTEXT
Sources and context
Talos adds interpretation and questions to source-based reporting. Illustrative scenarios are labeled separately from experimental results. Consult these resources for conditions and the scope of the work.