Tag: rt-2
All the articles with the tag "rt-2".
-
The Perception–Planning Gap: What's Actually Hard About Visual AI in 2026
A technical survey of where visual perception and planning research actually stands in 2026. Pixel-level perception is largely solved at the representation layer, but perception-for-action — geometry, physics, dexterity, long-horizon control — is not. Reading the recent literature on JEPA, DreamerV3, Sora-as-world-model, RT-2 / OpenVLA / π0, Helix, Gemini Robotics, DUSt3R / MASt3R / VGGT, and the world-model evaluation papers (WorldModelBench, Physion, IntPhys 2), the through-line is the same: we have strong representations and architectural ideas, but the data, evaluation, and physical-grounding infrastructure to validate them is what's missing.