Paper deep dive
G0.5: One Autoregressive Stream for Robot Reasoning and Action
Yicheng Liu, Zibin Dong, Baijun Ye, Tianyuan Yuan, Tao Jiang, Anqi Yang, Shicheng Cao, Haonan Liu, Yue Sun, Zihan Guo, Xiao Liu, Dong Ke, Changxun Pan, Chenru Wu, Tailai Cheng, Xiaoshu Ren, Xinlei Zhang, Jianning Cui, Zijie Zhao, Haoyu Zhang, Kaiming Xu, Haodong Yang, Bowen Zhang, Jiahui Niu, Shaoting Zhu, Shiduo Zhang, Hang Zhao
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert. This makes the VLM a context encoder rather than a decision-maker. We introduce G0.5, a pretrained autoregressive VLA in which a single transformer decoder emits reasoning and action tokens under a single objective. Three components make this tractable at foundation-model scale: a learnable cross-embodiment action tokenizer that maps heterogeneous robot actions into a shared vocabulary; a native chain-of-thought stream interleaving task decomposition, object grounding, and action hints with action tokens; and a visual memory module that injects multi-second history through the vision encoder. Because reasoning and action share a single set of weights, the pretrained VLM's capabilities carry over to physical behavior: the model follows instructions closely, and prompts directly steer action granularity, task horizon, and out-of-distribution scene handling without further training. Pretrained on a large collection of robot datasets together with VQA samples, G0.5 surpasses state-of-the-art models across 7 independent regimes: real-world fine-tuning on R1lite and R1pro robots (76.7\% vs.\ 53.3\% for $\pi_{0.5}$ and 24.4\% for GR00T-N1.7), the 2025 BEHAVIOR Challenge on 50 long-horizon household mobile manipulation tasks using a generalist policy (31.4\% vs.\ 26.3\% for $\pi_{0.5}$ and 26.1\% for the challenge winner), DROID post-training followed by zero-shot transfer to an unseen environment and objects (82.5\%), a language-following Pick-and-Place benchmark, LIBERO (98.9\%), RoboTwin 2.0 (93.3\%), and SimplerEnv-Bridge (87.3\%).
Tags
Links
- Source: https://arxiv.org/abs/2608.11739v1
- Canonical: https://arxiv.org/abs/2608.11739v1
Trouble viewing inline? Open PDF directly â
Full Text
109,638 characters extracted from source content.
Expand or collapse full text
Galaxea G0.5: One Autoregressive Stream for Robot Reasoning and Action Galaxea Team https://opengalaxea.github.io/G05/ multi-view RGB ¡ head + wrists <Pour the walnuts into the air fryer and close the drawer.= language instruction qâ...qâ proprioception R1 Lite embodiment Subtask / BBox / Trace ĂŻl_ctrlð 0731550288146329 ĂŻr_ctrlð 4209762158339005 1 marker + 8 codes per active part ¡ Ă R rounds ActionCodec continuous actions G0.5 One VLM fits all a plain autoregressive transformer â the same architecture as the VLM 1 Open the drawer 2 Pour the walnuts 3 Close the drawer 2 Instruction <Pull the drawer open by the handle.=  Actions ĂŻr_ctrlð a0012 ... â top dial â ... 2 Re-prompt <...by the handle lower handle.=  Actions ĂŻr_ctrlð a1254 ... â lower handle â ... 3 BBox pink bowl, air fryer, plate, banana, starfruit  Actions ĂŻl_ctrlð ... ... Q Subtask tÂĄ reach for the handle t¢ grasp the handle tÂŁ push the drawer t¤ retract the arm  Actions ĂŻr_ctrlð ... ... Context (no loss)ReasoningActions Language steering base prompt â top dial edited prompt â lower handle BBox reasoningSubtask reasoning oÂĄo¢oÂŁ Trains better AR > FM FM AR Converges faster, to a better optimum Generalizes zero-shot AR > FM AR82.5% FM57.5% DROID: held-out environment & unseen objects after post-training RL-native AR > FM AR FM Token likelihoods plug straight into RL Just as fast AR â FM FM190 ms AR w/ CoT*192 ms AR w/o CoT*130 ms Decoding is not the bottleneck *with FlashRT generalist specialist traininginference Figure 1:G0.5: reasoning and action in one autoregressive stream. Top left: A single VLM conditions on multi-view images, an instruction, proprioception, and an embodiment identifier, then generates optional chain-of-thought (CoT) and compact action codes under the same next-token objective. A cross-embodiment ActionCodec converts the codes into continuous motor commands, while active-part tokenization omits inactive control groups. Top right: Comparisons with flow-matching policies span generalist pretraining and specialist post-training, covering optimization, compatibility with reinforcement learning, transfer after DROID post-training to a held-out physical setup and previously unseen object instances, and inference latency. Bottom: A closed-loop rollout of open the drawerâpour the walnutsâclose the drawer. At each stage, updated visual and proprioceptive observations condition interleaved reasoning and action generation. The examples highlight prompt-driven action steering (left), grounded bounding-box prediction (middle), and adaptive subtask reasoning (right); colors distinguish conditioning context, reasoning, and action tokens. arXiv:2608.11739v1 [cs.RO] 12 Aug 2026 Abstract The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert. This makes the VLM a context encoder rather than a decision-maker. Instead, we argue for focusing on the VLM backbone: a unified model with a single set of weights that generates both reasoning and actions within a single autoregressive token stream. We introduceG0.5, a pretrained autoregressive VLA in which a single transformer decoder emits reasoning and action tokens under a single objective. Three components make this tractable at foundation-model scale: a learnable cross-embodiment action tokenizer that maps heterogeneous robot actions into a shared vocabulary; a native chain-of-thought stream interleaving task decomposition, object grounding, and action hints with action tokens; and a visual memory module that injects multi-second history through the vision encoder. Because reasoning and action share a single set of weights, the pretrained VLMâs capabilities carry over to physical behavior: the model follows instructions closely, and prompts directly steer action granularity, task horizon, and out-of-distribution scene handling without further training. Pretrained on a large collection of robot datasets together with VQA samples,G0.5 surpasses state-of-the-art models across 7 independent regimes: real-world fine-tuning on R1-Lite/R1-Pro robots (76.7% vs. 53.3% forí 0.5 and 24.4% for GR00T-N1.7), the 2025 BEHAVIOR Challenge on 50 long-horizon household mobile manipulation tasks using a generalist policy (31.4% vs. 26.3% forí 0.5 and 26.1% for the challenge winner), DROID post-training followed by zero-shot transfer to an unseen environment and objects (82.5%), a language-following Pick-and-Place benchmark, LIBERO (98.9%), RoboTwin 2.0 (93.3%), and SimplerEnv-Bridge (87.3%). 1 Introduction Vision-Language-Action (VLA) models have rapidly emerged as a leading paradigm for general-purpose robot control, extending large-scale vision-language pretraining from perception and language understanding to physical action [1,2,3]. Early VLA systems used an autoregressive interface that cast robot control as token generation: continuous actions were discretized, appended to the language vocabulary, and predicted by the VLM alongside text tokens [1,2]. This keeps the VLM itself as the actor, but scales poorly. As control frequency, action horizon, and action dimensionality increase, per-timestep autoregressive action tokens grow rapidly, making high-frequency control slow and expensive. This bottleneck pushed the field toward VLM-as-encoder architectures, where a pretrained VLM supplies hidden states or KV cache to a separately trained flow-matching or diffusion expert that predicts continuous action chunks [3, 4, 5, 6]. This shift improves action efficiency, but changes the role of the VLM. In VLM-as-encoder models, the VLM is no longer the action generator; it becomes a vision-language condition encoder, while the final action distribution is produced by an expert with separate parameters and a separate objective. Consequently, core generative capabilities of VLMsâchain-of-thought reasoning, in-context learning, and prompt-based motion steeringâcan affect behavior only after passing through a compressed conditioning bottleneck, rather than as native parts of action generation [7,8,9]. We therefore return to the autoregressive formulation, but remove the source of its original inefficiency: excessive action tokenization. A learning-based VQ tokenizer compresses action chunks into compact discrete codes, while active degree-of-freedom prediction avoids spending tokens on robot joints that do not need to move. Together, these choices substantially reduce the decoding burden while preserving the VLM as a generative actor. As part of the pretrained backbone, we also retain a lightweight visual-memory mechanism that feeds accumulated visual context through the vision encoder, following recent memory-augmented VLA designs [10], since persistent visual context benefits long-horizon control and closed-loop replanning. More importantly, once reasoning and action share the same autoregressive stream, chain-of-thought can be trained as a native component of control: the model can 2 zero-shot decompose an instruction into subtasks, identify task-relevant objects and their bounding boxes, and feed these intermediate predictions directly into subsequent action generation (Fig. 1). We introduceG0.5, a pretrained autoregressive VLA in which a single model reasons, plans, and acts within a unified token stream spanning images, language, reasoning traces, and actions. Our contributions are as follows: (1) A unified heterogeneous action codec. We pretrain a learning-based action codec that maps continuous action sequences from embodiments with different degrees of freedom, control frequencies, and morphologies into a shared token vocabulary. Unlike FAST, which applies a fixed DCT-based pipeline separately to each embodiment [11], our codec is learned end-to-end and cross-embodiment by design. It allows the VLM to represent actions from different robots through a common discrete interface, making autoregressive VLA practical at foundation-model scale; Fig. 1 illustrates this on R1-Lite, where the active-token layout adapts on the fly to whichever parts are in motion and drops the idle armâs token group from the stream entirely rather than padding it. (2) Native chain-of-thought through autoregressive training. We construct a family of CoT templates for task decomposition, scene grounding, and sub-goal sequencing, and train the model to emit reasoning tokens before and between action tokens in the same autoregressive stream. Unlike CoT- VLA, DualCoT-VLA, and related approaches that attach reasoning modules to VLM-as-encoder backbones [7,8,9,12], our CoT tokens share the decoder, context, and objective with the action tokens. Reasoning and action are therefore not separate stages, but coupled phases of one generative process (see the interleaved CoT and action segments in Fig. 1). This design yields two benefits that we evaluate separately: stronger grounding and execution under long-horizon instructionsâincluding zero-shot execution of household tasks under stage-conditioned instructions outside the pretraining distribution (Sec. 5.6)âand improved language following beyond what the codec alone provides. (3) Emergent prompt-driven behavior control. Preserving the autoregressive interface keeps the VLMâs in-context language capacity directly wired to action generation, in principle enabling prompt-level steering of physical behavior without retraining. In our zero-shot probes (Sec. 5.6) we see preliminary qualitative indications of thisâper-stage instruction wording such as adverbial qualifiers, spatial cues, or near-synonymous verbs visibly shifts policy behaviorâand leave a systematic study to future work. We suspect this capacity is partly structural to the autoregressive interface: when the VLM only conditions an external expert, prompts can shape the condition but cannot directly reshape the next-action distribution. We evaluateG0.5across seven settings that probe distinct facets of a general-purpose VLA: real-world fine-tuning on the R1-Lite and R1-Pro bimanual platforms, the BEHAVIOR-1K Challenge on 50 long- horizon household mobile-manipulation tasks [13], DROID post-training with zero-shot transfer to an unseen environment and objects, a Pick-and-Place language-following benchmark, and three standardized simulation suites (LIBERO, RoboTwin 2.0, SimplerEnv-Bridge) [14,15]. We compare against representative baselines from three model families: VLM-as-encoder models [3,4,5,6], autoregressive models [2,11], and the recently popular world action models [16]. Three findings stand out. First, on standard task success metrics,G0.5matches or surpasses the strongest baselines across these familiesâ98.9% on LIBERO, 93.3% on RoboTwin 2.0, 87.3% on SimplerEnv-Bridge, 82.5% on DROID with environment- and object-level zero-shot transfer, and 76.7% on the R1-Lite and R1-Pro platforms, compared with 53.3% forí 0.5 and 24.4% for GR00T-N1.7âindicating that the pretrainedG0.5backbone transfers effectively to downstream control across these heterogeneous suites. Second, on language following and multi-stage execution under stage-conditioned prompts,G0.5substantially outperforms VLM-as-encoder baselines on the Pick-and-Place benchmark and the BEHAVIOR-1K Challenge, where a singleG0.5checkpoint trained for one post-training epoch already surpasses bothí 0.5 trained for four epochs and the four-checkpoint Challenge winner. This is consistent with our argument that these capabilities are structurally weakened when the VLM is reduced to a condition encoder. Third, a small qualitative probe on two zero-shot long-horizon household tasks (Sec. 5.6) suggests that prompt wordingâadverbial qualifiers, spatial cues, and verb substitutionsâcan shift AR+CoT rollouts without retraining; we report this as an early hook for prompt-level behavior steering rather than a quantitative claim, and defer a systematic study to future work. Taken together, our results suggest that the path forward for VLA is not to place increasingly sophisticated action experts on top of an underused VLM, but to let the VLM remain what pretraining made it: an autoregressive reasoner that can also act, remember, 3 SEQUENCE TEMPLATE Conditioning segmentrole: user ¡ no loss <chat_user_prefix> <images><bos> Embodiment:<embodiment_text>; Task:<command_text>; State:<proprio>; <prompt_text><EOC>â task-conditioned CoT prefix prompt, then end-of-conditioning marker <chat_user_suffix> Generative segment¡ role: assistant âĄCross-entropy loss applied to every token in this block <chat_assistant_prefix> <CoT span>¡ optional ¡ any subset, sampled per step from 8 combinations (incl. no-CoT) âSubtask:<atomic_task_value>âBBox:<bbox_value>âTrace:<trace_2d_value>âActionHint:<action_hint_value> âcheckboxes denote independent inclusion; emitted in the left-to-right order above when selected Action:<EOV><action_codes>|<eos> <chat_assistant_suffix> ACTION SPAN â how <action_codes> unfolds into structured tokens <action_codes>âR residual rounds Ă active DoF groups Ă 8 action codes; onlyactivegroups are emitted <EOV>â begin generation, end-of-vision-conditioning <left_control_0><action0689><action1450>...<action0849>round 0, left arm â 8 action codes <right_control_0><action2144><action5012>...<action3311>round 0, right arm â 8 action codes optional<lower_body_control_0><action5234><action6891>...<action7402>â emitted only when the embodiment has a lower body <left_control_1><action1917><action7720>...<action4074>round 1 (residual refinement), left arm <right_control_1><action3026><action8814>...<action1889>round 1, right arm optional<lower_body_control_1><action4682><action0319>...<action8157> ⎠rounds 2 ... Râ1 repeat the same group structure |<eos>â end of sequence CONDITIONING PLACEHOLDERS user role â masked, no loss <images>multi-view RGB tokens, K camerasexpanded internally to <image0_image><image1_image>... by the visual tokenizer <embodiment_text>embodiment identifiere.g. r1pro, r1lite â selects the active-DoF schema <command_text>natural-language task instructiontruncated at 200 tokens <proprio>robot proprioceptive state s_tjoint positions and gripper status <prompt_text>CoT prefix promptshort directive declaring which targets follow, e.g. "predict bbox, subtask and action" CHAIN-OF-THOUGHT PLACEHOLDERS assistant role â supervised; FieldName: value headers; subset composable per step Subtask: <atomic_task_value>atomic sub-taske.g. Subtask: pick up the towel BBox: <bbox_value>key-object bounding boxese.g. BBox: towel <loc0418><loc0312><loc0680><loc0556>; plate <loc...> Trace: <trace_2d_value>2D gripper landing tracee.g. Trace: Left <loc0543><loc0436>; Right None ActionHint: <action_hint_value>frame-level gripper action hinte.g. ActionHint: close the left gripper while moving forward ACTION SPAN assistant role â supervised <left_control_r> <right_control_r>arm DoF-group markersalways emitted; r indexes residual rounds 0 ... Râ1 <lower_body_control_r>lower-body DoF-group markeroptional â only present for embodiments with a lower body <action0689> <action1450> ...action code8 action codes per group-round, decoded by the cross-embodiment ActionCodec CONTROL / CHAT TOKENS <bos> <EOC> <EOV> <eos>sequence controlbegin-of-sequence, end-of-CoT, end-of-vision-conditioning, end-of-sequence <chat_*_prefix/suffix>Qwen-style chat-role wrappersdelimit user vs. assistant turns; injected by the tokenizer Figure 2: Token sequence template. All inputs and outputs are serialised into a single autoregressive sequence: a conditioning segment (multi-view RGB, embodiment id, task instruction, proprioceptive stateâin user-side chat tokens) and a generative segment on which the next-token cross-entropy loss in Eq.(1)is applied. The generative segment composes an optional chain-of-thought spanâany subset of four self-describing reasoning targets (Subtask:,BBox:,Trace:,ActionHint:)âfollowed by the action codes, which themselves expand into í residual rounds of DoF-group markers each followed by 8 action codes (Sec. 3.1). 4 and adapt in context. We hope this work re-establishes autoregressive modeling as a foundation for VLA and that the pretrained backbone we release provides a useful starting point for future work. 2 Related Work 2.1 VLA Architectures: from VLM-as-Encoder to VLM-as-Actor Vision-language-action models split along one architectural axis: whether the VLM produces actions or only conditions a separate module that does. The dominant line couples a pretrained VLM with an action expert that consumes its features and emits continuous actions via diffusion or flow matching:í 0 [3] introduced a separately-parameterized expert with block-wise causal attention, andí 0.5 [4], GR00T-N1 / N1.5 / N1.6 [5], and SmolVLA [6] follow variants of the same template. The autoregressive line, including RT-2 [1], OpenVLA [2], andí 0 -FAST [11], instead discretizes actions and predicts them with the VLM itself under next-token prediction. The two lines are typically presented as a trade-offâcontinuous heads for smooth high-frequency control, AR for reasoning and simplicityâbut they also differ in what the VLM is for: in the first line, the VLM is a condition encoder whose pretrained reasoning is exercised only indirectly, while in the second, it remains the agent that acts. A revealing thread within the VLM-as-encoder line is the anti-forgetting problem: when the action expertâs gradients flow back into the VLM, the VLMâs pretrained perception and language capabilities degrade [17,18]. The mainstream remedy, Knowledge Insulation [17], stops these gradients and reintroduces AR action prediction as an auxiliary representation-learning objective for the backboneâimplicitly conceding that AR action supervision is exactly the signal that protects the VLMâs capabilities. Recent results push further: VLA-0 [18] shows that an unmodified VLM trained AR on actions-as-text outperformsí 0.5 -KI, OpenVLA-OFT, and SmolVLA on LIBERO without large-scale action pretraining, providing direct evidence that the AR paradigm is not the bottleneck. Our work takes this signal seriously and commits to the AR line end-to-end, retaining a flow-matching head only as an optional inference accelerator. What remains open after VLA-0âand what the rest of this section tracesâis how to scale the AR paradigm beyond a single low-frequency embodiment with closed-vocabulary tasks: through a tokenizer that respects morphological structure (Sec. 2.2) and reasoning that grounds language in action (Sec. 2.3). 2.2 Action Tokenization and Cross-Embodiment Action tokenization for VLAs has progressed through three generations. Per-dimension, per-timestep binning, as in RT-2 [1] and OpenVLA [2], fails on high-frequency dexterous data because adjacent timesteps are strongly correlated and binning wastes capacity [11]. FAST and FAST+ [11] replace binning with DCT plus byte-pair encoding, exploiting that correlation as compressible signal, and FAST+ is trained on one million trajectories to serve as a universal tokenizer. Neural and vector-quantized variantsâVQ-VLA [19], BEAST [20], and earlier VQ-BeT [21]âpush reconstruction quality further at the cost of joint training and more complex pipelines. Cross-embodiment generalization is largely orthogonal to all three. Mainstream VLAs handle morphological heterogeneity at the action-space level rather than the tokenizer:í 0 [3] pads all robots to an 18-dim union state, GR00T-N1 [5] uses per-embodiment MLP encoders and decoders, and SpatialVLA [22] unifies action spaces via adaptive grids. The closest neighbors to our work are Being-H0.5 [23], which maps heterogeneous robot controls into semantically aligned slots and even folds the MANO hand model into the same scheme, Green-VLA [24], which retargets across robots by aligning corresponding parts into a unified action space, and HEX [25], whose humanoid-aligned state representation operates on canonical body-part abstractions. All three operate at the action-vector level. Our contribution is to lift the same structural alignment into the tokenizer itself: a single frozen codec consumes a 5-part fixed-dimensional layout and emits a unified 27-dim action token stream, so left/right symmetry is preserved by construction and adding a new embodiment requires no new parameters in either the tokenizer or the action head. 5 2.3 Reasoning and Chain-of-Thought in VLAs Two families have emerged for injecting reasoning into VLAs. Bolt-on CoT routes natural-language plans or 2D paths from a high-level VLM into a separate low-level controller, as in HAMSTER [26] and Fast-in-Slow style System-2-feeds-System-1 designs [5]; the reasoning is an interface between modules rather than a co-generated component of the action. In-stream CoT, by contrast, generates reasoning and action in the same AR sequence from the same decoder. ECoT [27] reports a 28-point absolute improvement on OpenVLA by training it to predict plans, subtasks, motions, bounding boxes, and end-effector positions before actions; CoT-VLA [7] replaces text reasoning with autoregressively-generated subgoal images; Emma-X [28] predicts look-ahead 2D gripper checkpoints; andí 0.5 [4] emits high-level subtask text from the VLM before invoking its flow-matching expert. Our setting is closest in spirit to ECoT in that reasoning and action share a single AR decoder, but differs along two axes that matter for our claims: we combine four reasoning primitivesâobject bounding boxes, atomic subtask text, 2D end-effector traces inspired by TraceVLA [29], and action hintsâin one shared token vocabulary, and we expose them as prompt-conditional templates, letting the CoT mode be switched at inference without retraining. 3 G0.5 Model Design We design our model around a single commitment: perception, reasoning, and action should be unified within a single autoregressive process over a shared token vocabulary. This commitment shapes every component belowâthe action representation, the reasoning scaffold, the visual conditioning, and the training objectiveâand distinguishes our design from VLM-as-encoder architectures in which action generation lives in a separate module with a separate objective. Our model is initialized from Qwen3.5 2B [30], a pretrained vision-language model that provides a strong visual encoder, a shared multimodal token vocabulary, and an autoregressive decoder. At inference, given (i) a short temporal window of multi-view RGB observationsí (í) íĄââ fromížcameras, (i) an embodiment identifierí(e.g., R1-Pro), (i) a natural-language task instructionâ, and (iv) a proprioceptive stateí íĄ , the model autoregressively generates a structured output that concludes in a sequence of discrete action codes. Depending on the prompt template, the generation can optionally be preceded by chain-of-thought (CoT) segments that ground objects, decompose subtasks, or sketch gripper traces. The action codes are decoded by our cross-embodiment ActionCodec into continuous control commands in a unified action space shared across embodiments. The autoregressive VLM is self-contained and serves as the default policy in all main experiments. For comparison and optional deployment, we additionally attach a flow-matching head that follows the action-expert architecture ofí 0.5 [4] and conditions on the autoregressive trunkâs hidden states. All inputs and outputs are serialized into a single token sequence following the template in Fig. 2. The sequence is partitioned into a conditioning segmentâwrapping images, embodiment, task, and state in user-side chat tokens and terminated by<EOC>âand a generative segmentâwrapping the CoT trace and action codes in assistant-side chat tokens, with<EOV>marking the boundary between reasoning and action emission. Training uses the standard next-token cross-entropy loss, computed only over the generative segment: â(í)= â Ă íâí˘ logí í íĽ í | íĽ <í ,(1) whereí˘indexes the generative-segment tokens. Crucially, this single loss jointly supervises CoT generation and action generation: there is no auxiliary regression objective or expert distillation in pre-training. CoT traces and actions are all âjust tokensâ to the decoder, drawn from the same vocabulary and produced by the same forward pass. The remainder of this section unpacks the three components of the generative segment in the order they were derived: the cross-embodiment action codec (Sec. 3.1), the chain-of-thought scaffold (Sec. 3.2), and short-term visual memory (Sec. 3.3). 6 Part configurationsActiveNot available Full-body Bimanual Single-arm L ARMR ARML GRIPPERR GRIPPERTORSOCHASSIS L ARMR ARML GRIPPERR GRIPPERTORSOCHASSIS L ARMR ARML GRIPPERR GRIPPERTORSOCHASSIS Tokenization output <left_control><action0039><action1842><action7206><action4511><action0964>¡ <right_control><action8173><action0026><action5390><action2648><action9901>¡ <left_gripper><action1475><action6832><action0754><action3269><action5018>¡ <right_gripper><action9346><action2180><action6607><action0421><action7753>¡ Action chunks [t : t+H] [t+1 : t+H+1] Action encoder Time contrastive loss z(t) z(t+1) z(neg) positive pair negative pair Residual vector quantizer increasing accuracy z Level 0 res 0 Level 1 res 1 Level 2 res 2 Level 3 res 3 decoded z = res 0 + res 1 + res 2 + res 3 Action decoder Reconstructed parts L ARM R ARM GRIPPERS Figure 3: Structured action tokenization. Heterogeneous robot actions are decomposed into semantically aligned motion parts, encoded with a residual vector quantizer, and serialized as part-specific action tokens. This representation shares one action vocabulary across embodiments while allowing sparse prediction over only the activated parts. 3.1 Structured Tokenization of Heterogeneous Action Data A key challenge is how to represent heterogeneous actions from diverse embodiments in a structured token space that VLMs can efficiently model. Existing approaches suffer from two major limitations: (a) lack of structural decomposition. Most methods flatten the entire action space into a single vector before discretization [11,19,31,32], regardless of embodiment topology or controllable degrees of freedom (DoFs). This results in semantically entangled action tokens that transfer poorly across embodiments. In addition, token count scales directly with the total number of controllable DoFs, despite the fact that only a small subset of joints are typically active at each timestep. (b) poor token consistency. Discrete action spaces are usually learned without explicit structural constraints, causing semantically similar actions to map to token sequences with large Hamming distances [32]. As supervision signals for VLM training, such inconsistency introduces substantial optimization noise and reduces training efficiency. To address these issues, we adopt the action grouping strategy of FASTer [33] together with the training recipe of ActionCodec [32]. Specifically, we decompose each robot into independent motion parts (e.g., left control, right control, lower body), and pad each part to a shared maximum dimensionality before training a residual vector quantization (RVQ) model over the grouped actions. We further introduce a temporal contrastive objective to improve token consistency across temporally adjacent motions. During tokenization, we explicitly inject structural special tokens into the sequence. Concretely, the action span shown in the generative segment of Fig. 2 unfolds intoí residual rounds, each containing the currently active DoF-group markers (<left_control_r>,<right_control_r>, and optionally<lower_body_control_r>for embodiments with a lower body) followed by their 8 action codes. This formulation allows the model to predict only the motion parts that are actively involved in the current behavior. In practice, the proposed structured tokenization significantly improves training efficiency, enables heterogeneous embodiments to share a unified action configuration, and naturally supports sparse action prediction during inference, where inactive parts remain stationary without requiring additional token generation. We show the details in Figure 3. 3.2 Native Chain-of-Thought To preserve or further enhance the physical intelligence of VLMs, previous methods typically co-train auxiliary VQA tasks, such as sub-task or object bounding box prediction. However, these objectives are treated only as training-time supervision and never explicitly participate in the action generation process itself, making it difficult to directly assess whether such intermediate reasoning signals truly benefit downstream action prediction. In contrast, we leverage the unified autoregressive formulation of our model to naturally 7 integrate these auxiliary tasks into the action generation stream as native chain-of-thought (CoT) reasoning. Instead of treating reasoning-related annotations as isolated supervision targets, the model is trained to optionally perform intermediate reasoning before action prediction across four self-describing targetsâtask decomposition (Subtask:), key-object localization (BBox:), motion planning (Trace:), and action hints (ActionHint:)âwhich populate the CoT span shown in the generative segment of Fig. 2. Any subset of these targets can be emitted at each step, and we draw from 8 curated combinations (including a no-CoT baseline) per training step, all supervised within the same next-token objective. Surprisingly, the resulting CoT capability exhibits strong zero-shot generalization. On unseen scenes and tasks, the model is able to generate accurate subtasks, proactively identify task-relevant objects together with their bounding boxes, and predict additional reasoning traces such as 2D motion trajectories and action hints. More importantly, enabling CoT reasoning consistently improves instruction-following behavior and action accuracy on complex manipulation tasks. These results suggest that intermediate reasoning is not merely an auxiliary supervision signal, but can serve as an effective test-time guidance for embodied action generation. 3.3 Visual Memory Complex mobile manipulation tasks are inherently non-Markovian. Relying solely on single frame obser- vations often fails during temporary occlusions from robotic arms or environmental clutter, and lacks the temporal context needed to recognize failures and formulate alternative retry strategies. However, resolving partial observability by naively stacking historical vision tokens introduces severe limitations. It scales quadratically in computational cost, causing unacceptable latency for high-frequency control, and makes the model highly susceptible to error accumulation and state drifting when encountering unseen temporal trajectories. To overcome these challenges, we followí 0.7 [34] and MEM [10] by inserting factorized spatial and temporal attention modules every four layers within the Vision Transformer. This separable mechanism efficiently fuses historical context by sequentially mixing information across time steps and spatial patches. To strictly bound computational latency, we discard all historical tokens at the final layer, and stochastically drop all historical frames during training to prevent overfitting. Finally, we replace discrete text tokenizers with continuous state embeddings to perfectly synchronize proprioceptive inputs with the corresponding visual frames. 4 G0.5 Pre-training We pre-trainG0.5in a single stage on a heterogeneous mixture of robot demonstrations and web-scale visionâlanguage data. The model, tokenization, chain-of-thought (CoT) stream, and visual-memory module are described in Sec. 3; here we specify only the data composition, the sampling and supervision recipe, and the optimization setup. Robot data mixture. The robot portion of the pre-training mixture covers 14 embodiments across diverse real-world and simulated robot ontologies. DROID data are not part of this foundation pre-training mixture; for the evaluation in Sec. 5.1, the resulting model is subsequently post-trained on DROID data while excluding any demonstrations from the held-out evaluation environment and physical object instances. All sources are cast into a single 27-dimensional unified action space, partitioned as <left_control>(9) | <left_gripper>(1) | <right_control>(9) | <right_gripper>(1) | <lower_body>(7) Slots that a given embodiment does not actuate are filled withnooptokens at merge time, so embodiments of differing morphology share one output head without per-robot adapters. We treat each embodiment individually for pre-processing: the action normalization mode (z-score with tail clipping, orí 01 /í 99 quantile scaling) and the per-channel action filters are set per source rather than mixture-wide. 8 0.1% 1% 10% 40% Share of occurrences (%) pick place move put take fold grasp remove adjust open use pass close hold stack push coordinate turn transfer press scoop pour tilt return rotate wipe cooperate fill maintain hang lift smooth heat arrange give align pull remain unfold grip clean insert flip gather dip throw stand look flatten Others Action verbs 0.1% 1% 10% 100% Share of occurrences (%) towel spoon cloth bowl water pen cup marker plate shirt popcorn toy bottle lid clothes block remote cube clothing bread pepper notebook fork book tissue tape paper gift food glue nail shorts garment medicine chicken apple eraser machine fish ballpoint tea can pot scissors teapot chopsticks sleeve kettle pencil Others Objects Figure 4: Action and object concept distribution in the pre-training corpus. We show the most frequent action verbs and object nouns extracted from the pre-training data; each bar gives the conceptâs share of occurrences (%) on a logarithmic axis, and the trailing Others bar aggregates the remaining vocabulary. To characterize the semantic coverage of the pre-training corpus, we further analyze the frequency distribution of action and object concepts. As shown in Fig. 4, both action verbs and object nouns exhibit a clear long-tailed distribution. High-frequency actions are dominated by general manipulation primitives such as picking, placing, moving, and putting, while the object vocabulary is concentrated on common household and tabletop entities. This distribution indicates that the corpus provides broad coverage of everyday robot manipulation scenarios while retaining a diverse tail of less frequent skills and objects. Autolabeling pipeline. To enrich the annotation signals available in large robot manipulation corpora, we build an automated multimodal labeling pipeline that converts raw episodes into multi-granularity semantic annotations, visual grounding annotations, and action-trajectory annotations. For language annotation, we first apply rule-based temporal segmentation to identify candidate action segments and keyframes, and then query multimodal model APIs such as Gemini 3 [35] and Doubao Seed 2.0 Pro [36] to generate action hints, atomic task descriptions, and episode-level instructions. These multi-granularity language annotations allow us to train and query the policy under different instruction granularities and to construct CoT pairs for training intermediate reasoning. For visual grounding, we combine multimodal foundation models followed by SAM3 tracking [37] to generate per-frame bounding boxes and segmentation masks for task-relevant objects. Finally, for 2D end-effector traces, we compute bimanual end-effector positions from robot joint poses using forward kinematics and project the resulting 3D trajectories onto the head-camera image plane. Web and VQA co-training. To retain the VLMâs general language capability and broad generalization while strengthening its spatial perception, we co-train with a large-scale visionâlanguage mixture spanning generic web VQA [38,39], embodied VQA [40,41,42], and in-house annotations generated by the autolabeling pipeline above. The in-house portion covers subtask decomposition, object bounding boxes, and general commonsense VQA over our robot scenes. During pre-training, VQA and action samples are combined in an action-heavy mixture. Both sample types are optimized with the same next-token cross-entropy loss over their target tokens, so language answers, CoT traces, and action codes are all supervised within the unified autoregressive decoder. Chain-of-thought supervision. Each robot sample is assigned exactly one CoT format, drawn by weighted random sampling from eight candidates: a no-CoT baseline, atomic-task and high-level-task text, subtask text, subtask-with-action-hint, 2D trajectory traces, and bounding-box (object-localization) variants. The subtask-text format is assigned a higher sampling weight, while the remaining formats use the default weighting. This mirrors the increased emphasis placed on the in-domain subtask-prediction split on the VLM side, reflecting a consistent focus on subtask grounding across both modalities. Evaluation uses the fixed no-CoT format. 9 Implementation Details. We optimize a single cross-entropy objective over the shared vocabulary using AdamW with a warmup phase followed by a constant phase and a final cosine decay, while keeping the vision tower unfrozen throughout. The observation input provides a sparse multi-second history that includes the current frame. Historical frames are randomly dropped during training as regularization for the visual-memory module (Sec. 3.3), and the model is trained until convergence. 5 Experiments We design our experiments to comprehensively probe the capabilities ofG0.5along the axes that matter most for a general-purpose VLA: out-of-the-box deployability, transferability via fine-tuning, scalability to long-horizon tasks, fidelity to language, and adaptability to different contexts. Concretely, our evaluation is organized around the following research questions: ⢠Q1: How well doesG0.5generalize beyond its training environments and objects? After post-training on DROID data, we deployG0.5on a DROID Franka platform whose physical environment and object instances are absent from both pre-training and post-training; we also stress-test its instruction-following capability under our Pick-and-Place Benchmark on the R1-Lite robot (Sec. 5.1, Sec. 5.5). â˘Q2: How effectively canG0.5be adapted to out-of-domain benchmarks? We fine-tuneG0.5on external robot datasets, including DROID and Bridge, and evaluate it on the corresponding hardware and simulation suites. This measures how well the pretrained representation transfers when both the embodiment and the data distribution differ from our in-house platforms (Sec. 5.1, Sec. 5.2.1). â˘Q3: How doesG0.5perform on in-domain tasks after fine-tuning? We evaluate two complementary in-domain settings: standardized simulation benchmarks (LIBERO, RoboTwin 2.0) for reproducibility and comparison with prior work, and real-world fine-tuning on R1-Lite and R1-Pro across six task- embodiment settings to measure long-horizon bimanual manipulation under matched training and evaluation conditions (Sec. 5.2.3, Sec. 5.2.2, Sec. 5.4). â˘Q4: CanG0.5acquire long-horizon generalist mobile manipulation skills, and how do architectural choices and pre-training data distribution shape this capability? We evaluateG0.5with a single policy on the 2025 BEHAVIOR Challenge, a 50-task household benchmark where each episode averages 6.6 minutes and demands coordinated navigation and bimanual manipulation. We analyze how architectural choices and pre-training data distribution shape downstream long-horizon performance (Sec. 5.3). â˘Q5: How strong isG0.5âs language-following ability in cluttered scenes? We introduce the Pick-and-Place Benchmark (P Bench), which disentangles language grounding from low-level execution by separately reporting language following rate and task success rate across in-distribution and out-of-distribution object categories at multiple post-training scales (Sec. 5.5). â˘Q6: How do different contexts affectG0.5âs behavior? We study how augmenting the policy input with additional referring context, such as cropped object/container regions and coordinate tokens provided by an external VLM, influences language grounding and final task success, leveraging the flexible multi-image interface of G0.5 (Sec. 5.5). â˘Q7: Does putting reasoning in the same stream as action actually pay off? On a single pretrained checkpoint we toggle the action head (AR tokens vs. an additional flow-matching head) and the CoT stream (on/off) at inference time, across P Bench and two new zero-shot long-horizon household tasks. We also qualitatively observe how per-stage instruction wordingâe.g., adverbial qualifiers, spatial cues, or near-synonymous verbsâaffects rollouts under AR+CoT (Sec. 5.6). The remainder of this section is organized to answer each of these questions in turn. 5.1 DROID Environment- and Object-Level Zero-Shot Evaluation We first post-trainG0.5on the DROID dataset [43] and then deploy it on a held-out DROID robot setup. No demonstrations from the physical evaluation environment or involving the evaluation object instances 10 are included in either pre-training or post-training. This evaluation therefore measures environment- and object-level zero-shot generalization after DROID post-training, rather than dataset-level zero-shot transfer. 5.1.1 Evaluation Setup Robot Platform. We use a Franka Research 3 7-DoF robot arm equipped with a Robotiq 2F-85 parallel- jaw gripper, mounted on a height-adjustable standing desk following the standard DROID hardware configuration [43]. Visual observations are provided by two RGB cameras: a right-side third-person camera offering a fixed global view of the tabletop workspace, and a wrist-mounted camera providing a close-up view for fine-grained manipulation. The policy receives both camera streams together with the natural language task instruction. Tasks. We evaluate on 10 tabletop manipulation tasks drawn from the DROID environment [43], as illustrated in Fig. 5. Tasks span seven skill categories, each targeting a distinct manipulation challenge: â˘Move the carrot / peach into the bowl. Requires discriminating between a soft deformable carrot plush and a rigid spherical peach, and precisely depositing the target object into a small bowl. â˘Move the block onto the green / red plate. Requires colour-conditioned target selection and fine-grained grasping of a small block onto the correct plate. â˘Move the block into the cup. Requires accurate vertical clearance estimation to deposit the block inside a tall cup without colliding with the rim. â˘Put the towel / pen into the open drawer. Requires identifying the target object, localising the drawer opening, and grasping both deformable fabric and a thin rigid tool. â˘Move the bowl to the left. Requires spatial-direction understanding and stable grasping of a wide, irregularly shaped bowl for precise lateral displacement. â˘Take out the towel from the bowl and put it on the plate. A two-step sequential task: extract a deformable towel from a bowl, then reposition it onto a flat plate. â˘Put the block into the open drawer and close the drawer. A long-horizon task requiring two temporally dependent sub-goals: block insertion followed by drawer closure. Evaluation Protocol. Each task is evaluated over 10 trials. Task success is scored as a binary outcome (1 for completion, 0 otherwise), except for the sequential task put the block into the open drawer and close the drawer, which receives a partial score of 0.5 for completing only the insertion sub-step and a full score of 1.0 for full task completion. Baselines. We compareG0.5against two representative baselines:í 0.5 -DROID [4], trained on the original DROID dataset with a PaliGemma backbone, and MolmoAct2-DROID [44], a generalist policy built on the Molmo vision-language model and trained with the MolmoAct2 data preprocessing pipeline. 5.1.2 Quantitative Results Fig. 6 presents the per-task success rates across all three models. Overall,G0.5consistently outperforms both baselines across the majority of tasks, achieving an average success rate of 82.5%. G0.5-DROID vs.í 0.5 -DROID.G0.5-DROID outperformsí 0.5 -DROID on all 10 tasks, with particularly strong advantages on tasks that demand precise object discrimination and multi-step reasoning. On tasks where objects share similar appearance or require colour-conditioned target selection,G0.5-DROID demonstrates significantly stronger visual grounding. G0.5 -DROID vs. MolmoAct2-DROID.G0.5-DROID shows especially large margins on tasks involving spatial language instructions and object-category recognition, where MolmoAct2 struggles to ground instruction semantics into correct motor behaviour. Most notably, MolmoAct2-DROID completely fails on 11 (a) Carrot / Peachâ Bowl(b) Blockâ Green / Red Plate(c) Blockâ Cup(d) Towelâ Open Drawer (e) Penâ Open Drawer(f) Bowlâ Left(g) Towel: Bowlâ Plate(h) Blockâ Drawer + Close Figure 5: DROID environment- and object-level zero-shot evaluation tasks. After DROID post-training, we evaluateG0.5on 10 manipulation tasks across 8 held-out scene setups and previously unseen physical object instances on a Franka Research 3 robot arm. Tasks cover object placement, color-conditioned target selection, small-aperture insertion, deformable object manipulation, spatial displacement, and multi-step sequential execution. the sequential task put the block into the open drawer and close the drawer, whileG0.5-DROID succeeds on over half of the trials, demonstrating substantially stronger multi-stage task execution capability. We further observe that MolmoAct2-DROID frequently freezes or produces no motion when approaching objects such as the carrot, peach, or bowl, and often executes empty grasps when the gripper has not yet reached a valid pre-grasp pose. Effect of visual contrast on drawer localisation. The drawer cabinet used in this evaluation features a white semi-transparent body, which provides limited visual contrast for localising the insertion aperture. To examine the impact of this visual ambiguity, we conducted a controlled comparison on the towel insertion task: in the main evaluation, orange adhesive cards were attached to the drawerâs interior walls and base as explicit localisation markers, whereas the earlier experiment was run without any markers (í 0.5 -DROID: 90%, MolmoAct2-DROID: 80%,G0.5-DROID: 60%). Adding the high-contrast markers dramatically improves G0.5-DROIDâs performance to 100%, whileí 0.5 -DROID remains comparatively unaffected. This indicates thatG0.5-DROID is more sensitive to low-contrast semi-transparent surfaces and is relatively less capable of reliably localising targets without explicit high-contrast visual cues. Carrot âBowl 0 20 40 60 80 100 Success Rate (%) Peach âBowl Block â Gr. Plate Block â Red Plate Block âCup Towel âDrawer Pen âDrawer Bowl âLeft Towel Bowl âPlate Block â Drawer+Close Average DROID Environment- & Object-Level Zero-Shot Evaluation î§ . -DROID MolmoAct2-DROIDG0.5-DROID Figure 6: DROID environment- and object-level zero-shot evaluation results. All models are trained on DROID data, while the physical evaluation environment and object instances are held out. Per-task success rates (%) are reported forí 0.5 -DROID, MolmoAct2-DROID, andG0.5across 10 manipulation tasks. G0.5achieves an average of 82.5%, outperformingí 0.5 -DROID (57.5%) by 25.0 percentage points and MolmoAct2-DROID (52.0%) by 30.5 percentage points. 12 Table 1: Results on Bridge-SimplerEnv. All numbers are success rates (%). Since several original model papers do not report results on SimplerEnv-WidowX, we compile the corresponding baseline numbers from prior studies that evaluate these models on this benchmark. The best and second-best results are highlighted in bold and underlined, respectively. Method Put Spoon on Towel Put Carrot on Plate Stack Green Block on Yellow Block Put Eggplant in Yellow Basket Average í 0 [3]29.10.016.662.527.1 í 0 -FAST [11]29.121.910.866.632.1 í 0.5 [4]49.364.7 44.769.757.1 GR00T-N1.5 [5]75.354.357.061.361.9 StarVLA-GR00T [46]83.059.418.8100.065.3 RoboBrain2.5-8B [42]75.055.540.1100.067.6 MemoryVLA [47]75.075.037.5100.071.9 EO-1 [48]63.654.581.890.972.7 Xiaomi-Robotics-0 [49]95.862.575.083.379.2 G0.5 (Ours)97.575.083.393.387.3 5.2 Simulation Benchmarks 5.2.1 Bridge-SimplerEnv Bridge-SimplerEnv evaluates language-conditioned WidowX manipulation policies in SimplerEnv, a real-to- sim benchmark that instantiates the BridgeData V2/WidowX setup for scalable simulated policy evaluation [15]. We follow the official SimplerEnv WidowX+Bridge task suite and evaluate on four Bridge-style manipulation tasks: putting a spoon on a towel, putting a carrot on a plate, stacking a green cube on a yellow cube, and putting an eggplant into a yellow basket. To adapt our policy to the WidowX/Bridge embodiment before evaluation, we post-train it on BridgeData V2 demonstrations [45] for 80K gradient steps with a learning rate of3Ă 10 â5 . Throughout both post-training and evaluation, we adopt a state-free policy input, where robot joint states or other proprioceptive states are not provided to the model. This yields a stricter yet comparable evaluation protocol under the same SimplerEnv task suite. We then evaluate the resulting policy in SimplerEnv without any additional simulation-domain training. Results are summarized in Tab. 1, where G0.5 achieves the highest average success rate of 87.3% among the compared methods. 5.2.2 RoboTwin 2.0 RoboTwin 2.0 evaluates simulated bimanual manipulation across a broad suite of over 50 tasks, emphasizing behaviors that depend on coordinated dual-arm control rather than single-arm pick-and-place skills alone. We follow the multi-task training setup of [50,51]: models are trained on a combined set of 2,500 clean-scene demonstrations and 25,000 demonstrations collected with heavy scene randomization. We finetuneG0.5for 4 epochs using a learning rate of4Ă 10 â5 and a global batch size of 1024. Success rates are averaged over 100 trials per task in both clean and randomized evaluation settings. Results are reported in Tab. 2. Per-task success rates for G0.5 are provided in Tab. 7. 5.2.3 LIBERO LIBERO is a Franka robot arm simulation benchmark comprising four task suitesâGoal, Spatial, Object, and Longâwhich evaluate instruction following, spatial reasoning, object recognition, and long-horizon manipulation, respectively. Each suite contains 10 tasks with 50 demonstrations per task. We finetuneG0.5 for 100K steps using a learning rate of1Ă 10 â5 and a weight decay of1Ă 10 â2 . Following the standard LIBERO protocol, we evaluate the model over 50 rollout trials per task using the benchmark-defined initial states. Results are summarized in Tab. 3.G0.5achieves state-of-the-art overall performance among recent 13 Table 2: Results on RoboTwin 2.0. We report success rates under clean and randomized evaluation settings, together with their average. The best and second-best results are highlighted in bold and underlined, respectively. MethodClean Rand. Average í 0 [3]65.958.462.2 í 0.5 [4]82.776.879.8 LingBot-VLA [52] 86.585.385.9 Motus [50]88.787.087.8 StarVLA [46]88.787.888.3 LingBot-VA [51]92.9 91.592.2 Fast-WAM [16]91.991.891.8 G0.5 (Ours)93.792.893.3 Table 3: Results on LIBERO. The best and second-best results are highlighted in bold and underlined, respectively. MethodSpatial Object Goal Long Average Qwen-VLA-Base [53]â90.8 í 0 [3]98.096.894.4 88.494.4 InternVLA-M1 [54]98.099.093.8 92.695.9 Wall-OSS-0.5 [55]â96.5 í 0.5 [4]98.898.298.0 92.496.9 GR00T-N1.7 [5]97.798.597.5 94.497.0 OpenVLA-OFT [56]97.698.497.9 94.597.1 Fast-WAM [16]98.2100.0 97.0 95.297.6 Being-H0.5 [23]99.2 98.299.096.298.2 Motus [50]96.899.8 96.6 97.697.7 Qwen-VLA-Instruct [53]â97.9 EO1 [48]99.799.8 99.2 94.898.4 Cosmos Policy [57]98.1100.0 98.2 97.698.5 LingBot-VA [51]98.599.697.2 98.598.5 Xiaomi-Robotics-0 [49]98.8100.0 98.8 97.298.7 G0.5 (Ours)98.4100.0 98.6 98.698.9 VLA models, attaining an average success rate of98.9%. Notably, it delivers the strongest performance on the challenging Long suite. 5.3 Long-horizon Tasks The 2025 BEHAVIOR Challenge, built on the BEHAVIOR-1K benchmark [13] and the photo-realistic OmniGibson simulator powered by NVIDIA Isaac Sim, presents a demanding testbed for long-horizon mobile manipulation. The challenge selects 50 full-length household tasks from the 1,000 activity collection, covering diverse activities like rearrangement, cooking, cleaning, and installation. To support training, it provides 10,000 teleoperated expert demonstrations totaling over 1,100 hours, where each demonstration episode averages 6.6 minutes and spans up to 14 minutes. To accomplish these tasks, a policy must control an R1-Pro robot to simultaneously process RGB observations from the head and dual-wrist cameras, navigate through house-scale environments, and perform dexterous bimanual manipulation using two 7-DOF arms equipped with parallel-jaw grippers. During evaluation, policies are tested over 10 episodes per task with systematically randomized initial object states and robot poses. Because executing these complex household chores is significantly more demanding than short horizon table top tasks, overall performance is quantified by a Task Success Score, which serves as the primary ranking metric for the challenge. This metric measures how much of a goal condition a policy satisfies by computing the proportion of completed BDDL goal predicates and selecting the best matched 14 goal clause at the end of the episode. By awarding partial credit, it ensures that policies making meaningful progress score higher even without full task completion. Consequently, this granular scoring mechanism provides a smoother and more reliable way to evaluate incremental progress and compare policies across BEHAVIOR tasks than a traditional binary success rate. 5.3.1 Implementation Details For our evaluation, we adopt the official standard track and the default low-resolution RGB rendering setting. To ensure a fair comparison, we follow the first place solution [58] and use single frame observations during post training, but omit their explicit stage head. Notably, to validate the general mobile manipulation capabilities of our pre-trained model and to measure the comprehensive performance of a single policy across 50 diverse household tasks, we jointly co-train all 10,000 episodes from the 50 tasks during the post-training phase. Consequently, the test results reported below for bothí 0.5 andG0.5are evaluated using only a single checkpoint. Table 4: Overall results on the 2025 BEHAVIOR Challenge (50 tasks, 10 instances each). Task Success Score is the challenge ranking metric (task progress). The first place solution by the Robot Learning Collective (RLC) [58] uses a set of 4 checkpoints;í 0.5 [4] (4 epochs) andG0.5each use a single checkpoint, averaged over two eval runs. Best/second best in bold/underline. MethodTask Success Score (Ranking Metric)â RLC (1st place) [58]0.2605 Comet (2nd place) [59]0.1830 í 0.5 (4 epochs) [4]0.2626 G0.5 (Ours, 1 epoch)0.2904 G0.5 (Ours, 4 epochs)0.3136 5.3.2 Key Findings and Analysis We evaluateG0.5andí 0.5 directly to establish a strictly fair comparison of the pre-trained model weights using a single policy, whereas other baseline scores represent public leaderboard submissions utilizing multiple policies. From Table 4 and the detailed results in Table 6, we highlight the following key findings: â˘Training Efficiency. With only a single epoch of post-training,G0.5already surpassesí 0.5 trained for four epochs by +10.6% in the primary Task Success Score. With four epochs, this advantage widens to +19.4%, demonstrating that our model continues to improve with additional training. This result directly demonstrates the superior representational capacity of theG0.5pre-trained backbone: a stronger foundation model can extract task-relevant knowledge from the same downstream data far more efficiently, requiring significantly fewer gradient steps to acquire complex household manipulation skills. â˘Single-Policy Generalization. Across the entire suite of 50 tasks,G0.5(4 epochs) outperforms the first-place solution by +20.4% using only a single checkpoint, whereas the competition winner relies on a set of four distinct checkpoints to cover different task distributions. Even with just 1 epoch,G0.5already exceeds the first-place result by +11.5%. This confirms thatG0.5learns a sufficiently general whole-body control prior during pre-training, eliminating the need for task-specific checkpoint selection at evaluation time. We attribute these results primarily to three aspects of G0.5âs design: Structured Action Decomposition Benefits Mobile Manipulation. As described in Section 3.1, our structured tokenization decomposes the robotâs action space into independent motion parts (e.g., left control, right control, lower body). This decomposition is particularly beneficial for mobile manipulation tasks, as it explicitly decouples navigation from manipulation in the token space. Rather than learning from a flat, entangled action representation, the model acquires a factored whole-body control prior where each motion 15 group can be independently predicted. This advantage is clearly reflected in our results:G0.5achieves strong performance on long-horizon tasks that interleave navigation and object manipulation, such as moving boxes to storage (+0.35 vs.í 0.5 ), picking up trash (+0.30), and loading the car (+0.28), where the robot must navigate to different locations, grasp objects, and place them at target positions in sequence. Pre-Training Distribution Shapes Downstream Strengths. Our per-task analysis reveals a clear alignment between pre-training data composition and downstream task performance. As shown in Figure 4, the real- robot pre-training data forG0.5is predominantly composed of pick-and-place behaviors. Correspondingly, G0.5demonstrates strong advantages on open-space pick-and-place tasks, where the robot picks up objects and places them at target locations across diverse spatial configurations. Examples include setting mousetraps (+0.46), assembling gift baskets (+0.26), and putting shoes on rack (+0.20), all of which primarily require robust grasping, accurate placement, and coordinated navigation across diverse spatial configurations. Conversely,í 0.5 outperformsG0.5on container-interaction tasks that involve appliance or cabinet manip- ulation (e.g., make microwave popcorn: 0.95 vs. 0.55; cook hot dogs: 0.93 vs. 0.90). These skills are severely underrepresented in our pre-training data; however, the gap narrows substantially with more training: cook hot dogs improves from 0.45 (1 epoch) to 0.90 (4 epochs), approaching í 0.5 âs 0.93. Despite this distributional gap,G0.5leads on 29 out of 50 evaluated household tasks (58%) whileí 0.5 leads on only 15 (30%), with 6 tasks being comparable. This broad coverage underscores the generality of the pre-trained representations. Moreover, it suggests a clear path forward: enriching the pre-training data with container-interaction skills could further narrow the remaining gap. Visual Memory Pre-Training Improves Long-Horizon Performance. As described in Section 3.3,G0.5is pre-trained with factorized spatial-temporal attention that processes multi-frame visual context. Although we use single-frame input during post-training for fair comparison, the benefits of temporal pre-training are clearly evident in the downstream results. The gains are most pronounced on navigation-intensive, long-horizon tasks: moving boxes to storage, loading the car, bringing in wood, and tidying bedroom. These tasks require the robot to repeatedly traverse between distant locations while tracking which objects have been moved and where they were placed. We attribute this advantage to the visual dynamics inherent in mobile manipulation pre-training data: even in standard pick-and-place episodes, the robot frequently moves its base between grasp and place locations, causing consecutive frames from each camera to exhibit large visual changes including scene layout shifts and object appearance transitions. The factorized temporal attention in the vision encoder, operating within each camera view across time steps is well-suited to capture these sequential visual dynamics, encouraging each per-camera representation to encode not just the current observation but also an implicit understanding of how the scene evolves over time. Additionally, during pre-training we stochastically drop all historical frames with 30% probability to prevent the model from overfitting to historical context. Together, these design choices yield single-frame representations that are more spatially informed, which explains whyG0.5 generalizes well to long-horizon mobile manipulation even when post-trained with single-frame input. 5.4 Real-World Fine-Tuning Evaluation We evaluateG0.5through real-world fine-tuning experiments on two robot embodiments, R1-Lite and R1-Pro. This evaluation focuses on whether a policy can be adapted to robot embodiments with different kinematic structures and execute long-horizon bimanual manipulation tasks under matched training and evaluation conditions. Robot Embodiments. R1-Lite is a mobile dual-arm manipulation platform, comprising two 6-DoF arms, a 3-DoF torso, and a mobile omnidirectional base. The torso provides vertical and pitching motion to extend the manipulation workspace and improve operational flexibility. R1-Pro is a humanoid upper-body mobile manipulation platform, comprising two 7-DoF arms, a 4-DoF torso, and a mobile omnidirectional base. Compared with R1-Lite, the additional arm and torso degrees of freedom 16 provide enhanced dexterity and greater flexibility for complex bimanual manipulation tasks. Evaluating on both embodiments allows us to test whether the learned policy remains effective under different workspace, dexterity, and whole-body coordination requirements. Baselines and Fine-Tuning Protocol. We compareG0.5with two representative open-source VLA baselines, í 0.5 [4] and GR00T-N1.7 [5]. For each evaluation setting, all models are fine-tuned on the same training data with an aligned compute budget. Specifically, each model is trained using 16 H20 GPUs for the same wall-clock duration within the same setting, ranging from 4 to 10 hours depending on task complexity. All models are adapted to both robot embodiments and evaluated with the same observation space, action space, inference procedure, and low-level control settings. Evaluation Protocol. We use task to denote the semantic task objective, such as towel folding or carton folding, and setting to denote a specific task-embodiment pair, such as towel folding on R1-Lite or towel folding on R1-Pro. Under this definition, the real-world fine-tuning evaluation contains four tasks instantiated as six evaluation settings. The R1-Lite settings include towel folding, carton folding, and pencil-case packing, while the R1-Pro settings include towel folding, carton folding, and box transfer and stacking. Towel folding and carton folding are evaluated on both embodiments, enabling direct comparison across different robot configurations under the same task objectives. Each setting is evaluated over 15 real-world episodes. We report both task success rate and process score. The success rate measures the fraction of episodes in which the full task is completed, while the process score evaluates intermediate task progress based on predefined stage-wise criteria. The detailed stage definitions and scoring rules are provided in the appendix. To reduce the influence of uncontrolled environmental factors, such as lighting changes and robot hardware state variations, we evaluate the models in an interleaved order within each setting rather than evaluating one model exhaustively before the next. Observation Setup. Both platforms are equipped with three RGB cameras for visual observation. Two wrist-mounted cameras provide close-up views for fine-grained gripper manipulation, while one external camera provides a global view of the scene for spatial understanding and long-horizon planning. 5.4.1 Task Definitions and Evaluation Metrics Fig. 7 shows the six real-world evaluation settings across the two robot embodiments. The four tasks cover deformable object manipulation, contact-rich assembly, sequential object interaction, and whole-body bimanual coordination. â˘Folding Towel. This task is evaluated on both R1-Lite and R1-Pro. The robot is required to 1) grasp a towel from a basket, 2) lift and unfold the towel through coordinated bimanual motion, 3) flatten the towel on the tabletop, 4) fold the towel into a predefined configuration, and 5) place the folded towel into a designated target area. This task is challenging because towels exhibit highly deformable and unstable geometric states during manipulation. Small errors in grasping or tension control can accumulate throughout the folding process, leading to misalignment, incomplete folds, or entanglement. Successful execution therefore requires accurate dual-arm coordination, continuous shape regulation, and long-horizon manipulation of deformable objects. ⢠Folding Carton. This task is evaluated on both R1-Lite and R1-Pro. The robot is required to transform a flat carton into a complete box structure through a sequence of predefined folding operations. The task involves multiple stages of coordinated bimanual interaction, including edge alignment, surface folding, and structure stabilization. Since the carton is non-rigid and sensitive to manipulation errors, minor inaccuracies during intermediate folding stages may damage the structure or prevent successful assembly. The task therefore demands precise dual-arm coordination, accurate contact control, and stable sequential execution. â˘Box Transfer and Stacking. This task is evaluated on R1-Pro. The robot is required to sequentially transfer five boxes from one table to another and stack them into a stable configuration. During placement, each 17 (a) R1-Lite: Folding Towel(b) R1-Lite: Folding Carton(c) R1-Lite: Pencil-Case Packing (d) R1-Pro: Folding Towel(e) R1-Pro: Folding Carton(f) R1-Pro: Box Transfer and Stacking Figure 7: Overview of real-world fine-tuning evaluation settings. We evaluate four manipulation tasks instantiated as six task-embodiment settings across R1-Pro and R1-Lite. The R1-Pro settings include towel folding, carton folding, and box transfer and stacking, while the R1-Lite settings include towel folding, carton folding, and pencil-case packing. Towel folding and carton folding are shared across both embodiments, enabling cross-embodiment comparison under the same task objectives. box must be accurately aligned with the grooves of the box below. Unlike tabletop-only manipulation tasks, this task requires coordinated control of the upper body, including both arms and the torso, to achieve sufficient reachability and stable motion during transportation and placement. The main challenge lies in precise spatial alignment during stacking, as small positioning errors can cause instability or collapse of the stack. â˘Pencil-Case Packing. This task is evaluated on R1-Lite. The robot is required to 1) unzip a pencil case from its closed state, 2) identify and sequentially place designated stationery items into the pencil case, and 3) close the zipper after all target objects have been inserted. This task combines deformable object manipulation with fine-grained tool interaction. The zipper is small and requires accurate manipulation to operate reliably, while the deformable structure of the pencil case introduces additional geometric uncertainty during interaction. In addition, the robot must identify target objects and perform sequential pick-and-place operations under cluttered tabletop conditions. For all tasks, we report both task success rate and process score. The process score evaluates intermediate task progress based on predefined stage-wise completion criteria, enabling finer-grained comparison between different policies when a task is only partially completed. 5.4.2 Quantitative Results Fig. 8 summarizes the quantitative results across the six real-world evaluation settings. Overall,G0.5achieves the highest average performance among the three models. Across all six settings,G0.5obtains an average success rate of 76.7%, compared with 53.3% forí 0.5 and 24.4% for GR00T-N1.7.G0.5also achieves an average process score of 129.2, compared with 105.2 for í 0.5 and 68.9 for GR00T-N1.7. 18 Figure 8: Performance on real-world fine-tuning evaluation. We evaluateG0.5againstí 0.5 and GR00T-N1.7 on four manipulation tasks instantiated as six task-embodiment settings across R1-Pro and R1-Lite.G0.5 achieves strong overall performance in both task success rate and process score, demonstrating robust long-horizon manipulation capability across different embodiments. G0.5achieves the highest success rate in five out of the six settings. The only exception is the R1-Pro box transfer and stacking setting, whereí 0.5 achieves a higher final success rate of 93.3%, whileG0.5achieves 80.0%. However,G0.5remains competitive in this setting, achieving a process score of 142.5 compared with 148.0 for í 0.5 , and outperforming GR00T-N1.7 in both success rate and process score. The two shared tasks, towel folding and carton folding, allow direct comparison across the two robot embodiments. On these four shared task-embodiment settings,G0.5achieves an average success rate of 75.0%, outperformingí 0.5 at 43.3% and GR00T-N1.7 at 13.3%. For process score on the same shared settings, G0.5achieves an average score of 124.3, compared with 92.0 forí 0.5 and 49.9 for GR00T-N1.7. These results indicate thatG0.5maintains strong performance not only on embodiment-specific tasks, but also on the same task objectives executed by different robot configurations. The performance ofG0.5is also balanced across embodiments. On R1-Pro,G0.5achieves an average success rate of 75.6% and an average process score of 124.5. On R1-Lite,G0.5achieves an average success rate of 77.8% and an average process score of 133.8. This suggests thatG0.5adapts effectively to both the 6-DoF dual-arm embodiment of R1-Lite and the 7-DoF humanoid upper-body embodiment of R1-Pro under the same fine-tuning and evaluation protocol. 5.5 Pick-and-Place Benchmark Large-scale pretraining is expected to improve not only low-level action generation, but also language following in visually cluttered scenes. In real-world manipulation, a policy must first identify the object and target specified by the instruction before executing primitive skills such as picking and placing. This 19 distinction is critical because failures may arise either from incorrect language following, where the robot interacts with the wrong object, or from low-level execution errors after the correct target has been selected. To disentangle these factors, we introduce the Pick-and-Place Benchmark (P Bench), which separately reports language following rate and final task success rate. Dataset and Post-training Setup. We collect 50 hours of tabletop manipulation data using the R1-Lite robot. Each scene contains 5â20 objects randomly placed on the table with varying positions and orientations. The robot is instructed to pick up a specified object and place it into a specified container. Each instruction explicitly specifies both the target object and the target container, following the same format used during pretraining, e.g., âTask: Pick up the yellow utility knife with the left hand and place it into the white basket.â To evaluate the effect of post-training scale, we construct three nested subsets from the 50-hour dataset: 1H, 10H, and 50H, where the 1H subset is sampled from the 10H subset and the 10H subset is sampled from the full dataset. The models are trained for 12, 8, and 4 epochs on the 1H, 10H, and 50H subsets, respectively. This setup allows us to compare different data scales while keeping the data distribution consistent across subsets. Evaluation Setting. The test set includes both in-distribution and out-of-distribution object categories. We randomly sample 48 objects from the 50H subset and additionally include 16 categories absent from all post-training data for out-of-distribution evaluation. The full set of benchmark objects and containers is shown in Fig. 9. During evaluation, each tabletop scene contains 16 randomly placed objects and containers, following the same setup as data collection. In each trial, the robot receives a language instruction and is required to place the specified object into the specified container. Each model is evaluated over 64 real-world trials to reduce variance. For fair comparison, different models are evaluated on the same instruction under identical object layouts, container placements, and robot initial states. This paired evaluation protocol reduces variance from scene configuration and isolates the effect of the policy. We report two metrics: language following rate and task success rate. Language following rate measures whether the robot selects the object specified by the instruction among distractors. A trial is counted as language-following success if the robot moves toward the target object and attempts to grasp it. Task success rate measures whether the robot completes the full instruction by successfully grasping the specified object and placing it into the specified container. Results and Analysis. Using P Bench, we evaluateG0.5from four perspectives: zero-shot capability, the effect of post-training, comparison with í 0.5 , and the benefit of additional context (Fig. 10). Zero-shot capability.G0.5exhibits strong zero-shot language following. Without any P-specific post-training data, it achieves a language following rate of 65.6% and a task success rate of 59.4%. This indicates that large-scale pretraining provides transferable instruction-following ability and basic pick-and-place action priors. Effect of post-training. Post-training further improves both semantic grounding and execution reliability. G0.5reaches language following rates of 62.5%, 71.9%, and 84.4% under the 1H, 10H, and 50H settings, respectively, with corresponding task success rates of 57.8%, 65.6%, and 75.0%. The consistent improvement from 10H to 50H suggests that additional post-training data strengthens grounding for in-distribution objects and improves action reliability on the R1-Lite embodiment. Comparison withí 0.5 . Compared withí 0.5 ,G0.5achieves higher language following and task success across all post-training scales. The gap is most pronounced in the zero-shot and 1H settings, whereí 0.5 shows limited transfer to the R1-Lite setup. With 50H post-training,í 0.5 improves to 68.8% in language following and 65.6% in task success, indicating that target-domain post-training helps adapt the model to the instruction format, object-container distribution, and R1-Lite action interface. Nevertheless, under the same 50H setting, G0.5still outperformsí 0.5 by 15.6 percentage points in language following and 9.4 percentage points in task success. We attribute this advantage to large-scale web-data co-training, which improves open-vocabulary 20 Figure 9: Pick-and-Place Benchmark setting. The evaluation set contains 64 object categories and 3 container categories. Each trial presents 16 randomly arranged objects and containers, requiring the robot to identify the instructed target among distractors and place it into the specified container. Each policy is evaluated across all object categories in real-world trials to reduce variance. Zero-shot1H10H50H Post-Training Scale 0% 20% 40% 60% 80% 100% 65.6% 62.5% 71.9% 84.4% 0.0% 21.9% 56.3% 68.8% Language Following Rate Zero-shot1H10H50H Post-Training Scale 0% 20% 40% 60% 80% 100% 59.4% 57.8% 65.6% 75.0% 0.0% 3.1% 42.2% 65.6% Task Success Rate î§ . G0.5 Figure 10: P Bench evaluation results. Left: language following rate. Right: task success rate. We compare G0.5 and í 0.5 across zero-shot, 1H, 10H, and 50H post-training settings. 21 Table 5: Ablation on referring context for P Bench. We evaluateG0.5with progressively richer referring context, i.e., auxiliary inputs appended to the standard instruction that help the policy identify the language- specified target object beyond its category name. MetricName-only + Box Coord. + Target Visual Language Following Rate84.4%85.9%98.4% Task Success Rate75.0%76.6%84.4% semantic understanding, and to robot pretraining that includes the R1-Lite embodiment, which provides stronger action priors and execution quality. Additional referring context. Failure analysis shows that many remaining language-following errors occur on long-tail objects that are visually ambiguous, partially occluded, or difficult to identify from language alone. We therefore evaluate several referring-context variants in Table 5. Name-only uses the standard instruction format, where the prompt specifies only the target object and container names. + Box Coord. augments the instruction with textual coordinate tokens for the target object and container boxes. Despite providing explicit spatial cues, this setting does not improve over the name-only baseline. We hypothesize that directly injecting coordinate tokens introduces an instruction-format shift from the name-only robot pretraining distribution, and that the post-training data may be insufficient for the action head to reliably exploit this new conditioning signal. + Target Visual further augments the input with cropped visual regions of the target object and container. These visual contexts are appended to the original camera views and encoded with the same visual encoder as the standard observations. Compared with box coordinates alone, the target visual context provides fine-grained local appearance cues, such as texture, shape, and category-specific visual details. These cues are particularly useful for targets that are difficult to disambiguate from language alone or belong to long-tail categories with limited linguistic exposure but distinctive visual appearance, such as a Chinese chess piece labeled âhorseâ. This setting significantly improves language following to 98.4% and task success to 84.4%. 5.6 Zero-Shot Probe of CoT and Action Head We isolate the contributions of chain-of-thought and the action decoder by taking a single pretrainedG0.5 checkpoint and varying only the inference-time configuration; no parameters are fine-tuned or adapted, and the same weights are reused across all cells. The probe spans three tasks of increasing horizon on the R1-Lite platform: P Bench (single stage), and two new long-horizon zero-shot tasksâAir Fryer and Cook Baconâeach decomposed into five sequential stages (Air Fryer: approachâopen doorâgrasp breadâplace insideâ close door; Bacon: approachâ grasp baconâ place in panâ turn on stoveâ flip). At runtime the policy receives a per-stage natural-language instruction for the current sub-goal. We toggle (i) the decoderâAR for autoregressive action tokens versus FM for an additional flow-matching head (optional at inference)âand (i) the chain-of-thought stream, where the model optionally emits subtask and bounding-box reasoning before each action. When CoT is on, both decoders read from the post-CoT hidden state, so the comparison isolates the decoding interface rather than the conditioning input. We report the language-following rate and, for the long-horizon tasks, a progress score equal to the number of completed sub-stages (0â5). P Bench follows the zero-shot evaluation protocol of Sec. 5.5 (64rollouts); the long-horizon tasks (Fig. 11) useí=5 rollouts per cell. Finding 1: CoT improves grounding and execution within long-horizon stage-conditioned rollouts. On the single-stage P Bench, CoT brings essentially no change to language following: AR moves from65.6 to67.2and FM from59.4to60.9over 64 rolloutsâat mostâź1.6 percentage points for either decoder. With only one grounding event per rollout, there is little room for per-stage reasoning to help. On the five-stage Air Fryer and Bacon tasks the picture is different: with per-stage sub-goals supplied at runtime, CoT lets the policy ground the relevant object and execute each sub-step more reliably. With this structure the AR headâs progress score lifts from2.4to3.8on Air Fryer and from1.5to3.4on Bacon, with the language-following rate 22 Air Fryer 0 1 2 3 4 5 Progress Score (0--5) Cook BaconAir Fryer 0 20 40 60 80 100 Language Following (%) Cook Bacon Progress ScoreLanguage Following FM, no CoTFM, CoTAR, no CoTAR, CoT Figure 11: Long-horizon zero-shot probe on Air Fryer and Cook Bacon (same pretrainedG0.5checkpoint with only inference-time switching). Progress score (0â5, number of completed sub-stages) and language-following rate across the four decoderĂCoT cells: both metrics show the same ordering, with AR+CoT clearly leading on each task. rising in step (Fig. 11). The benefit thus appears where the task is presented as a sequence of stage-conditioned sub-goals. Air Fryer and Bacon are household manipulation scenes that do not appear in the pretraining data; CoT improves per-stage grounding and execution on them without any retraining. Qualitative observation: instruction wording. Beyond toggling CoT, we informally observed that the exact wording of the per-stage instruction affects behavior on these tasks. Two patterns recurred. First, adding adverbial or spatial qualifiers (e.g., âpush it in hardâ, âverticallyâ) tended to bring the executed motion closer to the intended sub-goal. Second, a single physical action often admits several near-synonymous verbsâclosing the air-fryer drawer can be phrased as press, push in, or closeâand substituting among them changed which rollouts succeeded in our small set. We report these only as qualitative observations. This probe is AR-only. Finding 2: AR appears to follow the CoT more closely than the FM head. Under matched CoT, the AR head benefits more than the FM head (Fig. 11): on Air Fryer, CoT lifts ARâs progress score from2.4to3.8while FM moves only from2.1to2.7; on Bacon,1.5â3.4for AR versus1.2â2.0for FM. The language-following rate echoes this gap under matched CoT (Air Fryer 72 vs. 48; Bacon 64 vs. 44). We hypothesize that this reflects the decoding interface rather than the reasoning content: the autoregressive action tokens are emitted in the same stream as the CoT and can attend to it directly, whereas the FM head conditions on a pooled summary of the hidden state. We do not directly probe this mechanism and leave its verification to future work. CoT correctness. The CoT is generated autoregressively by the VLA; once it terminates, the action is either continued autoregressively (AR) or sampled by the FM head. AR and FM are therefore run as two separate rollouts whose CoT traces, while produced by the same mechanism, are not identical, since the rollouts diverge once actions are executed. We hand-scored subtask text and bounding-box correctness on the CoT-on rollouts for both heads and found comparable qualityâroughly90%on P Bench,85%on Air Fryer, and 80%on Bacon, with no systematic ARâFM difference. The progress-score gap between the two heads under matched CoT therefore does not appear to come from differences in reasoning quality, which is consistent with the decoding-interface hypothesis in Finding 2. 5.7 G0.5 Fine-Tunes with RL Out of the Box An autoregressive policy emits actions as tokens, so it exposes exact token-level log-probabilitiesâprecisely the quantity that ratio-based RL algorithms consume. A flow-matching head offers no such likelihood 23 020406080100 Training step 60% 70% 80% 90% 100% Success rate 63.0% 90.1% 93.7% 96.1% 96.0% 97.4% 62.5% 85.7% 84.5% 84.5% 90.4% 92.9% GRPO Fine-Tuning: AR vs. FM FMAR Figure 12: GRPO fine-tuning: AR vs. FM. Average success rate over four LIBERO tasks during GRPO fine-tuning from a single demonstration per task (meanÂąstd over seeds). Starting from AR and FM policies with comparable initial success rates, the AR policy converges faster, attains a higher final success rate, and shows lower run-to-run variance. and must be reformulated before the same algorithms apply. We therefore ask whether the autoregressive interface is the easier one to optimize with RL, and test this in a low-data regime where post-training gains come almost entirely from exploration rather than imitation. We first jointly post-trained the AR and FM policies using a single demonstration trajectory per task on LIBERO [14]. We then selected four tasks on which the two policies reached comparable initial success rates and applied Group Relative Policy Optimization (GRPO) [60]. For the AR policy, actions were sampled with a temperature to encourage stochastic exploration while retaining tractable token-level log-probabilities. For the FM policy, we introduced an SDE into the denoising procedure and treated the denoising trajectory as a Markov process in order to approximate the policy log-probability, following RLinf [61]. As shown in Fig. 12, the AR policy converges substantially faster, reaches a higher final success rate, and trains more stably, with lower variance, than the FM policy. We hypothesize that this advantage stems from the AR policyâs native and direct likelihood parameterization, which makes policy probability ratios straightforward to compute. Applying ratio-based policy optimization to the FM policy, in contrast, requires an auxiliary stochastic reformulation, a discretization of the denoising dynamics, and additional noise-schedule choices; these components may introduce greater optimization sensitivity and gradient variance. 6 Conclusion We have argued, and empirically supported, that the path forward for VLA models is to let the VLM be what it was pretrained to beâan autoregressive reasoner that now also acts, remembers, and adapts in-contextârather than to design ever more sophisticated action experts on top of an underutilized backbone. G0.5instantiates this commitment with a single cross-entropy objective over a shared vocabulary, supported by a cross-embodiment action codec, a native chain-of-thought stream, and a multi-second visual memory module. Three observations point to a structural rather than incidental advantage of the autoregressive route. First, on Pick-and-Place benchmark, the zero-shot language-following rate ofG0.5exceeds the post-trainedí 0.5 baseline, suggesting that AR action supervision protectsârather than degradesâthe VLMâs instruction- following ability. Second, on the 2025 BEHAVIOR Challenge, a singleG0.5checkpoint trained for only one post-training epoch surpasses bothí 0.5 post-trained for four epochs and the four-checkpoint winner, indicating that the pretrained representations carry generalist mobile manipulation priors. Third, when fine-tuned under matched compute and an identical protocol on the R1-Lite and R1-Pro platforms,G0.5 24 beatsí 0.5 and GR00T-N1.7, indicating that the advantage over VLM-as-encoder architectures persists under apples-to-apples conditions rather than reflecting differences in training budget. G0.5inherits two acknowledged failure modes that future work should address. Drawer-insertion and semi-transparent cabinet tasks remain weak across bothG0.5variants, pointing to a sensing limit not closed by AR alone; and our visual memory captures only seconds of history, leaving long-horizon memory open to research. Lower-body actuation is represented in the unified action space, but is not evaluated separately in this work. More broadly, the prompt-level controllability our zero-shot probe begins to surfaceâwhere per-stage instruction wording shifts AR+CoT rollouts on out-of-distribution household tasksâdeserves a systematic empirical study of its own. We hope the released pretrained backbone serves as a starting point for further work in these directions. 7 Contributors Data engineering: Tao Jiang, Ke Dong, Xiaoshu Ren, Chenru Wu, Xiao Liu, Tianyuan Yuan, Zibin Dong, Zihan Guo, Zijie Zhao Annotation & supplemental data: Tianyuan Yuan, Tao Jiang, Changxun Pan, Xinlei Zhang, Chenru Wu, Haonan Liu, Haodong Yang, Bowen Zhang Policy training & research: Yicheng Liu, Zibin Dong, Tianyuan Yuan, Baijun Ye, Shicheng Cao, Shaoting Zhu, Xiao Liu Policy evaluation & benchmarking: Anqi Yang, Zihan Guo, Baijun Ye, Zibin Dong, Tao Jiang, Yue Sun, Tianyuan Yuan, Tailai Cheng, Changxun Pan, Jianning Cui, Shicheng Cao, Haonan Liu, Shaoting Zhu, Zijie Zhao, Haoyu Zhang, Jiahui Niu, Shiduo Zhang Writing & illustration: Yicheng Liu, Zibin Dong, Baijun Ye, Shicheng Cao, Haonan Liu, Tailai Cheng, Tao Jiang, Zihan Guo, Anqi Yang, Yue Sun, Tianyuan Yuan, Shiduo Zhang, Hang Zhao Project lead: Yicheng Liu⢠Project PI: Hang Zhao 25 References [1]Brianna Zitkovich, Tianhe Yu, Sichun Xu, Peng Xu, Ted Xiao, Fei Xia, Jialin Wu, Paul Wohlhart, Stefan Welker, Ayzaan Wahid, et al. Rt-2: Vision-language-action models transfer web knowledge to robotic control. In Conference on Robot Learning, pages 2165â2183. PMLR, 2023. [2]Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan Foster, Grace Lam, Pannag Sanketi, et al. Openvla: An open-source vision-language- action model. arXiv preprint arXiv:2406.09246, 2024. [3]Kevin Black, Noah Brown, Danny Driess, Adnan Esmail, Michael Equi, Chelsea Finn, Niccolo Fusai, Lachy Groom, Karol Hausman, Brian Ichter, et al.í 0 : A vision-language-action flow model for general robot control. arXiv preprint arXiv:2410.24164, 2024. [4]Physical Intelligence, Kevin Black, Noah Brown, James Darpinian, Karan Dhabalia, Danny Driess, Adnan Esmail, Michael Equi, Chelsea Finn, Niccolo Fusai, et al.í 0.5 : a vision-language-action model with open-world generalization. arXiv preprint arXiv:2504.16054, 2025. [5]Johan Bjorck, Fernando CastaĂąeda, Nikita Cherniadev, Xingye Da, Runyu Ding, Linxi Fan, Yu Fang, Dieter Fox, Fengyuan Hu, Spencer Huang, et al. Gr00t n1: An open foundation model for generalist humanoid robots. arXiv preprint arXiv:2503.14734, 2025. [6]Mustafa Shukor, Dana Aubakirova, Francesco Capuano, Pepijn Kooijmans, Steven Palma, Adil Zouitine, Michel Aractingi, Caroline Pascal, Martino Russi, Andres Marafioti, et al. Smolvla: A vision-language- action model for affordable and efficient robotics. arXiv preprint arXiv:2506.01844, 2025. [7]Qingqing Zhao, Yao Lu, Moo Jin Kim, Zipeng Fu, Zhuoyang Zhang, Yecheng Wu, Zhaoshuo Li, Qianli Ma, Song Han, Chelsea Finn, et al. Cot-vla: Visual chain-of-thought reasoning for vision-language-action models. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 1702â1713, 2025. [8]Zhide Zhong, Junfeng Li, Junjie He, Haodong Yan, Xin Gong, Guanyi Zhao, Yingjie Cai, Jiantao Gao, Xu Yan, Bingbing Liu, et al. Dualcot-vla: Visual-linguistic chain of thought via parallel reasoning for vision-language-action models. arXiv preprint arXiv:2603.22280, 2026. [9]Quanxin Shou, Fangqi Zhu, Shawn Chen, Puxin Yan, Zhengyang Yan, Yikun Miao, Xiaoyi Pang, Zicong Hong, Ruikai Shi, Hao Huang, et al. Halo: A unified vision-language-action model for embodied multimodal chain-of-thought reasoning. arXiv preprint arXiv:2602.21157, 2026. [10]Marcel Torne, Karl Pertsch, Homer Walke, Kyle Vedder, Suraj Nair, Brian Ichter, Allen Z Ren, Haohuan Wang, Jiaming Tang, Kyle Stachowicz, et al. Mem: Multi-scale embodied memory for vision language action models. arXiv preprint arXiv:2603.03596, 2026. [11] Karl Pertsch, Kyle Stachowicz, Brian Ichter, Danny Driess, Suraj Nair, Quan Vuong, Oier Mees, Chelsea Finn, and Sergey Levine. Fast: Efficient action tokenization for vision-language-action models. arXiv preprint arXiv:2501.09747, 2025. [12] Zhide Zhong, Haodong Yan, Junfeng Li, Xiangchen Liu, Xin Gong, Tianran Zhang, Wenxuan Song, Jiayi Chen, Xinhu Zheng, Hesheng Wang, et al. Flowvla: Visual chain of thought-based motion reasoning for vision-language-action models. arXiv preprint arXiv:2508.18269, 2025. [13] Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gokmen, Sanjana Srivastava, Roberto MartĂn-MartĂn, Chen Wang, Gabrael Levine, Michael Lingelbach, Jiankai Sun, et al. BEHAVIOR-1K: A benchmark for embodied ai with 1,000 everyday activities and realistic simulation. In Conference on Robot Learning, pages 80â93. PMLR, 2023. [14]Bo Liu, Yifeng Zhu, Chongkai Gao, Yihao Feng, Qiang Liu, Yuke Zhu, and Peter Stone. LIBERO: Benchmarking knowledge transfer for lifelong robot learning. Advances in Neural Information Processing Systems, 36:44776â44791, 2023. 26 [15]Xuanlin Li, Kyle Hsu, Jiayuan Gu, Karl Pertsch, Oier Mees, Homer Rich Walke, Chuyuan Fu, Ishikaa Lunawat, Isabel Sieh, Sean Kirmani, Sergey Levine, Jiajun Wu, Chelsea Finn, Hao Su, Quan Vuong, and Ted Xiao. Evaluating real-world robot manipulation policies in simulation. arXiv preprint arXiv:2405.05941, 2024. [16]Tianyuan Yuan, Zibin Dong, Yicheng Liu, and Hang Zhao. Fast-wam: Do world action models need test-time future imagination? arXiv preprint arXiv:2603.16666, 2026. [17]Danny Driess, Jost Springenberg, Brian Ichter, Lili Yu, Adrian Li-Bell, Karl Pertsch, Allen Ren, Homer Walke, Quan Vuong, Lucy Xiaoyang Shi, et al. Knowledge insulating vision-language-action models: Train fast, run fast, generalize better. Advances in Neural Information Processing Systems, 38:102867â102888, 2026. [18]Ankit Goyal, Hugo Hadfield, Xuning Yang, Valts Blukis, and Fabio Ramos. Vla-0: Building state-of-the-art vlas with zero modification. arXiv preprint arXiv:2510.13054, 2025. [19] Yating Wang, Haoyi Zhu, Mingyu Liu, Jiange Yang, Hao-Shu Fang, and Tong He. Vq-vla: Improving vision-language-action models via scaling vector-quantized action tokenizers. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 11089â11099, 2025. [20] Hongyi Zhou, Weiran Liao, Xi Huang, Yucheng Tang, Fabian Otto, Xiaogang Jia, Xinkai Jiang, Simon Hilber, Ge Li, Qian Wang, et al. Beast: Efficient tokenization of b-splines encoded action sequences for imitation learning. Advances in Neural Information Processing Systems, 38:172934â172959, 2026. [21]Seungjae Lee, Yibin Wang, Haritheja Etukuru, H Jin Kim, Nur Muhammad Mahi Shafiullah, and Lerrel Pinto. Behavior generation with latent actions. arXiv preprint arXiv:2403.03181, 2024. [22]Delin Qu, Haoming Song, Qizhi Chen, Yuanqi Yao, Xinyi Ye, Yan Ding, Zhigang Wang, JiaYuan Gu, Bin Zhao, Dong Wang, et al. Spatialvla: Exploring spatial representations for visual-language-action model. arXiv preprint arXiv:2501.15830, 2025. [23] Hao Luo, Ye Wang, Wanpeng Zhang, Sipeng Zheng, Ziheng Xi, Chaoyi Xu, Haiweng Xu, Haoqi Yuan, Chi Zhang, Yiqing Wang, et al. Being-h0. 5: Scaling human-centric robot learning for cross-embodiment generalization. arXiv preprint arXiv:2601.12993, 2026. [24]I Apanasevich, M Artemyev, R Babakyan, P Fedotova, D Grankin, E Kupryashin, A Misailidi, D Nerus, A Nutalapati, G Sidorov, et al. Green-vla: Staged vision-language-action model for generalist robots. arXiv preprint arXiv:2602.00919, 2026. [25]Shuanghao Bai, Meng Li, Xinyuan Lv, Jiawei Wang, Xinhua Wang, Fei Liao, Chengkai Hou, Langzhe Gu, Wanqi Zhou, Kun Wu, et al. Hex: Humanoid-aligned experts for cross-embodiment whole-body manipulation. arXiv preprint arXiv:2604.07993, 2026. [26]Yi Li, Yuquan Deng, Jesse Zhang, Joel Jang, Marius Memmel, Caelan Garrett, Fabio Ramos, Dieter Fox, Anqi Li, Abhishek Gupta, et al. Hamster: Hierarchical action models for open-world robot manipulation. In International Conference on Learning Representations, volume 2025, pages 24040â24068, 2025. [27]MichaĹ Zawalski, William Chen, Karl Pertsch, Oier Mees, Chelsea Finn, and Sergey Levine. Robotic control via embodied chain-of-thought reasoning. arXiv preprint arXiv:2407.08693, 2024. [28]Qi Sun, Pengfei Hong, Tej Deep Pala, Vernon Toh, U-Xuan Tan, Deepanway Ghosal, and Soujanya Poria. Emma-x: An embodied multimodal action model with grounded chain of thought and look-ahead spatial reasoning. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14199â14214, 2025. [29]Ruijie Zheng, Yongyuan Liang, Shuaiyi Huang, Jianfeng Gao, Hal DaumĂŠ I, Andrey Kolobov, Furong Huang, and Jianwei Yang. Tracevla: Visual trace prompting enhances spatial-temporal awareness for generalist robotic policies. In International Conference on Learning Representations, volume 2025, pages 54277â54296, 2025. 27 [30]Qwen Team. Qwen3. 5: Towards native multimodal agents, february 2026. URL https://qwen. ai/blog, 2026. [31] Suneel Belkhale and Dorsa Sadigh. Minivla: A better vla with a smaller footprint, 2024. URL https://github.com/Stanford-ILIAD/openvla-mini. [32]Zibin Dong, Yicheng Liu, Shiduo Zhang, Baijun Ye, Yifu Yuan, Fei Ni, Jingjing Gong, Xipeng Qiu, Hang Zhao, Yinchuan Li, and Jianye Hao. Actioncodec: What makes for good action tokenizers. arXiv preprint arXiv:2602.15397, 2026. [33] Yicheng Liu, Shiduo Zhang, Zibin Dong, Baijun Ye, Tianyuan Yuan, Xiaopeng Yu, Linqi Yin, Chenhao Lu, Junhao Shi, Luca Jiang-Tao Yu, Liangtao Zheng, Jingjing Gong, Tao Jiang, Xipeng Qiu, and Hang Zhao. FASTer: Toward powerful and efficient autoregressive visionâlanguageâaction models with learnable action tokenizer and block-wise decoding. In The Fourteenth International Conference on Learning Representations, ICLR, 2026. [34]Physical Intelligence, Bo Ai, Ali Amin, Raichelle Aniceto, Ashwin Balakrishna, Greg Balke, Kevin Black, George Bokinsky, Shihao Cao, Thomas Charbonnier, et al.í 0.7 : a steerable generalist robotic foundation model with emergent capabilities. arXiv preprint arXiv:2604.15483, 2026. [35]Google DeepMind. Gemini 3 pro model card, 2026. URLhttps://storage.googleapis.com/ deepmind-media/Model-Cards/Gemini-3-Pro-Model-Card.pdf. Model card, last updated May 2026. [36]ByteDance Seed Team. Seed 2.0 official launch, 2026. URLhttps://research.doubao.com/en/blog/ seed-2-0-official-launch. [37]Nicolas Carion, Laura Gustafson, Yuan-Ting Hu, Shoubhik Debnath, Ronghang Hu, Didac Suris, Chaitanya Ryali, Kalyan Vasudev Alwala, Haitham Khedr, Andrew Huang, Jie Lei, Tengyu Ma, Baishan Guo, Arpit Kalla, Markus Marks, Joseph Greer, Meng Wang, Peize Sun, Roman Radle, Triantafyllos Afouras, Effrosyni Mavroudi, Katherine Xu, Tsung-Han Wu, Yu Zhou, Liliane Momeni, Rishi Hazra, Shuangrui Ding, Sagar Vaze, Francois Porcher, Feng Li, Siyuan Li, Aishwarya Kamath, Ho Kei Cheng, Piotr Dollar, Nikhila Ravi, Kate Saenko, Pengchuan Zhang, and Christoph Feichtenhofer. Sam 3: Segment anything with concepts, 2025. URL https://arxiv.org/abs/2511.16719. [38]Haotian Liu, Chunyuan Li, Yuheng Li, Bo Li, Yuanhan Zhang, Sheng Shen, and Yong Jae Lee. Llava-next: Improved reasoning, ocr, and world knowledge, January 2024. URLhttps://llava-vl.github.io/ blog/2024-01-30-llava-next/. [39]Bo Li, Yuanhan Zhang, Dong Guo, Renrui Zhang, Feng Li, Hao Zhang, Kaichen Zhang, Peiyuan Zhang, Yanwei Li, Ziwei Liu, and Chunyuan Li. Llava-onevision: Easy visual task transfer, 2024. URL https://arxiv.org/abs/2408.03326. [40] Wentao Yuan, Jiafei Duan, Valts Blukis, Wilbert Pumacay, Ranjay Krishna, Adithyavairavan Murali, Arsalan Mousavian, and Dieter Fox. Robopoint: A vision-language model for spatial affordance prediction for robotics, 2024. URL https://arxiv.org/abs/2406.10721. [41] Jason Lee, Jiafei Duan, Haoquan Fang, Yuquan Deng, Shuo Liu, Boyang Li, Bohan Fang, Jieyu Zhang, Yi Ru Wang, Sangho Lee, Winson Han, Wilbert Pumacay, Angelica Wu, Rose Hendrix, Karen Farley, Eli VanderBilt, Ali Farhadi, Dieter Fox, and Ranjay Krishna. Molmoact: Action reasoning models that can reason in space, 2025. URL https://arxiv.org/abs/2508.07917. [42]Yuheng Ji, Huajie Tan, Jiayu Shi, Xiaoshuai Hao, Yuan Zhang, Hengyuan Zhang, Pengwei Wang, Mengdi Zhao, Yao Mu, Pengju An, Xinda Xue, Qinghang Su, Huaihai Lyu, Xiaolong Zheng, Jiaming Liu, Zhongyuan Wang, and Shanghang Zhang. Robobrain: A unified brain model for robotic manipulation from abstract to concrete, 2025. URL https://arxiv.org/abs/2502.21257. 28 [43]Alexander Khazatsky, Karl Pertsch, Suraj Nair, Ashwin Balakrishna, Sudeep Dasari, Siddharth Karam- cheti, Soroush Nasiriany, Mohan Kumar Srirama, Lawrence Yunliang Chen, Kirsty Ellis, et al. DROID: A large-scale in-the-wild robot manipulation dataset. arXiv preprint arXiv:2403.12945, 2024. [44]Haoquan Fang, Jiafei Duan, Donovan Clay, Sam Wang, Shuo Liu, Weikai Huang, Xiang Fan, Wei- Chuan Tsai, Shirui Chen, Yi Ru Wang, Shanli Xing, Jaemin Cho, Jae Sung Park, Ainaz Eftekhar, Peter Sushko, Karen Farley, Angad Wadhwa, Cole Harrison, Winson Han, Ying-Chun Lee, Eli VanderBilt, Rose Hendrix, Suveen Ellawela, Lucas Ngoo, Joyce Chai, Zhongzheng Ren, Ali Farhadi, Dieter Fox, and Ranjay Krishna. Molmoact2: Action reasoning models for real-world deployment, 2026. URL https://arxiv.org/abs/2605.02881. [45]Homer Rich Walke, Kevin Black, Tony Z Zhao, Quan Vuong, Chongyi Zheng, Philippe Hansen-Estruch, Andre Wang He, Vivek Myers, Moo Jin Kim, Max Du, et al. Bridgedata v2: A dataset for robot learning at scale. In Conference on Robot Learning, pages 1723â1736. PMLR, 2023. [46]StarVLA Community and Von Neumann Institute, HKUST. Starvla: A lego-like codebase for vision- language-action model developing, 2026. [47]Hao Shi, Bin Xie, Yingfei Liu, Lin Sun, Fengrong Liu, Tiancai Wang, Erjin Zhou, Haoqiang Fan, Xiangyu Zhang, and Gao Huang. Memoryvla: Perceptual-cognitive memory in vision-language-action models for robotic manipulation, 2025. [48]Delin Qu, Haoming Song, Qizhi Chen, Zhaoqing Chen, Xianqiang Gao, Dong Wang, Xinyi Ye, Qi Lv, Modi Shi, Guanghui Ren, Cheng Ruan, Maoqing Yao, Haoran Yang, Jiacheng Bao, Bin Zhao, and Xuelong Li. Eo-1: An open unified embodied foundation model for general robot control. arXiv preprint arXiv:2508.21112, 2026. [49]Rui Cai, Jun Guo, Xinze He, Piaopiao Jin, Jie Li, Bingxuan Lin, Futeng Liu, Wei Liu, Fei Ma, Kun Ma, Feng Qiu, Heng Qu, Yifei Su, Qiao Sun, Dong Wang, Donghao Wang, Yunhong Wang, Rujie Wu, Diyun Xiang, Yu Yang, Hangjun Ye, Yuan Zhang, and Quanyun Zhou. Xiaomi-robotics-0: An open-sourced vision-language-action model with real-time execution. arXiv preprint arXiv:2602.12684, 2026. [50]Hongzhe Bi, Hengkai Tan, Shenghao Xie, Zeyuan Wang, Shuhe Huang, Haitian Liu, Ruowen Zhao, Yao Feng, Chendong Xiang, Yinze Rong, Hongyan Zhao, Hanyu Liu, Zhizhong Su, Lei Ma, Hang Su, and Jun Zhu. Motus: A unified latent action world model. arXiv preprint arXiv:2512.13030, 2025. [51]Lin Li, Qihang Zhang, Yiming Luo, Shuai Yang, Ruilin Wang, Fei Han, Mingrui Yu, Zelin Gao, Nan Xue, Xing Zhu, Yujun Shen, and Yinghao Xu. Causal world modeling for robot control. arXiv preprint arXiv:2601.21998, 2026. [52] Wei Wu, Fan Lu, Yunnan Wang, Shuai Yang, Shi Liu, Fangjing Wang, Qian Zhu, He Sun, Yong Wang, Shuailei Ma, Yiyu Ren, Kejia Zhang, Hui Yu, Jingmei Zhao, Shuai Zhou, Zhenqi Qiu, Houlong Xiong, Ziyu Wang, Zechen Wang, Ran Cheng, Yong-Lu Li, Yongtao Huang, Xing Zhu, Yujun Shen, and Kecheng Zheng. A pragmatic vla foundation model. arXiv preprint arXiv:2601.18692, 2026. [53]Qwen Team. Qwen-vla: Unifying vision-language-action modeling across tasks, environments, and robot embodiments. arXiv preprint arXiv:2605.30280, 2026. [54]Xinyi Chen, Yilun Chen, Yanwei Fu, Ning Gao, Jiaya Jia, Weiyang Jin, Hao Li, Yao Mu, Jiangmiao Pang, Yu Qiao, Yang Tian, Bin Wang, Bolun Wang, Fangjing Wang, Hanqing Wang, Tai Wang, Ziqin Wang, Xueyuan Wei, Chao Wu, Shuai Yang, Jinhui Ye, Junqiu Yu, Jia Zeng, Jingjing Zhang, Jinyu Zhang, Shi Zhang, Feng Zheng, Bowen Zhou, and Yangkun Zhu. Internvla-m1: A spatially guided vision-language-action framework for generalist robot policy. arXiv preprint arXiv:2510.13778, 2025. [55]Andy Zhai, Brae Liu, Bruno Fang, Chalse Cai, Ellie Ma, Ethan Yin, Hao Wang, Hugo Zhou, James Wang, Lights Shi, Lucy Liang, Make Wang, Qian Wang, Roy Gan, Ryan Yu, Shalfun Li, Starrick Liu, Sylas Chen, Vincent Chen, and Zach Xu. Igniting vlms toward the embodied space. arXiv preprint arXiv:2509.11766, 2025. 29 [56] Moo Jin Kim, Chelsea Finn, and Percy Liang. Fine-tuning vision-language-action models: Optimizing speed and success. arXiv preprint arXiv:2502.19645, 2025. [57] Moo Jin Kim, Yihuai Gao, Tsung-Yi Lin, Yen-Chen Lin, Yunhao Ge, Grace Lam, Percy Liang, Shuran Song, Ming-Yu Liu, Chelsea Finn, and Jinwei Gu. Cosmos policy: Fine-tuning video models for visuomotor control and planning. arXiv preprint arXiv:2601.16163, 2026. [58] Ilia Larchenko, Gleb Zarin, and Akash Karnatak. Task adaptation of vision-language-action model: 1st place solution for the 2025 behavior challenge. arXiv preprint arXiv:2512.06951, 2025. [59] Junjie Bai, Yu-Wei Chao, Qizhi Chen, Jinwei Gu, Moo Jin Kim, Zhaoshuo Li, Xuan Li, Tsung-Yi Lin, Ming-Yu Liu, Nic Ma, et al. Openpi comet: Competition solution for 2025 behavior challenge. arXiv preprint arXiv:2512.10071, 2025. [60] Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, YK Li, Yang Wu, et al. Deepseekmath: Pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300, 2024. [61]Chao Yu, Yuanqing Wang, Zhen Guo, Hao Lin, Si Xu, Hongzhi Zang, Quanlu Zhang, Yongji Wu, Chunyang Zhu, Junhao Hu, et al. RLinf: Flexible and efficient large-scale reinforcement learning via macro-to-micro flow transformation. arXiv preprint arXiv:2509.15965, 2025. 30 A Appendix / supplemental material Table 6: Detailed results on the 2025 BEHAVIOR Challenge (50 tasks, 10 instances each). Task Success Score is the challenge ranking metric (task progress). The first place solution by the Robot Learning Collective (RLC) [58] uses a set of 4 checkpoints;í 0.5 [4] (4 epochs) andG0.5each use a single checkpoint, averaged over two eval runs. Best/second best in bold/underline. TaskRLC [58] Comet [59] í 0.5 (4 epochs) [4]G0.5 (1 epoch)G0.5 (4 epochs) assembling gift baskets0.21250.00000.23120.51880.4938 attach camera to tripod0.00000.00000.00000.00000.0000 boxing books for storage0.00000.00000.00000.00000.0000 bringing in wood0.06670.50000.16670.33330.3500 bringing water0.26670.90000.65000.83330.7000 can meat0.00000.00000.0333 0.01110.0444 canning food0.01000.00000.05500.08000.1100 carrying in groceries0.15000.00000.17500.07500.1500 chop an onion0.30000.00000.17500.41250.4000 chopping wood0.10000.00000.08750.23750.2000 clean a patio0.00000.00000.00000.00000.0000 clean a trumpet0.00000.00000.00000.00000.0000 clean boxing gloves0.2000 0.00000.00000.22500.1750 clean desk0.12730.00000.22270.28640.2591 clean plates and food0.18570.00000.38570.17860.1929 clear food to fridge0.08000.00000.08000.18000.2700 collect childrens toys0.43330.00000.42140.5857 0.5929 cook bacon0.75710.00000.42140.07140.3214 cook cabbage0.00000.00000.05000.15000.2000 cook hot dogs0.85001.00000.92500.45000.9000 freeze pies0.01430.15710.1357 0.05710.0429 get organized for work0.02000.00000.02000.1050 0.1100 hanging pictures0.00000.20000.00000.00000.0000 hiding Easter eggs0.1444 0.24440.07780.05000.0500 loading the car0.20000.00000.00000.23330.2833 make microwave popcorn0.90000.70000.95000.15000.5500 make pizza0.00000.00000.00000.00000.0000 move boxes to storage0.6500 1.00000.20000.62500.5500 outfit basic toolbox0.25710.10000.34290.14290.2500 pick up toys0.30000.00000.18330.31670.4083 pick up trash0.66670.76670.55000.81670.8500 prepare lunch box0.51670.00000.54170.56670.5667 put away Halloween decor. 0.20000.50000.37140.48570.5286 put dishes away0.2714 0.00000.52500.13930.2464 put shoes on rack0.50000.54000.36500.64500.5650 put up Christmas decor.0.43330.00000.56110.46670.3889 rearrange kitchen furn.0.30000.37500.38750.35000.3625 set up coffee station0.15000.21670.28330.25000.1917 setting mousetraps0.33330.00000.10830.50830.5667 setting the fire0.32500.20000.07500.31250.1250 slicing vegetables0.18890.00000.22780.44440.2611 sorting household items0.06250.00000.19380.14370.2062 sorting vegetables0.47690.00000.60000.52310.6231 spraying for bugs0.25000.10000.10000.20000.1500 spraying fruit trees0.3000 0.35000.20000.12500.1500 storing food0.37500.00000.57500.49380.6625 tidying bedroom0.40000.00000.35000.56670.6167 turning on radio0.60001.00000.15000.30000.0500 wash a baseball cap0.45000.30000.60000.6500 0.7500 wash dog toys0.00000.00000.37500.22500.2167 Overall0.26050.18300.26260.29040.3136 31 Table 7: Per-task success rates of G0.5 on RoboTwin 2.0 under clean and randomized evaluation settings. TaskClean Rand. Adjust Bottle100100 Beat Block Hammer10096 Blocks Ranking RGB100100 Blocks Ranking Size9696 Click Alarmclock100100 Click Bell100100 Dump Bin Bigbin9496 Grab Roller100100 Handover Block9884 Handover Mic98100 Hanging Mug4056 Lift Pot100100 Move Can Pot9894 Move Pillbottle Pad9696 Move Playingcard Away10098 Move Stapler Pad8070 Open Laptop10098 Open Microwave9288 Pick Diverse Bottles8486 Pick Dual Bottles9688 Place A2B Left9494 Place A2B Right9490 Place Bread Basket9898 Place Bread Skillet9690 Place Burger Fries10098 Place Can Basket6872 Place Cans Plasticbox96100 Place Container Plate10098 Place Dual Shoes8894 Place Empty Cup100100 Place Fan10094 Place Mouse Pad8484 Place Object Basket9092 Place Object Scale9694 Place Object Stand10096 Place Phone Stand9498 Place Shoe9894 Press Stapler9292 Put Bottles Dustbin9090 Put Object Cabinet9090 Rotate QRcode9698 Scan Object10092 Shake Bottle100100 Shake Bottle Horizontally 100100 Stack Blocks Three98100 Stack Blocks Two100100 Stack Bowls Three9486 Stack Bowls Two9690 Stamp Seal8892 Turn Switch7480 Average93.72 92.84 32