Literature
Display
← All papers

GreenWAM: A World Foundation Model for Robotics

Gennady Sidorov · Valerii Kornilov · Denis Grankin · Polina Fedotova · Aleksey Postnikov

Preprint posted · arXiv (preprint) ↗

World models16 min text · CondensedOriginal paper ↗
Contents

At a glance

GreenWAM adapts Cosmos 3 Edge to 20 robot families using a shared anatomical action interface and joint video–action training. The resulting foundation supports action-conditioned prediction and, after benchmark-specific adaptation, robot policies. A copied action expert and retained world-model training modes improve control in controlled comparisons. Results include 86.98% clean/48.10% randomized RoboTwin success, 97.4% LIBERO and 86.8% zero-shot LIBERO-plus success, and 95.6%/84.0% instruction success on one humanoid packing task under familiar/changed conditions. These are separate adapted checkpoints, not one unchanged policy for every benchmark. A distilled student runs at 35.4 ms per call on an RTX 4090, with some success loss.

1 Introduction

World prediction and control share a problem: action coordinates have different meanings across robots. GreenWAM addresses this by mapping native states into common anatomical slots, training seven prediction modes, and deriving policies through an action expert. The robotics stage starts from the action-trained Cosmos 3 Edge [58], broadens its robot coverage, and retains one shared projector. Evaluation separates the unchanged foundation’s predictions on held-out recordings from benchmark-adapted prediction and control. Controlled experiments examine the value of robot specialization, expert separation and continued world-model training; robot-specific execution still requires a codec and downstream adaptation.

Figure 1 From robot experience to prediction and control. (a–b) Video, measured states and text from 20 robot families form aligned subtask examples. (c–d) A shared 79-slot anatomical action space connects robot motion to a joint video–action model built on Cosmos 3 Edge. (e) Forward prediction of GreenWAM for Unitree G1 and AgiBot G2A on held-out recordings (Section 5.1). (f) As a policy, the foundation adds a coupled action expert and is distilled for humanoid control. (g) GreenWAM against the best of three references on every axis (grey dashed outline). Left: policy, against 𝜋0.5 [62], X-VLA [103] and FastWAM [95]; the 𝜋0.5 CALVIN value is the supervised fine-tuned checkpoint reported by 𝜋RL [17], RoboDojo scores come from the official leaderboard [67]. Right: WorldArena 1.0 against Motubrain [56], FlowWAM-FiveAges [21] and UNIS [46]: three categories of the motion-capped score (Section 5.2; for the other models an upper bound) and three fidelity metrics. Every axis starts where its bar chart in Figures 9 and 11 starts, but not below half of its best value, and ends at the best value on that axis.
Figure 1 From robot experience to prediction and control. (a–b) Video, measured states and text from 20 robot families form aligned subtask examples. (c–d) A shared 79-slot anatomical action space connects robot motion to a joint video–action model built on Cosmos 3 Edge. (e) Forward prediction of GreenWAM for Unitree G1 and AgiBot G2A on held-out recordings (Section 5.1). (f) As a policy, the foundation adds a coupled action expert and is distilled for humanoid control. (g) GreenWAM against the best of three references on every axis (grey dashed outline). Left: policy, against 𝜋0.5 [62], X-VLA [103] and FastWAM [95]; the 𝜋0.5 CALVIN value is the supervised fine-tuned checkpoint reported by 𝜋RL [17], RoboDojo scores come from the official leaderboard [67]. Right: WorldArena 1.0 against Motubrain [56], FlowWAM-FiveAges [21] and UNIS [46]: three categories of the motion-capped score (Section 5.2; for the other models an upper bound) and three fidelity metrics. Every axis starts where its bar chart in Figures 9 and 11 starts, but not below half of its best value, and ends at the best value on that axis.

2 Related Work

Related approaches specialize video foundations for robotics [58, 25, 27], share experience across embodiments [60, 59, 22], or generate both video and actions [104, 92, 42]. GreenWAM makes anatomical correspondence explicit before projection; unlike image-space action maps [63], joint slots can describe fingers and moving-camera robots without rendering calibrated markers. Its action expert begins as a copy of the generator, preserving the initial function. Four fixed history anchors enable continuation, while training uses recorded history. Table 1 compares reported capabilities rather than ranking model quality.

Figure 2 Robot data and action types of Cos- mos 3 [58] and GreenWAM: shares of robot hours (top; AgiBot World supplies 81% of the robot hours of Cosmos 3, the largest GreenWAM family 15% of ours) and action representations (bottom).
Figure 2 Robot data and action types of Cos- mos 3 [58] and GreenWAM: shares of robot hours (top; AgiBot World supplies 81% of the robot hours of Cosmos 3, the largest GreenWAM family 15% of ours) and action representations (bottom).
Table 1 Closest technical reports by the capabilities of the model they present. A mark means the report presents the model in that role; it does not rank quality. Actions→video: generation conditioned on robot actions (forward dynamics, action-conditioned simulation); Video→actions: inverse dynamics; Policy: joint prediction of video and actions used for control; Long rollout: autoregressive continuation with memory of past blocks; Real robot: experiments on a physical robot, for GreenWAM on the Green humanoid (Section 6.5).
Table 1 Closest technical reports by the capabilities of the model they present. A mark means the report presents the model in that role; it does not rank quality. Actions→video: generation conditioned on robot actions (forward dynamics, action-conditioned simulation); Video→actions: inverse dynamics; Policy: joint prediction of video and actions used for control; Long rollout: autoregressive continuation with memory of past blocks; Real robot: experiments on a physical robot, for GreenWAM on the Green humanoid (Section 6.5).

3 GreenWAM

Layout-specific codecs map robot states into common coordinates. A shared generator predicts video, motion, or both; downstream policies add a coupled action expert.

3.1 Model Overview

The model starts from Cosmos 3 Edge 4B [58]: a mixture-of-transformers reasoner/generator with a causal video VAE and rectified flow [50]. During robotics training, the reasoner and VAE remain frozen; the generator, shared action projections and modality embeddings train. State and video tokens share the generator until policy adaptation introduces an action expert. Prompts retain the parent’s JSON structure.

Figure 3 GreenWAM architecture, shown for the world–action (WAM) mode on one held-out Green humanoid episode. The task instruction, the multi-camera canvas and the robot’s native joint state at 𝑡= 0 enter a frozen reasoner, a trained generator for the video tokens and, in the adapted policy, an action expert for the state and action tokens, all sharing multimodal attention (the Cosmos 3 Edge mixture of transformers); the layout’s codec maps the native joints to the 79 anatomical slots before the shared input projection (Figure 4). In GreenWAM the state and action tokens pass through the generator; the action expert is split off it for policy adaptation (Section 6.1). Filled tokens are clean conditions and dashed tokens are noised targets; which streams are conditions changes with the mode (Figure 29). Predicted state targets are decoded relative to 𝑞0 (Equation (2)) and mapped back to native joint states. Video: ground truth (top) and the GreenWAM prediction (bottom). Frozen and trained refer to the robotics stage.
Figure 3 GreenWAM architecture, shown for the world–action (WAM) mode on one held-out Green humanoid episode. The task instruction, the multi-camera canvas and the robot’s native joint state at 𝑡= 0 enter a frozen reasoner, a trained generator for the video tokens and, in the adapted policy, an action expert for the state and action tokens, all sharing multimodal attention (the Cosmos 3 Edge mixture of transformers); the layout’s codec maps the native joints to the 79 anatomical slots before the shared input projection (Figure 4). In GreenWAM the state and action tokens pass through the generator; the action expert is split off it for policy adaptation (Section 6.1). Filled tokens are clean conditions and dashed tokens are noised targets; which streams are conditions changes with the mode (Figure 29). Predicted state targets are decoded relative to 𝑞0 (Equation (2)) and mapped back to native joint states. Video: ground truth (top) and the GreenWAM prediction (bottom). Frozen and trained refer to the robotics stage.

3.2 Shared Anatomical Action Space

A codec selects, reorders, signs and normalizes native channels into 79 anatomical slots: 12 legs, 23 body, 18 arms and 26 hands. Missing or unresolved coordinates are masked out of the loss. Matching tensor positions therefore mean matching anatomical motions rather than padded native indices; all families use shared projectors.

Inverse dynamics predicts absolute states, including the initial state. Forward dynamics and WAM usually express major joints relative to the block’s initial state while keeping hands/grippers absolute; these offsets are neither velocities nor accumulated increments. The Green layout makes its whole state relative. When reliable Cartesian end-effector data exist, the sampler chooses joint or EEF views equally without duplicating the window’s probability. Cartesian poses use separate slots and SE(3) composition; the additive equations apply to joints, and the projector performs no kinematics.

Figure 4 Shared 79-slot anatomical action space. Top: the codec of one layout selects its native channels, puts them in slot order and flips signs and shifts zeros where needed, so that a slot means the same joint motion on every robot, for example the same positive direction of the left shoulder roll; three of the fourteen Worker channels are shown. A shared input projection maps the slot vector to state tokens. Bottom: slots filled by eight source layouts; empty slots are masked in the loss.
Figure 4 Shared 79-slot anatomical action space. Top: the codec of one layout selects its native channels, puts them in slot order and flips signs and shifts zeros where needed, so that a slot means the same joint motion on every robot, for example the same positive direction of the left shoulder roll; three of the fourteen Worker channels are shown. A shared input projection maps the slot vector to state tokens. Bottom: slots filled by eight source layouts; empty slots are masked in the loss.
Equations 1–2
(1)Equation 1.
(2)Equation 2.

3.3 Joint Video–Action Modeling

Seven modes differ in which streams are clean conditions and which are generated targets. Every generated stream in an example shares a noise level and masked rectified-flow velocity objective. WAM jointly predicts video and state offsets from initial video/state and instructions. History modes continue video from four anchors, optionally conditioned on commanded states. Table 2 gives the exact mixture: 75% of examples predict video without generating actions; 25% generate states through inverse dynamics or WAM. Eligibility depends on available modalities, accepted text and outcome labels. Visual/dynamics modes use complete subtasks, while WAM uses short windows inside successful demonstrations.

Table 2 Training modes. Shares are sampling probabilities over examples, not over tokens or compute.
Table 2 Training modes. Shares are sampling probabilities over examples, not over tokens or compute.
Equations 3–4
(3)Equation 3.
(4)Equation 4.

3.4 Multi-View Observations and Temporal Context

Three-camera recordings become a single canvas with the head view above left/right wrist views; five resolution buckets limit distortion without cropping. Source-specific motion checks establish camera roles. Autoregressive prediction uses independently encoded anchors at the start, one-third, two-thirds and end of available history, repeating the initial frame when necessary. Training uses recorded history, but inference feeds back generated frames. History crosses adjacent accepted subtasks and resets at rejected gaps or episode boundaries.

Figure 5 Training canvases of five robot families. From left: Unitree G1 and AIRBOT MMK2 with dexterous hands, RealMan AIDAL, AgileX Cobot Magic and AgiBot G2 with grippers; all recorded on real robots except AgiBot G2, which comes from simulation. The head camera occupies the top two thirds of the canvas, and the left and right wrist cameras share the bottom row (dashed lines); each view is resized to its panel without cropping. All five use the 640×640 canvas, the most frequent of the five canvas sizes.
Figure 5 Training canvases of five robot families. From left: Unitree G1 and AIRBOT MMK2 with dexterous hands, RealMan AIDAL, AgileX Cobot Magic and AgiBot G2 with grippers; all recorded on real robots except AgiBot G2, which comes from simulation. The head camera occupies the top two thirds of the canvas, and the left and right wrist cameras share the bottom row (dashed lines); each view is resized to its panel without cropping. All five use the 640×640 canvas, the most frequent of the five canvas sizes.

4 Robot Experience and Training

The data pipeline aligns video, measured states and language within complete annotated subtasks, filters unusable clips, and derives separate visual descriptions and prospective commands.

4.1 Cross-Embodiment Corpus

The corpus contains 20 two-armed robot families, including humanoids, gripper platforms and dexterous hands, across real and simulated data. Public and internal datasets are converted to LeRobot format [13]. Its training unit is a provenance-tracked subtask “atom” with synchronized views, states and text.

4.2 Data Curation and Training Mixture

Registration fixes camera roles, state semantics and robot properties. Annotation-based segmentation admits 1.44 million atoms/1,688.5 hours; quality filtering retains 1.43 million/1,674.7 hours. Captioning accepts 1.24 million visual descriptions, and command derivation accepts 1.19 million commands. Ambiguous boundaries and overlong atoms are rejected rather than arbitrarily clipped.

Qwen3.8-27B [64] writes a structured, field-by-field visual record. An attempt check describes the actual ending before action phases are written, preventing incomplete demonstrations from becoming claimed successes. A text-only pass converts those phases into prospective commands without seeing native operator instructions. Video modes use descriptions; forward dynamics/WAM use commands; inverse dynamics uses a fixed instruction. WAM requires positive success labels, whereas other eligible modes can use failures. Action targets come from measured states, not heterogeneous recorded command columns. Sampling chooses mode, robot cluster, dataset and window, with boosted shares for Worker/ARX5 and Green.

Figure 6 Robot data. (a) The corpus: 20 robot families, 1 688.5 h after admission, 74% real, all two-armed, in three embodiment groups; each group is shown by a head-camera frame whose width is proportional to its hours. (b) Episodes are cut into subtask clips (atoms) at annotated subtask boundaries within length limits (Equation (10)) (1.44 million clips, 1 688.5 h); video-quality filtering removes idle, duplicated, cut and undecodable clips (1.43 million clips, 1 674.7 h). (c) One clip (RoboCOIN, Unitree G1 with dexterous hands, real), shown at the boundaries of its action phases. Its visual description and derived command are quoted in part, verbatim; its recorded state trajectory shows the three joints that move most of the left arm and of the left hand, each scaled to its own range. Arrows name the training modes that use each output, with their shares of examples (Table 2); the state trajectory serves all three action modes, as a condition of forward dynamics and as the target of world–action prediction and inverse dynamics, so the shares overlap.
Figure 6 Robot data. (a) The corpus: 20 robot families, 1 688.5 h after admission, 74% real, all two-armed, in three embodiment groups; each group is shown by a head-camera frame whose width is proportional to its hours. (b) Episodes are cut into subtask clips (atoms) at annotated subtask boundaries within length limits (Equation (10)) (1.44 million clips, 1 688.5 h); video-quality filtering removes idle, duplicated, cut and undecodable clips (1.43 million clips, 1 674.7 h). (c) One clip (RoboCOIN, Unitree G1 with dexterous hands, real), shown at the boundaries of its action phases. Its visual description and derived command are quoted in part, verbatim; its recorded state trajectory shows the three joints that move most of the left arm and of the left hand, each scaled to its own range. Arrows name the training modes that use each output, with their shares of examples (Table 2); the state trajectory serves all three action modes, as a condition of forward dynamics and as the target of world–action prediction and inverse dynamics, so the shares overlap.
Figure 7 Captioner and command pass. The inputs are the head-camera clip of Figure 6c with its duration, subtask label, embodiment, effector and domain. The captioner (Qwen3.8-27B [64]) writes nine fields in one dialogue, one field per turn; the attempt record and the consistency field (red) are checks and never enter a training prompt. Blue dots mark the fields that form the visual description (fields from subjects through context, action phases and the temporal caption); green dots mark the fields the command pass reads (context, action phases and the temporal caption). Content gates test forbidden phrases, the effector against the registry, and contact and completion claims against the attempt record; a failing field is rewritten at most twice, and the whole dialogue is attempted at most four times. The command pass turns the action phases into one command per phase, keeping all phases in order; shown are the opening words of the three commands derived for the input clip. Bottom: the visual description conditions text-to-video and image-to-video, the command conditions forward dynamics and world–action prediction, and inverse dynamics receives a fixed instruction.
Figure 7 Captioner and command pass. The inputs are the head-camera clip of Figure 6c with its duration, subtask label, embodiment, effector and domain. The captioner (Qwen3.8-27B [64]) writes nine fields in one dialogue, one field per turn; the attempt record and the consistency field (red) are checks and never enter a training prompt. Blue dots mark the fields that form the visual description (fields from subjects through context, action phases and the temporal caption); green dots mark the fields the command pass reads (context, action phases and the temporal caption). Content gates test forbidden phrases, the effector against the registry, and contact and completion claims against the attempt record; a failing field is rewritten at most twice, and the whole dialogue is attempted at most four times. The command pass turns the action phases into one command per phase, keeping all phases in order; shown are the opening words of the three commands derived for the input clip. Bottom: the visual description conditions text-to-video and image-to-video, the command conditions forward dynamics and world–action prediction, and inverse dynamics receives a fixed instruction.
Equation 5
(5)Equation 5.

4.3 GreenWAM Training

Rectified-flow training averages video errors over valid elements. State errors average within anatomical groups and then across present groups, preventing high-dimensional hands from dominating solely by coordinate count. Video and state losses have equal weights, scaled by 10; clean conditions and missing coordinates receive no loss. Text drops with probability 0.1 for classifier-free guidance [32]. The frozen-reasoner/VAE setup trains on 64 H100 GPUs with batch 256. The released foundation is the 36,500-step checkpoint, representing 9.34 million sampled examples; downstream adaptations start from it.

Equation 6
(6)Equation 6.

5 GreenWAM as a World Model

World-model tests use the generator without the action expert. The first experiment uses the unchanged robotics checkpoint; the WorldArena comparison uses an adapted checkpoint.

5.1 The Robotics Checkpoint on Held-Out Recordings

Qualitative prediction uses one held-out recording for each of six families, with the Green humanoid shown in both simulation and reality. The model conditions on an initial frame and recorded states. Scaling displacement by 0, 0.5, 1 or 1.5 scales generated motion: zero commands retain under one-fifth of normal frame-to-frame motion; 1.5× commands increase it by roughly one-quarter. These examples demonstrate action following within represented families, not zero-shot control of unseen bodies.

Figure 8 Action following. One start frame of Unitree G1 (head camera) predicted forward with the recorded state offsets scaled by 0, 0.5, 1 and 1.5; each column shows the halfway point (top) and the end (bottom) of the prediction. With zero offsets the bread stays on the table; with the other three scales it ends on the plate, and at the halfway point the larger the scale, the further the arm has moved.
Figure 8 Action following. One start frame of Unitree G1 (head camera) predicted forward with the recorded state offsets scaled by 0, 0.5, 1 and 1.5; each column shows the halfway point (top) and the end (bottom) of the prediction. With zero offsets the bread stays on the table; with the other three scales it ends on the plate, and at the halfway point the larger the scale, the further the arm has moved.

5.2 WorldArena Adaptation and Results

After adaptation on permitted clean RoboTwin demonstrations, GreenWAM predicts 1,000 WorldArena 1.0 test episodes using recorded actions and history, an empty text prompt and 35 sampling steps. Reported trajectory, depth and 3D accuracies are 56.0, 98.2 and 93.4, strongest among the selected compared world–action/video generators. JEPA similarity is second among all 127 listed entries.

The authors recompute an aggregate that caps dynamic degree, flow and motion smoothness at recorded-video values. GreenWAM receives per-video caps; competitors receive caps applied to published metric means, which yield upper bounds for their scores. The resulting 63.31 is not the official WorldArena 1.0 leaderboard score and is below some selected models. Several appearance/judge metrics reward generated videos above recordings themselves; high scores on those axes need not mean better agreement with actual motion. Appendix C states omitted comparisons and evaluator details.

Figure 9 WorldArena 1.0, track 1: GreenWAM among models of the leaderboard. Fidelity: agreement with the ground-truth video. JEPA similarity compares the distributions of V-JEPA features of real and generated videos at the set level (JEDi [54]; higher is better); trajectory and depth accuracy are computed per video. Overall and categories: EWMScore (Equation (7)), the mean of the 15 board metrics with dynamic degree, flow score and motion smoothness capped at the ground truth, and three of its categories. GreenWAM is capped per video on all 1 000 test episodes; for the other models the caps are applied to their leaderboard means [84], which gives them an upper bound. Controllability, visual quality and motion quality also enter EWMScore and are listed with all categories in Table 11. Cut marks identify axes that do not start at zero.
Figure 9 WorldArena 1.0, track 1: GreenWAM among models of the leaderboard. Fidelity: agreement with the ground-truth video. JEPA similarity compares the distributions of V-JEPA features of real and generated videos at the set level (JEDi [54]; higher is better); trajectory and depth accuracy are computed per video. Overall and categories: EWMScore (Equation (7)), the mean of the 15 board metrics with dynamic degree, flow score and motion smoothness capped at the ground truth, and three of its categories. GreenWAM is capped per video on all 1 000 test episodes; for the other models the caps are applied to their leaderboard means [84], which gives them an upper bound. Controllability, visual quality and motion quality also enter EWMScore and are listed with all categories in Table 11. Cut marks identify axes that do not start at zero.
Figure 10 Long WorldArena rollouts. Two test episodes of WorldArena 1.0, “open the flap” and “move the bottles”, each over 20 s, with the recording above the prediction of GreenWAM at six moments. Only the first frame, outlined, comes from the recording; the model then follows the recorded actions in blocks of about 7 s, each conditioned on four of its own generated frames.
Figure 10 Long WorldArena rollouts. Two test episodes of WorldArena 1.0, “open the flap” and “move the bottles”, each over 20 s, with the recording above the prediction of GreenWAM at six moments. Only the first frame, outlined, comes from the recording; the model then follows the recorded actions in blocks of about 7 s, each conditioned on four of its own generated frames.
Equation 7
(7)Equation 7.

6 GreenWAM as a Policy

Control predicts future states together with video, executes a decoded action chunk and replans. Each benchmark has its own adaptation data, command interface and inference settings.

6.1 Policy Architecture

For policy adaptation, action tokens move into a transformer copied exactly from the generator. Video and action streams retain shared attention at every layer but develop separate feed-forward parameters. The copy preserves initial predictions, then specializes through training. It adds one generator-sized tower and roughly 8% training-step time; the comparison isolates this parameterization change at a fixed adaptation budget.

Equation 8
(8)Equation 8.

6.2 Policy Post-Training

Policies learn from target-robot demonstrations, conditioning on instruction, camera canvas and measured state. Predicted offsets decode into native commands; a robot-specific controller executes a prefix before observing again. RoboTwin background replacement uses simulator segmentation and preserves original shading, while independent camera color augmentation changes appearance without altering state/action targets. These augmentations create no new trajectories or geometric corrections.

6.3 Simulation Benchmarks

RoboTwin, CALVIN, RoboDojo and LIBERO are absent from the robotics-stage corpus, then used for benchmark-specific adaptation. Baselines are published reports/leaderboard values, with differing pretraining noted in the tables. The results therefore compare complete methods, not uniformly matched pretraining budgets.

Figure 11 Manipulation benchmarks. GreenWAM (first bar of each panel) and selected baselines from Tables 3, 12 and 13 and from published LIBERO [48] and LIBERO-plus [24] results. RoboTwin reports mean clean/randomized success over 50 tasks with 100 trials per task; pretraining on randomized RoboTwin scenes is marked in Table 3. LIBERO reports the average success over its four task suites and LIBERO-plus the zero-shot success over all perturbed episodes; GreenWAM values on both come from the same policy (Table 14). LIBERO and LIBERO-plus values and their sources are listed in Table 14. Cut marks identify axes that do not start at zero.
Figure 11 Manipulation benchmarks. GreenWAM (first bar of each panel) and selected baselines from Tables 3, 12 and 13 and from published LIBERO [48] and LIBERO-plus [24] results. RoboTwin reports mean clean/randomized success over 50 tasks with 100 trials per task; pretraining on randomized RoboTwin scenes is marked in Table 3. LIBERO reports the average success over its four task suites and LIBERO-plus the zero-shot success over all perturbed episodes; GreenWAM values on both come from the same policy (Table 14). LIBERO and LIBERO-plus values and their sources are listed in Table 14. Cut marks identify axes that do not start at zero.

6.3.1 RoboTwin 2.0

Training uses 50 clean demonstrations per task across 50 tasks. On 100 official-seed trials per task and condition, GreenWAM reaches 86.98% clean and 48.10% randomized success, averaging 67.54%. Some baseline pretrained checkpoints include randomized RoboTwin demonstrations; Table 3 marks this difference. Controlled 3,000-step comparisons attribute gains to the specialized initialization and expert architecture, separately from the final leaderboard recipe.

Figure 12 RoboTwin 2.0 rollouts of the GreenWAM policy. The task stack_blocks_two in a clean (top) and a randomized scene (bottom). Head-camera frames at six phases: start, red block grasped, red block placed, green block grasped, green block carried, tower built. Both episodes succeed.
Figure 12 RoboTwin 2.0 rollouts of the GreenWAM policy. The task stack_blocks_two in a clean (top) and a randomized scene (bottom). Head-camera frames at six phases: start, red block grasped, red block placed, green block grasped, green block carried, tower built. Both episodes succeed.
Table 3 RoboTwin 2.0, 50 tasks. Average success rate, %.
Table 3 RoboTwin 2.0, 50 tasks. Average success rate, %.

6.3.2 CALVIN

Training uses environments A–C only; evaluation uses 1,000 five-instruction chains in unseen D. GreenWAM averages 4.64 completed instructions, with an approximately 0.03 standard error. It exceeds several reported baselines but not the strongest entries in Table 12.

6.3.3 RoboDojo

RoboDojo weights five capability dimensions equally. Following its official training protocol, GreenWAM scores 16.12 and reaches 10.49% success, above the displayed π0.5, X-VLA and X-WAM entries but below leading leaderboard methods. These are simulation benchmark results; the broader benchmark also contains real-world tasks.

6.3.4 LIBERO and LIBERO-plus

One LIBERO-adapted policy reaches 97.4% on the four standard suites and 86.8% on all 10,030 LIBERO-plus perturbed episodes, the highest zero-shot perturbation result in Table 14. “Zero-shot” means no LIBERO-plus training, not no LIBERO adaptation. The single-arm Franka is absent from the two-armed robotics corpus but uses the shared interface during adaptation. Success is strongest for lighting/noise/language; initial robot state remains hardest at 67.5%. Viewpoint changes yield 81.7%.

Figure 13 LIBERO-plus by axis. Zero-shot success; baselines from [52].
Figure 13 LIBERO-plus by axis. Zero-shot success; baselines from [52].

6.4 Distillation for Real-Time Control

Following Flash-WAM [4], a frozen teacher, online student and EMA target train a one-step joint video/action policy. Both modalities share a four-level noise schedule; teacher guidance applies to video, not actions. Separate consistency losses plus a small action flow-matching term keep predictions anchored to demonstrations.

Caching, packed guidance, first-frame VAE encoding, compilation and W8A8 quantization reduce latency from 435.9 to 134.6 ms. Distillation then reaches 35.4 ms/28.3 Hz: 3.8× faster than that optimized teacher, or 12.3× faster than the unoptimized baseline. These are RTX 4090 measurements; onboard deployment remains future work. Faster inference comes with reduced humanoid instruction success.

Figure 14 Consistency distillation of the policy. The losses are those of Equation (9). (a) One step on the shared noise path: the teacher steps from 𝑥𝑠to ̃𝑥𝑒between neighboring anchors of the schedule, and the student at 𝑥𝑠and the exponential-moving-average (EMA) target at ̃𝑥𝑒must give the same clean estimate. (b) Training: a frozen teacher, the trained student and its EMA copy as the target; video and action consistency losses and an action flow-matching term, with the gradient to the student only. (c) On the robot the student replaces the teacher’s guided multi-step sampling with one step and one pass. The recipe follows Flash-WAM [4], with one noise level for both streams and an added action flow-matching term.
Figure 14 Consistency distillation of the policy. The losses are those of Equation (9). (a) One step on the shared noise path: the teacher steps from 𝑥𝑠to ̃𝑥𝑒between neighboring anchors of the schedule, and the student at 𝑥𝑠and the exponential-moving-average (EMA) target at ̃𝑥𝑒must give the same clean estimate. (b) Training: a frozen teacher, the trained student and its EMA copy as the target; video and action consistency losses and an action flow-matching term, with the gradient to the student only. (c) On the robot the student replaces the teacher’s guided multi-step sampling with one step and one pass. The recipe follows Flash-WAM [4], with one noise level for both streams and an added action flow-matching term.
Figure 15 Policy inference latency on one NVIDIA RTX 4090. Median latency per policy call over 100 episodes. The optimizations are applied cumulatively to the GreenWAM policy; the light segment of each row is the time removed by that step. Speed-ups are relative to GreenWAM without optimizations; Table 10 also gives the time to the first action.
Figure 15 Policy inference latency on one NVIDIA RTX 4090. Median latency per policy call over 100 episodes. The optimizations are applied cumulatively to the GreenWAM policy; the light segment of each row is the time removed by that step. Speed-ups are relative to GreenWAM without optimizations; Table 10 also gives the time to the first action.
Equation 9
(9)Equation 9.

6.5 Real-World Humanoid Evaluation

Four policies adapt on the same demonstration split for a Green humanoid packing task, with common cameras and controlled joints but model-specific preprocessing and action recipes. Five consecutive instructions grasp/place a cap and bottle and lift the bag, without scene resets between instructions. Each policy gets 45 ID and 25 OOD instructions across 14 configurations, one attempt each; OOD changes objects or scene conditions.

GreenWAM reaches 95.6% ID/84.0% OOD instruction success, versus Cosmos 3 Edge’s 88.9%/80.0% and π0.5’s 84.4%/76.0%. The distilled student reaches 91.1%/80.0%. These small, single-task results measure individual instructions rather than whole five-step task completion; the illustrative handover is not an extra evaluated instruction.

Figure 16 GreenWAM policy inference on the Green humanoid. Eight frames of one continuous episode, cropped from a side camera: the robot puts a cap and a bottle into a bag, lifts the bag by its handles and hands it to a person. Colors mark the three subtasks.
Figure 16 GreenWAM policy inference on the Green humanoid. Eight frames of one continuous episode, cropped from a side camera: the robot puts a cap and a bottle into a bag, lifts the bag by its handles and hands it to a person. Colors mark the three subtasks.
Figure 17 Instruction success on the Green humanoid. In-distribution and out-of-distribution success of the four policies, the fraction of successful instructions within each split (Equation (14)). The teacher and the distilled student run with the same execution settings.
Figure 17 Instruction success on the Green humanoid. In-distribution and out-of-distribution success of the four policies, the fraction of successful instructions within each split (Equation (14)). The teacher and the distilled student run with the same execution settings.

7 Empirical Analysis

Paired comparisons hold downstream data, adaptation budget, sampler and evaluation seeds fixed. Robot specialization and expert comparisons train for 3,000 steps; retained-mode comparisons continue the same checkpoint for 2,500. Task/episode hierarchical bootstrap intervals quantify evaluation uncertainty for the chosen checkpoints, not variation across independent training runs.

Figure 18 Controlled comparisons at a fixed budget. Paired differences (Equation (15)) with 95% intervals from a hierarchical bootstrap over tasks and episodes; the sign is the choice made in GreenWAM minus the alternative, and teal marks intervals that exclude zero. World model: forward PSNR on 50 held-out RoboTwin windows, and first-block PSNR and capped EWMScore on the 1 000 WorldArena test episodes, bootstrapped over episodes; each column has its own scale. Policy: RoboTwin 2.0 success over 50 tasks with 20 trials per task and setting. World-model modes: WAM with visual prediction, that is forward dynamics and image-to-video with weights 0.05 each next to WAM at 0.9, compared with WAM only. Q1: robot specialization, GreenWAM against Cosmos 3 Edge; Q2: an action expert against a single tower, both from GreenWAM; Q3: world-model modes kept during policy adaptation. The row Q1 + Q2 compares GreenWAM with an action expert split off at the start against the single-tower Cosmos 3 Edge run; each pair is estimated on the common seeds of its two runs (Equation (15)), so this row need not equal the sum of Q1 and Q2.
Figure 18 Controlled comparisons at a fixed budget. Paired differences (Equation (15)) with 95% intervals from a hierarchical bootstrap over tasks and episodes; the sign is the choice made in GreenWAM minus the alternative, and teal marks intervals that exclude zero. World model: forward PSNR on 50 held-out RoboTwin windows, and first-block PSNR and capped EWMScore on the 1 000 WorldArena test episodes, bootstrapped over episodes; each column has its own scale. Policy: RoboTwin 2.0 success over 50 tasks with 20 trials per task and setting. World-model modes: WAM with visual prediction, that is forward dynamics and image-to-video with weights 0.05 each next to WAM at 0.9, compared with WAM only. Q1: robot specialization, GreenWAM against Cosmos 3 Edge; Q2: an action expert against a single tower, both from GreenWAM; Q3: world-model modes kept during policy adaptation. The row Q1 + Q2 compares GreenWAM with an action expert split off at the start against the single-tower Cosmos 3 Edge run; each pair is estimated on the common seeds of its two runs (Equation (15)), so this row need not equal the sum of Q1 and Q2.

7.1 What Robot Specialization Brings to Each Role

Compared with adapting Cosmos 3 Edge, the robot-specialized initialization improves WorldArena prediction: 87.1% of episodes are closer to the recording, PSNR rises about 1.1–1.2 dB, trajectory accuracy rises from 44.4 to 47.4 and depth accuracy from 96.65 to 97.12. Those fixed-budget values differ from the final adapted model’s scores. The parent must learn joint-space projections from scratch.

On RoboTwin, specialization raises mean policy success by 5.4 percentage points at 3,000 steps and improves prediction on 38/50 held-out clips. Adding the expert widens the mean advantage to 8.4 points. Similar final validation losses do not erase the closed-loop success gap; the extra robotics-stage cost is not matched in this comparison.

Figure 19 Forward PSNR per held-out clip of the poli- cies from GreenWAM and from Cosmos 3 Edge: 38 of 50 RoboTwin clips lie above the diagonal.
Figure 19 Forward PSNR per held-out clip of the poli- cies from GreenWAM and from Cosmos 3 Edge: 38 of 50 RoboTwin clips lie above the diagonal.
Figure 20 Gain over Cosmos 3 Edge during adaptation. Mean RoboTwin 2.0 success (Figure 18).
Figure 20 Gain over Cosmos 3 Edge during adaptation. Mean RoboTwin 2.0 success (Figure 18).

7.2 Coupling the World Model to Action

Copying an action expert at adaptation start improves mean success by 3.3 percentage points over the shared tower, with 2.8 clean/3.7 randomized points. Both start with identical predictions and nearly match final validation loss. The expert trades extra parameters and modest per-step cost for improved control.

7.3 Retaining World-Model Modes during Policy Adaptation

Continuing with 90% WAM, 5% forward dynamics and 5% image-to-video improves randomized success by 8.0 percentage points versus WAM alone, without a significant clean-scene change. Both variants already predict video in WAM; the gain concerns retaining separate world-model modes. It improves 31/50 randomized tasks and worsens nine.

Figure 21 Per-task effect of visual prediction. Randomized RoboTwin success per task, 20 trials, with and without forward dynamics and image- to-video.
Figure 21 Per-task effect of visual prediction. Randomized RoboTwin success per task, 20 trials, with and without forward dynamics and image- to-video.

7.4 What the Policy Imagines

Decoded video predictions reveal different failure patterns. In clean scenes, a review finds 19/20 sampled failures accurately predict the wrong action’s outcome: knowing what will happen does not ensure choosing a successful action. Under randomization, 13/20 failures involve distorted prediction or mistaking distractors for targets. Randomized success falls from 85% to 27% across increasing prediction-error groups; early prediction accuracy also correlates with eventual success. These observations support, but do not independently establish causation for, the benefit of retained world-model training.

Figure 22 What the RoboTwin policy imagines while it acts. A success and a failure in clean scenes (in distribution) and in randomized scenes (out of distribution). For each episode, the head-camera frame rendered after an action chunk is executed (top strip) and the frame the policy predicted for the same moment in the WAM mode (bottom strip), at four moments from the start to the end of the episode; LPIPS is the mean over the episode. In the clean failure the policy imagines the outcome of its actions correctly, including the wrong order in which the blocks end; in the randomized failure the imagined scene departs from the executed one.
Figure 22 What the RoboTwin policy imagines while it acts. A success and a failure in clean scenes (in distribution) and in randomized scenes (out of distribution). For each episode, the head-camera frame rendered after an action chunk is executed (top strip) and the frame the policy predicted for the same moment in the WAM mode (bottom strip), at four moments from the start to the end of the episode; LPIPS is the mean over the episode. In the clean failure the policy imagines the outcome of its actions correctly, including the wrong order in which the blocks end; in the randomized failure the imagined scene departs from the executed one.
Figure 23 Prediction error and success on RoboTwin 2.0. LPIPS between the predicted and the executed head-camera frames, averaged over each episode. Left: successful and failed episodes in clean and randomized scenes (box: quartiles; line: median). Right: success rate in this run of the episodes grouped by their mean error (below 0.03, 0.03–0.05, 0.05–0.07 and above 0.07), drawn at the median error of each group.
Figure 23 Prediction error and success on RoboTwin 2.0. LPIPS between the predicted and the executed head-camera frames, averaged over each episode. Left: successful and failed episodes in clean and randomized scenes (box: quartiles; line: median). Right: success rate in this run of the episodes grouped by their mean error (below 0.03, 0.03–0.05, 0.05–0.07 and above 0.07), drawn at the median error of each group.

7.5 Robustness to Scene Randomization

Single-axis tests on nonofficial seeds find background textures and table-height changes cause the largest drops, 12 and eight percentage points; distractors/lighting change success by under one point. Appearance augmentation cannot teach the different motions required by altered geometry. Small joint errors strongly reduce expert replay success, and replanning after eight rather than 16 steps lowers clean success by 14.8 points. Background replacement improves randomized success by 13.1 points in the selected paired comparison without changing clean success.

Figure 24 Randomization axes of RoboTwin 2.0. One scene of stack_blocks_two right after reset, without a policy, under each axis: background textures, table height (lowered by up to 3 cm in the official setting, raised or lowered by 3 cm in our test), distractor objects on the table, lighting color and intensity, and all axes together as in the official randomized setting. All tiles use the head camera except table height, which is barely visible there and is shown from the left wrist camera; the dashed line marks the table edge of the clean scene. The scene is generated anew for each setting, so object positions differ between tiles.
Figure 24 Randomization axes of RoboTwin 2.0. One scene of stack_blocks_two right after reset, without a policy, under each axis: background textures, table height (lowered by up to 3 cm in the official setting, raised or lowered by 3 cm in our test), distractor objects on the table, lighting color and intensity, and all axes together as in the official randomized setting. All tiles use the head camera except table height, which is barely visible there and is shown from the left wrist camera; the dashed line marks the table edge of the clean scene. The scene is generated anew for each setting, so object positions differ between tiles.

8 Discussion and Limitations

The evidence supports one foundation for multiple adapted prediction/control roles and a shared action interface across bodies. It does not demonstrate one universally deployed policy. Geometry shifts, initial-state changes and accumulating autoregressive errors remain weaknesses. Benchmark-specific post-training is required, and physical evaluation covers one humanoid and one packing task. Future work includes onboard distilled inference, bodies unseen by both parent and robotics stages, motion-level augmentation, and reliable imagined-rollout policy evaluation.

9 Conclusion

Shared anatomical coordinates, robot-specialized joint prediction, a copied action expert and retained world-model modes form the proposed recipe. Released benchmark weights and evaluation code support replication. Strong selected benchmark results coexist with unresolved geometry robustness, physical evaluation breadth and long-horizon reliability.

A Data Inventory and Anatomical Mappings

A.1 Family and Source Inventory

The 1,217-dataset inventory groups variant layouts into 20 main robot families: twelve Unitree G1 layouts share a family, as do real/simulated Green and the two Worker datasets. The largest admitted contributions are AgiBot G2A 256.0 h, Piper/Cobot Magic 227.2 h, Green 214.8 h, Unitree G1 204.9 h and AgiBot G1/Genie-1 148.5 h. Figures 25–26 retain the full family canvases and volume breakdown.

Figure 25 Robot families of the corpus. Training canvases of the robot families, as the model receives them: the head view on top and the other cameras in a strip below. Each tile shows one dataset of its family, so other datasets of the same family may differ in hands or cameras. Humanoids come first, then two-arm platforms; the chip on each tile gives the body type, and the label below gives the effector.
Figure 25 Robot families of the corpus. Training canvases of the robot families, as the model receives them: the head view on top and the other cameras in a strip below. Each tile shows one dataset of its family, so other datasets of the same family may differ in hands or cameras. Humanoids come first, then two-arm platforms; the chip on each tile gives the body type, and the label below gives the effector.
Figure 26 Hours per robot family, real-world and simulated. Combined names such as Piper / Cobot Magic denote datasets of one robot body grouped into one family (Section A). End labels are rounded. Hour shares differ from the sampling probabilities used in training (Section B.4).
Figure 26 Hours per robot family, real-world and simulated. Combined names such as Piper / Cobot Magic denote datasets of one robot body grouped into one family (Section A). End labels are rounded. Hour shares differ from the sampling probabilities used in training (Section B.4).

A.2 Corpus Admission and Quality Filtering

Admission requires a head/ego video above 10 FPS and at least 448 pixels on its short side. Annotated subtasks remain whole; ambiguous boundaries and clips above the duration/resolution limit are rejected. Quality gates detect idle intervals, repeated runs, cuts and decoding failures. Failed/recovery demonstrations remain valid physical data. Episode-level splitting yields about 1.40 million training and 28.6 thousand held-out atoms before text exclusions. Missing accepted captions/commands disqualify text-dependent modes rather than trigger a native-instruction fallback.

Table 4 Data-quality pass over the admitted corpus. Atoms in thousands, hours rounded to one decimal. An atom can be removed for several reasons (40 atoms are), so the reason rows do not add up to the total.
Table 4 Data-quality pass over the admitted corpus. Atoms in thousands, hours rounded to one decimal. An atom can be removed for several reasons (40 atoms are), so the reason rows do not add up to the total.
Equation 10
(10)Equation 10.

A.3 Anatomical Mappings

Forty-three source layouts map documented channels to anatomical roles using URDF/manufacturer information and measured trajectories; major mappings are checked with forward kinematics. Uncertain channels stay masked. Post-training layouts extend the codecs, while shared projectors retain their form. RoboTwin reuses the Worker/ARX5 correspondence, with reported path errors of 5.2/7.1 mm; CALVIN’s Franka uses Cartesian slots. Training-only statistics distinguish absolute/offset encodings, and WAM normalization uses successful demonstrations.

Figure 27 Coverage of the 79 anatomical slots by family. Rows: the 20 families ordered by admitted hours. Columns: slots grouped into legs (12), body (23: base pose, twist, torso and head), arms (18) and hands (26), with left and right subgroups. A colored cell is filled by a named channel of at least one layout of the family. A gray cell holds only unresolved channels of that body part: they stay in the data, are excluded from the loss and claim no correspondence to the slot. A light cell marks an absent slot. The hands of Ruantong/A2D are unresolved.
Figure 27 Coverage of the 79 anatomical slots by family. Rows: the 20 families ordered by admitted hours. Columns: slots grouped into legs (12), body (23: base pose, twist, torso and head), arms (18) and hands (26), with left and right subgroups. A colored cell is filled by a named channel of at least one layout of the family. A gray cell holds only unresolved channels of that body part: they stay in the data, are excluded from the loss and claim no correspondence to the slot. A light cell marks an absent slot. The hands of Ruantong/A2D are unresolved.

B Training and Adaptation Recipes

B.1 Robotics Training Recipe

The robotics recipe uses the parent’s shifted flow-noise schedule, mode-homogeneous microbatches of four, and square-root batch scaling from a 2×10⁻⁵ learning rate at batch 128. Newly initialized action projections and modality embeddings use five times the base rate. Figure 28 and Table 5 retain all mode losses, optimizer settings, noise scheduling and checkpoint details.

Figure 28 Robotics-stage training. Training loss of each mode as reported (light) and its running median over about 500 steps (dark); inverse dynamics and WAM are on a log scale because they start an order of magnitude higher, and their medians fall from 8.3 to 0.29 and from 6.2 to 1.98.
Figure 28 Robotics-stage training. Training loss of each mode as reported (light) and its running median over about 500 steps (dark); inverse dynamics and WAM are on a log scale because they start an order of magnitude higher, and their medians fall from 8.3 to 0.29 and from 6.2 to 1.98.
Table 5 Recipe of the robotics stage.
Table 5 Recipe of the robotics stage.

B.2 Temporal Sampling and Prediction Targets

Native timestamps are preserved while video rate is capped at 30 FPS; states follow the same selected grid, without rescaling positions. Five canvas buckets preserve view proportions. Whole-subtask modes avoid truncated actions; autoregressive blocks cover up to 30 seconds of future video. Equation 11 fixes four historical anchors, all before the target block. WAM predicts about 1.07 seconds inside positively labeled successful subtasks, keeping the enclosing command and adding no action targets through video padding.

Figure 29 Clean conditions and noised targets in the seven modes, with each mode’s share of training examples. Text (caption or instruction) is a clean condition in every mode. Forward dynamics, with and without history, conditions on 𝑞0 and the clean future targets 𝛿𝑘of Equation (2); inverse dynamics predicts absolute states including 𝑞0. WAM predicts future frames and state offsets over about 1.07 s at the effective frame rate of the source. Autoregressive modes predict the next whole-subtask block from four RGB anchors of the history.
Figure 29 Clean conditions and noised targets in the seven modes, with each mode’s share of training examples. Text (caption or instruction) is a clean condition in every mode. Forward dynamics, with and without history, conditions on 𝑞0 and the clean future targets 𝛿𝑘of Equation (2); inverse dynamics predicts absolute states including 𝑞0. WAM predicts future frames and state offsets over about 1.07 s at the effective frame rate of the source. Autoregressive modes predict the next whole-subtask block from four RGB anchors of the history.
Equation 11
(11)Equation 11.

B.3 Structured Captions and Commands

The captioner receives video, duration, source goal and registered embodiment/effector/domain facts. Nine fields are generated in one dialogue; attempt and consistency checks are withheld from training prompts. Content gates enforce consistent object names, ordered phases, supported contact claims and actual completion. A field can be rewritten twice and an atom retried four times. A second pass turns every accepted phase into an ordered command without truncation. Tables 6–7 preserve the full schema and worked example, including the difference between the original label and derived instruction.

Table 6 Fields of the caption record in generation order. The two checks are generated in the same dialogue but stored outside the caption and never enter a training prompt.
Table 6 Fields of the caption record in generation order. The two checks are generated in the same dialogue but stored outside the caption and never enter a training prompt.
Table 7 One atom from the source label to the derived command: the clip of Figure 6c (RoboCOIN, Unitree G1 with dexterous hands, real). Captioner and rewriter outputs are quoted verbatim.
Table 7 One atom from the source label to the derived command: the clip of Figure 6c (RoboCOIN, Unitree G1 with dexterous hands, real). Captioner and rewriter outputs are quoted verbatim.

B.4 Training Mixture

Sampling first selects mode and cluster, then dataset, subtask and window. Worker/ARX5 receives 12%, Green 18%, and the remaining configured clusters share 70% proportional to the square root of eligible unique-subtask counts. A maximum-entropy joint table preserves both mode and cluster marginals subject to support. Dataset selection likewise uses square-root counts. Extra windows or joint/EEF alternatives do not increase an atom’s probability. Table 8 preserves exact configured shares; small datasets repeat more than their hour totals alone would imply.

Table 8 Configured sampling targets by registered family, computed from the training split, next to admitted hours. Targets are set before text and mode admission.
Table 8 Configured sampling targets by registered family, computed from the training split, next to admitted hours. Targets are set before text and mode admission.
Equations 12–13
(12)Equation 12.
(13)Equation 13.

B.5 Policy Adaptation Recipes

RoboTwin adaptation uses 2,500 clean demonstrations, physically correct 16.67 Hz timing, dense eligible windows and the 0.9/0.05/0.05 mode mixture. It predicts/executes 16 steps with eight denoising steps. WorldArena adaptation runs 10,000 steps on clean RoboTwin video using forward dynamics with history and no text. LIBERO adds appearance/perspective augmentation and paraphrases, then evaluates the same policy on LIBERO-plus without its training episodes.

RoboDojo uses its official data, stream-restricted attention, 60,000 steps and 20% image-to-video examples. CALVIN uses ABC only, predicts 20 steps with four UniPC steps and executes ten. Humanoid policies share the demonstration split but retain their own preprocessing/action recipes. Student consistency uses masked pseudo-Huber losses with weights 1/1/0.01 and EMA decay 0.995. Validation selects checkpoints/settings; neither ID test episodes nor OOD trials enter selection.

C Evaluation Protocols

The following protocols distinguish prediction, simulated control, physical instruction success and inference latency. Figure 30 shows the evaluation settings.

Figure 30 Benchmark scenes. One frame per benchmark and setting. The RoboTwin 2.0, LIBERO and LIBERO- plus frames come from evaluation episodes of our policies: the first head-camera frames of the clean and randomized episodes of Figure 12, a standard LIBERO scene, a LIBERO-plus scene with the camera turned by −32∘and one with a changed table texture. The other frames are recorded benchmark data: the static camera of an environment-D episode of CALVIN, the head camera of a RoboDojo demonstration and a recorded frame of a WorldArena 1.0 test episode.
Figure 30 Benchmark scenes. One frame per benchmark and setting. The RoboTwin 2.0, LIBERO and LIBERO- plus frames come from evaluation episodes of our policies: the first head-camera frames of the clean and randomized episodes of Figure 12, a standard LIBERO scene, a LIBERO-plus scene with the camera turned by −32∘and one with a changed table texture. The other frames are recorded benchmark data: the static camera of an environment-D episode of CALVIN, the head camera of a RoboDojo demonstration and a recorded frame of a WorldArena 1.0 test episode.

C.1 Public Benchmarks

RoboTwin evaluates 50 tasks with 100 trials per task in both clean and randomized scenes. WorldArena uses all 1,000 track-1 episodes and reports an author-recomputed motion-capped score, not its official leaderboard aggregate. Competitor mean-based caps are upper bounds; selected figures omit BLM, WorldScape v0.2, GigaWorld-1, GE-Sim 2.0 and SisyphusWorld. Appearance/judge metrics sometimes score generated videos above recordings and correlate weakly with trajectory accuracy.

RoboDojo averages across five dimensions, with 150 trials per task across three seeds. LIBERO averages four suites; LIBERO-plus uses one trial per perturbed episode after standard-only training. CALVIN reports 1,000 five-instruction chains in D, excluding all D data from training.

Table 9 Evaluation protocols. Figure 30 shows one frame of each benchmark.
Table 9 Evaluation protocols. Figure 30 shows one frame of each benchmark.

C.2 Real-Humanoid Comparison Protocol

Each humanoid policy receives the same 14 scene configurations, split into nine ID and five OOD, with five consecutive instructions each. Every instruction is attempted once. Success requires completion before timeout without human assistance; failures, policy-induced stops and timeouts count as failures. Scores are separately normalized over 45 ID and 25 OOD instructions.

Equation 14
(14)Equation 14.

C.3 Latency Benchmark

Latency is measured on one RTX 4090 with FlashAttention-2, over 100 episodes. Requests condition on a fixed observation/state and 128-token instruction; three latent frames comprise one conditioning frame and two generated frames. Median steady-state latency reuses instruction caches; first-action latency includes cache construction. Table 10 reports cumulative optimizations. The distilled policy reaches 35.4 ms steady state and 48.8 ms after a new instruction; these measurements isolate model inference rather than full robot-loop latency.

Table 10 Policy inference latency on one NVIDIA RTX 4090. Optimizations are applied cumulatively to the GreenWAM policy, and speedups are relative to it. Median latency over 100 episodes; TTA is the time to the first action after a new instruction.
Table 10 Policy inference latency on one NVIDIA RTX 4090. Optimizations are applied cumulatively to the GreenWAM policy, and speedups are relative to it. Median latency over 100 episodes; TTA is the time to the first action after a new instruction.

C.4 Paired Comparisons

Paired outcomes are averaged over episodes within tasks, then over tasks. A hierarchical bootstrap resamples tasks and paired episodes 5,000 times; the central 95% interval reflects evaluation uncertainty of the two fixed checkpoints. It does not capture training-run variability. Forward prediction substitutes per-clip PSNR for binary success.

Equation 15
(15)Equation 15.

C.5 Evaluation Details

Empty-prompt WorldArena inference omits ineffective classifier-free guidance. CALVIN test instructions stay outside paraphrase pools. RoboTwin final results use 100 trials per task/setting; controlled comparisons share seeds.

D Additional Results and Qualitative Examples

D.1 Benchmark Tables

Tables 11–14 preserve the complete selected WorldArena, CALVIN, RoboDojo and LIBERO comparisons with their provenance. They distinguish best individual axes from overall ranking and standard LIBERO performance from zero-shot perturbation robustness.

Table 11 WorldArena 1.0, track 1: overall score, categories and fidelity of the models in Figure 9. EWMScore (Equation (7)) is the mean of the 15 board metrics with dynamic degree, flow score and motion smoothness capped at the ground truth: per video for GreenWAM, at the leaderboard means for the other models (an upper bound for them). The last row scores the recorded test videos themselves with the same evaluator.
Table 11 WorldArena 1.0, track 1: overall score, categories and fidelity of the models in Figure 9. EWMScore (Equation (7)) is the mean of the 15 board metrics with dynamic degree, flow score and motion smoothness capped at the ground truth: per video for GreenWAM, at the leaderboard means for the other models (an upper bound for them). The last row scores the recorded test videos themselves with the same evaluator.
Table 12 CALVIN ABC→D, 1 000 chains. Aver- age number of completed instructions in a chain of five. Values are taken from Xiaomi-Robotics- 0 [15] (Table 2), except DreamVLA [98] (Ta- ble 1), MMaDA-VLA [51] (Table 1) and 𝜋0.5, the supervised fine-tuned checkpoint reported in 𝜋RL [17] (Table 5).
Table 12 CALVIN ABC→D, 1 000 chains. Aver- age number of completed instructions in a chain of five. Values are taken from Xiaomi-Robotics- 0 [15] (Table 2), except DreamVLA [98] (Ta- ble 1), MMaDA-VLA [51] (Table 1) and 𝜋0.5, the supervised fine-tuned checkpoint reported in 𝜋RL [17] (Table 5).
Table 13 RoboDojo simulation benchmark. Score and success rate averaged over the five capability dimensions, from the official leaderboard [67]: the top five entries and the methods shown in Figure 11. Human teleoperation reaches a score of 80.42 and a success rate of 76.03% [19].
Table 13 RoboDojo simulation benchmark. Score and success rate averaged over the five capability dimensions, from the official leaderboard [67]: the top five entries and the methods shown in Figure 11. Human teleoperation reaches a score of 80.42 and a success rate of 76.03% [19].
Table 14 LIBERO and LIBERO-plus. Average success over the four LIBERO task suites and zero-shot LIBERO-plus success over all perturbed episodes, %.
Table 14 LIBERO and LIBERO-plus. Average success over the four LIBERO task suites and zero-shot LIBERO-plus success over all perturbed episodes, %.

D.2 Failure Cases

The two illustrated failures reach the target but miss precise final placement: cheese rests tilted on a bowl rim; a stapler is released only partly onto its pad. Neither policy corrects the error before the step limit, exposing placement and recovery weaknesses.

Figure 31 Failure cases of the LIBERO and RoboTwin policies (Tables 3 and 14). Imprecise final phase without recovery. LIBERO-Goal, “put the cream cheese in the bowl”: the cheese reaches the bowl but rests tilted on its rim, which the success check does not accept; the policy then moves toward the plate and does not return before the limit of 310 steps. RoboTwin 2.0, move_stapler_pad in a clean scene: the stapler is carried to the green pad but released only partly onto it, and the gripper holds it without correction until the limit of 400 control steps.
Figure 31 Failure cases of the LIBERO and RoboTwin policies (Tables 3 and 14). Imprecise final phase without recovery. LIBERO-Goal, “put the cream cheese in the bowl”: the cheese reaches the bowl but rests tilted on its rim, which the success check does not accept; the policy then moves toward the plate and does not return before the limit of 310 steps. RoboTwin 2.0, move_stapler_pad in a clean scene: the stapler is carried to the green pad but released only partly onto it, and the gripper holds it without correction until the limit of 400 control steps.
Concept demonstration

Open image ↗