Overview
This edition covers the complete sixteen-page v3 dated 11 June 2026. It retains all six numbered figures, eight numbered tables, the full training/deployment appendix and the final list of proposed future diagnostics.

At a glance
RoboNaldo trains one low-level humanoid controller in three stages: imitate a human kick, adapt it to target-directed stationary-ball shooting, then combine locomotion commands and a kick trigger for moving balls. A heuristic high-level planner handles approach and timing; task rewards reshape contact while motion tracking supplies balance.
A Unitree G1 uses onboard LiDAR/camera sensing and a specially reflective ball. Among valid launches, real free-kick and moving-ball errors average .73 m and .86 m from 3 m. These figures exclude failed launches: contact rates are 91.2% and 74.1%, and moving-ball balance survival is 88.9%. Peak reported ball speed is 13.10 m/s.
1 Introduction
Shooting combines single-leg balance, brief foot–ball contact, aim and power. Fixed motion imitation provides coordination but cannot choose a new strike time or contact geometry; task-only learning must discover these behaviors with sparse delayed feedback.
RoboNaldo stages those difficulties. Its point-target and moving-ball evaluations complement prior humanoid soccer and PAiD systems. The contribution is the combined curriculum, timing interface and reward design, rather than a general autonomous soccer player.
2 Related Work
Related work motivates a distinction between controlling brief impulse contacts and sustaining force over many timesteps, and between goal-region success and point-target accuracy.
Humanoid soccer and the shooting gap.
Prior soccer controllers emphasize locomotion, reactive kicking or goal-region entry. The authors argue that cosine-direction metrics can hide substantial lateral error at distance. Table 1 retains their capability comparison, including concurrent systems; its check marks describe reported evaluation coverage rather than a common empirical benchmark.
| Method | Shooting capability | Deployment | |||
|---|---|---|---|---|---|
| Point-acc | Speed | Moving | Ego | Out | |
| STOFT [8] | |||||
| Reactive [27] | ✓ | ✓ | |||
| Striker [30] | ✓ | ||||
| HumanX† [26] | ✓ | ||||
| PAiD† [7] | ✓ | ✓ | ✓ | ||
| RoboNaldo(Ours) | ✓ | ✓ | ✓ | ✓ | ✓ |
Humanoid whole-body object interaction.
Whole-body interaction methods such as HDMI and ResMimic provide useful motion/contact machinery, but shooting gives a much shorter useful contact interval. The new reward preserves approach and outcome feedback around the impact instead of requiring sustained simultaneous position/force alignment.
Curriculum reinforcement learning.
The curriculum jointly changes task difficulty and learning signals. Ball diversity is introduced after a reliable kick exists, followed by explicit moving-ball timing. This follows the broader curriculum-RL idea of ordering learning problems, with task-specific stage transitions.
3 Method
The method combines a low-level motion-conditioned policy, a sequential training schedule and task-specific rewards. The third stage exposes approach velocity/heading and kick triggering as high-level commands.
3.1 Task Formulation
Policy inputs use robot-frame ball and target information, while evaluation measures the launched ball relative to the target in world coordinates.
Soccer shooting task.
Free-kicks start with a stationary ball; moving-ball trials add incoming velocity and uncertain arrival time. Success uses the minimum ball–target distance after first valid foot contact. This is a closest-approach criterion, not inherently the same as goal-line placement or a scored goal.
Equation
Policy observation.
The actor receives reference-joint cues, proprioception and prior actions with five-step histories, plus ball and target positions. Stage 3 replaces the reference-anchor cue with a nine-dimensional command while preserving the 547-dimensional input. A trigger changes the reference phase from locomotion to kicking; the critic has privileged noise-free body state.
3.2 Curriculum Design
Stage 1 retargets one side-foot human kick using GVHMR and GMR, then learns motion tracking following BeyondMimic without ball-task rewards. Stage 2 introduces the ball, target and spawn diversity so the strike can adapt to free-kicks. Stage 3 adds moving balls and separates locomotion, kick and post-kick stabilization.
The heuristic planner extrapolates planar ball position, guides the robot toward a feasible approach and triggers when predicted closest distance and height satisfy reachability gates. It snaps the motion clock to the kick phase with training jitter, then holds a stabilization reference after contact.
Stages advance using observed behavior, reward plateaus and converged action-noise scale. These are practical judgments rather than a fully specified automatic promotion threshold. The previous checkpoint initializes each next stage.
Equations
High-level control interface.
The command/trigger interface separates high-level decisions from the low-level shooting policy. Other controllers can in principle supply the same inputs without retraining the low-level model; the demonstrated system uses the heuristic planner, and a broadly evaluated learned high-level replacement is future work.
3.3 Reward Design
The total reward combines motion tracking, shooting task terms and regularization. Appendix B retains all component definitions, weights and stage scales; shaping accuracy and maintaining stable contact must be balanced.
Equation
Motion tracking reward.
Exponential tracking terms cover fourteen body parts and emphasize foot velocity. They provide coordinated balance and swing structure, with distance-dependent relaxation near the ball in Stage 3.
Regularization reward.
Regularizers constrain action changes, second differences, slip, airborne behavior, joint speed/torque and limit violations. The published sign/weight conventions are retained exactly; the table sometimes prints both a negative quantity and a negative weight without resolving how these are combined in implementation.
Soccer shooting task reward.
Task shaping rewards approach, contact alignment, speed and eventual placement. A sparse target threshold is .5 m in Stage 2 and .35 m in Stage 3; a dense exponential term uses the best ball–target distance so far.
An additional ballistic extrapolation predicts where the current post-contact trajectory crosses the goal line, giving earlier placement feedback. It is a simplified shaping model with a floor clamp, not a full friction/bounce model or a replacement for the reported evaluation metric.
Equations
Instant interaction reward.
The interaction reward multiplies a sum of approach/outcome terms by a sum of velocity/force terms. Adding within each group keeps feedback available around a brief impact instead of making it vanish whenever one contact signal is absent.
The source calls shooting contact sub-10 ms in related work, but later describes three to five physics steps at 200 Hz, which is 15–25 ms. Both statements are retained as a source timing inconsistency.
Equation 1
| (1) |
4 Simulation Experiments
Simulation compares direct reinforcement learning, motion-prior approaches, a concurrent soccer baseline and staged RoboNaldo checkpoints, followed by curriculum and mechanism ablations.
Setup and metrics.
Training uses 4,096 parallel environments on an RTX 4090; evaluation uses 16,384 held-out episodes. Targets span an 8×2 m plane 5 m ahead. Stationary balls are sampled in a frontal square; moving balls approach at up to 5 m/s.
Metrics include nearest target error, .5/1 m success, post-contact peak ball speed, contact and survival. Table 2 reports ± values, but the text does not clearly specify independent training-seed count or the meaning of every uncertainty entry.
Experimental results.
Stage 2 free-kicks achieve .899 m error, 65.5% success within 1 m and 14.792 m/s peak-speed metric, compared with PAiD’s 1.850 m, 19.5% and 4.986 m/s. Stage 3 retains strong free-kicks and reaches 63.3% within 1 m on moving balls, with 79.2% contact and 98.8% survival.
Directly applying Stage 2 to moving balls gives only 7.2% within 1 m and 15.3% contact. Pure tracking is stable but poorly directed; task-only PPO and AMP struggle. These are the authors’ implementations and evaluation settings, not universal rankings of the algorithms.
The printed .899/1.850 error ratio is 48.6%, corresponding to about 51.4% lower error. The abstract instead calls it 48.6% lower; the numeric table is retained as the comparison basis.
| Entry | Regime | 0.5m suc. (%) | 1.0m suc. (%) | Shot err. (m) | (m/s) | Contact (%) | Alive (%) |
|---|---|---|---|---|---|---|---|
| Main comparison: free-kick | |||||||
| PPO [19] | Free-kick | ||||||
| AMP [16] | Free-kick | ||||||
| PAiD [7] | Free-kick | ||||||
| Stage 1 motion tracking | Free-kick | ||||||
| RoboNaldo stage 2 | Free-kick | ||||||
| RoboNaldo stage 3 | Free-kick | ||||||
| Main comparison: moving-ball shooting | |||||||
| PPO [19] | Moving | ||||||
| AMP [16] | Moving | ||||||
| PAiD [7] | Moving | ||||||
| Stage 2 zero-shot | Moving | ||||||
| RoboNaldo stage 3 | Moving | ||||||
| Ablations: curriculum | |||||||
| Stage 02 | Free-kick | ||||||
| Stage 13 | Moving | ||||||
| Stage 23 w/o planner | Moving | ||||||
| Ablations: mechanism | |||||||
| W/o adaptive sampling | Moving | ||||||
| W/o stabilization | Moving | ||||||
| Ablations: interaction reward | |||||||
| HDMI-style reward | Free-kick | ||||||
Ablations.
Skipping motion pretraining, skipping free-kick adaptation or omitting the Stage 3 planner each causes large performance losses. Removing adaptive sampling or post-kick stabilization reduces moving-ball survival to 32.8% or 24.4%, despite high ball speed.
Replacing the interaction reward with the HDMI-style alternative lowers free-kick .5 m success from 28.8% to 2.5%. The variants warm-start from relevant stage checkpoints. A separate weight-only/difficulty-controlled ablation is planned rather than completed.
5 Real-World Experiments
Hardware experiments exercise onboard sensing and control indoors and outdoors. The quantitative accuracy table separates launched shots from all attempts.
5.1 Hardware Setup and Perception
The 35 kg, 29-DoF Unitree G1 uses a size-5 ball, a head-mounted Livox MID-360 and chest RealSense D435. ONNX inference runs onboard at 50 Hz over DDS; no external motion-capture state estimate is used during deployment.
The ball is retro-reflective, and an AprilTag board or fixed coordinate specifies the target. The sensing arrangement is therefore instrumented; ordinary unmodified soccer-ball perception is not established.
5.2 Experimental Results
Of 136 free-kick attempts, 124 launch the ball and all remain upright. On those valid launches, .5/1 m success is 31.5/80.6%, mean error .73 m and mean speed 7.42 m/s. Center targets are most accurate (.65 m), while left shots are faster and right shots slower, consistent with a right-footed bias.
Of 27 human-passed moving-ball attempts, 20 launch successfully. Conditional success is 30/70%, error .86 m and mean speed 7.10 m/s; overall contact and survival are 74.1% and 88.9%. Missed launches and falls must therefore be considered separately from the accuracy of successful kicks.
The maximum observed speed, 13.10 m/s, is distinct from the mean speeds. Its comparison with published professional-player speeds is contextual and uses different settings and summary statistics, not a matched human-versus-robot experiment.
Figure 4C’s regional success percentages match denominators using all attempts, while Table 3 explicitly conditions accuracy on valid launches. For example, the left region shows about 26/66% in the plot versus 30.6/77.6% in the table; these answer different reliability questions.
| 0.5m suc. (%) | 1.0m suc. (%) | Shot err. (m) | (m/s) | Contact (%) | Alive (%) | |||
|---|---|---|---|---|---|---|---|---|
| Free-kick | ||||||||
| Overall | 136 | 124 | 31.5 | 80.6 | 91.2 | 100.0 | ||
| Left | 58 | 49 | 30.6 | 77.6 | 84.5 | 100.0 | ||
| Center | 50 | 48 | 35.4 | 85.4 | 96.0 | 100.0 | ||
| Right | 28 | 27 | 25.9 | 77.8 | 96.4 | 100.0 | ||
| Moving-ball | 27 | 20 | 30.0 | 70.0 | 74.1 | 88.9 |
6 Discussion and Conclusion
The staged combination produces directed, high-speed kicks on the tested humanoid with onboard sensing. Explicit timing and post-impact stabilization are central to moving-ball performance, whose contact reliability remains below stationary free-kicks.
Limitations and future work.
The system depends on one reference motion, a handcrafted high-level trigger and a retro-reflective ball. Multiple skills, autonomous soccer decisions, learned timing and robust natural-ball perception are future directions rather than demonstrated capabilities.
Acknowledgments
The work acknowledges support from the Hong Kong Jockey Club Charities Trust’s JC STEM laboratory and the University of Hong Kong’s data-science seed fund, alongside named contributors to experiments and logistics.
Appendix A Observation Space: Per-Dimension Breakdown
Table A.1 preserves the full 547-dimensional observation vector. Reference joints contribute 58 dimensions, anchor/command cues nine, proprioceptive histories 450 and ball/target histories thirty. Stage 3 changes the nine-dimensional cue without changing actor input size; the critic adds privileged body state.
| Group | Component | Dim. |
|---|---|---|
| Motion reference | reference joint positions, (29 DOF) | 29 |
| reference joint velocities, (29 DOF) | 29 | |
| Anchor reference† | anchor (torso) position in body frame, | 3 |
| anchor orientation (6D rotation), | 6 | |
| Proprioception (5 history) | base angular velocity | 15 |
| joint positions (29 DOF) | 145 | |
| joint velocities (29 DOF) | 145 | |
| previous actions (29 DOF) | 145 | |
| Exteroception (5 history) | ball position in robot frame | 15 |
| target position in robot frame | 15 | |
| Total | 547 |
Appendix B Reward Terms and Weights
Table B.1 specifies tracking, task and regularization terms, while Table B.2 gives outer curriculum weights and spawn settings. Tracking kernels use base scales divided by two in Stages 2–3, and Stage 3 additionally relaxes their weights near the ball.
The appendix prose says regularization scale .2 in Stages 1–2, whereas Table B.2 gives Stage 1 outer regularization weight zero. The nested task/component scales and the published discrepancy are retained; they should not be collapsed into an assumed single weight.
| Term | Quantity / form | Weight |
| Motion tracking | ||
| anchor position ( m) | torso position vs. ref. | |
| anchor orientation ( rad) | torso orientation vs. ref. | |
| body positions ( m) | 14 relative body positions | |
| body orientations ( rad) | 14 body orientations | |
| body linear vel. ( m/s) | 14 body linear velocities | |
| body angular vel. ( rad/s) | 14 body angular velocities | |
| feet linear vel. ( m/s) | 2 feet linear velocities | |
| Task () | ||
| error_ball_to_target | exp; (); within thr. | |
| predicted_error_ball_to_target | exp; (Eq. 3, ) | |
| goal_reward_burst | constant for 10 steps on success (delay 100) | |
| robot_ball_contact | ankle– proximity contact force, buffered | |
| contact orientation | ankle velocity vs. balltarget | |
| ankle–ball / torso–ball distance | / torso–ball dist. | / |
| ball_velocity | sat. Lorentzian on post-contact | |
| alive | constant while upright | |
| Regularization () | ||
| action rate | (1.0/1.5) | |
| action smoothness | (1.0/2.0) | |
| feet slip | in stance | |
| no-fly | (1.0/1.25) | |
| joint velocity | ||
| joint torque | ||
| joint limit (always active) | (1.0/1.5) | |
| undesired contacts | contact off ankles/wrists | |
| feet contact time | smooth foot-contact duration | (1.0/1.2) |
Instant Interaction Reward factors.
Equation 2 expands the interaction factors: foot-to-ball clearance shapes approach, best-so-far target distance shapes outcome, a thresholded speed term rewards useful velocity and a capped force term rewards impact. The original clipping, thresholds and kernel powers remain visible.
Equation 2
| (2) | ||||||
Densified Shooting Reward.
Equation 3 estimates time to the target’s goal-line coordinate using ball velocity, then predicts position under gravity. Positive predicted time activates the dense target-error reward; height is clamped at ball radius, and the source switches to actual landing position after crossing. This provides earlier feedback under an approximate trajectory model.
Equation 3
| (3) | ||||
Proximity-based tracking relaxation.
Tracking weights interpolate from term-specific near-ball scales at .35 m to full weight at 1 m. Foot-velocity tracking falls to .05 while orientation retains .6, allowing contact adaptation without discarding balance guidance. Table B.3 preserves all seven near-ball factors; sensitivity to these choices remains proposed work.
Equation 4
| (4) |
| Term | anchor pos. | anchor ori. | body pos. | body ori. | body lin. vel. | body ang. vel. | feet lin. vel. |
|---|---|---|---|---|---|---|---|
| 0.10 | 0.60 | 0.20 | 0.60 | 0.20 | 0.30 | 0.05 |
Appendix C Hyperparameters and Domain Randomization
The appendix specifies optimization, planner geometry, simulator rates and domain randomization. These details define the evaluated configuration, not a comprehensive parameter-sensitivity study.
PPO (RSL-RL).
PPO uses three-layer actor/critic MLPs of 512–256–128 units with ELU and observation normalization. Rollouts have 24 environment steps; updates use five epochs and four minibatches. The clip ratio is .2, discount .99 and GAE .95; adaptive learning starts at 2×10⁻⁵ with KL target .01.
The source gives clipped value loss with coefficient one, entropy .001, gradient clip one, initial action-noise standard deviation one, up to 100,000 iterations per stage and checkpointing every 1,000. These are configured limits; actual per-stage training duration and total compute are not reported.
Equations
Heuristic planner.
The heuristic predicts .4 s ahead, permits .25 m closest approach below .75 m height, and uses a nominal foot offset (.15,−.1) m. Kick-boundary frame 240 is sampled with ±10-frame jitter. Exact desired-position/orientation and closest-approach formulas remain below; the heuristic is specific to the chosen motion and embodiment.
Equations
Simulation.
Physics runs at 200 Hz with fourfold decimation to 50 Hz control. Ten-second episodes contain 500 control steps. The simulated ball has .115 m radius, about .41 kg mass and .95 restitution; foot and ball contact sensors provide interaction feedback. Solver settings are eight position and four velocity iterations.
Domain randomization.
Per-episode robot static friction is sampled from .3–1.6, dynamic friction from .3–1.2 and restitution from 0–.5. Default joint positions vary by ±.01 rad; torso center of mass varies by ±.025 m fore–aft and ±.05 m laterally/vertically. Actuator delay is described only as a few control steps.
Every 1–3 s, random pushes add up to ±.5 m/s horizontal and ±.2 m/s vertical velocity, plus ±.52 rad/s roll/pitch and ±.78 rad/s yaw velocity. Ball spawn and initial velocity follow Table B.2. These are configured training disturbances, not measured deployment robustness limits.
Equations
Appendix D Deployment Details
Table D.1 compares sensor options. Its nominal LiDAR range and latency entries should be distinguished from this mounting’s approximately two-metre useful ground coverage and the roughly 10 Hz processed point-cloud stream described below.
Perception.
Near-range ball localization filters LiDAR returns by reflectivity, range and region, then fits a known-radius sphere and smooths its center with a constant-velocity Kalman filter. Farther away, the D435 infrared stream supplies a bright-blob/circularity estimate fused into the same pelvis-frame state.
The source reports failures of RGB YOLO and color/background detectors under blur, lighting and clutter, without a quantified localization benchmark. AprilTags localize the goal board, or a fixed target coordinate is used; measurements older than 300 ms are invalidated. Reliable long-range tracking of a fast ball remains future work.
Joint-index remapping.
Isaac Lab and Unitree/MuJoCo order joints differently. A fixed permutation and inverse map observations and actions between the conventions. The appendix says this map is in released code, but does not print its entries here; this edition does not invent them or infer release availability.
Initialization and control loop.
Deployment zero-fills the five-step histories and linearly blends the initial configuration into the first policy action over ten control steps. The 50 Hz loop reads joint/IMU and ball/target states, performs ONNX inference and sends checked position commands with PD gains. A dedicated button switches to immediate damping; this is an operator fallback, not a formal safety guarantee.
Equation
Appendix E Additional Simulation Results
The twelve heatmaps show target-dependent error, peak speed and .5/1 m success for Stage 2 free-kicks, Stage 3 free-kicks and Stage 3 moving balls. Extreme lateral and high targets are harder; the panels retain the complete spatial coverage and color scales.
Appendix F Additional Results
Despite the heading “Additional Results,” this section lists planned diagnostics: localization error, relaxation-scale sensitivity, joint coordination, hardware failure breakdown with confidence intervals, and a weight-only ablation. None of those additional quantitative findings is supplied in this version.