At a glance
Autonomous Neural Dynamic Policies (ANDPs) combine stable linear dynamical systems using positive neural-network weights. The resulting policy can condition on images while driving its controllable state to a fixed attractor. Simulated multitask motions and a physical pouring experiment demonstrate imitation and perturbation recovery. The convergence guarantee assumes commanded velocities are followed; it is not a guarantee for the complete robot–environment system.
I Introduction
The aim is to retain neural-network flexibility while giving movement policies an analyzable convergence property. ANDPs separate directly controlled coordinates from contextual observations and use the latter to select a state-dependent mixture of stable dynamics. Their differentiable parameterization permits unconstrained gradient-based fitting.

II Related Work
Dynamic Movement Primitives provide structured movement generation, while SEDS and LPV-DS learn autonomous stable vector fields. Neural Dynamic Policies combine neural predictions with movement primitives but do not provide this paper’s fixed-attractor guarantee. ANDPs replace Gaussian mixture gating with neural gating while constraining each elementary system. [7], [17], [18].
III Problem formulation
Training receives demonstrated state sequences rather than expert control commands. A policy should reproduce those trajectories under unknown system dynamics. A low-level controller may be needed to convert desired state velocities into executable robot inputs.
Equation 1
| (1) |
IV Proposed Policy Structure
The policy is a positively weighted sum of linear systems sharing one attractor. Positive-definite symmetric parts of their matrices yield a common Lyapunov decrease and asymptotic convergence of the directly controlled state. Contextual observations can change the weights without changing the attractor. The theorem assumes perfect velocity tracking and does not establish collision avoidance, bounded commands, or stability of uncontrolled environment variables.
Equations 2–4
| (2) |
| (3) |
| (4) |
IV-A ANDPs via Neural Networks
A neural network predicts softmax mixture weights. Each system matrix is represented by a positive-definite component plus a skew-symmetric component; a Cholesky factor with positive diagonal ensures the former condition. These substitutions enforce stability during unconstrained optimization. Experiments fix the attractor to the average final demonstrated state.
V Experiments
The evaluation uses simulated image-conditioned motions and a physical Franka Panda pouring task. It tests trajectory reproduction, switching task cues during execution, recovery from external forces, and end-effector orientation control. The experiments use imitation learning; reinforcement learning is suggested rather than evaluated.

V-A Multi-Task Learning
One demonstration each of linear, sinusoidal, and curved motion trains a single policy. A grayscale 64×64 image selects the task through a convolutional gating network. Changing the image at one second switches the motion pattern; force perturbations at zero and five seconds also produce recovery toward the shared attractor. These are illustrative rollouts rather than a broad quantitative robustness benchmark.


V-B Physical Robot Experiment
Three kinesthetic demonstrations teach a six-coordinate end-effector pouring motion, using plastic pieces to emulate liquid. Across ten initial robot configurations, the median fraction of pieces reaching the bowl is 100%, with the 25th and 75th percentiles at 67.5% and 100%. This metric measures transported pieces, not the fraction of fully successful trials.





VI Results and Conclusions
The architecture supports image and pose inputs with a fixed-attractor convergence guarantee under its tracking assumption. A shared fixed attractor limits long-horizon tasks and nonmonotonic motions; moving goals, reinforcement learning, and broader image-based evaluation remain future work.
Acknowledgments
The authors acknowledge support from the Hellenic Foundation for Research and Innovation and the UK Research and Innovation Future Leaders Fellowship.