Autoregressive Meta-Actions for Unified Controllable Trajectory Generation

Jianbo Zhao1,2, Taiyu Ban1, Xiyang Wang2, Qibin Zhou2, Hangning Zhou2†, Zhihao Liu2, Mu Yang2, Lei Liu1†, Bin Li1
1University of Science and Technology of China, 2Mach Drive,

Abstract

Controllable trajectory generation guided by high-level semantic decisions, termed meta-actions, is crucial for autonomous driving systems. A significant limitation of existing frameworks is their reliance on invariant meta-actions assigned over fixed future time intervals, causing temporal misalignment with the actual behavior trajectories. This misalignment leads to irrelevant associations between the prescribed meta-actions and the resulting trajectories, disrupting task coherence and limiting model performance. To address this challenge, we introduce Autoregressive Meta-Actions, an approach integrated into autoregressive trajectory generation frameworks that provides a unified and precise definition for meta-action-conditioned trajectory prediction. Specifically, We decompose traditional long-interval meta-actions into frame-level meta-actions, enabling a sequential interplay between autoregressive meta-action prediction and meta-action-conditioned trajectory generation. This decomposition ensures strict alignment between each trajectory segment and its corresponding meta-action, achieving a consistent and unified task formulation across the entire trajectory span and significantly reducing complexity. Moreover, we propose a staged pre-training process to decouple the learning of basic motion dynamics from the integration of high-level decision control, which offers flexibility, stability, and modularity. Experimental results validate our framework's effectiveness, demonstrating improved trajectory adaptivity and responsiveness to dynamic decision-making scenarios.

Video

BibTeX

@misc{zhao2025autoregressivemetaactionsunifiedcontrollable,
        title={Autoregressive Meta-Actions for Unified Controllable Trajectory Generation}, 
        author={Jianbo Zhao and Taiyu Ban and Xiyang Wang and Qibin Zhou and Hangning Zhou and Zhihao Liu and Mu Yang and Lei Liu and Bin Li},
        year={2025},
        eprint={2505.23612},
        archivePrefix={arXiv},
        primaryClass={cs.RO},
        url={https://arxiv.org/abs/2505.23612}, 
    }
  

Acknowledgement

This website is adapted from Nerfies, licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.