titleBiCAT: Bimanual Coordination Action Tokenization
authorsXuanwei Liu, Guipu Cao, Zhongyi Luo, Jiafei Duan
date2026-11-17
venuearXiv (preprint, not peer reviewed)
idarXiv:2611.23499
affiliationNational University of Singapore
upvotes3 (Hugging Face Daily Papers, 2026-11-21)
linksabs pdf hf code
cite
primerVision-language-action models
relatedJeva: System One Models from First Principles
Jeveration: System One Models Now Generate
SO-Arena: Benchmarking the Capability Spectrum and Reliability of System One Models
Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulation
AI for Games in the Foundation Model Era
abstractAutoregressive vision-language-action (VLA) models predict discrete action tokens with the next-token objective of their vision-language backbone, so the action tokenizer defines the interface between the policy and the robot. In bimanual manipulation, the two arms share a repertoire of movements yet coordinate through complementary roles, and an action representation should capture both. However, most existing tokenizers encode both arms as a single concatenated action vector, in which motion patterns common to the two arms are not shared and cross-arm dependencies remain entangled within each token. The policy must therefore learn both aspects implicitly. We propose Bimanual Coordination Action Tokenization (BiCAT), which shares one motion representation across arms while conditioning each arm's tokens on its partner through symmetric cross-arm attention and a joint decoder. The policy then predicts all tokens of each arm in parallel, generating the left arm first and the right arm conditioned on it. Across ten RoboTwin 2.0 tasks and six real-world tasks on three embodiments, BiCAT achieves the highest success among the compared tokenizers. In simulation, it improves mean success by 17.6 percentage points over the strongest of eight baselines, with the largest gains on tasks that require close coordination between the arms, while requiring only 40.5 ms per action chunk. These results suggest that the action tokenizer is a natural place to model bimanual coordination.

bibtex

@misc{liu2026bicat,
  title={BiCAT: Bimanual Coordination Action Tokenization},
  author={Xuanwei Liu and Guipu Cao and Zhongyi Luo and Jiafei Duan},
  year={2026},
  eprint={2611.23499},
  archivePrefix={arXiv},
  url={https://arxiv.org/abs/2611.23499}
}