titleHuman-to-Robot Transfer via Bridging Representation and Action Space in VLAs
authorsJunhyeong Park, Wook Jung, Taeyoung Kim, Huiwon Jang, Jinwoo Shin
date2026-11-03
venuearXiv (preprint, not peer reviewed)
idarXiv:2611.04391
affiliationKAIST AI
upvotes13 (Hugging Face Daily Papers, 2026-11-06)
linksabs pdf hf code
cite
abstractPretrained Vision-Language-Action (VLA) policies provide a strong starting point for deployment, but adapting them to a target robot and environment still requires costly embodiment-specific demonstrations. Human demonstrations are far easier to collect, yet directly leveraging them is challenging due to the substantial human-robot embodiment gap, particularly when the underlying VLA has been pretrained primarily on robot data. We introduce H2RB (Human-To-Robot Bridge), a human-robot co-training framework for adapting pretrained VLA policies from unpaired human and robot demonstrations. H2RB bridges the embodiment gap at both interfaces: geometry-anchored alignment grounds human and robot observations in a compatible representation, while a decoupled-decoder tokenizer shares action latents without forcing both domains through a single action mapping. This design allows human demonstrations to provide useful behavioral supervision while retaining the rich visual, semantic, and control priors of the pretrained VLA. Across real-world tasks, H2RB substantially improves object transfer performance from 8.0 to 51.8 and enables skill transfer to score 62.7, in settings where co-train baselines totally fail to transfer human-demonstrated skills. The benefit also persists under object-placement shifts, improving out-of-distribution transfer from 6.0 to 45.3. H2RB suggests a way for human demonstrations to serve as a scalable supervision source for adapting pretrained robotic policies, reducing the dependence on costly target-robot data collection.

bibtex

@misc{park2026human,
  title={Human-to-Robot Transfer via Bridging Representation and Action Space in VLAs},
  author={Junhyeong Park and Wook Jung and Taeyoung Kim and Huiwon Jang and Jinwoo Shin},
  year={2026},
  eprint={2611.04391},
  archivePrefix={arXiv},
  url={https://arxiv.org/abs/2611.04391}
}