title"I didn't Make the Micro Decisions": Measuring, Inducing, and Exposing Goal-Level AI Contributions in Collaboration
authorsEunsu Kim, Jessica R. Mindel, Kyungjin Kim, Sherry Tongshuang Wu
date2026-05-20
venuearXiv (preprint, not peer reviewed)
idarXiv:2605.21363
upvotes3 (Hugging Face Daily Papers, 2026-11-01)
linksabs pdf hf code
abstractAs large language models (LLMs) increasingly shape how users form, refine, and extend their goals, attributing contributions in human-AI collaboration becomes critical for users calibrating their own reliance and for evaluators assessing AI-assisted work. Yet existing methods focus on final artifacts, missing the process through which goals themselves are jointly shaped. We introduce a goal-level attribution framework, CoTrace, that decomposes explicit goals into verifiable requirements and traces both direct contributions and indirect influences across dialogue turns. Applying CoTrace to 638 real-world collaboration logs, we find that while models account for only 11-26% of goal-shaping contribution, they contribute substantially more on introducing lower-level concrete requirements, and make various kinds of indirect contributions. Through controlled simulations, we show that interaction design choices significantly affect model goal-shaping behavior. In a user study, exposing participants to goal-level analyses shifts their perceived contributions by nearly 2 points on a 5-point scale, revealing systematic miscalibration in how users understand their own AI-assisted work.

cite

@misc{kim2026i,
  title={"I didn't Make the Micro Decisions": Measuring, Inducing, and Exposing Goal-Level AI Contributions in Collaboration},
  author={Eunsu Kim and Jessica R. Mindel and Kyungjin Kim and Sherry Tongshuang Wu},
  year={2026},
  eprint={2605.21363},
  archivePrefix={arXiv},
  url={https://arxiv.org/abs/2605.21363}
}