Jakob Thumm

Contacts:

Email: thumm at stanford dot edu

Jakob Thumm

Jakob is a postdoctoral scholar in the Department of Aeronautics and Astronautics. His research aims to improve the safety, efficiency, and acceptance of autonomous robots by combining formal methods and machine learning. Jakob focuses on developing algorithms that enable robots to efficiently act in dynamic environments while guaranteeing safety at all times. He is particularly interested in allowing robots to safely work together with humans.

Prior to joining Stanford, Jakob earned his Ph.D. in Computer Engineering from the Technical University of Munich. His doctoral thesis is titled ``Establishing Safe and Preference-Aligned Human-Robot Collaboration in Autonomous Manipulation’’ and passed with highest distinctions. Jakob received his M.Sc. and B.Sc. in Mechatronics from the Karlsruhe Institute of Technology, researching the intersection of system modelling and machine learning.

Outside the lab, Jakob is a passionate runner and volunteer at Sutro Stewards, where he maintains hiking trails in the heart of San Francisco.


ASL Publications

  1. J. Thumm, C. Agia, M. Pavone, and M. Althoff, “Text2Interaction: Establishing Safe and Preferable Human-Robot Interaction,” in Conf. on Robot Learning, Munich, Germany, 2024. (In Press)

    [BibTeX] [Abstract]

    Abstract: Adjusting robot behavior to human preferences can require intensive human feedback, preventing quick adaptation to new users and changing circumstances. Moreover, current approaches typically treat user preferences as a reward, which requires a manual balance between task success and user satisfaction. To integrate new user preferences in a zero-shot manner, our proposed Text2Interaction framework invokes large language models to generate a task plan, motion preferences as Python code, and parameters of a safety controller. By maximizing the combined probability of task completion and user satisfaction instead of a weighted sum of rewards, we can reliably find plans that fulfill both requirements. We find that 83% of users working with Text2Interaction agree that it integrates their preferences into the plan of the robot, and 94% prefer Text2Interaction over the baseline. Our ablation study shows that Text2Interaction aligns better with unseen preferences than other baselines while maintaining a high success rate. Real-world demonstrations and code are made available at sites.google.com/view/text2interaction.

     
    @inproceedings{ThummAgiaEtAl2024,
  author = {Thumm, J. and Agia, C. and Pavone, M. and Althoff, M.},
  title = {Text2Interaction: Establishing Safe and Preferable Human-Robot Interaction},
  booktitle = {{Conf. on Robot Learning}},
  year = {2024},
  month = nov,
  address = {Munich, Germany},
  keywords = {press},
  note = {In press},
  owner = {agia},
  timestamp = {2024-10-30},
  url = {https://arxiv.org/abs/2408.06105}
}