How can we enable agents to efficiently and safely learn online, from interaction with the real world? I will first present safe Bayesian optimization, where we quantify uncertainty in the unknown objective and constraints, and, under some regularity conditions, can guarantee both safety and convergence to a natural notion of reachable optimum. I will then consider Bayesian model-based deep reinforcement learning, where we use the epistemic uncertainty in the world model to guide exploration while ensuring safety. Lastly I will discuss how we can meta-learn flexible probabilistic models from related tasks and simulations, and demonstrate our approaches on real-world applications, such as robotics tasks and tuning the SwissFEL Free Electron Laser.

Autonomous robots are becoming increasingly prevalent in our daily existence, from navigating our roads and sky, assisting in households and warehouses, conducting daring search and rescue missions, and even exploring the frontiers of space. Yet building robots that can safely and fluently interact with humans in a trusted manner remains an elusive task. Ensuring robots can keep a sufficiently safe distance from humans is at odds with fluent interactions, yet humans are remarkable at seamlessly avoiding collision in crowded settings. In this talk, we will study how humans engage in safe and fluent multi-agent interactions and how this can be applied to robot decision-making and control. In the first half of the talk, I will introduce the notion of safety concepts and demonstrate how we can tractably synthesize data-driven safety concepts using control theoretic tools as inductive biases. These data-driven safety concepts are designed to capture how humans think about safety in real-world scenarios more accurately. In the second half, I will present recent work investigating how fluent motion can lead to safer interactions. Specifically, I will show that legible and proactive robot behavior can lead to prosocial interactions. This talk aims to revisit how safety is defined and rethink how safety and fluency can be more compatible with one another in human-robot interactions.

2024 is off to an exciting start with enormous enthusiasm for humanoids and other robots based on recent advances in "end-to-end" large robot action models. Initial results are promising, and several collaborative efforts are underway to collect the needed demonstration data. But is Data All You Need? I'll present my view of the status quo in terms of manipulation task definition, data collection, and experimental evaluation. I'll then suggest that to reach expected performance levels, it may be helpful for the community to reconsider good old fashioned engineering in terms of modularity, metrics, and failure analysis. I'll present MANIP, a potential framework for doing this that shows promise for tasks such as cable untangling, surgical suturing, and bagging. I welcome feedback: this will be the first time I present this talk and I expect it to be a bit controversial ;)

Embryonic tissue is an active material able to self-shape, self-heal, and control its strength in space and time. Realizing these features in synthetic materials would change static objects—with properties set at design time—into dynamic programmable matter. However, unlike tissue, which achieves these capabilities by rearranging tight-packed cells throughout the tissue, current material-like robotic collectives can generally only move units at the perimeter of the collective. In this talk, I will describe how by encoding key tissue-inspired processes into robotic units, here we build material-like robotic collectives capable of topological rearrangement throughout the collective, enabling spatiotemporal control of shape and strength.

With advancements in machine learning and artificial intelligence, a new generation of “learning-enabled” robots is emerging, which are better suited to operating autonomously in unstructured, uncertain, and unforgiving environments. To achieve these goals, robots must be able to adapt to evolving conditions that are different from those seen during training or expected during deployment. In this talk I will first talk about adapting to novel instantiations, i.e., different task instances with shared structure, through parameter adaptation. Such adaptation is done passively, by augmenting physics-based models with learned models, with our key contribution being that the interpretability of physical parameters is retained, allowing us to monitor adaptation. Second, I will talk about a framework for active adaptation where the model monitors its own performance and curates a diverse subset of uncertain inputs to be used for periodic fine-tuning of the model, improving performance over the full data lifecycle.

Driver assistance systems hold the promise of improving safety on the road. We are particularly interested in developing new assistance systems that smoothly share control with the driver and testing them in a wide range of driving conditions. Given the central role of the driver in a shared control system, it is critical to elicit natural driving behavior during tests. This talk discusses the development of a flexible driving simulation platform that can be used for safe and immersive shared control testing. Our platform, known as "Vehicle-in-the-Loop", enables experiments on a real vehicle within a simulated traffic scenario viewed by the driver in a virtual reality headset. By implementing this platform around a four-wheel steer-by-wire vehicle, the driver can interact with shared control systems in a variety of test conditions – including low friction and highway speed driving – all on one vehicle platform and at one proving ground.

Robot design is an inherently difficult process that requires balancing multiple different aspects: kinematics and geometry, materials and compliance, actuation, fabrication, control complexity, power, and more. Computational design systems aim to simplify this process by helping designers check whether their designs are feasible and interdependencies are satisfied. But what can we say about when a design that accomplishes a task even exists? Or what the simplest design that does a job is? In this talk, I will discuss recent work from my group in which we have discovered that, in some cases, design problems can be mapped to problems in robot planning, and that results derived in the planning space allow us to make formal statements about design feasibility. These ideas apply to systems as varied as traditional robot arms, dynamical quadrupeds, compliant manipulators, and modular truss structures. I will share examples from systems developed in my group and forecast forward on the implications of these results for future robot co-design.

TBD

TBD

TBD