Title
Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration
Abstract
Bayesian optimization (BO) with Gaussian processes (GP) has become an indispensable algorithm for black box optimization problems. Not without a dash of irony, BO is often considered a black box itself, lacking ways to provide reasons as to why certain parameters are proposed to be evaluated. This is particularly relevant in human-in-the-loop applications of BO, such as in robotics. We address this issue by proposing ShapleyBO, a framework for interpreting BO's proposals by game-theoretic Shapley values.They quantify each parameter's contribution to BO's acquisition function. Exploiting the linearity of Shapley values, we are further able to identify how strongly each parameter drives BO's exploration and exploitation for additive acquisition functions like the confidence bound. We also show that ShapleyBO can disentangle the contributions to exploration into those that explore aleatoric and epistemic uncertainty. Moreover, our method gives rise to a ShapleyBO-assisted human machine interface (HMI), allowing users to interfere with BO in case proposals do not align with human reasoning. We demonstrate this HMI's benefits for the use case of personalizing wearable robotic devices (assistive back exosuits) by human-in-the-loop BO. Results suggest human-BO teams with access to ShapleyBO can achieve lower regret than teams without.
Paper information
Full paper information (preprint, external website) - pdf
Bio
Julian Rodemann is a PhD Fellow at the Department of Statistics at Ludwig-Maximilians-Universität (LMU) Munich. His research revolves around adaptive machine learning and online learning.
Practical
This seminar is part of the seminar series on Integreat's objective Fair, Explainable and Trustworthy Machine Learning.
The Tuesdays seminars series are devoted to various topics relevant for the Integreat´s research focus. Presenters from the Integreat community and beyond have 40 minutes to present, followed by a group discussion.
Seminars are open for attendance for everybody.
For those not able to attend in person: https://uio.zoom.us/j/62535744013
Point of contacts:
- Organiser and moderator: Professor Robert Jenssen, UiT The Arctic University of Norway
- Integreat Administrative Leader Maria Dikova, University of Oslo