Emma van Zoelen, Delft University

Abstract

A growing body of research on human-agent teaming [1], [2] and human-robot collaboration [3], [4] shows that machines are increasingly acting as team members to humans. The agents and robots in these studies often employ different forms of Machine Learning to enable them to adapt to their environment (e.g. [5], [6]). Given that humans are naturally adaptive, it is certain that partners will mutually adapt their actions. Over longer periods of time, this adaptation transforms into co-evolution [7].  

In our research, we investigate how to support human-machine team partners in identifying co-adaptive behavior and in sharing successful Collaboration Patterns (reflective communication [8]). Such communication enables the human-machine team to achieve shared awareness of these Patterns, and helps them to successfully co-learn. 

We have previously run experiments in a virtual Urban-Search-and-Rescue environment [9]. Human participants collaborated with a Reinforcement Learning agent in saving an earthquake victim from underneath a pile of rocks. Both the human and the agent had to learn to use their unique capabilities to jointly complete the task (interdependence [10]). Teams developed a great diversity of Collaboration Patterns, that were often continued for several rounds of the task. However, due to spontaneous deviations by both the human and the machine partner, mistakes sometimes occurred.  

To enable communication and the development of shared awareness of successful Collaboration Patterns, the human-machine team needs a common language. We have developed an ontology that provides a knowledge structure for Collaboration Patterns: a conceptual framework that functions as a basis for communication. An accompanying Graphical User Interface (GUI) enables team partners to formalize and refine Collaboration Patterns through communication. The ontology and GUI were evaluated using video recordings of human-machine teams at work. Results showed that they supported humans in recognizing and defining Collaboration Patterns in the videos successfully. We are currently preparing an evaluation of the use of the ontology and GUI by a human-machine team during task execution.  

Collaborative learning is essential for human-machine teams to be successful. Our research contributes to the formalization, implementation and validation of a framework that supports identification, reflection and agreement of successful human-machine team behaviors.