Druckansicht der Internetadresse:

Fakultät für Mathematik, Physik und Informatik

Angewandte Informatik III - Robotik und eingebettete Systeme - Prof. Dr. Dominik HENRICH

Seite drucken


All fields:


Relevant Perception Modalities for Flexible Human-Robot Teams
Nico Höllerich , Dominik Henrich

Abstract (english)
Robust and reliable perception plays an important role when humans engage into cooperation with robots in industrial or household settings. Various explicit and implicit communication modalities and perception methods can be used to recognize expressed intentions. Depending on the modality, different sensors, areas of observation, and perception methods need to be utilized. More modalities increase the complexity and costs of the setup.
We consider the scenario of a cooperative task in a potentially noisy environment, where verbal communication is hardly feasible. Our goal is to investigate the importance of different, non-verbal communication modalities for intention recognition. To this end, we build upon an established benchmark study for human cooperation and investigate which input modalities contribute most towards recognizing the expressed intention. To measure the detection rate, we conducted a second study. Participants had to predict actions based on a stream of symbolic input data.
Findings confirm the existence of a common gesture dictionary and the importance of hand tracking for action prediction when the number of feasible actions increases. The contribution of this work is a usage ranking of gestures and a comparison of input modalities to improve prediction capabilities in human-robot cooperation.

Publication data

Year: 2020
Publication date: 04. September 2020
Place: Neapel
Source: 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
Project: FlexCobot
Keywords (english): Human-Robot Interaction , Non-verbal Cues and Expressiveness , User Study
Referrer: https://www.ai3.uni-bayreuth.de/de/publikationen/resypub/index.php?mode=pub_show&pub_ref=hllerich2020a
Free text: Link to publication


  TITLE             = "Relevant Perception Modalities for Flexible Human-Robot Teams",
  AUTHOR            = "Höllerich, Nico and Henrich, Dominik",
  YEAR              = "2020",
  JOURNAL           = "29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)",
  HOWPUBLISHED      = "\url{https://www.ai3.uni-bayreuth.de/de/publikationen/resypub/index.php?mode=pub_show&pub_ref=hllerich2020a}",
  NOTE              = "<a href="https://doi.org/10.1109/RO-MAN47096.2020.9223593" target="_blank">Link to publication</a>",

Twitter Youtube-Kanal UBT-A Kontakt