Publikationsdatenbank
Publication
Relevant Perception Modalities for Flexible Human-Robot TeamsNico Höllerich , Dominik Henrich
Abstract (english)
Robust and reliable perception plays an important role when humans engage into cooperation with robots in industrial or household settings. Various explicit and implicit communication modalities and perception methods can be used to recognize expressed intentions. Depending on the modality, different sensors, areas of observation, and perception methods need to be utilized. More modalities increase the complexity and costs of the setup.
We consider the scenario of a cooperative task in a potentially noisy environment, where verbal communication is hardly feasible. Our goal is to investigate the importance of different, non-verbal communication modalities for intention recognition. To this end, we build upon an established benchmark study for human cooperation and investigate which input modalities contribute most towards recognizing the expressed intention. To measure the detection rate, we conducted a second study. Participants had to predict actions based on a stream of symbolic input data.
Findings confirm the existence of a common gesture dictionary and the importance of hand tracking for action prediction when the number of feasible actions increases. The contribution of this work is a usage ranking of gestures and a comparison of input modalities to improve prediction capabilities in human-robot cooperation.
Publication data
| Year: | 2020 |
| Publication date: | 04. September 2020 |
| Place: | Neapel |
| Source: | 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) |
| Project: | FlexCobot |
| Keywords (english): | Human-Robot Interaction , Non-verbal Cues and Expressiveness , User Study |
| Referrer: | https://www.ai3.uni-bayreuth.de/de/publikationen/resypub/index.php?mode=pub_show&pub_ref=hllerich2020a |
| Free text: | Link to publication |
BibTeX
@ARTICLE{hllerich2020a,
TITLE = "Relevant Perception Modalities for Flexible Human-Robot Teams",
AUTHOR = "Höllerich, Nico and Henrich, Dominik",
YEAR = "2020",
JOURNAL = "29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)",
HOWPUBLISHED = "\url{https://www.ai3.uni-bayreuth.de/de/publikationen/resypub/index.php?mode=pub_show&pub_ref=hllerich2020a}",
NOTE = "<a href="https://doi.org/10.1109/RO-MAN47096.2020.9223593" target="_blank">Link to publication</a>",
}