Intuitive Robot Teleoperation through Multi-Sensor Informed Mixed Reality Visual Aids
View/ Open
Author
Livatino, Salvatore
Guastella, Dario C.
Muscato, Giovanni
Rinaldi, Vincenzo
Cantelli, Luciano
Melita, Carmelo D.
Caniglia, Alessandro
Mazza, Riccardo
Padula, Gianluca
Attention
2299/23904
Abstract
Mobile robotic systems have evolved to include sensors capable of truthfully describing robot status and operating environment as accurately and reliably as never before. This possibility is challenged by effective sensor data exploitation, because of the cognitive load an operator is exposed to, due to the large amount of data and time-dependency constraints. This paper addresses this challenge in remote-vehicle teleoperation by proposing an intuitive way to present sensor data to users by means of using mixed reality and visual aids within the user interface. We propose a method for organizing information presentation and a set of visual aids to facilitate visual communication of data in teleoperation control panels. The resulting sensor-information presentation appears coherent and intuitive, making it easier for an operator to catch and comprehend information meaning. This increases situational awareness and speeds up decision-making. Our method is implemented on a real mobile robotic system operating outdoor equipped with on-board internal and external sensors, GPS, and a reconstructed 3D graphical model provided by an assistant drone. Experimentation verified feasibility while intuitive and comprehensive visual communication was confirmed through an assessment, which encourages further developments.
Publication date
2021-02-08Published in
IEEE AccessPublished version
https://doi.org/10.1109/ACCESS.2021.3057808Other links
http://hdl.handle.net/2299/23904Metadata
Show full item recordRelated items
Showing items related by title, author, creator and subject.
-
Stereo Viewing and Virtual Reality Technologies in Mobile Robot Teleguide
Livatino, S.; Muscato, G.; Privitera, F. (2009)The use of 3-D stereoscopic visualization may provide a user with higher comprehension of remote environments in teleoperation when compared with 2-D viewing, in particular, a higher perception of environment depth ... -
Augmented reality stereoscopic visualization for intuitive robot teleguide
Livatino, S.; Muscato, G.; De Tommaso, D.; Macaluso, M. (Institute of Electrical and Electronics Engineers (IEEE), 2010)This paper proposes a method to simultaneously and coherently present visual and laser sensors information through an augmented reality visualization interface further enhanced by stereoscopic viewing. The use of graphical ... -
Video and laser based augmented reality stereoscopic viewing for mobile robot teleoperation
Livatino, Salvatore; Muscato, G.; Banno, F.; De Tommaso, D.; Macaluso, M. (IFAC Proceedings, 2010)This paper proposes an augmented reality visualization interface to simultaneously present visual and laser sensors information further enhanced by stereoscopic viewing. The use of augmented layers is proposed to represent ...