This content is not included in your SAE MOBILUS subscription, or you are not logged in.
A Voice and Pointing Gesture Interaction System for On-Route Update of Autonomous Vehicles’ Path
ISSN: 0148-7191, e-ISSN: 2688-3627
Published April 02, 2019 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
This paper describes the development and simulation of a voice and pointing gesture interaction system for on-route update of autonomous vehicles’ path. The objective of this research is to provide users of autonomous vehicles a human vehicle interaction mode that enables them to make and communicate spontaneous decisions to the autonomous car, modifying its pre-defined autonomous route in real-time. For example, similar to giving directions to a taxi driver, a user will be able to tell the car «Stop there» or «Take that exit». In this way, the user control/spontaneity vs interaction flexibility dilemma that current autonomous vehicle concepts have, could be solved, potentially increasing the user acceptance of this technology.
The system was designed following a level structured state machine approach. The simulations were developed using MATLAB and VREP, a robotics simulation platform, which has accurate vehicle and sensor models. The simulation results demonstrate the main functions of the proposed system and set potential challenges that should be addressed prior to a real car implementation. The resolution of these challenges constitute our team’s on-going efforts in this research area.
CitationSauras-Perez, P. and Pisu, P., "A Voice and Pointing Gesture Interaction System for On-Route Update of Autonomous Vehicles’ Path," SAE Technical Paper 2019-01-0679, 2019, https://doi.org/10.4271/2019-01-0679.
Data Sets - Support Documents
|Unnamed Dataset 1|
- IEEE - News Releases 2012 http://www.ieee.org/about/news/2012/5september_2_2012.html
- Montemerlo , M. et al. Junior: The Stanford Entry in the Urban Challenge Journal of Field Robotics 2008
- IEEE - News Releases http://www.ieee.org/about/news/2014/14_july_2014.html
- Waymo https://waymo.com/
- Rodel C. et al Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications 2014
- De Ambroggi , L. and Kona A. https://technology.ihs.com/502831/automotive-semiconductor-impression-220514
- Schoettle B. and Sivak M. 2014
- Rupp , J.D. and King , A.G. Autonomous Driving - A Practical Roadmap SAE Technical Paper 2010-01-2335 2010 10.4271/2010-01-2335
- Sauras-Perez , P. , Gil-Batres , A. , Singh Gill , J. , Pisu , P. et al. VoGe: A Voice and Gesture System for Interacting with Autonomous Cars SAE Technical Paper 2017-01-0068 2017 10.4271/2017-01-0068
- Wang , M. and Latotzky , D. Driving an Autonomous Car with Eye Tracking Free University of Berlin 2010
- Göhring , D. et al. Semi-Autonomous Car Control Using Brain Computer Interfaces Intelligent Autonomous Systems 12 Springer Berlin, Heidelberg 2013 393 408
- Coppelia Robotics - VREP http://www.coppeliarobotics.com/
- King-Hele , D. Erasmus Darwin’s Improved Design for Steering Carriages--and Cars Notes and Records of the Royal Society 56 1 41 62 2002
- The Open Motion Planning Library http://ompl.kavrakilab.org/ 2018
- System.Speech Namespaces https://msdn.microsoft.com/en-us/library/gg145021(v=vs.110).aspx 2018
- Speech Recognition Grammar Specification Version 1.0 https://www.w3.org/TR/speech-grammar/ 2018
- Corke , P.I. Robotics, Vision & Control: Fundamental Algorithms in MATLAB Springer 2011 978-3-642-20143-1
- Thrun , S. https://www.udacity.com/ 2017
- OpenGL https://www.opengl.org/ 2018
- OpenGL Projection Matrix http://www.songho.ca/opengl/gl_projectionmatrix.html 2018
- iOS - Siri - Apple http://www.apple.com/ios/siri/ 2018
- Alexa https://developer.amazon.com/alexa 2018