This content is not included in your SAE MOBILUS subscription, or you are not logged in.
A Voice and Pointing Gesture Interaction System for On-Route Update of Autonomous Vehicles’ Path
ISSN: 0148-7191, e-ISSN: 2688-3627
Published April 02, 2019 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
This paper describes the development and simulation of a voice and pointing gesture interaction system for on-route update of autonomous vehicles’ path. The objective of this research is to provide users of autonomous vehicles a human vehicle interaction mode that enables them to make and communicate spontaneous decisions to the autonomous car, modifying its pre-defined autonomous route in real-time. For example, similar to giving directions to a taxi driver, a user will be able to tell the car «Stop there» or «Take that exit». In this way, the user control/spontaneity vs interaction flexibility dilemma that current autonomous vehicle concepts have, could be solved, potentially increasing the user acceptance of this technology.
The system was designed following a level structured state machine approach. The simulations were developed using MATLAB and VREP, a robotics simulation platform, which has accurate vehicle and sensor models. The simulation results demonstrate the main functions of the proposed system and set potential challenges that should be addressed prior to a real car implementation. The resolution of these challenges constitute our team’s on-going efforts in this research area.
CitationSauras-Perez, P. and Pisu, P., "A Voice and Pointing Gesture Interaction System for On-Route Update of Autonomous Vehicles’ Path," SAE Technical Paper 2019-01-0679, 2019, https://doi.org/10.4271/2019-01-0679.
Data Sets - Support Documents
|[Unnamed Dataset 1]|
- IEEE - News Releases, “Expert Members of IEEE Identify Driveless Cars as Most Viable Form of Intelligent Transportation, Dominating the Roadway by 2040 and Sparking Dramatic Changes In Vehicular Travel,” IEEE, Sept. 2012, http://www.ieee.org/about/news/2012/5september_2_2012.html, last visited October 2018.
- “33 Corporations Working On Autonomous Vehicles,” CB Insights, Aug. 2016, https://www.cbinsights.com/blog/autonomous-driverless-vehicles-corporations-list/, last visited October 2018.
- Montemerlo, M. et al., “Junior: The Stanford Entry in the Urban Challenge,” Journal of Field Robotics, 2008.
- “Driveless Car Market Match,” http://www.driverless-future.com/, last visited October 2018.
- “The Mercedes-Benz F 015 Luxury in Motion,” https://www.mercedes-benz.com/en/mercedes-benz/innovation/research-vehicle-f-015-luxury-in-motion/, last visited October 2018.
- Rinspeed XchangeE, https://www.rinspeed.eu/en/XchangE_24_concept-car.html, last visited October 2018.
- IEEE - News Releases, “IEEE Survey Reveals Mass-Produced Cars Will Not Have Steering Wheels, Gas/Brakes Pedals, Horns, or Rearview Mirrors by 2035,” IEEE, July 2014, http://www.ieee.org/about/news/2014/14_july_2014.html, last visited March 2017.
- Waymo, https://waymo.com/, last visited March 2017.
- Rodel C. et al., “Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience,” In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ACM, 2014.
- De Ambroggi, L. and Kona A., “Google’s Driverless Car to Boost Revenues for Semiconductor,” IHS Technology, June 2014, https://technology.ihs.com/502831/automotive-semiconductor-impression-220514, last visited March 2017.
- Schoettle B. and Sivak M., “A Survey of Public Opinion About Autonomous and Self-Driving Vehicles in the U.S., the U.K., and Australia,” University of Michigan Transportation Research Institute (UMTRI), July 2014.
- Rupp, J.D. and King, A.G., “Autonomous Driving - A Practical Roadmap,” SAE Technical Paper 2010-01-2335, 2010, doi:10.4271/2010-01-2335.
- Sauras-Perez, P., Gil-Batres, A., Singh Gill, J., Pisu, P. et al., “VoGe: A Voice and Gesture System for Interacting with Autonomous Cars,” SAE Technical Paper 2017-01-0068, 2017, doi:10.4271/2017-01-0068.
- Wang, M. and Latotzky, D., Driving an Autonomous Car with Eye Tracking (Free University of Berlin, 2010).
- Göhring, D. et al., “Semi-Autonomous Car Control Using Brain Computer Interfaces,” in Intelligent Autonomous Systems 12, Springer Berlin, Heidelberg, 2013, 393-408.
- Coppelia Robotics - VREP, http://www.coppeliarobotics.com/, last visited October 2018.
- King-Hele, D., “Erasmus Darwin’s Improved Design for Steering Carriages--and Cars,” Notes and Records of the Royal Society 56(1):41-62, 2002.
- The Open Motion Planning Library, http://ompl.kavrakilab.org/, last visited October 2018.
- System.Speech Namespaces, https://msdn.microsoft.com/en-us/library/gg145021(v=vs.110).aspx, last visited October 2018.
- Speech Recognition Grammar Specification Version 1.0, https://www.w3.org/TR/speech-grammar/, last visited October 2018.
- Corke, P.I., Robotics, Vision & Control: Fundamental Algorithms in MATLAB (Springer, 2011). ISBN:978-3-642-20143-1.
- Thrun, S., “Artificial Intelligence for Robotics,” Udacity Course, Online Learning, https://www.udacity.com/, last visited March 2017.
- OpenGL, https://www.opengl.org/, last visited October 2018.
- OpenGL Projection Matrix, http://www.songho.ca/opengl/gl_projectionmatrix.html, last visited October 2018.
- iOS - Siri - Apple, http://www.apple.com/ios/siri/, last visited October 2018.
- Alexa, https://developer.amazon.com/alexa, last visited October 2018.