VoGe: A Voice and Gesture System for Interacting with Autonomous Cars

Authors

• Pablo Sauras-Perez - Clemson University
• Andrea Gil - Clemson University
• Jasprit Singh Gill - Clemson University
• Pierluigi Pisu - Clemson University
• Joachim Taiber - ITIC

Topic

• Autonomous vehicles
• Brake pedals
• Research and development
• Simulators
• Wheels
• Vehicle drivers
• Suppliers
• Identification
• Robotics

Citation

Also In

References

1. Continental Automotive – Advanced Driver Assistance Systems http://www.continental-automotive.com/www/automotive_de_en/themes/passenger_cars/chassis_safety/adas/ October 2016
2. Juliussen , E. and Carlson , J. Autonomous Cars – Not if, but when IHS Automotive Jan. 2014
3. Nissan’s Autonomous Self Driving Car | Nissan USA http://www.nissanusa.com/blog/autonomous-drive-car October 2016
4. Model S Autopilot Press Kit | Tesla Motors https://www.teslamotors.com/presskit/autopilot October 2016
5. Autonomous Cars – An industry influence study Appinions Inc. July 2014
6. Self-Driving Cars: The Next Revolution KPMG 2012
7. Self-Driving Cars: Are We Ready? KPMG 2013
8. IEEE – News Releases Expert Members of IEEE Identify Driveless Cars as Most Viable Form of Intelligent Transportation, Dominating the Roadway by 2040 and Sparking Dramatic Changes In Vehicular Travel IEEE Sept. 2012 http://www.ieee.org/about/news/2012/5september_2_2012.html October 2016
9. Montemerlo , M. et al. Junior: The Stanford Entry in the Urban Challenge Journal of Field Robotics 2008
10. Google Self-Driving Car Project https://www.google.com/selfdrivingcar/ October 2016
11. IEEE – News Releases IEEE Survey Reveals Mass-Produced Cars Will Not Have Steering Wheels, Gas/Brakes Pedals, Horns, or Rearview Mirrors by 2035 IEEE July 2014 http://www.ieee.org/about/news/2014/14_july_2014.html October 2016
12. Lu , D. T. Z. et al. Unlock and authentication for autonomous vehicles U.S. Patent 9,194,168 Nov. 24 2015
13. Markoff , J. Google’s Next Phase in Driverless Cars: No Steering Wheel or Brake Pedals The New York Times May 2014 http://www.nytimes.com/2014/05/28/technology/googles-next-phase-in-driverless-cars-no-brakes-or-steering-wheel.html October 2016
14. McFarland , M. Look inside Google’s new self-driving car The Washington Post July 2015 https://www.washingtonpost.com/news/innovations/wp/2015/07/13/look-inside-googles-new-self-driving-car/ October 2016
15. Dagmar , K. and Schmidt , A. Design space for driver-based automotive user interfaces Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications ACM 2009
16. Rodel , C. et al. Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications ACM 2014
17. De Ambroggi , L. and Kona , A. Google's driverless car to boost revenues for semiconductor IHS Technology June 2014 https://technology.ihs.com/502831/automotive-semiconductor-impression-220514 October 2016
18. Schoettle , B. and Sivak , M. A survey of public opinion about autonomous and self-driving vehicles in the U.S., the U.K., and Australia University of Michigan Transportation Research Institute UMTRI July 2014
19. Rupp , J. D. and King , A. G. Autonomous Driving – A Practical Roadmap SAE International 2010
20. DeMattia , N. Autonomous Driving: Coming in Small Doses BMW Blog 2015 http://www.bmwblog.com/2015/04/07/autonomous-driving-coming-in-small-doses/ October 2016
21. Davies , A. Ford’s Skipping the Trickiest Thing About Self-Driving Cars WIRED Nov. 2015 http://www.wired.com/2015/11/ford-self-driving-car-plan-google/ October 2016
22. SAE On-Road Automated Vehicle Standards Committee Taxonomy and definitions for terms related to on-road motor vehicle automated driving systems SAE International 2014
23. Smith , B. W. and Svensson , J. Automated and Autonomous Driving: Regulation under Uncertainty Organization for Economic Co-operation and Development (OECD) 2015
24. Smith , B. W. Publications – NewlyPossible https://newlypossible.org/wiki/index.php?title=Publications October 2016
25. Casley , S. V. et al. A study of public acceptance of autonomous cars Worcester Polytechnic Institute Worcester, MA, USA 2013
26. Fagnant , D. J. and Kockelman , K. Preparing a Nation for Autonomous Vehicles: Opportunities, Barriers and Policy Recommendations for Capitalizing on Self-Driven Vehicles Transportation Research Part A July 2013
27. Kalra , N. , Anderson , J. and Wachs , M. Liability and Regulation of Autonomous Vehicle Technologies California PATH Program Institute of Transportation Studies, University of California Berkeley April 2009
28. Jiang , T. et al. Self_Driving Cars: Disruptive or Incremental? Applied Innovation Review June 2015
29. California Department of Motor Vehicles Order to Adopt-Article 3.7 Autonomous vehicles August 2014
30. Urmson , C. The View from the Front Seat of the Google Self-Driving Car, Chapter 3 https://medium.com/@chris_urmson/the-view-from-the-front-seat-of-the-google-self-driving-car-chapter-3-476ea9deed9a#.ny2z0sdhw October 2016
31. Hemmersbaugh , P. A. Letter from NHTSA to Dr. Chris Urmson NHTSA 2016 http://isearch.nhtsa.gov/files/Google%20--%20compiled%20response%20to%2012%20Nov%20%2015%20interp%20request%20--%204%20Feb%2016%20final.htm October 2016
32. Federal Automated Vehicles Policy. Accelerating the Next Revolution in Road Safety USDOT September 2016
33. Youngs , J. 2014 U.S. Automotive Emerging Technologies Study Results J.D. Power, McGraw Hill Financial 2014 http://www.jdpower.com/cars/articles/jd-power-studies/2014-us-automotive-emerging-technologies-study-results October 2016
34. Adams , T. Self-driving cars: from 2020 you will become a permanent backseat driver The Guardian 2015 http://www.theguardian.com/technology/2015/sep/13/self-driving-cars-bmw-google-2020-driving October 2016
35. The Mercedes-Benz F 015 Luxury in Motion https://www.mercedes-benz.com/en/mercedes-benz/innovation/research-vehicle-f-015-luxury-in-motion/ October 2016
36. Rinspeed XchangeE http://www.rinspeed.eu/concept-galery.php?cid=25 October 2016
37. Sparkes , M. Google forced to add steering wheel to driveless cars The Telegraph Aug. 2014 http://www.telegraph.co.uk/technology/google/11051009/Google-forced-to-add-steering-wheel-to-driverless-cars.html October 2016
38. Bolt , R. A. Put that there: Voice and Gesture at the Graphics Interface Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques ACM 1980
39. Kranstedt , A. et al. Deixis: How to determine demonstrated objects using a pointing cone Gesture in Human-Computer Interaction and Simulation Springer Berlin Heidelberg 2005 300 311
40. Holzapfel , H. , Nickel , K. and Stiefelhagen , R. Implementation and Evaluation of a Constraint-Based Multimodal Fusion System for Speech and 3D Pointing Gestures Proceedings of the 6th International Conference on Multimodal Interfaces ACM 2004
41. Kowadlo , G. , Ye , P. , and Zukerman , I. Influence of Gestural Salience on the Interpretation of Spoken Requests INTERSPEECH 2010
42. Muller , C. and Weinberg , G. Multimodal input in the car, today and tomorrow IEEE MultiMedia IEEE 2011
43. Pfleging , B. , Schneegass , S. and Schmidt , A. Multimodal Interaction in the Car: Combining Speech and Gestures on the Steering Wheel Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications ACM 2012
44. Hobbs , N. et al. Gesture-based automotive controls U.S. Patent 8,942,881 Jan. 27 2015
45. King , A. G. Interacting with vehicle controls through gesture recognition U.S. Patent Application 13/366,388 Aug. 8 2013
46. Riener , A. et al. Standardization of the In-Car Gesture Interaction Space Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications ACM 2013
47. Vaghefinazari , P. et al. System and Method for incorporating Gesture and Voice Recognition into a Single System U.S. Patent US9211854 B2 Dec. 15 2015
48. Rumelin , S. , Marouane , C. , Butz , A. Free-hand pointing for identification and interaction with distant objects Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications ACM 2013
49. Matsumura , K. et al. Stick'N Conversation: Stick In-car Conversation into Places Using Multi Person Finger Pointing Gestures Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications ACM 2015
50. McCall , C. E. et al. Gesture actuated point of interest information systems and methods U.S. Patent Application 12/430,389 Oct. 28 2010
51. Traore , I. Continuous Authentication Using Biometrics: Data, Models, and Metrics IGI Global 2011
52. Kinect – Windows app development https://dev.windows.com/en-us/kinect October 2016
53. EmguCV OpenCV in .NET (C#, VB, C++ and more) http://www.emgu.com/ October 2016
54. OpenCV http://opencv.org/ October 2016
55. Arduino – Home https://www.arduino.cc/ October 2016
56. Minoru 3D http://www.minoru3d.com/ October 2016
57. Bradski , G. and Kaehler , A. Learning OpenCV: Computer vision with the OpenCV library O'Reilly Media, Inc. 2008
58. Jiang , Y. et al. Target object identification and localization in mobile manipulations 2011 IEEE International Conference on Robotics and Biomimetics (ROBIO) IEEE 2011
59. Wang , M. and Latotzky , D. Driving an autonomous car with eye tracking Free University of Berlin 2010
60. Göhring , D. et al. Semi-autonomous car control using brain computer interfaces Intelligent Autonomous Systems 12 Springer Berlin Heidelberg 2013 393 408
61. Richarz , J. et al. There you go!-estimating pointing gestures in monocular images for mobile robot instruction 15th IEEE International Symposium on Robot and Human Interactive Communication IEEE 2006
62. Droeschel , D. et al. Learning to interpret pointing gestures with a time-of-flight camera Proceedings of the 6th international conference on Human-robot interaction ACM 2011
63. Kang , S. et al. Do you see what I see: towards a gaze-based surroundings query processing system Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications ACM 2015
64. Kim , Y. H. and Misu , T. Identification of the driver's interest point using a head pose trajectory for situated dialog systems Proceedings of the 16th International Conference on Multimodal Interaction ACM 2014
65. Misu , T. et al. Situated language understanding for a spoken dialog system within vehicles Computer Speech & Language 34 1 2015 186 200
66. Grossman , T. and Balakrishnan , R. The design and evaluation of selection techniques for 3D volumetric displays Proceedings of the 19th annual ACM Symposium on User Interface Software and Technology ACM 2006
67. Steed , A. Towards a general model for selection in virtual environments IEEE Symposium on 3D User Interfaces IEEE 2006
68. Zobl , M. et al. A usability study on hand gesture controlled operation of in-car devices Proceedings HCI 2001
69. Tchankue , P. et al. Design and evaluation of a multimodal interface for in-car communication systems Proceedings of the 2010 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists ACM 2010
70. Baron , A. and Green , P. Safety and usability of speech interfaces for in-vehicle tasks while driving: A brief literature review No. UMTRI-2006-5 University of Michigan, Transportation Research Institute 2006
71. Hua , Z. and Wei , L. Ng. Speech recognition interface design for in-vehicle system Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications ACM 2010
72. Alvarez , I. et al. Designing driver-centric natural voice user interfaces Adjunct Proceedings of AutomotiveUI ACM 2011
73. Pickering , C. et al. A review of automotive human machine interface technologies and techniques to reduce driver distraction 2nd International Conference on Institution of Engineering and Technology (IET) 2007
74. Riener , A. and Rossbory , M. Natural and Intuitive Hand Gestures: A Substitute for Traditional Vehicle Control? Proceedings of the AutomotiveUI ACM 2011
75. Lee , J. C. In search of a natural gesture ACM Crossroads 16.4 2010 9 12
76. Malizia , A. and Bellucci , A. The artificiality of natural user interfaces Communications of the ACM 55 3 2012 36 38
77. Norman , D. A. Natural user interfaces are not natural Interactions of the ACM 17 3 2010 6 10
78. Norman , D. A. and Nielsen , J. Gestural interfaces: a step backward in usability Interactions of the ACM 17 5 2010 46 49
79. Sauras-Perez , P. et al. Variability analysis of in-car gesture interaction 2014 International Conference on Connected Vehicles and Expo (ICCVE) IEEE 2014
80. Głomb , P. et al. Choosing and modeling the hand gesture database for a natural user interface Gesture and sign language in human-computer interaction and embodied communication Springer Berlin Heidelberg 2011
81. Grandhi , S. A. et al. Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ACM 2011

Cited By