This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Pointing Gesture Based Point of Interest Identification in Vehicle Surroundings
Technical Paper
2018-01-1094
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Language:
English
Abstract
This article presents a pointing gesture-based point of interest computation method via pointing rays’ intersections for situated awareness interactions in vehicles. The proposed approach is compared with two alternative methods: (a) a point of interest identification method based on the intersection of the pointing ray with the point cloud (PoC) resulting from the vehicle sensors, and (b) the traditional ray-casting approach, where the point of interest is computed based on the first intersection of the pointing rays with locations stored in a 2D annotated map. Simulation results show that the presented method outperforms by 36.25% the traditional ray casting one. However, as it was expected, the sensor-based computation method is more accurate. The validation of our approach was conducted by experiments performed in a test track facility. Although limited due to instrumentation challenges that will be described, the analysis of the results shows that a point of interest computation method based on pointing rays’ intersections performs 16.25% better than the traditional ray-casting one. This result is of particular interest in dense scenarios, where more than one point of interest intersects the pointing rays in a 2D map. Finally, this article shows how a POI disambiguation step can help to solve all the POI identification inaccuracies.
Citation
Sauras-Perez, P. and Pisu, P., "Pointing Gesture Based Point of Interest Identification in Vehicle Surroundings," SAE Technical Paper 2018-01-1094, 2018, https://doi.org/10.4271/2018-01-1094.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 | ||
Unnamed Dataset 3 | ||
Unnamed Dataset 4 |
Also In
References
- S. Rumelin , C. Marouane , A. Butz Free-hand Pointing for Identification and Interaction with Distant Objects Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ACM 2013
- K. Matsumura , T. Sakamoto , H. Norma , Y. Sumi Stick'N Conversation: Stick In-car Conversation into Places Using Multi Person Finger Pointing Gestures Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ACM 2015
- C. E. McCall , W. A. Biondo , D. T. Proefke Gesture actuated point of interest information systems and methods, Gm Global Technology Operations, Inc. 2010
- S. Kang , B. Kim , S. Han , H. Kim Do You See What I See: Towards A Gaze-based Surroundings Query Processing System Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ACM 2015
- Y. H. Kim , and T. Misu Identification of the Driver's Interest Point Using a Head Pose Trajectory for Situated Dialog Systems Proceedings of the 16th International Conference on Multimodal Interaction, ACM 2014
- T. Misu , A. Raux , R. Gupta , I. Lane Situated Language Understanding for a Spoken Dialog System within Vehicles Computer Speech & Language 34 1 2015 186 200
- P. Sauras-Perez , A. Gil-Batres , J. Singh Gill , P. Pisu , J. Taiber VoGe: A Voice and Gesture System for Interacting with Autonomous Cars SAE Technical Paper 2017-01-0068 2017
- T. Grossman , and R. Balakrishnan The Design and Evaluation of Selection Techniques for 3D Volumetric Displays Proceedings of the 19th annual ACM Symposium on User Interface Software and Technology, ACM 2006
- A. Steed Towards a General Model for Selection in Virtual Environments IEEE Symposium on 3D User Interfaces, IEEE 2006
- N.T. Dang A Survey and Classification of 3D Pointing Techniques 2007 International Conference on Research, Innovation and Vision for the Future, IEEE 2007
- E. W. Weisstein http://mathworld.wolfram.com/Line-LineIntersection.html 2017
- The Open Motion Planning Library http://ompl.kavrakilab.org/ 2017
- D. King-Hele Erasmus Darwin’s Improved Design for Steering Carriages--and Cars Notes and records of the Royal Society 56 1 2002 41 62
- Kinect for Windows SDK https://msdn.microsoft.com/en-us/library/dn799271.aspx 2017
- USGlobalSat http://usglobalsat.com/ 2017
- Programming Kinect for Windows v2 https://channel9.msdn.com/Series/Programming-Kinect-for-Windows-v2 2017
- https://dev.windows.com/en-us/kinect 2017
- https://jonnyboats.wordpress.com/2009/06/ 2017
- International Transportation Innovation Center http://www.itic-sc.com/ 2017
- OpenGL https://www.opengl.org/ 2017
- OpenGL Projection Matrix http://www.songho.ca/opengl/gl_projectionmatrix.html 2017