This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Multimodal Maintenance Application HCI
Technical Paper
1999-01-5508
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Human Computer Interface (HCI) in applications for the maintenance of complex machinery such as an aircraft can be enhanced by exploiting new developments in HCI. We have developed a multimodal HCI demonstration system for maintenance applications, incorporating Augmented Reality (AR), Speech Recognition, and 3- dimensional audio technologies. The Augmented Reality interface is based on an original dynamic tracking approach to provide rapid update of the scene with graphical overlays. We enhance the use of this interface with speech recognition to control the system and to add annotations using dictation-based text information. A combination of 3-D audio, graphic animations, and text displays is used to communicate information to the user.
Recommended Content
Technical Paper | Multimodal HCI Integration |
Technical Paper | Human Factors Evaluation of the Truck Productivity Computer's™ Electroluminescent Display |
Aerospace Standard | Human Engineering Considerations in the Application of Color to Electronic Aircraft Displays |
Authors
Citation
Sundareswaran, V., Behringer, R., Chen, S., and Wang, K., "Multimodal Maintenance Application HCI," SAE Technical Paper 1999-01-5508, 1999, https://doi.org/10.4271/1999-01-5508.Also In
References
- Espiau, B. Chaumette, F. Rives, P. 1992 A new approach to visual servoing in robotics IEEE Trans. On Robotics and Automation 8 3 313 326
- Behringer, R. 1999 Registration for Outdoor Augmented Reality Applications Using Computer Vision Techniques and Hybrid Sensors. . VR 99.Houston 244 251
- Sundareswaran, V. Behringer, R. 1998 Visual Servoing-based Augmented Reality In Procs .Intl. Workshop on Augmented Reality San Francisco, USA Nov 1
- BLAUERT, J. Hearing : The Psychophysics of Human Sound Localization MIT Press 1997