Browse Topic: Human machine interface (HMI)

Items (1,002)
Find
Vibro-Acoustic simulation for vehicle audio design2026-01-0670To be published on 06/20/2026
Acoustic user interfaces and audio experiences are among the leading comfort factors in new vehicle interior designs. OEMs are more and more focusing on loudspeaker design and positioning, to provide the most immersive experience to the customers. The industrial target is to be able to predict the performance of an audio system in early design phases. This paper presents a methodology to model source-receiver transfer functions in a full-scale vehicle cabin and investigates the installation effect of the speakers in a real car door. A hybrid methodology is developed to be able to model the loudspeaker in different environment.
Zerrad, Mehdi, Errico, Fabrizio, Mordillat, Philippe
Towards a Smarter E-Bike: Enhancing Energy Efficiency through Adaptive Speed Control2026-01-0736To be published on 06/01/2026
This paper presents the development of a speed controller for e-bikes, designed as part of an energy-adaptive assistance system. The controller provides riders with appropriate support along planned routes, based on the available battery capacity. The control concept is intended for integration into existing commercial e-bikes without requiring extensive modifications to the drive system. Therefore, the rider remains part of the control loop, adjusting the support mode according to instructions from the controller. The speed controller is implemented as a rule-based state machine, enabling comprehensible design and parameterization Since the rider must manually switch between support modes while riding, the control logic incorporates hysteresis and dead times to ensure stability, prevent oscillations and avoid frequent mode switching. The user interface is a smartphone application that issues visual and audio instructions for switching support modes. An initial, system-independent
Rauch, Yannick, Simmann, Gabriel, Schneider, Manuel, Goss, Christian, Kriesten, Reiner
Augmented Reality and Multimodal Interfaces for Astronaut Training and In-Orbit Operations2026-26-0796To be published on 06/01/2026
Augmented Reality (AR) and multimodal human–machine interfaces (HMI)—combining visual overlays, voice, gesture, eye-tracking, and biometric sensing—are now maturing into flight-relevant technologies capable of transforming astronaut training and in-orbit operations. These interfaces reduce task time, lower error rates, and mitigate cognitive load, thereby strengthening both crew autonomy and mission safety. For India, the timing is critical: Gaganyaan human spaceflight program is approaching decisive crewed missions in the late 2020s, and the Bharatiya Antariksh Station (BAS) is targeted for the 2030s. AR/MMI can be positioned not as an accessory but as a core enabling system for training throughput, real-time crew support, and resilient station operations. This paper provides (i) an overview of India’s current scenario, including Gaganyaan astronaut training ecosystems, IIT Madras collaborations on AR/VR, and Vyommitra humanoid readiness; (ii) synthesis of global case studies—NASA
Yadav, Anoop Singh
A GenAI-Based Approach for Real-Time Multilingual In-Flight Communication Systems.2026-26-0784To be published on 06/01/2026
In today’s global aviation industry, passenger experience is strongly influenced by effective communication. In-flight announcements, often limited to English and a single local language, can create confusion and stress for international travelers who may not be fluent in either. This communication gap not only impacts passenger comfort but also poses potential risks in conveying time-sensitive or safety-critical information. Recent advances in Generative Artificial Intelligence (GenAI), particularly in speech recognition, neural machine translation, and naturalistic text-to-speech, provide a pathway to overcome these challenges. This paper explores the concept of real-time multilingual in-flight announcements, delivered in each passenger’s preferred language through connected headphones or personal devices. The proposed system architecture integrates speech-to-text conversion, language translation, and speech synthesis with aircraft infotainment platforms. Potential applications range
Mishra, Ashwini, Kature, Kartik, Patil, Ashish
SAE TOMORROW TODAY - Why Curing Motion Sickness Is Key to AV Success135675/7/2026
Did you know that motion sickness affects 1 in 3 people? As AVs gain traction and drivers become passengers, it may be the biggest barrier to the future of autonomous mobility. With a focus on addressing the root cause of motion sickness, Motion Sync offers breakthrough solution: a haptic pre-activation system that helps passengers anticipate vehicle movement with a personalized in-cabin experience that could redefine comfort and productivity. Listen in as we sit down with Dr. Daniel Sousa Schulman, CEO and Founder of Motion Sync, to unpack the science behind motion sickness and why it's a critical issue for EVs, robotaxis, and self-driving cars. You'll learn why passengers get sick, why drivers don't, and how EVs can actually make symptoms worse. As a topic critical to the success of autonomous vehicles, it's a conversation you don't want to miss. We'd love to hear from you. Share your comments, questions and ideas for future topics and guests to podcast@sae.org. Don't forget to take
Patterson, Lori
A Cooperative Hand Gesture Recognition System for Human Machine Interface to Control Robotic Arms2026-01-02524/7/2026
In the context of Industry 5.0, effective human–machine collaboration requires seamless and natural interaction. Hand-Gesture Recognition (HGR) has emerged as a promising technology for developing human–machine interfaces (HMI) that enable users to control robotic systems without physical controllers or wearable devices. This research presents a real-time HGR system designed to control a 6-Degree-of-Freedom (DoF) robotic arm using YOLOv10, a state-of-the-art deep learning model for hand gesture detection and classification. While YOLOv10 delivers high recognition accuracy, its computational demands surpass the capabilities of edge devices typically mounted on robotic platforms, creating a hardware bottleneck. To address this challenge, a cooperative client–server architecture is proposed, distributing computational workload between the edge device and a more powerful remote server. An RGB camera attached to the robotic arm captures hand gesture images and transmits them to the server
DeHaven, Aaron Lee, Park, Jungme
Chinese Drivers’ Preference for In-Vehicle Information Display: Insights from a Large-Scale Online Survey12-09-03-00202/20/2026
Integrating intelligent and connected technologies in vehicles has significantly enriched the information environment for drivers, aiding them in making comprehensive driving decisions. However, inadequate information display may lead drivers to miss crucial information or increase their cognitive load, thereby affecting driving safety and user experience. It is essential to study drivers’ preferences for in-vehicle information display, the factors influencing these preferences, and to present information through appropriate modalities and carriers. Drawing on 695 valid questionnaire responses, this study investigates drivers’ preferences for recommendatory, explanatory, alerting, and warning information across three display modalities and six display carriers. A multivariate ordered probability model was further developed to examine the influence of user characteristics on these preferences. The results showed that drivers preferred visual cues over auditory ones, with a selection
He, Gang, Diao, Kai, Luo, Longfei, Xie, Bingjun, Zhong, Yixin, Qi, Jianping
Multi-Storey AI Based Parking System2026-28-01292/12/2026
This paper presents a novel AI-based parking management system designed to enhance efficiency, reduce manual intervention, and optimize operational costs in modern parking facilities. By integrating computer vision with infrared (IR) sensors, the system continuously monitors parking areas in real time, accurately detecting vehicle occupancy and dynamically updating the space availability. The hybrid approach minimizes reliance on conventional sensors, improving accuracy and environmental robustness. Additional features include intelligent navigation assistance guiding drivers to available spots and integrated video surveillance for enhanced security through AI-driven suspicious activity detection. The user interface provides real-time updates ensuring a seamless and convenient parking experience. Overall, this system offers a comprehensive solution that advances parking technology through automation, real-time monitoring, and secure, user-friendly operation.
N, Kalaiarasi, Gupta, Shivansh, Hajarnis, Mihir, Anand, Vikas
Dynamic Stability Enhancement during Emergency Obstacle Avoidance under Inappropriate Driver Operation10-10-02-00152/2/2026
In response to the decline in vehicle stability and the resulting safety risks caused by inappropriate driver operations during high-speed emergency obstacle avoidance, a human–machine cooperative control strategy based on driver operation recognition is proposed. The strategy establishes a vehicle controllability boundary by integrating real-time driver inputs with tire adhesion limits, enabling dynamic evaluation of the influence of operations on system controllability and identification of potential inappropriate operations. On this basis, a control authority allocation mechanism is developed, capable of adaptively adjusting to vehicle states and driver operations. By combining road boundary constraints with vehicle stability envelope constraints, the strategy dynamically regulates the steering angle, ensuring vehicle stability while retaining the driver’s effective intentions as much as possible. Unlike conventional path-tracking or single-envelope control approaches, the proposed
Liu, Yangyi, Zhou, Bing, Wu, Xiaojian, Jiang, Xiaokun, Cui, Qingjia
Proactive AI-Enhanced Cybersecurity for Next-Gen Automotive Infotainment ECU2026-26-06191/16/2026
With the rapid advancement of connected vehicle technologies, infotainment Electronic Control Units (ECUs) have become central to user interaction and connectivity within modern vehicles. However, this enhanced functionality has introduced new vulnerabilities to cyberattacks. This paper explores the application of Artificial Intelligence (AI) in enhancing the cybersecurity framework of infotainment ECUs. The study introduces AI-powered modules for threat detection and response, presents an integrated architecture, and validates performance through simulation using MATLAB, CANoe, and NS-3. This approach addresses real-time intrusion detection, anomaly analysis, and voice command security. Key benefits include zero-day exploit resistance, scalability, and continuous protection via OTA updates. The paper references real-world automotive cyberattack cases such as OTA vulnerability patches, Connected Drive exploits, and Uconnect hack, emphasizing the critical need for AI-enabled proactive
More, Shweta, Kulkarni, Shraddha, Kumar, Priyanshu, Ghanwat, Hemant, Joshi, Vivek
Artificial Intelligence in Passenger Cars: Unlocking Intelligent Mobility and Human-Centric Vehicle Innovation2026-26-06721/16/2026
Artificial Intelligence (AI) is radically transforming the automotive industry, particularly in the domain of passenger vehicles where personalization, safety, diagnostics, and efficiency. This paper presents an exploration of AI/ML applications through quadrant of the key pillars: Customer Experience (CX), Vehicle Diagnostics, Lifecycle Management, and Connected Technologies. Through detailed use cases, including AI-powered active suspension systems, intelligent fault code prioritization, and eco-routing strategies, we demonstrate how AI models such as machine learning, deep learning, and computer vision are reshaping both the user experience and engineering workflow of modern electric vehicles (EVs). This paper combines simulations, pseudo-algorithms and data-centric examples of the combined depth of functionality and deployment readiness of these technologies. In addition to technical effectiveness, the paper also discusses the challenges at field level in adopting AI at scale i.e
Hazra, Sandip, Tangadpalliwar, Sonali, Khan, Arkadip
Accelerating Sunroof System Development with Modular Hardware-in-the-Loop Testing2026-26-05191/16/2026
This paper presents a novel Hardware-in-the-Loop (HiL) testing framework for validating panoramic Sunroof systems independent of infotainment module availability. The increasing complexity of modern automotive features—such as rain-sensing auto-close, global closure, and voice-command operation—has rendered traditional vehicle-based validation methods inefficient, resource-intensive, and late in the development cycle. To overcome these challenges, a real-time HiL system was developed using the Real time simulation, integrated with Simulink-based models for simulation, control, and fault injection. Unlike prior approaches that depend on complete vehicle integration, this methodology enables early-stage testing of Sunroof ECU behavior across open, close, tilt, and shade operations, even under multi-source input conflicts and fault conditions. Key innovations include the emulation of real-world conditions such as simultaneous voice and manual commands, sensor faults, and environmental
Ghanwat, Hemant, Lad, Aniket Suryakant, Joshi, Vivek, More, Shweta
Sound Quality Refinement and Vibration Reduction During Horn Application in Electric Vehicles2026-26-03381/16/2026
This paper focuses on the cabin sound quality refinement and the tactile vibration reduction during horn application in the electric vehicle. A loud cracking sound inside the cabin and higher accelerator pedal vibration are perceived while operating the horn. Sound diagnosis is carried out to find out the frequencies causing the cracking noise. Transfer path analysis is conducted to identify the nature of noise and the predominant path through which forces transfer. Based on finding from TPA, various recommendations are evaluated which reduced the noise to a certain extent. Operational Deflection Shape (ODS) is conducted on the horn mounting bracket and on the body to identify the component having higher deflection at the identified frequencies. Recommendations like DPDS improvement on the horn bracket and the body is assessed and the effect of each outcome is discussed. With all the recommendations proposed, the cabin noise levels are reduced by ~ 8 dB (A) and the accelerator pedal
S, Nataraja Moorthy, Rao, Manchi, R, Ashwin sathya, S, THARAKESWARULU, Raghavendran, Prasath
Machine Learning Based Indirect Engine Oil Deterioration Monitoring System2026-26-06561/16/2026
Maximizing vehicle uptime and reducing maintenance costs are critical objectives in modern automotive systems, making efficient resource utilization a top priority. One of the key factors is engine oil life or degradation, which directly affects the engine performance, longevity, and overall vehicle efficiency/fuel economy. Most vehicles tracks engine oil life solely on a fixed mileage interval while few uses dedicated sensor, which is costly and requires service and maintenance. As the engine oil degrades, it reduces Oil Total Acid Number (TAN) increases while Oil Total Base Number (TBN) decreases. It is recommended that maximum usable life of the engine oil is up to the crossover point between oil TAN and TBN (as the engine oil degrades). Vehicle driving pattern governs the occurrence of crossover points with respect to vehicle mileage. Based on this fundamental concept, an XG-Boost machine-learning algorithm is trained using vehicle Controller Area Network (CAN) channels and varying
Dusane, Mangesh, Tade, Vilas, Iqbal, Shoaib
Decision-Fatigue Mitigation in Automotive HMI System2026-26-06521/16/2026
With the advent of digital displays in driver cabins in commercial vehicles, drivers are being offered many features that convey some useful or critical information to drivers or prompt the driver to act. Due to the availability of a vast number of features, drivers face decision fatigue in choosing the appropriate features. Many are unaware of all available functionalities displayed in the Human Machine Interface (HMI) System, leading to a bare minimum usage or complete neglect of helpful features. This not only affects driving efficiency but also increases cognitive load, especially in complex driving scenarios. To alleviate the fatigue faced by drivers and to reduce the induced lethargy to choose appropriate features, we propose an AI driven recommendation agent/system that helps the driver choose the features. Instead of manually choosing between multiple settings, the driver can simply activate the recommendation mode, allowing the system to optimize selections dynamically. The
K, Sunil, Dhoot, Disha
Robust Validation of Rotary Switch with TFT Display in Hardware in Loop Simulation2026-26-05401/16/2026
Modern automotive systems are increasingly integrating advanced human-machine interfaces, including TFT displays, to enhance driver experience and functionality. Ensuring the reliability of these systems under diverse operating conditions is critical, especially given their role in vehicle control. This paper presents a Hardware-in-the-Loop (HIL) testing methodology for validation of rotary switch with TFT display. The HIL setup simulates real-world vehicle conditions, including CAN communication, power fluctuations and user interactions, enabling early detection of potential failure modes such as display flickering or communication loss. The results demonstrate improved robustness and reliability of the gear selection switch, supporting its deployment across multiple vehicle platforms.
Bhuyan, Anurag, Jahagirdar, Shweta, Khandekar, Dhiraj
A Data-Centric Approach to Identify Optimal NVH Simulation Tools and Solvers2026-26-03561/16/2026
The world is moving towards data driven evolution with wide usage tools & techniques like Artificial Intelligence, Machine Learning, Digital Twin, Cloud Computing etc. In automotive sector, the large amount of data being generated through physical and digital test evaluations. Computer-Aided Engineering (CAE) is one of the highest contributors for data generation as physical testing involves high cost due to prototypes & test set-up. The Automotive Noise, Vibration & Harshness (NVH) field is advancing exponentially due to new stringent regulatory norms & customer preferences towards comfort, where digitally advanced techniques are playing a key role in the revolution of NVH. Data generation through CAE tool is a crucial aspect of Engineer’s daily activities and selecting such appropriate CAE software and solvers is critical, as it influences user interface experience, accuracy, solution time, hardware requirements, variability expertise, Design of Experiments ability, and integration
Hipparge, Vinod, Masurkar, Nikita, Arabale, Vinand, Billade, Dayanand
Comprehnsive Measurement and Evidential Evaluation of Driver Drowsiness and Alertness Warning System2026-26-05201/16/2026
The paper aimed to improve the accurate quantification of driver drowsiness and to provide comprehensive, evidence-based validation for a Vision-Based Driver Drowsiness and Alertness Warning System. Advanced quantification of driver drowsiness is designed to enhance distinction of true positive events from False Positive and False Negative events. Methodology to pursue this included assessing inputs such as facial features, driver visibility, dynamic driving tasks, driving patterns, driving course time and vehicle speed. The system is programmed to actively learn Eye Aspect Ratio (EAR) reference and adapt personalised EAR threshold value to process EAR frames against the learnt threshold value. This method optimized the data frames to enhance the evaluation and processing of essential frames, thereby reducing delays in the processor and the Human-Machine Interface (HMI) warning module. Comprehensive validation is systematically conducted within a controlled test track environment to
Balasubrahmanyan, Chappagadda, Akbar Badusha, A
Development of a Seamless Selectively Elevated Fabric Switch for Intuitive and Sustainable Automotive Interior Interfaces2026-26-05961/16/2026
This technology solves a long-standing ergonomic and aesthetic problem in automotive and consumer interface design, as the use of mechanical switches disrupts the clean look of modern interiors and tends to attract dust and wear. Currently available technologies, such as capacitive touch buttons and mechanical push switches, do not provide the corresponding tactile feedback or clear indication of touch, and usually contain visible openings that interrupt the design flow. Moreover, traditional switches are made up of multiple built-in components, which results in complicated construction and difficult maintenance. To address these drawbacks, we propose a Seamlessly Integrated, Selectively Elevated Fabric Switch that remains flush with the surface when not in use and automatically rises to form a tactile interface when required. The system is a multi-layer construction consisting of an outer fabric upholstery layer, a tactile actuation membrane, and a smart electromagnetic actuator layer
Mohunta, Sanjay, Panchal, Girish, Puthran, Shaunak
Algorithm Development for AI Driven Path Planning Using Augmented Reality for Navigating in Indian Complex Road Scenarios2026-26-00381/16/2026
The road infrastructure in India has complex navigational challenges with most of the road unstructured especially in rural areas. Decision-making becomes a challenge for drivers in unpredictable environments such as narrow roads, flooded roads and heavy traffic. In this paper, an Augmented Reality based ML-Algorithm for Driver Assistance (ARMADA) has been proposed that improves awareness to safely maneuver in these conditions. The methodology for development and validation of this Augmented Reality (AR) based algorithm contains multiple steps. Firstly, extensive data collection is conducted using real time recording and benchmark datasets like Berkeley Deep Drive (BDD) and Indian Driving Dataset (IDD). Secondly, collected data are annotated and trained using an optimal machine learning (ML) model to accurately identify the complex scenario. In third step, an ARMADA algorithm is developed, integrating these models to estimate road widths, detect floods and provide seamless driver
Anandaraj, Prem Raj, Sivakumar, Vishnu, Thanikachalam, Ganesh, L, Radhakrishnan, Motoki, Yaginuma, Selvam, Dinesh Kumar
Optimization of Tactile Vibrations in Agricultural Tractor Using Design of Experiments2026-26-03441/16/2026
One of agricultural tractors most important aspects is operator comfort. In addition to working long hours, tractor operators may be at risk for health problems due to vibrations and mechanical shocks. The tactile vibrations of a tractor are a major consideration when choosing one for agricultural use. This project's mandate includes a study of tractor vibration control problems. It is essential to investigate the governing system in order to determine the cause of the problem. Evaluating the vibrations transmitted via the tractor and using the design of experiments (DOE) approach to lessen vibrations on particular tactile regions were the study's goals. There are several measures currently under investigation which can be used to reduce the vibrations caused by resonance in this paper, these include reducing the natural frequency so as to be able to avoid resonance with the second order engine frequency and the damping coefficient; this will ensure the amplitude of vibration at
Baviskar, Shreyas, dhobale, Vishwajeet, Bhangare, Amit, Kunde, Sagar, Wagh, Sachin
Deconstructing Driver State in Smart Cockpits: Physiological Validation of Perceived Risk, Trust, and Fatigue during Automated Driving2025-01-734512/31/2025
For driver-automation collaborative driving, accurately monitoring driver state in smart cockpits is crucial for enhancing safety, comfort, and human-computer interactions. However, existing research lacks clarity regarding the relationships among driver states, and there is no consensus on the optimal physiological channels to reliably capture these states. This study examined three critical psychological constructs (i.e., perceived risk, trust in the automated driving system, and driver fatigue) using a 37-participant driving simulation experiment. We manipulated multiple factors to induce distinct driver states among participants and recorded subjective scale ratings, heart rate variability, galvanic skin response, and eye movement data. Subjective scale ratings were adopted as the ground truth to examine the corresponding measurement relationships between different physiological signals and the three targeted dimensions of driver states. Our results proved that perceived risk
Wang, Zhenyuan, Li, Qingkun, Wang, Wenjun, Liu, Weimin, Sun, Zhaocong, Cheng, Bo
Research on the Influencing Factors of Driver’s Trust in Autonomous Driving System2025-01-734412/31/2025
Although autonomous driving system is being used more frequently, its widespread adoption is still in its infancy. As a result, drivers may perceive the autonomous driving system as unreliable, which hinders the spread of automated driving. The goal of this study is to investigate the major variables influencing drivers’ trust in autonomous driving system. Significant positive correlations between the variables were found using the questionnaire survey, reliability validity test, and factor analysis of the questionnaire data. In order to measure the impact of system performance, user comprehension, system feedback mechanism, individual characteristics, and environmental factors on trust perception, a structural equation modeling (SEM) as an analytical tool. A total of 274 valid data were retained. By modeling and analyzing the recovered data, it showed that the fit are all in the acceptable range, the model construction is reasonable, and therefore the subsequent path analysis can be
Wang, Caiyong, He, Xingmiao, Tang, Yu, Chen, Rong, Li, Chuzhao
Risk Identification and Accompanying Information Service Design of Long Downhill Road Section2025-99-025012/23/2025
In order to reduce traffic accidents and losses in long downhill sections of expressways, giving drivers reasonable prevention and control means of information induction can improve the safety of long downhill sections. The location of the accompanying information service of the driver's vehicle terminal and the rationality of the intervention information are worth studying. This study takes a high-speed long downhill road as an example, divides the risk level of the long downhill road based on the road safety risk index model, and verifies it with the help of driving behavior data. Secondly, three coverage schemes of sensing devices are designed according to the results of risk classification, and the HMI interface of accompanying information service is designed according to the different coverage degrees of sensing devices. Finally, a driving simulation experiment was carried out based on the driving simulator, and the speed control level, psychological comfort level, operational
Wang, Yuejia, Weng, Wenzhong, Luan, Sen, Dai, Yibo
An AI-Based Embedded Offline Voice Assistant for Commercial Trucks: Enhancing Driver Safety and HMI Design2025-36-007812/18/2025
Commercial vehicle operation faces challenges from driver distraction associated with traditional Human-Machine Interfaces (HMIs) and inconsistent network connectivity, particularly in long-haul scenarios. This paper addresses these issues through the development and presentation of an embedded, offline AI-powered voice assistant. The system is designed to reduce driver distraction and enhance operational efficiency by enabling hands-free control of vehicle functions and access to critical information, irrespective of internet availability. The technical approach involves a three-tier architecture comprising an Android-based In-Vehicle Infotainment (IVI) unit for primary user interaction and voice processing, an Android mobile device acting as a communication bridge and processing hub, and a proprietary OBD-II dongle for CAN bus interfacing. Offline speech recognition is achieved using embedded wake word detection and speech-to-intent engines. A user-centered design methodology
De Oliveira Nelson, Rafael, De Almeida, Lucas Gomes, Arantes Levenhagen, Ivan
Enhancing Multisensory Automotive Experience with Immersive Technologies2025-36-024412/18/2025
The integration of sensory stimuli in Virtual Reality remains a challenge in the automotive industry, especially regarding consumer perception and immersive experience. This study aims to examine the applications of virtual reality in the automotive industry, analyzing how the integration of sensory stimuli can impact consumer perception, the technological challenges involved, and the opportunities for innovation in the sector, contributing to the advancement of immersive automotive experiences. We adopted a literature-based analytical approach, involving the review of VR technologies applied to product design, consumer interaction, and sensory integration, with a focus on tactile, visual, and olfactory stimuli. The analysis considered technological, cultural, and market factors, ensuring a comprehensive understanding of the current state and challenges of VR adoption in the automotive context. As a result, we identified key benefits of VR in improving design, testing, training, and
Ramos, Catharina, Thasla, Yasmim, Rodrigues, Daniela, Alfonso, Marcio, Leite, Rodrigo, Ribeiro, Eulália, Winkler, Ingrid
Autonomous Driving Takeover Requests: The Influence of Spatio-Temporal Characteristics of Human-Machine Interface Elements on Driving Trust2025-99-044012/10/2025
Takeover safety in conditional automation depends heavily on effective Takeover Requests (TORs). This study investigated the implication of the temporal distribution of takeover interface elements (temporal distribution: takeover cues appear first/last, spatial distribution: left/center/right) on driving trust in scenarios with different levels of urgency (low: road construction/high: traffic accidents). The results suggest that driver perceptions of the reliability of an automated driving system during control transitions may be influenced by the temporal characteristics of the distribution of human-machine interface elements. Drivers need to supervise the operation status of the autopilot system, and presenting timely information about the system at critical nodes can help improve driver trust. The central spatial distribution contributes to trust in high emergencies, while the right spatial distribution enhances driver trust more in low emergencies. This study informs takeover
Wu, Jianfeng, Li, Zihan
Predictive Maintenance Solution with Real-Time Insights and Cost Estimation for Machine Health Management2025-28-030211/6/2025
This paper introduces a comprehensive solution for predictive maintenance, utilizing statistical data and analytics. The proposed Service Planner feature offers customers real-time insights into the health of machine or vehicle parts and their replacement schedules. By referencing data from service stations and manufacturer advisories, the Service Planner assesses the current health and estimated lifespan of parts based on metrics such as days, engine hours, kilometers, and statistical data. This approach integrates predictive analytics, cost estimation, and service planning to reduce unplanned downtime and improve maintenance budgeting, aligning with SAE expectations for review-ready manuscripts. The user interface displays current part health, replacement due dates, and estimated replacement costs. For example, if air filter replacement is recommended every six months, the solution uses manufacturer advisories to estimate the remaining life of the air filter in terms of days or
Chaudhari, Hemant Ashok
Review of Bio-Inspired Actuators and Their Potential for Adaptive Vehicle Control12-09-02-001110/10/2025
Adaptive vehicle control systems are crucial for enhancing safety, performance, and efficiency in modern transportation, particularly as vehicles become increasingly automated and responsive to dynamic environments. This review explores the advancements in bio-inspired actuators and their potential applications in adaptive vehicle control systems. Bio-inspired actuators, which mimic natural mechanisms such as muscle movement and plant tropism, offer unique advantages such as flexibility, adaptability, and energy efficiency. The article categorizes these actuators based on their mechanisms, including shape memory alloys, dielectric elastomers, ionic polymer–metal composites, and soft pneumatic actuators. The review highlights the properties, operating principles, technical maturity, and potential applications for each mechanism in automotive systems. Additionally, it investigates current uses of these actuators in adaptive suspension, active steering, braking systems, and human–machine
Mittal, Vikram, Shah, Rajesh, Roshan, Mathew
Real Driving Database for Automotive Drive System Development2025-01-037810/7/2025
Knowledge of real-world driving behavior is fundamental to the development of drive systems. The derivation of representative requirements or driving cycles for use case-specific vehicle use allows a customer-centered drive system design. These datasets contain data such as distance, standstill times, average accelerations or a customer driving style estimation. In addition, the real-world data can be used for regulatory purposes such as the definition of utility factors or the definition of real driving emission cycles. In a research project funded by FVV e.V., we have developed a universal database software including data storage, user interface and general data plausibility functions for real driving data. The database contains detailed time series measurement data on component and vehicle level such as torque and speed of electric motors and internal combustion engines as well as general mobility data such as driving distance statistics. A key objective of the database development
Sander, Marcel, Sturm, Axel Wolfgang, Martínez Medina, Óscar, Henze, Roman, Kühne, Ulf, Eilts, Peter
Conductive Polymer Improves Sensor-Based DevicesTBMG-5398510/1/2025
Scientists have produced a new, powerful electricity-conducting material that could improve wearable technologies, including medical devices. The new technique uses hyaluronic acid applied directly to a gold-plated surface to create a thinner, more durable film, or polymer, used to conduct electricity in devices like biosensors. It could lead to major improvements in the function, cost, and usability of devices like touchscreens and wearable biosensors.
Analyzing Aircraft Antenna Placement and Performance with Unified Modeling and Simulation25AERP10_0610/1/2025
Reliable antenna performance is crucial for aircraft communication, navigation, and radar detection systems. However, an aircraft's structure can detune the antenna input impedance and obstruct radiation, creating a range of potential problems from a low-quality experience for passengers who increasingly expect connectivity while in the air, to violating legal requirements around strict compliance standards. Determining appropriate antenna placement during the design phase can reduce risk of costly problems arising during physical testing stages. Engineers traditionally use a variety of CAD and electromagnetic simulation tools to design and analyze antennas. The use of multiple software tools, combined with globally distributed aircraft development teams, can result in challenges related to sharing models, transferring data, and maintaining the associativity of design and simulation results. To address these challenges, aircraft OEMs and suppliers are implementing unified modeling and
Developing Digital Twins at the Subsystem Level Using Heterogenous Modeling and Simulation (M&S) for Development and Testing of Artifical Intelligence/Machine Learning (AI/ML) and Autonomous Ground Systems2025-01-04749/16/2025
To achieve Army modernization plans, advanced approaches for testing and evaluation of autonomous ground systems and their integration with human operators should be utilized. This paper presents a framework for developing digital twins at the subsystem level using heterogeneous modeling and simulation (M&S) to address the challenges of manned-unmanned teaming (MUM-T) in operational environments. Focusing on the interplay between robotic combat vehicles (RCVs) and human operations, the framework enables evaluation of soldiers’ cognitive loads while managing tasks such as maneuvering robotic systems, interacting with aided target detection, and engaging simulated adversaries. By employing subsystem-level digital twins, we aim to isolate and control key variables, enabling a detailed assessment of both systems’ performance and operator effectiveness. Through realistic operational scenarios and human-machine interface testing, our approach may help identify optimal solutions for soldier
Van Emden, Kristin, Strickland, Jared, Whitt, John, Flint, Benjamin, Ma, Lein, McDonnell, Joseph, Bergin, Dennis, Huynh, Kevin, Nolta, Lukas, Song, Jae, Weber, Kody, Gates, Burhman, Bounker, Paul, Madak, Joseph T.
Evaluating the Haptic Touchscreen Experience in VR2025-01-04709/16/2025
Virtual Reality (VR) systems are increasingly integrating haptic feedback to increase the level of immersion in virtual environments. This study is designed to investigate the impact of varying fidelity levels on the user experience when interacting with a tablet touchscreen User Interface (UI) in a virtual environment. Participants take part in touchscreen gesture-based tasks in different haptic fidelity levels, including no gloves, low haptic fidelity vibrotactile gloves, high haptic fidelity pneumatic gloves, and a real-world control condition. This study was designed to measure the user experience, which includes presence, embodiment, and system usability using qualitative surveys along with quantitative performance metrics. This study aims to understand how haptic feedback impacts the user experience to facilitate more informed employment of VR technology in training, simulation, and rapid prototyping.
Al-Shubeilat, Fares, Athamnah, Solaf, AlJundi, Abdel Rahman, Brudnak, Mark, Wood, Ryan, Louie, Wing Yue Geoffrey, Rawashdeh, Osamah
Soft Robot Modules for New Haptic InteractionsTBMG-537839/1/2025
EPFL researchers have developed a customizable soft robotic system that uses compressed air to produce shape changes, vibrations, and other haptic, or tactile, feedback in a variety of configurations. The device holds significant promise for applications in virtual reality, physical therapy, and rehabilitation.
Invited Presentation Padfield Best Young Paper Award at ERF 2024: Multisensory Integration Model for Combined Visual-Haptic 2D LocalizationF-0081-2025-01545/20/2025
This paper describes a combined visual and haptic localization experiment that addresses the area of multi-modal cueing. The aim of the present investigation is to characterize accuracy and precision of tactile cue-ing in the peri-personal space (PPS), the space around the body in which sensory information is perceived as meaningful (Ref. 1). Outcomes of the unimodal (visual and haptic) and multi-modal (combined visual-haptic) localizations are used to make predictions about the multimodal integrative phenomenon. In the localization experiment, participants are presented with visual, haptic, or multimodal target cues using the body-centered reference frame and are instructed to indicate the corresponding hypothetical target location in space using a mouse pointer in an open-loop feedback condition.
Fischer, Madeline, Saetti, Umberto, Godfroy-Cooper, Martine, Fischer, Douglas, Ganelin, Benjamin
Full-Body Haptic Cueing for Augmented Pilot Perception in Position/Velocity Tracking TasksF-0081-2025-01365/20/2025
This paper investigates the use of multi-modal cueing through full-body haptic feedback to enhance pilot-vehicle system (PVS) performance, reduce mental workload (MWL), and increase situational awareness (SA) in both good and degraded visual environments (GVE/DVE). Piloted simulations were conducted using an H-60-like flight dynamics model in a virtual reality (VR) motion-based simulator, evaluating two ADS-33-like mission task elements (MTEs) – precision hover and slalom – under visual-only and combined visual and haptic feedback conditions in both GVE and DVE. The H-60 flight dynamics were augmented with a dynamic inversion (DI)- based stability augmentation system (SAS), implementing rate-command/attitude hold (RCAH) response type on the roll, pitch, and yaw axes and altitude hold response type on the vertical axis. The SAS was designed to achieve Level 1 handling qualities per ADS-33 standards. The full-body haptic cueing strategy leveraged an outer-loop DI control law, which
Morcos, Michael T., Saetti, Umberto, Geiger, Derek H., Kubik, Stephen T., Breed, Adam R., Crane, Clifton J., Luzzani, Gabriele, Fischer, Madeline R., Jun, Dogyu, Gary, Evan
Human-AI Interaction in Autonomous Medical Evacuation HelicoptersF-0081-2025-02825/20/2025
The vertical flight industry is on its way to a transformative era, with autonomous technologies set to alter aerial vehicle operations. While it seems certain that fully autonomous helicopters will eventually be deployed for a variety of missions, some high-stakes situations—like medical evacuations (MEDEVAC)—will for the foreseeable future demand human participation in the form of Emergency Medical Care-giving Crew. This study describes the testbed built to run and investigate hypothetical future situations in which a helicopter is autonomously piloted while a human medic with no aviation training, subjected to aviation and medical emergencies, manages patient care onboard. A total of 22 participants, with emergency medical technician certification, nursing or a medical board certification, were invited to run and evaluate the use of AI pilot (AP) in different scenarios of medical evacuation under the following emergencies: medical, empty fuel tank, pressure sensor miscalibration
Doda, Sanya, Feigh, Karen, Agbeyibor, Richard, Cortes, Carmen, Kolb, Jack, Magalhaes, Jose
From Cockpit Controls to Dashboard DataTBMG-530775/6/2025
In the early days of computers, interfaces were paper printouts or blinking lights, but as the technology matured, the graphical user interface (GUI) quickly became the standard.
Objectifying Visual Perception for Automotive Screens through Vibration Targets2025-01-00435/5/2025
New mobility concepts with smart infrastructure have led to enhanced customer driving experience. The potential to develop safe cars with minimal driver intervention is a great need of the future. The cusp for fully autonomous driving has produced much technical talk, which has led to faster transition and adoption. One of the features that global OEMs have tried to focus on, is Human Machine Interface (HMI) solutions, popularly called display screens. The touchscreen HMIs are common in all mid-range budget cars. They offer driver support beyond just streaming music, including inputs for navigation, parking assistance, in-car technologies, Advanced Driver Assistance Systems (ADAS), and infotainment. Poor display screen visibility is a phenomenon observed when a vehicle is driven over different road surfaces. This paper presents a user-centric approach for the right design & development of the HMI for a vibration free driving experience. The mounting strategies for the display screens
Adil, MD Shahzad, C M, Mithun, Mohammed, Riyazuddin, R, Prasath
Global Vehicle Vibration Enhancement Using Circular Force Technology2025-01-00155/5/2025
In addition to providing safety advantages, sound and vibration are being utilized to enhance the driver experience in Battery Electric Vehicles (BEVs). There's growing interest and investment in using both interior and exterior sounds for pedestrian safety, driver awareness, and unique brand recognition. Several automakers are also using audio to simulate virtual gear shifting of automatic and manual transmissions in BEVs. According to several automotive industry articles and market research, the audio enhancements alone, without the vibration that drivers are accustomed to when operating combustion engine vehicles, are not sufficient to meet the engagement, excitement, and emotion that driving enthusiasts expect. In this paper, we introduce the use of new automotive, high-force, compact, light-weight circular force generators for providing the vibration element that is lacking in BEVs. The technology was developed originally for vibration reduction/control in aerospace applications
Norris, Mark A., Orzechowski, Jeffrey, Sanderson, Brad, Swanson, Douglas, Vantimmeren, Andrew
Learned Human Eye Gaze for Object Tracking: A Preliminary Study09-13-01-00044/15/2025
Visual object tracking technology is the core foundation of intelligent driving, video surveillance, human–computer interaction, and the like. Inspired by the mechanism of human eye gaze, a new correlation filter (CF) tracking algorithm, named human eye gaze (HEG) tracking algorithm, was proposed in this study. The HEG tracking algorithm expanded the tracking detection idea from the traditional detection-tracking to detection-judging-tracking by adding a judging module to check the initial and retrack the unreliable tracking result. In addition, the detection module was further integrated into the edge contour feature on the basis of the HOG (histogram of oriented gradients) extracting feature and the color histogram to reduce the sensitivity of the algorithm to factors such as deformation and illumination changes. The comparison conducted on the OTB-2015 dataset showed that the overall overlap precision, distance precision, and center location error of the HEG tracking algorithm were
Jiang, Yejie, Jiang, Binhui, Chou, Clifford C.
Deriving Architectural Requirements for SAE J3016 TM Level 3 System from Functional Safety Perspective2025-01-80094/1/2025
Vehicles with SAE J3016TM Level 3 systems are exposed to road infrastructure, Vulnerable Road Users (VRUs), traffic and other actors on roadways. Hence safe deployment of Level 3 systems is of paramount importance. One aspect of safe deployment of SAE Level 3 systems is the application of functional safety (ISO 26262) to their design, development, integration, and testing. This ensures freedom from unreasonable risk, in the event of a system failure and sufficient provisions to maintain Dynamic Driving Task (DDT) and to initiate Minimum Risk Maneuver (MRM), in the presence of random hardware and systematic failures. This paper explores leveraging ISO 26262 standard to develop architectural requirements for enabling SAE Level 3 systems to maintain DDT and MRM during fault conditions and outlines the importance of fail-operability for Level 3 systems, from a functional safety perspective. At a high-level, UN Regulation No. 157 – Automated Lane Keeping Systems (ALKS) is used as a baseline
Mudunuri, Venkateswara Raju, Jayakumar, Namitha
Operational Evaluation of a Pre-Production L2 System HMI2025-01-80504/1/2025
The study analyzed data from on-road drives with a pre-production Level 2 (L2) partial automation system using a sample of 27 drivers ranging from 21 to 75 years of age. The system provides continuous automatic lateral and longitudinal control but requires the driver to remain attentive and intervene when necessary. The L2 system was equipped with a Driving Monitoring System (DMS) that issued escalating alerts to remind the driver to pay attention or take over when needed. During the 14-month study period, drivers completed 354,768 miles of travel with the L2 system engaged, totaling 5,913 trips. The results of the study showed that drivers were highly responsive to attention reminders and takeover alerts, with high compliance rates and quick response times. Importantly, there was no evidence of habituation to these alerts over time. These findings support the effectiveness of the system's DMS and alert HMI (Human-Machine Interface) strategy in promoting the proper use of the system
Llaneras, Robert, Glaser, Yi, Green, Charles, August, Maureen, Landry, Steven
The Effect of Directional Tactile Guidance on Takeover Performance in Level 3 Automated Driving2025-01-80494/1/2025
Automated driving is an important development direction of the current automotive industry. Level 3 automated driving allows the driver to perform non-driving related tasks (NDRTs) during automated driving, however, once the operating conditions exceed the designed operating domain, the driver is still required to take over. Therefore, it is important to rationally design takeover requests (TORs) in Level 3 conditional automated driving. This paper investigates the effect of directional tactile guidance on driver takeover performance in emergency obstacle avoidance scenarios during the transfer of control from automated driving mode to manual driving. 18 participants drove a Level 3 conditional automated driving vehicle in a driving simulator on a two-way four-lane urban road, performed a takeover, and avoided obstacles while performing non-driving related tasks. The driver's takeover performance during the takeover process was measured and subjective driver evaluation data was
Liang, Xinying, Liang, Yunhan, Ma, Xiaoyuan, Wang, Luyao, Chen, Guoying, Hu, Hongyu
Development of a Computer-Less Robotic Platform for ADAS Testing2025-01-80644/1/2025
Testing collision avoidance systems on vehicles has become increasingly complex. Robotic platforms called Pedestrian Target Carriers (PTC) typically require Global Positioning System (GPS), network communications, tuning, and ever-increasing scope to the user interface to function. As an alternative to these complicated systems, but as an improvement to a pulley system pedestrian target carrier, a simplistic robotic platform was developed. An open-loop user interface was designed and developed, and a series of tests were performed to evaluate the effectiveness of the robot in performing basic, repeatable straight-line tests with a vehicle in the loop. Based on testing outcomes, the development of further control algorithms, user requirements, and the prototype improvements are analyzed for future work.
Bartholomew, Meredith, Muthaiah, Ponaravind, Heydinger, Gary, Zagorski, Scott
Adding and Assessing Vehicle Sound and Steering Feedback: Application to an Unreal Engine Driving Simulator2025-01-86684/1/2025
To provide an affordable and practical platform for evaluating driving safety, this project developed and assessed 2 enhancements to an Unreal-based driving simulator to improve realism. The current setup uses a 6x6 military truck from the Epic Games store, driving through a pre-designed virtual world. To improve auditory realism, sound cues such as engine RPM, braking, and collision sounds were implemented through Unreal Engine's Blueprint system. Engine sounds were dynamically created by blending 3 distinct RPM-based sound clips, which increased in volume and complexity as vehicle speed rose. For haptic feedback, the road surface beneath each tire was detected, and Unreal Engine Blueprints generated steering wheel feedback signals proportional to road roughness. These modifications were straightforward to implement. They are described in detail so that others can implement them readily. A pilot study was conducted with 3 subjects, each driving a specific route composed of a straight
Duan, Lingbo, Xu, Boyu, Green, Paul
User Experience for Digitalized and Smart Cockpits and Cabins of Next-gen MobilityEPR20250063/31/2025
This SAE Edge Research Report explores advancements in next-generation mobility, focusing on digitalized and smart cockpits and cabins. It offers literature review, examining current customer experiences with traditional vehicles and future mobility expectations. Key topics include integrating smart cockpit and cabin technologies, addressing challenges in customer and user experience (UX) in digital environments, and discussing strategies for transitioning from traditional vehicles to electric ones while educating customers. User Experience for Digitalized and Smart Cockpits and Cabins of Next-gen Mobility covers both on- and off-vehicle experiences, analyzing complexities in developing and deploying digital products and services with effective user interfaces. Emphasis is placed on meeting UX requirements, gaining user acceptance, and avoiding trust issues due to poor UX. Additionally, the report concludes with suggestions for improving UX in digital products and services for future
Abdul Hamid, Umar Zakir
Smart Clusters: Functional Safety Concepts and Requirements12-08-02-00183/28/2025
This study presents a detailed review of a contemporary safety concept for a smart cluster, comprising a multipurpose display and a head unit. It focuses on elucidating the fundamental regulatory requirements for smart clusters within the frameworks of the United States and the European Union, and draws connections to their functional safety requirements and concepts. The article explores a range of safety mechanisms and architectures designed to implement these proposed functional safety requirements. For each mechanism, we provide an in-depth analysis of its benefits and drawbacks, as well as a thorough explanation of its operational logic. This comprehensive evaluation offers valuable insights into developing safer and more efficient smart clusters in line with international regulatory standards.
Anisimov, Valentin, Babaev, Islam, Shinde, Chaitanya
Improving Safety of Autonomous Vehicles: A Verifiable Method for Graceful Degradation of Decision and Control Responsibilities12-08-02-00213/24/2025
Developing safe and reliable autonomous vehicles is crucial for addressing contemporary mobility challenges. While the goal of autonomous vehicle development is full autonomy, up to SAE Level 4 and beyond, human intervention remains necessary in critical or unfamiliar driving scenarios. This article introduces a method for gracefully degrading system functionality and seamlessly transferring decision-making and control between the autonomous system and a remote safety operator when needed. This transfer is enabled by an onboard dependability cage, which continuously monitors the vehicle’s performance during its operation. The cage communicates with a remote command control center, allowing for remote supervision and intervention by a safety driver. We assess this methodology in both lab and test field settings in a case study of last-mile parcel delivery logistics and discuss the insights and results obtained from these evaluations.
Aniculaesei, Adina, Aslam, Iqra, Zhang, Meng, Buragohain, Abhishek, Vorwald, Andreas, Rausch, Andreas
Items per page:
1 – 50 of 1002