Browse Topic: Human machine interface (HMI)
Acoustic user interfaces and audio experiences are among the leading comfort factors in new vehicle interior designs. OEMs are more and more focusing on loudspeaker design and positioning, to provide the most immersive experience to the customers. The industrial target is to be able to predict the performance of an audio system in early design phases. This paper presents an integrated vibro-acoustic methodology enabling early-stage prediction of loudspeaker performance in real vehicle conditions. The approach combines electromechanical characterization, a hybrid loudspeaker calibrated model valid across the audible range and coupled FEM/BEM/SEA simulations to capture the loudspeaker response in the vehicle’s cabin considering door-installation effects and cabin acoustics. The method is validated experimentally on a rear-door loudspeaker installed in a production vehicle, showing strong correlation with measured SPL. A final application case demonstrates its capability to assess the impact of alternative speaker mounting positions during the design phase.
This paper investigates the use of full-body vibrotactile cueing to augment operator perception during swarm teleoperation tasks. Piloted simulations are conducted in a virtual reality (VR) flight simulation environment using a quadcopter swarm model and a nonlinear dynamic inversion (NDI) flight control architecture. A scaled version of the ADS-33 slalom Mission Task Element (MTE) is implemented to evaluate swarm formation maintenance and obstacle avoidance under four experimental conditions: Good Visual Environment (GVE), Degraded Visual Environment (DVE), and each of these conditions augmented with haptic feedback. Haptic cues are delivered through vibrotactile vests and sleeves to convey information on formation deformation and gate proximity. Experimental results involving human participants indicate that haptic feedback improves formation maintenance and increases operators’ situational awareness of follower drone positions without increasing perceived mental workload. While haptic cues provided modest assistance in gate localization, visual conditions remained the dominant factor influencing obstacle avoidance performance. Overall, the results indicate that full-body haptic feedback provides an effective modality for augmenting operator perception and supporting swarm supervision tasks, particularly in visually degraded environments.
Prior work demonstrated that acceleration washout in motion simulators produces decay-rate sensing ambiguity within the vestibular system, forcing pilots to rely on visual cues for control. While Pilot Induced Oscillation Ratings (PIORs) for flight and simulation have been matched using different sensing thresholds, a quantitative basis for the 50% reduction in the visual decay-rate threshold has remained elusive. This paper provides evidence that pilots perceive decay rate proprioceptively through stick force during both flight and simulation, rather than through vestibular or visual channels. The residues of the stick-force sensitivity transfer function reflect the amplification or attenuation of neighboring zeros and poles; when these residues fall outside the human's 30 dB tactile sensory window, the resulting decay rate becomes imperceptible. Modeling reveals that stabilization via the visual channel in simulators produces dominant mode characteristics - decay rates, frequencies, and residues - that diverge significantly from vestibular-stabilized flight. The Virtual Vestibular Cueing (VVC) technique is introduced to tune the visual channel using pseudo-vestibular rate cueing, optimally aligning the simulated dominant mode with flight-validated residues and decay rates. A preliminary fixed-base study demonstrates that VVC synchronizes performance and subjective ratings by restoring this tactile-vestibular harmony. This work establishes that handling qualities are fundamentally an Information Theory problem: Level 1 ratings occur when the residue-to-decay gradient is tuned to map the dominant mode's physical 'elbow' onto the human sensory window. This paper establishes that perceptual fidelity is not determined by the closed-loop vehicle residues, but by the force sensitivity residues. By identifying the stick-force channel as the superior conduit for this mapping, VVC allows designers to restore informational integrity in virtual environments across all axes of aircraft dynamics. VVC ensures that the visual channel supports a control strategy where the tactile feedback remains within the human sensory window, preventing the 'wrong reading' that leads to simulator-to-flight rating mismatches.
This paper presents a novel AI-based parking management system designed to enhance efficiency, reduce manual intervention, and optimize operational costs in modern parking facilities. By integrating computer vision with infrared (IR) sensors, the system continuously monitors parking areas in real time, accurately detecting vehicle occupancy and dynamically updating the space availability. The hybrid approach minimizes reliance on conventional sensors, improving accuracy and environmental robustness. Additional features include intelligent navigation assistance guiding drivers to available spots and integrated video surveillance for enhanced security through AI-driven suspicious activity detection. The user interface provides real-time updates ensuring a seamless and convenient parking experience. Overall, this system offers a comprehensive solution that advances parking technology through automation, real-time monitoring, and secure, user-friendly operation.
This paper focuses on the cabin sound quality refinement and the tactile vibration reduction during horn application in the electric vehicle. A loud cracking sound inside the cabin and higher accelerator pedal vibration are perceived while operating the horn. Sound diagnosis is carried out to find out the frequencies causing the cracking noise. Transfer path analysis is conducted to identify the nature of noise and the predominant path through which forces transfer. Based on finding from TPA, various recommendations are evaluated which reduced the noise to a certain extent. Operational Deflection Shape (ODS) is conducted on the horn mounting bracket and on the body to identify the component having higher deflection at the identified frequencies. Recommendations like DPDS improvement on the horn bracket and the body is assessed and the effect of each outcome is discussed. With all the recommendations proposed, the cabin noise levels are reduced by ~ 8 dB (A) and the accelerator pedal vibration levels are reduced by ~ 40%. Sound quality parameter which needs to be considered during the horn selection is explained. The modal criteria which must be taken into account during development phase to avoid the horn cracking noise and tactile vibration is also proposed.
With the rapid advancement of connected vehicle technologies, infotainment Electronic Control Units (ECUs) have become central to user interaction and connectivity within modern vehicles. However, this enhanced functionality has introduced new vulnerabilities to cyberattacks. This paper explores the application of Artificial Intelligence (AI) in enhancing the cybersecurity framework of infotainment ECUs. The study introduces AI-powered modules for threat detection and response, presents an integrated architecture, and validates performance through simulation using MATLAB, CANoe, and NS-3. This approach addresses real-time intrusion detection, anomaly analysis, and voice command security. Key benefits include zero-day exploit resistance, scalability, and continuous protection via OTA updates. The paper references real-world automotive cyberattack cases such as OTA vulnerability patches, Connected Drive exploits, and Uconnect hack, emphasizing the critical need for AI-enabled proactive cybersecurity frameworks.
One of agricultural tractors most important aspects is operator comfort. In addition to working long hours, tractor operators may be at risk for health problems due to vibrations and mechanical shocks. The tactile vibrations of a tractor are a major consideration when choosing one for agricultural use. This project's mandate includes a study of tractor vibration control problems. It is essential to investigate the governing system in order to determine the cause of the problem. Evaluating the vibrations transmitted via the tractor and using the design of experiments (DOE) approach to lessen vibrations on particular tactile regions were the study's goals. There are several measures currently under investigation which can be used to reduce the vibrations caused by resonance in this paper, these include reducing the natural frequency so as to be able to avoid resonance with the second order engine frequency and the damping coefficient; this will ensure the amplitude of vibration at resonance becomes minimal. The tactile testing is done on the specific tactile places. The findings give an insight into the ways of reducing operator fatigue and improving the tractor ergonomics.
With the advent of digital displays in driver cabins in commercial vehicles, drivers are being offered many features that convey some useful or critical information to drivers or prompt the driver to act. Due to the availability of a vast number of features, drivers face decision fatigue in choosing the appropriate features. Many are unaware of all available functionalities displayed in the Human Machine Interface (HMI) System, leading to a bare minimum usage or complete neglect of helpful features. This not only affects driving efficiency but also increases cognitive load, especially in complex driving scenarios. To alleviate the fatigue faced by drivers and to reduce the induced lethargy to choose appropriate features, we propose an AI driven recommendation agent/system that helps the driver choose the features. Instead of manually choosing between multiple settings, the driver can simply activate the recommendation mode, allowing the system to optimize selections dynamically. The novelty of this proposal focuses on introducing Intelligence in HMI Systems in such a way that it will maximize the operational usage and reduce decision fatigue in drivers. In this paper, we aim to propose a novel metric - “Decision fatigue index” to conceptualize both – the reduction in driver's cognitive load and AI models to capture, train based on the data from the driver preferences, road conditions, vehicle dynamics and user customizations. The most relevant mitigation/intervention strategies will be augmented in the HMI, which enhances ease of use, improves safety, and ensures that drivers receive the most relevant assistance.
Reliable antenna performance is crucial for aircraft communication, navigation, and radar detection systems. However, an aircraft's structure can detune the antenna input impedance and obstruct radiation, creating a range of potential problems from a low-quality experience for passengers who increasingly expect connectivity while in the air, to violating legal requirements around strict compliance standards. Determining appropriate antenna placement during the design phase can reduce risk of costly problems arising during physical testing stages. Engineers traditionally use a variety of CAD and electromagnetic simulation tools to design and analyze antennas. The use of multiple software tools, combined with globally distributed aircraft development teams, can result in challenges related to sharing models, transferring data, and maintaining the associativity of design and simulation results. To address these challenges, aircraft OEMs and suppliers are implementing unified modeling and simulation technology and processes, which enables them to combine their CAD model with multiphysics simulation within a secure, data-managed and collaborative computing environment. By using a common user interface with unified collaboration, data management, and design and simulation tools, development teams can create a virtual twin of the complete system, including the aircraft structure, electronics and antennas.
Scientists have produced a new, powerful electricity-conducting material that could improve wearable technologies, including medical devices. The new technique uses hyaluronic acid applied directly to a gold-plated surface to create a thinner, more durable film, or polymer, used to conduct electricity in devices like biosensors. It could lead to major improvements in the function, cost, and usability of devices like touchscreens and wearable biosensors.
To achieve Army modernization plans, advanced approaches for testing and evaluation of autonomous ground systems and their integration with human operators should be utilized. This paper presents a framework for developing digital twins at the subsystem level using heterogeneous modeling and simulation (M&S) to address the challenges of manned-unmanned teaming (MUM-T) in operational environments. Focusing on the interplay between robotic combat vehicles (RCVs) and human operations, the framework enables evaluation of soldiers’ cognitive loads while managing tasks such as maneuvering robotic systems, interacting with aided target detection, and engaging simulated adversaries. By employing subsystem-level digital twins, we aim to isolate and control key variables, enabling a detailed assessment of both systems’ performance and operator effectiveness. Through realistic operational scenarios and human-machine interface testing, our approach may help identify optimal solutions for soldier-robot collaborations, ensuring readiness in MUM-T operations. This methodology provides a pathway for refining AI/ML capabilities, enhancing autonomy, and informing the Army’s broader testing and evaluation objectives.
EPFL researchers have developed a customizable soft robotic system that uses compressed air to produce shape changes, vibrations, and other haptic, or tactile, feedback in a variety of configurations. The device holds significant promise for applications in virtual reality, physical therapy, and rehabilitation.
This paper describes a combined visual and haptic localization experiment that addresses the area of multi-modal cueing. The aim of the present investigation is to characterize accuracy and precision of tactile cue-ing in the peri-personal space (PPS), the space around the body in which sensory information is perceived as meaningful (Ref. 1). Outcomes of the unimodal (visual and haptic) and multi-modal (combined visual-haptic) localizations are used to make predictions about the multimodal integrative phenomenon. In the localization experiment, participants are presented with visual, haptic, or multimodal target cues using the body-centered reference frame and are instructed to indicate the corresponding hypothetical target location in space using a mouse pointer in an open-loop feedback condition.
The vertical flight industry is on its way to a transformative era, with autonomous technologies set to alter aerial vehicle operations. While it seems certain that fully autonomous helicopters will eventually be deployed for a variety of missions, some high-stakes situations—like medical evacuations (MEDEVAC)—will for the foreseeable future demand human participation in the form of Emergency Medical Care-giving Crew. This study describes the testbed built to run and investigate hypothetical future situations in which a helicopter is autonomously piloted while a human medic with no aviation training, subjected to aviation and medical emergencies, manages patient care onboard. A total of 22 participants, with emergency medical technician certification, nursing or a medical board certification, were invited to run and evaluate the use of AI pilot (AP) in different scenarios of medical evacuation under the following emergencies: medical, empty fuel tank, pressure sensor miscalibration, and engine failure. A comprehensive evaluation of both objective and subjective performance metrics revealed that novice medical professionals could effectively execute medical evacuation operations in conjunction with an AI pilot, even during unforeseen circumstances. The analysis of response times unveiled distinct perspectives on how medics perceive and manage various emergency situations when an AP functions as a collaborative and effective team member.
This paper investigates the use of multi-modal cueing through full-body haptic feedback to enhance pilot-vehicle system (PVS) performance, reduce mental workload (MWL), and increase situational awareness (SA) in both good and degraded visual environments (GVE/DVE). Piloted simulations were conducted using an H-60-like flight dynamics model in a virtual reality (VR) motion-based simulator, evaluating two ADS-33-like mission task elements (MTEs) – precision hover and slalom – under visual-only and combined visual and haptic feedback conditions in both GVE and DVE. The H-60 flight dynamics were augmented with a dynamic inversion (DI)- based stability augmentation system (SAS), implementing rate-command/attitude hold (RCAH) response type on the roll, pitch, and yaw axes and altitude hold response type on the vertical axis. The SAS was designed to achieve Level 1 handling qualities per ADS-33 standards. The full-body haptic cueing strategy leveraged an outer-loop DI control law, which provided vibrotactile feedback to cue desired roll, pitch, and yaw attitudes to the pilot. Roll cues were delivered via tactors mounted on the upper arms, pitch cues via tactors on the chest and back, and yaw cues via tactors on the calves. Eight test subjects participated in the piloted simulations, including three U.S. Navy test pilots and five subjects with different flying experiences. Results indicated that haptic feedback significantly improved hover performance, reducing MWL and enhancing SA, particularly in DVE. However, in the slalom task, predefined haptic guidance misaligned with pilots’ individual control strategies, leading to performance degradation. This finding highlights the need for pilot-specific adaptive haptic feedback to mitigate inconsistencies in dynamic maneuvering tasks.
In the early days of computers, interfaces were paper printouts or blinking lights, but as the technology matured, the graphical user interface (GUI) quickly became the standard.
In addition to providing safety advantages, sound and vibration are being utilized to enhance the driver experience in Battery Electric Vehicles (BEVs). There's growing interest and investment in using both interior and exterior sounds for pedestrian safety, driver awareness, and unique brand recognition. Several automakers are also using audio to simulate virtual gear shifting of automatic and manual transmissions in BEVs. According to several automotive industry articles and market research, the audio enhancements alone, without the vibration that drivers are accustomed to when operating combustion engine vehicles, are not sufficient to meet the engagement, excitement, and emotion that driving enthusiasts expect. In this paper, we introduce the use of new automotive, high-force, compact, light-weight circular force generators for providing the vibration element that is lacking in BEVs. The technology was developed originally for vibration reduction/control in aerospace applications, has been recently tested in various vehicles, and demonstrates the effectiveness for providing a real haptic feel across the entire vehicle. Shaking the vehicle globally provides a unique capability for BEVs, including Hybrid Electric Vehicles and for helping to create a smooth transition between Gas and Electric power, for example. The technology can be used to generate and emulate high-performance, high power, combustion engine feel, including idle, engine run-up/acceleration, simulated gear shifts, and Advanced Driving Assistance and Systems (ADAS) haptic indicators. The optional and customizable vibration can also mask road vibration which becomes very noticeable in otherwise smooth BEVs and can provide the perfect supplement to existing audio enhancements and gear shifting features. Additionally, the paper describes how the force generating device can be packaged in a light weight, compact, low-power manner. The technology will be compared to other force generating methods, and discuss its pros and cons.
The study analyzed data from on-road drives with a pre-production Level 2 (L2) partial automation system using a sample of 27 drivers ranging from 21 to 75 years of age. The system provides continuous automatic lateral and longitudinal control but requires the driver to remain attentive and intervene when necessary. The L2 system was equipped with a Driving Monitoring System (DMS) that issued escalating alerts to remind the driver to pay attention or take over when needed. During the 14-month study period, drivers completed 354,768 miles of travel with the L2 system engaged, totaling 5,913 trips. The results of the study showed that drivers were highly responsive to attention reminders and takeover alerts, with high compliance rates and quick response times. Importantly, there was no evidence of habituation to these alerts over time. These findings support the effectiveness of the system's DMS and alert HMI (Human-Machine Interface) strategy in promoting the proper use of the system with increased usage and exposure.
Items per page:
50
1 – 50 of 1018