Browse Topic: Augmented / virtual reality
This paper investigates the use of full-body vibrotactile cueing to augment operator perception during swarm teleoperation tasks. Piloted simulations are conducted in a virtual reality (VR) flight simulation environment using a quadcopter swarm model and a nonlinear dynamic inversion (NDI) flight control architecture. A scaled version of the ADS-33 slalom Mission Task Element (MTE) is implemented to evaluate swarm formation maintenance and obstacle avoidance under four experimental conditions: Good Visual Environment (GVE), Degraded Visual Environment (DVE), and each of these conditions augmented with haptic feedback. Haptic cues are delivered through vibrotactile vests and sleeves to convey information on formation deformation and gate proximity. Experimental results involving human participants indicate that haptic feedback improves formation maintenance and increases operators’ situational awareness of follower drone positions without increasing perceived mental workload. While haptic cues provided modest assistance in gate localization, visual conditions remained the dominant factor influencing obstacle avoidance performance. Overall, the results indicate that full-body haptic feedback provides an effective modality for augmenting operator perception and supporting swarm supervision tasks, particularly in visually degraded environments.
For Urban Air Mobility taxis, passengers will experience different levels of heave motion during flight. Researchers at NASA Armstrong Flight Research Center conducted two studies in which passengers were exposed to varying levels of heave motion in the Armstrong Virtual Reality Passenger Ride Quality Laboratory. In the first study, twenty-three volunteers from the Armstrong workforce evaluated the motions on a five-point rating scale and a binary comfort scale; in the second study, fifty volunteers evaluated a flight experience with varying levels of stimuli using a five-point comfort scale and a five-point passenger acceptance scale. This paper combines the results of these two studies to observe the relationship between heave motion and passenger rider quality and acceptance. Both passenger comfort and acceptance were found to decrease with increasing heave acceleration The statistically significant relationship between the magnitude of heave acceleration and passenger comfort for individual studies and combined results are discussed.
A team of researchers at Penn State have devised a new, streamlined approach to design metasurfaces, a class of engineered materials that can manipulate light and other forms of electromagnetic radiation with just their structures. This rapid optimization process could help manufacture advanced optical systems like camera lenses, virtual reality headsets, holographic imagers and more, the team said.
A new system that brings together real-world sensing and virtual reality would make it easier for building maintenance personnel to identify and fix issues in commercial buildings that are in operation. The system was developed by computer scientists at the University of California San Diego and Carnegie Mellon University.
Driver-in-the-Loop (DIL) simulators have become crucial tools across automotive, aerospace, and maritime industries in enabling the evaluation of design concepts, testing of critical scenarios and provision of effective training in virtual environments. With the diverse applications of DIL simulators highlighting their significance in vehicle dynamics assessment, Advanced Driver Assistance Systems (ADAS) and autonomous vehicle development, testing of complex control systems is crucial for vehicle safety. By examining the current landscape of DIL simulator use cases, this paper critically focuses on Virtual Validation of ADAS algorithms by testing of repeatable scenarios and effect on driver response time through virtual stimuli of acoustic and optical warnings generated during simulation. To receive appropriate feedback from the driver, industrial grade actuators were integrated with a real-time controller, a high-performance workstation and simulation software called Virtual Test Drive (VTD). By developing an integrated solution for acquiring driver response, creation of scenarios and evaluation of control systems, this paper focuses on virtual validation of systems in a time saving and cost-effective manner.
The integration of Advanced Driver Assistance Systems (ADAS) into modern vehicles necessitates innovative solutions for interior packaging that balance out safety, performance, and ergonomic considerations. This paper introduces an inverted U-shaped steel tube cross car beam (CCB) as a superior alternative to traditional straight tube designs, tailored for premium vehicle instrument panels. The U-shaped geometry overcomes the limitations of straight tube beams by creating additional packaging space for components such as AR-HUDs, steering columns, HVAC systems, and electronic control units (ECUs). This geometry supports efficient crunch packaging while accommodating ergonomic requirements like H-point, eyeball trajectory, and cockpit depth for optimal ADAS component placement. The vertical alignment of the steering column within the U-shaped design further enhances space utilization and structural integrity. This study demonstrates that the inverted U-shaped CCB is a transformative solution for ADAS packaging, providing superior durability, crash performance, and knee injury mitigation compared to traditional straight tube designs. By addressing challenges such as crunch packaging, structural stiffness, and manufacturing efficiency, the U-shaped beam sets a new standard for global automotive platforms. The findings underscore its potential to revolutionize vehicle interiors, enabling advanced technology integration while maintaining safety and efficiency.
The automotive industry faces increasing challenges in managing vehicle lifecycle complexity, including inefficiencies in design, manufacturing, and maintenance. Traditional reactive maintenance approaches often lead to unexpected downtimes, increased costs, and diminished customer experience. Moreover, rapidly evolving technologies demand agile and adaptive development processes. The Digital Twin (DT) concept which involves leveraging advanced technologies to create virtual representations of physical systems offers a promising solution by enabling real-time simulation, prediction, and optimization throughout the vehicle lifecycle. By bridging physical and digital realms, Digital Twins provide a powerful tool for improving system efficiency, adaptability, and quality. This paper highlights the benefits of applying Digital Twin principles at the systems engineering level, offering a solution for more resilient, innovative, and customer-centric vehicle systems. This study explores the integration of Digital Twin technology within a Model-Based Systems Engineering (MBSE) framework, focusing on system-level applications. Using the example of a feature within Seating Systems, we demonstrate how Digital Twin can streamline feature development, improve integration across component-level designs, and proactively identify potential issues. The proposed approach aims to reduce development iterations, enhance feature robustness, and improve user experience.
Virtual reality (VR), Augmented Reality (AR) and Mixed reality (MR) are advanced engineering techniques that coalesces physical and digital world to showcase better perceiving. There are various complex physics which may not be feasible to visualize using conventional post processing methods. Various industrial experts are already exploring implementation of VR for product development. Traditional computational power is improving day-by-day with new additional features to reduce the discrepancy between test and CFD. There has been an increase in demand to replace actual tests with accurate simulation approaches. Post processing and data analysis are key to understand complex physics and resolving critical failure modes. Analysts spend a considerable amount of time analyzing results and provide directions, design changes and recommendations. There is a scope to utilize advanced features of VR, AR and MR in CFD post process to find out the root cause of any failures occurred with advanced visualization. This paper focusses on how VR can be used for 3D CFD detailed result analysis. Various physics such as Conjugate heat transfer (both steady state and transient), Discrete phase model, and Flow analysis have been integrated with VR in this study. Few case studies are also discussed, demonstrating how VR helped in understanding complex physics and provided directions for product development. After treatment systems have complex multi physics involved. Using VR, droplet interaction with exhaust gases inside the system helped in better understanding of complex physics. Steady state thermal simulation is another area where VR visualization helps to understand high temperature plume in proximity regions. This paper also focusses on the challenges experienced during integration and usage of VR. ANSYS FLUENT with Ensight are primary tools which have integrated with VR setup to utilize benefit of VR. Automated scripts have been created for ease of VR hand tools usage. Analyst issues in current post processing methods and solutions to it through VR are also discussed in this paper. Advance level implementation of AR is demonstrated in this study.
Virtual reality (VR) video games that combine screen time with exercise are a great way to get fit, but game designers face a major challenge — adherence to ‘exergames’ is low, with most users dropping out once they start to feel uncomfortable or bored.
EPFL researchers have developed a customizable soft robotic system that uses compressed air to produce shape changes, vibrations, and other haptic, or tactile, feedback in a variety of configurations. The device holds significant promise for applications in virtual reality, physical therapy, and rehabilitation.
The complex and turbulent ship airwakes make shipboard rotorcraft launch and recovery difficult for even the most seasoned pilots. One of the main challenges to using flight simulation to train pilots is the real-time accurate prediction of the ship airwake. A real-time, accurate methodology that is able to operate on personal computers without computational meshing is being developed for Advanced Air Mobility (AAM) applications. The early success of this novel approach indicates that it may be well-suited to meet the challenge of dynamic interface (DI) applications as well. To explore this, a novel reduced-order model (ROM) to represent unsteady airwakes for shipboard operations is underway. This ROM will be integrated into an ocean-based representative environment model (REM) to close the gap in real-time simulations without significant computational investment. The ROM effort presented here specifically investigates which superstructure wake characteristics are dominant in different regions where flight operations are conducted. Canonical ship geometries that have been significantly studied experimentally and computationally provide the substantiation of this approach. Evaluation of the accuracy of the approach is presented, correlated with Lattice-Boltzmann simulations, theoretical and experimental data.
Small, highly maneuverable Urban Air Mobility (UAM) air taxis might exhibit motions during hover and low-speed flight that are unfamiliar to many passengers, and for which there are no established guidelines to predict passenger comfort. Researchers performed a study in the Armstrong Virtual Reality Passenger Ride Quality Laboratory to identify relationships between sudden motion characteristics and UAM passenger comfort and acceptance. Twenty-three volunteer test subjects from the Armstrong workforce each completed a 15-minute experience as a passenger in a virtual air taxi simulation. Subjects evaluated a series of flight maneuvers with varying levels of sudden motion using a five-point rating scale and indicated which motion(s) they found uncomfortable. Researchers then administered a post-test questionnaire to relate the passengers’ ratings to their willingness to fly on a real air taxi with similar levels of motion. The study results relate peak heave acceleration and jerk to passenger acceptance.
This paper investigates the use of multi-modal cueing through full-body haptic feedback to enhance pilot-vehicle system (PVS) performance, reduce mental workload (MWL), and increase situational awareness (SA) in both good and degraded visual environments (GVE/DVE). Piloted simulations were conducted using an H-60-like flight dynamics model in a virtual reality (VR) motion-based simulator, evaluating two ADS-33-like mission task elements (MTEs) – precision hover and slalom – under visual-only and combined visual and haptic feedback conditions in both GVE and DVE. The H-60 flight dynamics were augmented with a dynamic inversion (DI)- based stability augmentation system (SAS), implementing rate-command/attitude hold (RCAH) response type on the roll, pitch, and yaw axes and altitude hold response type on the vertical axis. The SAS was designed to achieve Level 1 handling qualities per ADS-33 standards. The full-body haptic cueing strategy leveraged an outer-loop DI control law, which provided vibrotactile feedback to cue desired roll, pitch, and yaw attitudes to the pilot. Roll cues were delivered via tactors mounted on the upper arms, pitch cues via tactors on the chest and back, and yaw cues via tactors on the calves. Eight test subjects participated in the piloted simulations, including three U.S. Navy test pilots and five subjects with different flying experiences. Results indicated that haptic feedback significantly improved hover performance, reducing MWL and enhancing SA, particularly in DVE. However, in the slalom task, predefined haptic guidance misaligned with pilots’ individual control strategies, leading to performance degradation. This finding highlights the need for pilot-specific adaptive haptic feedback to mitigate inconsistencies in dynamic maneuvering tasks.
We present the flight testing and integration of the Microsoft HoloLens 2 as a head-worn display (HWD) in DLR's research helicopter. Building on its successful use in a helicopter simulator, initial flight tests confirmed its feasibility in a real helicopter. Current tests focused on system optimization, with head tracking identified as the critical component for hologram stability. Since the HoloLens' inside-out tracking fails in moving vehicles, it was fused with an external infrared tracker, automatically calibrated via an optimization approach adaptable to various trackers and mounting positions. A test pilot with HWD experience rated the system as fully functional, enabling the first successful experiments with holographic Mission Task Elements. Beyond the helicopter, the HoloLens was tested in a car and on a high-speed boat, where holograms remained spatially stable despite high-frequency movements, with a maximum low-frequency error of 0.6° in heading. Static errors depended solely on the external tracker's quality. These results demonstrate the HoloLens 2's potential for operational use in dynamic vehicle environments, enhancing immersion. Its mixed-reality features and adaptability proved particularly valuable for rapid research and development across platforms.
Augmented reality (AR) has become a hot topic in the entertainment, fashion, and makeup industries. Though a few different technologies exist in these fields, dynamic facial projection mapping (DFPM) is among the most sophisticated and visually stunning ones. Briefly put, DFPM consists of projecting dynamic visuals onto a person’s face in real-time, using advanced facial tracking to ensure projections adapt seamlessly to movements and expressions.
State-of-the-art fighter aircraft have a large number of support systems that operate in multiple areas. These systems are continuously optimized to achieve maximum efficiency and performance. Countless sensors monitor the environment and generate important data that helps to understand the areas overflown. But even in life-threatening combat situations, target acquisition systems support pilots and provide additional information that can be decisive with the help of augmented reality (AR) and artificial intelligence (AI). Military aviation is an arena with great potential for the use of technical aids that have transformed the original fighter aircraft into a technological masterpiece. In addition to the high level of complexity, the upcoming generation change from fifth- to sixth-generation fighter jets poses major challenges for component suppliers and accelerates the pace of technological competition. A military fighter jet is already an extremely demanding environment for technical equipment.
State-of-the-art fighter aircraft have a large number of support systems that operate in multiple areas. These systems are continuously optimized to achieve maximum efficiency and performance. Countless sensors monitor the environment and generate important data that helps to understand the areas overflown. But even in life-threatening combat situations, target acquisition systems support pilots and provide additional information that can be decisive with the help of augmented reality (AR) and artificial intelligence (AI). Military aviation is an arena with great potential for the use of technical aids that have transformed the original fighter aircraft into a technological masterpiece.
Researchers in the emerging field of spatial computing have developed a prototype augmented reality headset that uses holographic imaging to overlay full-color, 3D moving images on the lenses of what would appear to be an ordinary pair of glasses. Unlike the bulky headsets of present-day augmented reality systems, the new approach delivers a visually satisfying 3D viewing experience in a compact, comfortable, and attractive form factor suitable for all-day wear.
This research aimed to explore the integration of Virtual reality technology in ergonomically testing automotive interior designs. This objective was aimed at ensuring that such technology could be used to ameliorate user comfort through controlled simulations. Existing ergonomic testing methods are often limited when it comes to recreating actual driving situations and quickly repeating design improvements. VR could be used as a solution because its ergonomically tested simulation can be used to provide users with the real experience of driving. The users can be observed while they experience it and asked for their feedback. For this research, an interactive VR environment imitating a 10-minute-long trip through traffic and changing road conditions was created. It was populated by ten users, concatenated equally in men and women, both aged 20-35, representing approximate demographics of workers in the automotive production industry. Participants of the research were asked to use assessed metrics, which included subjective comfort rating, control reachability, visibility rating and overall user experience within the VR simulation. The VR environment was overall well-received by the demands of this research. Its uses found it comfortable and easy to use, with average metrics of 7.5, 8.0, and 7.5, respectively for comfort, controls, and visibility. The overall user experience averaged at 7.8. The information obtained through this research proves that VR environments can be used effectively to simulate the interior of cars and ameliorate the ergonomics of their designs. This could potentially be a revolutionary technology, accelerating automotive development by the early detection of design mistakes and facilitating iterative improvements with subsequent iterations.
Seoul National University College of Engineering announced that researchers from the Department of Electrical and Computer Engineering’s Optical Engineering and Quantum Electronics Laboratory have developed an optical design technology that dramatically reduces the volume of cameras with a folded lens system utilizing “metasurfaces,” a next-generation nano-optical device. By arranging metasurfaces on the glass substrate so that light can be reflected and moved around in the glass substrate in a folded manner, the researchers have realized a lens system with a thickness of 0.7 mm, which is much thinner than existing refractive lens systems. The research, which was supported by the Samsung Future Technology Development Program and the Institute of Information & Communications Technology Planning & Evaluation (IITP), was published on October 30 in the journal Science Advances. Traditional cameras are designed to stack multiple glass lenses to refract light when capturing images. While this structure provided excellent high-quality images, the thickness of each lens and the wide spacing between lenses increased the overall bulk of the camera, making it difficult to apply to devices that require ultra-compact cameras, such as virtual and augmented reality (VR-AR) devices, smartphones, endoscopes, drones, and more.
Researchers have developed SPINDLE, a pioneering robotic rehabilitation system. Combining virtual reality (VR) with customized resistance training, SPINDLE offers personalized therapy to enhance strength and dexterity for activities of daily living (ADLs). Its adaptability and potential for home use represent a major advancement in tremor rehabilitation, with broader healthcare implications.
A research team at The University of Texas at Austin created a noninvasive electroencephalogram (EEG) sensor that was installed in a Meta VR headset that can be worn comfortably for long periods. The EEG measures the brain’s electrical activity during the immersive VR interactions.
Researchers worldwide are currently working on the next evolution of communication networks, called “beyond 5G” or 6G networks. To enable the near-instantaneous communication needed for applications like augmented reality or the remote control of surgical robots, ultra-high data speeds will be needed on wireless channels. In a study published recently in IEICE Electronics Express, researchers from Osaka University and IMRA AMERICA have found a way to increase these data speeds by reducing the noise in the system through lasers.
In the increasingly connected and digital world, businesses are sprinting to integrate technological advancements into their corporate fabric. This is evident with the emerging concept of “digital twinning.” Digital twins are virtual representations of real-world objects or systems used to digitally model performance, identify inefficiencies, and design solutions. This helps improve the “real world” product, reduces costs, and increases efficiency. However, this replication of a physical entity in the digital space is not without its challenges. One of the challenges that will become increasingly prevalent is the processing, storing, and transmitting of Controlled Unclassified Information (CUI). If CUI is not protected properly, an idea to save time, money, and effort could result in the loss of critical data. The Department of Defense's (DoD) CUI Program website defines CUI as “government-created or owned unclassified information that allows for, or requires, safeguarding and dissemination controls in accordance with laws, regulations, or government-wide policies. It is sensitive information that does not meet the criteria for classification but must still be protected.” In March 2020, DoD published Instruction 5200.48, establishing the official DoD CUI Registry.
The National Research Council of Canada (NRC) has recently developed an Integrated Reality In-flight Simulator (IRIS) that allows helicopter pilots to fly the NRC's Bell 412 Advanced Systems Research Aircraft (ASRA) while wearing a commercial off-the-shelf (COTS) virtual reality headset. IRIS is the first airborne simulator of its kind that combines COTS virtual reality and Fly-By-Wire (FBW) synthetic turbulence for helicopter operations. Simulations are not exact replications of actual environments; therefore, a methodology of comparing pilot workload with respect to an analysis of the differences between the simulated and actual environments is required. During a recent flight trial, NRC validated the effectiveness of IRIS to replicate a pilot's workload during ship landing tasks using these workload scales. During the analysis, NRC took initial steps in developing methodologies to examine environmental characteristics and then correlate them to an associated pilot workload. The work also included the initial development of methodologies to analyze pilot workload and alternative prediction methods that better map subjective or quantitative pilot workload data to DIPES.
Items per page:
50
1 – 50 of 663