Browse Topic: Level 5 (Full driving automation)
Precision control in Level 4 Automated Vehicles is essential for enhancing operational efficiency, accuracy, and safety. This work, conducted as part of ARPA-E’s NEXTCAR program, focuses on developing a robust hardware and software control solution to enable drive-by-wire functionality. A previous publication by the authors presented the hardware solutions for overtaking stock vehicle controls. This paper focuses on a model-based and data-driven control algorithm to enable drive-by-wire functionality for longitudinal and lateral motion control for a 2021 Honda Clarity Plug-In Hybrid Electric Vehicle. This vehicle was equipped with a set of sensors and an onboard processing unit to enable Level 4 automation. For lateral controls, an algorithm was developed to command steering torque to the electronic power steering module, ensuring the vehicle could attain the desired steering angle position at varying speeds. The system leveraged feedforward and feedback mechanisms. Feedback controller gains were identified through frequency response analysis of the steering torque assist electric motor and were further refined during track testing. To optimize the controller’s response time, a feedforward function was developed using a physics-aware model of the vehicle's steering system. The independent feature selection for the model was guided by using the physics of the system. For longitudinal control, the control inputs included the positions of the brake and accelerator pedals sent to the stock ECU, with the desired speed as the setpoint. The setup used a combination of feedforward and feedback control to achieve the target acceleration or deceleration. These algorithms underwent extensive dynamometer and track testing to perform various maneuvers in conjunction with the automated driving system.
Avoiding and mitigating any potential collision is dependent on (1) road user ability to avoid entering into a conflict (conflict avoidance effect) and (2) road user response should a conflict be entered (collision avoidance effect). This study examined the collision avoidance effect of the Waymo Driver, a currently deployed SAE level 4 automated driving system (ADS), using a human behavior reference model, designed to be representative of a human driver that is non-impaired, with eyes on the conflict (NIEON). Reliable performance benchmarking methodologies for assessing ADS performance are an essential component of determining system readiness. This consistently performing, always-attentive driver does not exist in the human population. Counterfactual simulations were run on responder collision scenarios based on reconstructions from a 10-year period of human fatal crashes from the Operational Design Domain of the Waymo ADS in Chandler, Arizona. Of 16 simulated conflicts entered, 12 (75%) were prevented by the Waymo Driver, and 10 (62.5%) were prevented by the NIEON model. The NIEON Model mitigated an additional 5 collisions and did not mitigate 1 collision. In these 16 conflicts entered, 93% of serious injury risk was reduced by the Waymo Driver, whereas 84% of serious injury risk was reduced by the NIEON model. Further, in a case-by-case evaluation, the Waymo Driver’s collision avoidance led to reduced serious injury risk when compared to the NIEON model in every simulated event. The results of this paper demonstrate that a reference model like NIEON can be used to benchmark ADS responder performance in response to high-risk initiating behaviors performed by the current driving population.
The rapid introduction of new Automated Driving Systems (ADS) in the last years has led to an urge for robust methodologies for the type approval of vehicles equipped with such technologies. As a result, different Regulations addressing this field have been adopted. These Regulations are mainly based in the New Assessment and Testing Methodology (NATM) developed within the World Forum for the Harmonisation of Vehicle Regulations (WP29). However, the complexity of the regulatory ecosystem extends beyond type approval. This complexity requires a thorough analysis in order to avoid any possible gap which may jeopardise the feasibility of Automated Driving Vehicles deployment. This paper analyses the possible mismatches among the different regulations currently in place or under development and proposes a holistic approach, where the concept of the Operational Design Domain (ODD) takes a relevant role.
The automotive industry is rapidly advancing towards autonomous vehicles, making sensors such as Cameras, LiDAR, and RADAR critical components for ensuring constant information exchange between the vehicle and its surrounding environment. However, these sensors are vulnerable to harsh environmental conditions like rain, dirt, snow, and bird droppings, which can impair their functionality and disrupt accurate vehicle maneuvers. To ensure all sensors operate effectively, dedicated cleaning is implemented, particularly for Level 3 and higher autonomous vehicles. It is important to test sensor cleaning mechanisms across different weather conditions and vehicle operating scenarios to ensure reliability and performance. One crucial aspect of testing is tracking the trajectory of the cleaning fluid to ensure it does not cause self-soiling of vehicles and affects the field of view or visibility zones of other components like the windshield. While wind tunnel tests are valuable, digitalizing this process is vital for making design decisions early in vehicle development. This work presents a digital methodology to test the self-soiling of a vehicle due to the cleaning systems present on vehicle exterior components, e.g. during mud cleaning at different vehicle speeds. The cleaning mechanism involves multiple water nozzles positioned above, below, or on the sides of these components, which spray water jets to remove dirt or mud deposits. The developed numerical method models the motion of cleaning fluid and contaminants after component cleaning. Steady-state aerodynamic simulations using the Finite Volume Method (FVM) are used to capture airflow, while the interaction of air with cleaning fluid and components is analyzed using a Smoothed Particle Hydrodynamics (SPH) solver. Correlations from this study and wind tunnel tests reveal potential optimization opportunities for existing cleaning systems by inspecting surrounding airflows at various vehicle speeds. Preliminary design evaluations indicate a specific vehicle speed range where self-soiling of vehicle components such as the windshield occurs due to mud cleaning. The proposed numerical method provides the capability to evaluate and qualitatively compare vehicle self-soiling due to various cleaning system designs of exterior components, offering valuable insights for optimizing cleaning mechanisms in autonomous vehicles.
This study presents a structured evaluation framework for reasonably foreseeable misuse in automated driving systems (ADS), grounded in the ISO 21448 Safety of the Intended Functionality (SOTIF) lifecycle. Although SOTIF emphasizes risks that arise from system limitations and user behavior, the standard lacks concrete guidance for validating misuse scenarios in practice. To address this gap, we propose an end-to-end methodology that integrates four components: (1) hazard modeling via system–theoretic process analysis (STPA), (2) probabilistic risk quantification through numerical simulation, (3) verification using high-fidelity simulation, and (4) empirical validation via driver-in-the-loop system (DILS) experiments. Each component is aligned with specific SOTIF clauses to ensure lifecycle compliance. We apply this framework to a case of driver overreliance on automated emergency braking (AEB) at high speeds—a condition where system intervention is intentionally suppressed. Initial numerical analysis suggested that the scenario narrowly satisfies the acceptance criteria. Applying the proposed framework to this scenario reveals that significant safety risks can persist even when the system functions according to its design intent. Our findings demonstrate that foreseeable misuse can be formally modeled, simulated, and empirically validated within the SOTIF framework. The proposed approach enables system developers to quantify behavioral risk and assess human-centered edge cases with greater rigor. This work contributes to operationalizing SOTIF for behavioral safety assurance and lays the foundation for future research on risk mitigation through adaptive HMI and context-aware alerts.
Safety Management Systems (SMSs) have been used in many safety-critical industries and are now being developed and deployed in the automated driving system (ADS)-equipped vehicle (AV) sector. Industries with decades of SMS deployment have established frameworks tailored to their specific context. Several frameworks for an AV industry SMS have been proposed or are currently under development. These frameworks borrow heavily from the aviation industry although the AV and aviation industries differ in many significant ways. In this context, there is a need to review the approach to develop an SMS that is tailored to the AV industry, building on generalized lessons learned from other safety-sensitive industries. A harmonized AV-industry SMS framework would establish a single set of SMS practices to address management of broad safety risks in an integrated manner and advance the establishment of a more mature regulatory framework. This paper outlines a proposed SMS framework for the AV industry based on robust taxonomy development and validation criteria and provides rationale for such an approach.
The rapid development of open-source Automated Driving System (ADS) stacks has created a pressing need for clear guidance on their evaluation and selection for specific use cases. This paper introduces a scenario-based evaluation framework combined with a modular simulation framework, offering a scalable methodology for assessing and benchmarking ADS solutions, including but not limited to off-the-shelf designs. The study highlights the lack of clear Operational Design Domain (ODD) descriptions in such systems. Without a common understanding, users must rely on subjective assumptions, which hinders the process of accurate system selection. To address this gap, the study proposes adopting a standardised ISO 34503 ODD description format within the ADS stacks. The application of the proposed framework is showcased through a case study evaluating two open-source systems, Autoware and Apollo. By first defining the assumed system’s ODD, then selecting a relevant scenario, and establishing pass/fail criteria, the framework provides objective data to highlight performance differences between both systems. The proposed methodology provides an unbiased foundation for informed decision-making, promoting the safe and effective integration of ADS technologies.
As the autonomy of ADAS features are moving from SAE level 0 autonomy to SAE level 5 autonomy of operation, reliance on AI/ML based algorithms in ADAS critical functions like perception, fusion and path planning are increasing predominantly. AI/ML based algorithms offer exceptional performance of the ADAS features, at the same time these advanced algorithms also bring in safety challenges as well. This paper explores the functional safety aspects of AI/ML based systems in ADAS functions like perception, object fusion and path planning, by discussing the safety requirements development for AI/ML systems, dataset safety life cycle, verification and validation of AI systems, and safety analysis used for AI systems. Among all the safety aspects listed above, emphasis is put on dataset safety lifecycle as that is not only the most important element for training ML based algorithms for ADAS usage, but also the most cumbersome and expensive. The safety characteristics associated with dataset lifecycle are dataset safety analysis, dataset requirements development, dataset design and implementation, dataset verification and validation and then finally dataset maintenance. All these dataset life cycle characteristics are discussed in detail. Holistically, this paper outlines the process flow on what is needed from safety point of view to evaluate AI/ML based systems to claim the vehicles with advanced AI/ML systems are free from unreasonable risk. Also, considering perception system as an example, Key Performance Indicators (KPI) from safety perspective are defined to explain the acceptance and rejection criteria of the AI/ML based perception system.
The rapid development of autonomous vehicles necessitates rigorous testing under diverse environmental conditions to ensure their reliability and safety. One of the most challenging scenarios for both human and machine vision is navigating through rain. This study introduces the Digitrans Rain Testbed, an innovative outdoor rain facility specifically designed to test and evaluate automotive sensors under realistic and controlled rain conditions. The rain plant features a wetted area of 600 square meters and a sprinkled rain volume of 600 cubic meters, providing a comprehensive environment to rigorously assess the performance of autonomous vehicle sensors. Rain poses a significant challenge due to the complex interaction of light with raindrops, leading to phenomena such as scattering, absorption, and reflection, which can severely impair sensor performance. Our facility replicates various rain intensities and conditions, enabling comprehensive testing of Radar, Lidar, and Camera sensors. By simulating real-world rain scenarios, we can measure key performance metrics, including accuracy, response time, reliability, and the rate of false positives and negatives. The Digitrans Rain Testbed employs advanced measurement techniques to characterize rain, including droplet size distribution, intensity, and homogeneity. These parameters are critical for understanding how different sensors react to rain and for optimizing their design and functionality. Our findings demonstrate the importance of realistic rain testing in improving the resilience and reliability of automotive sensors. By addressing the specific challenges posed by rain, we can enhance the safety and trustworthiness of autonomous vehicles. The Digitrans Rain Testbed represents a significant step forward in the development of robust testing methodologies, ensuring that future autonomous vehicles can navigate safely and effectively, even in the most challenging weather conditions. This research underscores the necessity of rigorous, real-world testing in advancing autonomous vehicle technology and paves the way for safer and more reliable automated driving systems.
Some challenges, such as reworking airbags to meet all seating scenarios, will be solved by the OEM as the final system integrator. Rearward-facing front seats have generally been limited to concept cars that explore a far-away world in which SAE Level 5 autonomous driving has been perfected. Magna has rewritten that playbook, winning a contract with a Chinese OEM for a reconfigurable seating system that includes fully rotating front seats on long rails, creating an unusually flexible cabin. Currently configured for vehicles with two rows of seating, the system features power-swivel seats along rails or tracks nearly two meters (6.6 ft) long. The front passenger and driver seats can rotate 270 degrees.
In the evolving landscape of automated driving systems, the critical role of vehicle localization within the autonomous driving stack is increasingly evident. Traditional reliance on Global Navigation Satellite Systems (GNSS) proves to be inadequate, especially in urban areas where signal obstruction and multipath effects degrade accuracy. Addressing this challenge, this paper details the enhancement of a localization system for autonomous public transport vehicles, focusing on mitigating GNSS errors through the integration of a LiDAR sensor. The approach involves creating a 3D map using the factor graph-based LIO-SAM algorithm, which is further enhanced through the integration of wheel encoder and altitude data. Based on the generated map a LiDAR localization algorithm is used to determine the pose of the vehicle. The FAST-LIO based localization algorithm is enhanced by integrating relative LiDAR Odometry estimates and by using a simple yet effective delay compensation method to enable operation at higher velocities. To robustly fuse LiDAR- and GNSS-based position estimates, an emperical motivated geobased adjustment scheme for the covariances of the two datasources is presented. The performance of the mapping and localization components is validated with real driving data, demonstrating improved stability and accuracy compared to the GNSS-based localization system.
On-road vehicles equipped with driving automation features are entering the mainstream public space. This category of vehicles is now extending to include those where a human might not be needed for operation on board. Several pilot programs are underway, and the first permits for commercial usage of vehicles without an onboard operator are being issued. However, questions like “How safe is safe enough?” and “What to do if the system fails?” persist. This is where remote operation comes in, which is an additional layer to the automated driving system where a human assists the so-called “driverless” vehicle in certain situations. Such remote-operation solutions introduce additional challenges and potential risks as the entire chain of “automated vehicle, communication network, and human operator” now needs to work together safely, effectively, and practically. And as much as there are technical questions regarding network latency, bandwidth, cybersecurity, etc., aspects like human workload, attentiveness, and situational awareness also need to be clarified. Furthermore, on an even higher level, experts still debate the relevance of remote operation to launch automated vehicles—with various expert opinions ranging from they are “essential requirement” to “not advisable.” At the same time, many experts assume that virtually any company aiming for vehicles with SAE Level 4 driving automation is considering at least some form of remote operation. This chapter aims to highlight those unsettled issues and introduce solutions that are evolving. Similarly, developing standards and regulations are also summarized, which are needed to provide frameworks for the deployment of such driving automation with remote operation.
On-road vehicles equipped with driving automation features are entering the mainstream public space. This category of vehicles is now extending to include those where a human might not be needed for operation on board. Several pilot programs are underway, and the first permits for commercial usage of vehicles without an onboard operator are being issued. However, questions like “How safe is safe enough?” and “What to do if the system fails?” persist. This is where remote operation comes in, which is an additional layer to the automated driving system where a human assists the so-called “driverless” vehicle in certain situations. Such remote-operation solutions introduce additional challenges and potential risks as the entire chain of “automated vehicle, communication network, and human operator” now needs to work together safely, effectively, and practically. And as much as there are technical questions regarding network latency, bandwidth, cybersecurity, etc., aspects like human workload, attentiveness, and situational awareness also need to be clarified. Furthermore, on an even higher level, experts still debate the relevance of remote operation to launch automated vehicles—with various expert opinions ranging from they are “essential requirement” to “not advisable.” At the same time, many experts assume that virtually any company aiming for vehicles with SAE Level 4 driving automation is considering at least some form of remote operation. This chapter aims to highlight those unsettled issues and introduce solutions that are evolving. Similarly, developing standards and regulations are also summarized, which are needed to provide frameworks for the deployment of such driving automation with remote operation.
The impending deployment of automated vehicles (AVs) represents a major shift in the traditional approach to ground transportation; its effects will inevitably be felt by parties directly involved with vehicle manufacturing and use (e.g., automotive original equipment manufacturers (OEMs), public transportation systems, heavy goods transportation providers) and those that play roles in the mobility ecosystem (e.g., aftermarket and maintenance industries, infrastructure and planning organizations, automotive insurance providers, marketers, telecommunication companies). The focus of this chapter is to address a topic overlooked by many who choose to view automated driving systems and AVs from a “10,000-foot perspective:” the topic of how AVs will communicate with other road users such as conventional (human-driven) vehicles, bicyclists, and pedestrians while in operation. This unsettled issue requires assessing the spectrum of existing modes of communication—both implicit and explicit, both biological and technological—employed by road users today.
Artificial intelligence (AI)-based solutions are slowly making their way into mobile devices and other parts of our lives on a daily basis. By integrating AI into vehicles, many manufacturers are looking forward to developing autonomous cars. However, as of today, no existing autonomous vehicles (AVs) that are consumer ready have reached SAE Level 5 automation. To develop a consumer-ready AV, numerous problems need to be addressed. In this chapter we present a few of these unaddressed issues related to human-machine interaction design. They include interface implementation, speech interaction, emotion regulation, emotion detection, and driver trust. For each of these aspects, we present the subject in detail—including the area’s current state of research and development, its current challenges, and proposed solutions worth exploring.
Items per page:
50
1 – 50 of 92