Try Mobilus Beta
Search tips
 This content is not included in your SAE MOBILUS subscription, or you are not logged in.

Literature Review of Verification and Validation Activities of Automated Driving Systems

Journal Article
12-03-04-0020
ISSN: 2574-0741, e-ISSN: 2574-075X
DOI: https://doi.org/10.4271/12-03-04-0020
Published February 03, 2021 by SAE International in United States
Literature Review of Verification and Validation Activities of Automated Driving Systems
Sector:
Citation: Wishart, J., Como, S., Forgione, U., Weast, J. et al., "Literature Review of Verification and Validation Activities of Automated Driving Systems," SAE Intl. J CAV 3(4):267-323, 2020, https://doi.org/10.4271/12-03-04-0020.
Language: English

References

  1. Campbell , M. , Egerstedt , M. , How , J.P. , and Murray , R.M. Automated Driving in Urban Environments: Approaches, Lessons and Challenges Philos. Trans. R. Soc. London A, Math. Phys. Sci. 368 1928 4649 4672 2010
  2. Anderson , J.M. , Kalra , N. , Stanley , D. , Sorensen , P. et al. Automated Vehicle Technology: A Guide for Policymakers Santa Monica RAND Corp 2014
  3. IEEE ® ® 2011 452
  4. Scigliano , R. , Scionti , M. , and Lardeur , P. Verification and Validation for the Vibration Study of Automotive Structures Modelled by Finite Elements Journal of Strain Analysis 48 1 59 72 2012
  5. Ireland , M. , Hoffmann , R. , Miller , A. , Norman , G. et al. 2016
  6. Behere , S. , and Törngren , M. A Functional Reference Architecture for Automated Driving Information and Software Technology 73 136 150 2016
  7. Chen , D. , Feng , L. , Qureshi , T.N. , Lönn , H. et al. An Architectural Approach to the Analysis, Verification and Validation of Software Intensive Embedded Systems Computing 95 649 688 2013
  8. Boukerche , A. , Siddiqui , A.J. , and Mammeri , A. Automated Vehicle Detection and Classification: Models, Methods, and Techniques ACM Computing Surveys 50 5 62 2017
  9. Kamali , M. , Dennis , L. , McAree , O. , Fisher , M. , and Veres , S. Formal Verification of Automated Vehicle Platooning Science of Computer Programming 148 88 106 2017
  10. Li , N. , Oyler , D. , Zhang , M. , Yildiz , Y. et al. Game Theoretic Modeling of Driver and Vehicle Interactions for Verification and Validation of Automated Vehicle Control Systems IEEE Transactions on Control Systems Technology 26 1 2017
  11. Pedan , M. , Gregor , M. , and Plinta , D. Implementation of Automated Guided Vehicle System in Healthcare Facility Procedia Engineering 192 665 670 2017
  12. Overton , B. , Spalding , I. , and Thomas , M. Issues in the Validation and Verification of Vehicle Software 2016 SAE World Congress 1998 1 4
  13. Siegl , S. , Hielscher , K.-S. , and German , R. Model Driven Testing of Embedded Automotive Systems with Timed Usage Models Proceedings of 2010 IEEE International Conference on Vehicular Electronics and Safety QingDao 2010
  14. Sapronov , L. and Bose , P. Model-based Validation and Verification of Automated Networked Vehicles 2005 IEEE Aerospace Conference Big Sky, MT 2005
  15. Althoff , M. , and Dolan , J. Online Verification of Automated Road Vehicles Using Reachability Analysis IEEE Transactions on Robotics 30 4 903 918 2014
  16. Shladover , S. , and Nowakowski , C. Regulatory Challenges for Road Vehicle Automation: Lessons from the California Experience Transportation Research Part A: Policy and Practice 122 125 133 2017
  17. Kianfar , R. , Falcone , P. , and Fredriksson , J. Safety Verification of Automated Driving Systems IEEE Intelligent Transportation Systems Magazine 73 73 86 2013
  18. Llaneras , R. , Cannon , B. , and Green , C. Strategies to Assist Drivers in Remaining Attentive While Under Partially Automated Driving: Verification of Human-Machine Interface Concepts Journal of the Transportation Research Board 2663 1 20 26 2017
  19. Tellis , L. 2012
  20. Department of Defense 2012
  21. Association for Standardization of Automation and Measuring Systems 2019
  22. Association for Standardization of Automation and Measuring Systems 2020
  23. OpenScenario https://www.asam.net/standards/detail/openscenario/ 2018
  24. Automated Vehicle Safety Consortium https://avsc.sae-itc.org/welcome-5471WV-42927L3.html?respondentID=23150208#about 2019
  25. SAE International 2018
  26. Automated Vehicle Safety Consortium 2020
  27. PATH http://www.path.berkeley.edu/ 2018
  28. NHTSA https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/documents/sae2017ltellis.pdf 2018
  29. CETRAN https://www.lta.gov.sg/apps/news/page.aspx?c=2&id=e950a4c8-dd8b-4434-90dd-30cc6cace662 2018
  30. CityMobil http://www.citymobil-project.eu/ 2018
  31. DARPA https://www.darpa.mil/program/assured-autonomy 2018
  32. DARPA https://www.darpa.mil/attachments/AssuredAutonomyProposersDay_Program%20Brief.pdf 2018
  33. dSPACE https://www.dspace.com/en/pub/home/applicationfields/our_solutions_for/driver_assistance_systems.cfm 2018
  34. Edge Case Research https://edge-case-research.com 2018
  35. ENABLE-S3 http://www.enable-s3.eu/domains/automotive/ 2018
  36. Euro NCAP https://www.euroncap.com/en 2018
  37. Fortellix https://www.foretellix.com 2018
  38. GATEway https://gateway-project.org.uk/ 2018
  39. Global NCAP http://www.globalncap.org 2018
  40. ISSUU https://issuu.com/globalncap/docs/seminar-on-isa-systems 2018
  41. IIHS https://www.iihs.org/iihs/sr/statusreport/article/53/4/1 2018
  42. https://innovatiecentrale.nl/nl 2018
  43. Wishart , J. , Como , S. , Elli , M. , Russo , B. et al. Driving Safety Performance Assessment Metrics for ADS-Equipped Vehicles SAE Technical Paper 2020-01-1206 2020 https://doi.org/10.4271/2020-01-1206
  44. Wishart , J. Operational Safety Assessment Metrics for ADS-Equipped Vehicles Automated Vehicle Symposium (AVS) 2020
  45. International Organization for Standardization 2019
  46. National Instruments http://www.ni.com/white-paper/13647/en/ 2018
  47. ITS America 2019 https://static1.squarespace.com/static/596fb16003596e0fa70a232f/t/5d09054e2626740001932e6b/1560872271499/2019+One+Pager+6-18-19.pdf
  48. LUTZ http://ori.ox.ac.uk/projects/lutz-self-driving-pods/ 2018
  49. Mcity https://mcity.umich.edu/ 2018
  50. Liu , H. and Feng , Y. 2018
  51. Feng , Y. , Yu , C. , Xu , S. , Liu , H.X. et al. An Augmented Reality Environment for Connected and Automated Vehicle Testing and Evaluation IEEE Intelligent Vehicles Symposium (IV) June 2018 1549 1554
  52. Feng , S. , Feng , Y. , Yu , C. , Zhang , Y. et al. Testing Scenario Library Generation for Connected and Automated Vehicles, Part 1: Methodology IEEE Transactions on Intelligent Transportation Systems 2019 https://doi.org/10.1109/TITS.2020.2972211
  53. Feng , S. , Feng , Y. , Sun , H. , Bao , S. et al. Testing Scenario Library Generation for Connected and Automated Vehicles, Part 2: Case Studies IEEE Transactions on Intelligent Transportation Systems 2020
  54. Zhao , D. Accelerated Evaluation of Automated Vehicles 9 595 607 2016
  55. Zhao , D. , Huang , X. , Peng , H. , Lam , H. et al. Accelerated Evaluation of Automated Vehicles Safety in Car-Following Maneuvers IEEE Transactions on Intelligent Transportation Systems 19 733 744 2017
  56. Shalev-Shwartz , S. , Shammah , S. , and Shashua , A. 2017
  57. NASA https://www.nasa.gov 2018
  58. NASA https://ti.arc.nasa.gov/m/groups/asr/ASR-1page-2012_V3.pdf 2018
  59. Brat , G. , Denney , E. , Giannakopoulou , D. , Frank , J. et al. 2002
  60. U.S. Department of Transportation 2016
  61. U.S. Department of Transportation 2017
  62. U. D. o. Transportation https://www.transportation.gov/av/3 2019
  63. National Science & Technology Council and U.S. Department of Transportation 2020 https://www.transportation.gov/sites/dot.gov/files/docs/policy-initiatives/automated-vehicles/360956/ensuringamericanleadershipav4.pdf
  64. SAE 2019 https://www.sae.org/servlets/works/committeeHome.do?comtID=TEVAVS4
  65. PEGASUS http://connectedautomateddriving.eu/project/pegasus/ 2018
  66. PEGASUS Project Office https://www.pegasusprojekt.de/files/tmpl/Pegasus-Abschlussveranstaltung/PEGASUS-Gesamtmethode.pdf 2019
  67. T. a. I. (Japanese Ministry of Economy) https://www.sakura-prj.jp/tabid78.html 2019
  68. I. f. A. E. (ika) https://www.ika.rwth-aachen.de/en/research/projects/automated-driving/3126-set-level-4to5.html 2019
  69. HiTec Marketing http://www.hitec.at/e_ref_pro.htm 2018
  70. Transport Systems Catapult https://ts.catapult.org.uk/ 2018
  71. Transport Systems Catapult https://s3-eu-west-1.amazonaws.com/media.ts.catapult/wp-content/uploads/2017/04/25114137/ATS34-Taxonomy-of-Scenarios-for-Automated-Driving.pdf 2018
  72. Underwriters Laboratories Inc. 2019 https://edge-case-research.com/ul4600/
  73. United Nations Economic Commission for Europe 2019 http://www.unece.org/trans/main/welcwp29.html
  74. UNECE 2019 http://www.unece.org/fileadmin/DAM/trans/main/wp1/wp1doc/WP1_Resolution_Brochure_EN_web.pdf
  75. DoD http://www.system-safety.org/Documents/MIL-STD-882E.pdf 2018
  76. Voyage https://voyage.auto/ 2018
  77. Voyage https://oas.voyage.auto/autonomy-assessment/ 2018
  78. Emerging Technology https://www.technologyreview.com/s/609503/the-open-source-driving-simulator-that-trains-automated-vehicles/ 2018
  79. Twitter Tech News 2018 https://Twittertechnews.com
  80. Apollo https://apollo.auto/devcenter/devcenter.html 2018
  81. Apollo Auto https://github.com/apolloauto 2018
  82. Bloomberg https://www.bloomberg.com/news/articles/2018-09-12/how-self-driving-cars-can-get-past-the-learning-permit-stage-without-any-risk 2018
  83. Applied Intuition https://www.appliedintuition.com/products/
  84. Best , A. 2017
  85. CPFL https://github.com/CPFL/Autoware/wiki 2018
  86. Autoware https://autoware.ai/ 2018
  87. Atlantic Media Company https://www.theatlantic.com/technology/archive/2017/08/inside-waymos-secret-testing-and-simulation-facilities/537648/ 2018
  88. Technology Review https://www.technologyreview.com/s/609503/the-open-source-driving-simulator-that-trains-automated-vehicles/ 2018
  89. CARLA https://Carla.org 2018
  90. Mechanical Simulation Corporation https://www.carsim.com/products/carsim/ 2018
  91. Cesium https://cesium.com/blog/2018/04/03/cesium-for-automated-driving-simulation/ 2018
  92. TechCrunch techcrunch.com/2018/06/26/audi-israeli-cognata-automated-vehicle/ 2018
  93. Cognata https://medium.com/@cognataAI/cognata-builds-cloud-based-autonomous-vehicle-simulation-platform-with-nvidia-and-microsoft-accd46b160e6 2018
  94. DeKort , M. 2019 https://medium.com/@imispgh/simulation-can-create-a-complete-digital-twin-of-the-real-world-if-dod-aerospace-technology-is-used-c79a64551647
  95. DeKort , M. 2020
  96. EB Robinos https://www.elektrobit.com/products/eb-robinos/ 2018
  97. Metamoto https://www.smartcitiesworld.net/news/news/metamoto-launches-simulation-as-a-service-offering-3081 2018
  98. NVIDIA Developer https://developer.nvidia.com/driveworks 2018
  99. PreScan https://tass.plm.automation.siemens.com/prescan 2018
  100. Pro-SiVIC https://www.esi-group.com/upgrade-neural-networks-autonomous-driving-using-simulation 2018
  101. rFpro https://www.rfpro.com/ 2018
  102. rFpro https://www.mathworks.com/products/connections/product_detail/rfpro.html 2018
  103. VREXPERIENCE https://www.ansys.com/products/systems/ansys-vrxperience/vrxperience-capabilities 2018
  104. Aldenhoven Testing Center https://www.atc-aldenhoven.de/en/contact.html 2019
  105. Aldenhoven Testing Center https://www.atc-aldenhoven.de/en/about-us.html 2019
  106. Aldenhoven Testing Center https://www.atc-aldenhoven.de/en/tracks.html 2019
  107. Aldenhoven Testing Center https://www.atc-aldenhoven.de/en/connectivity.html 2019
  108. American Center for Mobility https://www.acmwillowrun.org/about-us/ 2019
  109. 2017 https://www.savethebomberplant.org/new-neighbors-american-center-for-mobility/
  110. American Center for Mobility https://www.acmwillowrun.org/learn-about-the-facility/ 2018
  111. NeMo https://nemo-emobility.eu/about/partners/idiada/ 2019
  112. Applus IDIADA https://www.applusidiada.com/en/service/test_tracks-1328274864265 2019
  113. AstaZero 2018 http://www.astazero.com/address/
  114. Coxworth , B. AstaZero Road Safety Testing Facility Opens in Sweden New Atlas 2014 https://newatlas.com/astazero-road-safety-track/33477/
  115. AstaZero 2018 http://www.astazero.com/the-test-site/about/
  116. AstaZero 2018 http://www.astazero.com/about-astazero/partners/
  117. AstaZero 2018 http://www.astazero.com/the-test-site/the-design/
  118. AstaZero 2018 http://www.astazero.com/the-test-site/proving-ground-center/
  119. Energy Research Institute @NTU erian.ntu.edu.sg/ContactUs/Pages/Home.aspx 2017 http://erian.ntu.edu.sg/ContactUs/Pages/Home.aspx
  120. TNO Netherlands 2017 https://www.tno.nl/en/about-tno/news/2017/10/tno-and-ntu-singapore-confirm-research-collaboration-in-autonomous-vehicles/
  121. Energy Research Institute @NTU erian.ntu.edu.sg/Programmes/IRP/FMSs/Pages/Centre-of-Excellence-for-Testing-Research-of-AVs-NTU-CETRAN.aspx 2017 http://erian.ntu.edu.sg/Programmes/IRP/FMSs/Pages/Centre-of-Excellence-for-Testing-Research-of-AVs-NTU-CETRAN.aspx
  122. GoMentum Station http://gomentumstation.net/about/ 2018
  123. Pullen , J.P. GoMentum Station Offers Driverless Car Testing Ground | Time Time Magazine 2015 http://time.com/4012989/driverless-cars-gomentum/
  124. GoMentum Station http://gomentumstation.net/collaborations/ 2019
  125. GoMentum Station http://gomentumstation.net/vision/ 2019
  126. Horiba Mira 2019 https://www.horiba-mira.com/our-services/vehicle-proving-ground
  127. Horiba Mira 2019 https://www.horiba-mira.com/
  128. HORIBA MIRA 2019 https://www.horiba-mira.com/our-services/proving-ground-and-events/test-tracks
  129. HORIBA MIRA 2019 https://www.horiba-mira.com/our-services/city-circuit
  130. KATRI http://www.ts2020.kr/eng/html/kat/Proving.do;jsessionid=TE2RLxOkhPvilVT3ItghPPDaB8BDDY0IFxATsFJ8m​Qyr8JHUU23fU0mZ2jm​BuQPk.TSHP-WAS2_servlet_engine2 2019
  131. Hao , K. Quartz 2017 https://qz.com/1121372/south-korea-opens-k-city-the-latest-fake-town-built-for-self-driving-cars/
  132. Mcity 2019 https://mcity.umich.edu/our-work/mcity-test-facility/
  133. Mcity 2019 https://mcity.umich.edu/our-partners/
  134. Millbrook Proving Ground 2019 http://www.millbrook.co.uk/contact/ 2019
  135. Millbrook Proving Ground 2019 http://www.millbrook.co.uk/cav/
  136. SunTrax 2018 http://www.suntraxfl.com/#contact-us
  137. Claytor , S. Bay News 9 2018 https://www.baynews9.com/fl/tampa/news/2018/08/17/first-phase-of-suntrax-to-open-in-less-than-a-year
  138. SunTrax 2018 http://www.suntraxfl.com/#explore-facilities
  139. SunTrax 2018 http://www.suntraxfl.com/#partnerships
  140. SunTrax 2018 http://www.suntraxfl.com/#about-us
  141. SunTrax 2018 http://www.suntraxfl.com/#explore-facilities
  142. TRC Inc. 2017 http://www.trcpg.com/about-us/
  143. TRC 2017 http://www.trcpg.com/people-skills-and-knowledge/
  144. TRC 2017 http://www.trcpg.com/virtual-facility-tour/
  145. Virginia Tech Transportation Institute 2019 https://www.vtti.vt.edu/facilities/virginia-smart-road.html
  146. Road Traffic Technology https://www.roadtraffic-technology.com/projects/virginias-smart-road/ 2019
  147. Virginia Tech Transportation Institute 2019 https://www.vtti.vt.edu/about/partners-sponsors.html
  148. Uber ATG 2018 https://uber.app.box.com/v/UberATGSafetyReport

Cited By

Recommended Content

Ground Vehicle Standard PERFORMANCE SPECIFICATION FOR AUTOMOTIVE WIRE HARNESS RETAINER CLIPS
Journal Article Developing a Standardized Performance Evaluation of Vehicles with Automated Driving Features
Technical Paper Research on the Radiated Immunity Test Methods of ADAS Functions in Intelligent Vehicles