This content is not included in your SAE MOBILUS subscription, or you are not logged in.

Assessing the Safety of Environment Perception in Automated Driving Vehicles

Journal Article
09-08-01-0004
ISSN: 2327-5626, e-ISSN: 2327-5634
Published April 21, 2020 by SAE International in United States
Assessing the Safety of Environment Perception in Automated Driving Vehicles
Sector:
Citation: Berk, M., Schubert, O., Kroll, H., Buschardt, B. et al., "Assessing the Safety of Environment Perception in Automated Driving Vehicles," SAE Int. J. Trans. Safety 8(1):49-74, 2020, https://doi.org/10.4271/09-08-01-0004.
Language: English

References

  1. SAE International Surface Vehicle Recommended Practice ™ 2016
  2. Winner , H. , Hakuli , S. , Lotz , F. , and Singer , C. Handbook of Driver Assistance Systems Cham Springer International Publishing 2016 978-3-319-12351-6
  3. Winner , H. ADAS, Quo Vadis? Winner , H. , Hakuli , S. , Lotz , F. , and Singer , C. Handbook of Driver Assistance Systems Cham Springer International Publishing 2016 1557 1584 978-3-319-12351-6
  4. Wachenfeld , W. and Winner , H. The Release of Autonomous Vehicles Maurer , M. , Gerdes , J.C. , Lenz , B. , and Winner , H. Autonomous Driving Berlin/Heidelberg Springer Berlin Heidelberg 2016 425 449 978-3-662-48845-4
  5. Weitzel , A. Approval Strategies for Advanced Driving Assistance Systems: [Bericht zum Forschungsprojekt FE 82.0546/2012] Berichte der Bundesanstalt für Straßenwesen Fahrzeugtechnik 98 Bremen Fachverl. NW 2014 978-3-95606-118-9
  6. Kalra , N. and Paddock , S.M. Driving to Safety: How Many Miles of Driving Would It Take to Demonstrate Autonomous Vehicle Reliability? Transportation Research Part A: Policy and Practice 94 182 193 2016 https://doi.org/10.1016/j.tra.2016.09.010
  7. Shalev-Shwartz , S. , Shammah , S. , and Shashua , A. On a Formal Model of Safe and Scalable Self-Driving Cars 2017
  8. Winkle , T. Development and Approval of Automated Vehicles: Considerations of Technical, Legal, and Economic Risks Maurer , M. , Gerdes , J.C. , Lenz , B. , and Winner , H. Autonomous Driving Berlin/Heidelberg Springer Berlin Heidelberg 2016 589 618 978-3-662-48845-4
  9. Wachenfeld , W. and Winner , H. The New Role of Road Testing for the Safety Validation of Automated Vehicles Watzenig , D. and Horn , M. Automated Driving: Safer and More Efficient Future Driving Cham Springer International Publishing 2017 419 435 978-3-319-31895-0
  10. Pegasus https://www.pegasusprojekt.de/en/pegasus-method 2020
  11. Koopman , P. and Wagner , M. Challenges in Autonomous Vehicle Testing and Validation SAE Int. J. Trans. Safety 4 1 15 24 2016 https://doi.org/10.4271/2016-01-0128
  12. ISO 2011
  13. Weitzel , A. 2013
  14. ISO 2019
  15. Ulbrich , S. , Menzel , T. , Reschka , A. , Schuldt , F. et al. Defining and Substantiating the Terms Scene, Situation, and Scenario for Automated Driving 2015 IEEE 18th International Conference on Intelligent Transportation Systems - (ITSC 2015) Gran Canaria, Spain Sept. 15-18, 2015 982 988 978-1-4673-6596-3
  16. Pütz , A. , Zlocki , A. , and Eckstein , L. Absicherung hochautomatisierter Fahrfunktionen mithilfe einer Datenbank relevanter Szenarien Uni-DAS e. V 11. Workshop Fahrerassistenzsysteme und automatisiertes Fahren Walting Mar. 29-31, 2017 978-3-00-055656-2
  17. Bagschik , G. , Menzel , T. , Reschka , A. , and Maurer , M. Szenarien für Entwicklung, Absicherung und Test von automatisierten Fahrzeugen Uni-DAS e. V 11. Workshop Fahrerassistenzsysteme und automatisiertes Fahren Walting Mar. 29-31, 2017 978-3-00-055656-2
  18. Berk , M. , Kroll , H.-M. , Schubert , O. , Buschardt , B. et al. Bayesian Test Design for Reliability Assessments of Safety-Relevant Environment Sensors Considering Dependent Failures SAE Technical Paper 2017-01-0050 2017 https://doi.org/10.4271/2017-01-0050
  19. Deutscher Bundestag 1989
  20. Häring , I. Risk Acceptance Criteria Häring , I. Risk Analysis and Management: Engineering Resilience Singapore Springer Singapore 2015 313 342 978-981-10-0013-3
  21. Anderson , J.M. , Samaras , C. , Stanley , K.D. , Kalra , N. et al. Autonomous Vehicle Technology: A Guide for Policymakers Santa Monica, CA RAND Corporation 2016 978-0-8330-8398-2
  22. Johansen , I.L. 2010
  23. Health & Safety Executive Reducing Risks, Protecting People: HSE’s Decision-Making Process Sudbury HSE Books 2001 0-7176-2151-0
  24. Starr , C. Social Benefit versus Technological Risk Science 165 3899 1232 1238 1969
  25. European Standard 2000
  26. Ethics Commission 2017
  27. Slovic , P. Perception of Risk Science 236 4799 280 285 1987
  28. Tversky , A. and Kahneman , D. Judgment under Uncertainty: Heuristics and Biases Science 185 4157 1124 1131 1974
  29. Fischhoff , B. , Slovic , P. , Lichtenstein , S. , Read , S. et al. How Safe Is Safe Enough?: A Psychometric Study of Attitudes towards Technological Risks and Benefits Policy Sci 9 2 127 152 1978 https://doi.org/10.1007/BF00143739
  30. Gelman , A. Bayesian Data Analysis Texts in Statistical Science Third Edition Boca Raton, FL CRC Press 2014 978-1-4398-4095-5
  31. Rausand , M. and Høyland , A. System Reliability Theory: Models, Statistical Methods, and Applications Second Edition Hoboken, NJ Wiley-Interscience 2004 978-0-471-47133-2
  32. Lyu , M.R. Handbook of Software Reliability Engineering New York McGraw Hill 1996 0-07-039400-8
  33. Ericson , C.A. Hazard Analysis Techniques for System Safety Hoboken, NJ Wiley 2005 0471720194
  34. Thrun , S. , Burgard , W. , and Fox , D. Probabilistic Robotics Cambridge, MA MIT Press 2005 978-0262201629
  35. Brooks , R.A. Intelligence without Reason Artificial Intelligence: Critical Concepts 3 107 163 1991
  36. Shanahan , M. Reinventing Shakey Logic-Based Artificial Intelligence New York Springer 2000 233 253
  37. Durrant-Whyte , H. and Henderson , T.C. Multisensor Data Fusion Siciliano , B. and Khatib , O. Springer Handbook of Robotics Second Edition Berlin Springer 2016 867 892 978-3-319-32552-1
  38. Straub , D. 2014
  39. Ditlevsen , O.D. and Madsen , H.O. Structural Reliability Methods Chichester/New York John Wiley & Sons 1999 0471960861
  40. Yoo , S. and Harman , M. Regression Testing Minimization, Selection and Prioritization: A Survey Software Testing, Verification and Reliability 22 2 67 120 2012
  41. Arnold , R.S. and Bohner , S. Software Change Impact Analysis Los Alamitos, CA IEEE Computer Society Press 1996 978-0-8186-7384-9
  42. Li , B. , Sun , X. , Leung , H. , and Zhang , S. A Survey of Code-Based Change Impact Analysis Techniques Software Testing, Verification and Reliability 23 8 613 646 2013
  43. Lucia , A.D. , Fasano , F. , and Oliveto , R. Traceability Management for Impact Analysis 2008 Frontiers of Software Maintenance Beijing, China 2008 21 30
  44. Berk , M. , Schubert , O. , Kroll , H.-M. , Buschardt , B. et al. Reliability Assessment of Safety-Critical Sensor Information: Does One Need a Reference Truth? IEEE Transactions on Reliability 68 4 1227 1241 2019
  45. Berk , M. , Schubert , O. , Kroll , H.-M. , Buschardt , B. et al. Exploiting Redundancy for Reliability Analysis of Sensor Perception in Automated Driving Vehicles IEEE Transactions on Intelligent Transportation Systems 2019
  46. Darms , M. Data Fusion of Environment-Perception Sensors for ADAS Winner , H. , Hakuli , S. , Lotz , F. , and Singer , C. Handbook of Driver Assistance Systems Cham Springer International Publishing 2016 549 566 978-3-319-12351-6
  47. Hoermann , S. , Henzler , P. , Bach , M. , and Dietmayer , K. Object Detection on Dynamic Occupancy Grid Maps Using Deep Learning and Automatic Label Generation 2018 IEEE Intelligent Vehicles Symposium (IV), 2018 IEEE Intelligent Vehicles Symposium (IV) Changshu June 26-30, 2018 826 833 978-1-5386-4452-2
  48. Rasshofer , R.H. , Spies , M. , and Spies , H. Influences of Weather Phenomena on Automotive Laser Radar Systems Adv. Radio Sci. 9 49 60 2011 https://doi.org/10.5194/ars-9-49-2011
  49. Ishimaru , A. Wave Propagation and Scattering in Random Media and Rough Surfaces Proc. IEEE 79 10 1359 1366 1991 https://doi.org/10.1109/5.104210
  50. Blevis , B. Losses due to Rain on Radomes and Antenna Reflecting Surfaces IEEE Trans. Antennas Propagat. 13 1 175 176 1965 https://doi.org/10.1109/TAP.1965.1138384
  51. Rivero , J.R.V. , Tahiraj , I. , Schubert , O. , Glassl , C. et al. Characterization and Simulation of the Effect of Road Dirt on the Performance of a Laser Scanner 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC) Yokohama, Japan 2017 1 6
  52. Berk , M. , Kroll , H.-M. , Schubert , O. , Buschardt , B. et al. Zuverlässigkeitsanalyse umfelderfassender Sensorik: Eine stochastische Methodik zur Berücksichtigung von Umgebungseinflüssen am Beispiel von LiDAR Sensoren VDI Wissensforum GmbH Fahrerassistenz und automatisiertes Fahren: 32. VDI-VW-Gemeinschaftstagung, VDI-Berichte Wolfsburg Nov. 8-9, 2016 455 475 978-3-18-092288-1
  53. Dietmayer , K. Predicting of Machine Perception for Automated Driving Maurer , M. , Gerdes , J.C. , Lenz , B. , and Winner , H. Autonomous Driving Berlin/Heidelberg Springer Berlin Heidelberg 2016 407 424 978-3-662-48845-4
  54. Mählisch , M. 2009 978-3-941543-03-4
  55. Peterson , W. , Birdsall , T. , and Fox , W. The Theory of Signal Detectability Transactions of the IRE Professional Group on Information Theory 4 4 171 212 1954
  56. Swets , J.A. Signal Detection Theory and ROC Analysis in Psychology and Diagnostics: Collected Papers New York Psychology Press 2014
  57. Fawcett , T. An Introduction to ROC Analysis Pattern Recognition Letters 27 8 861 874 2006 https://doi.org/10.1016/j.patrec.2005.10.010
  58. Petrovskaya , A. and Thrun , S. Model Based Vehicle Detection and Tracking for Autonomous Urban Driving Autonomous Robots 26 2-3 123 139 2009
  59. Dietmayer , K.C.J. , Reuter , S. , and Nuss , D. Representation of Fused Environment Data Winner , H. , Hakuli , S. , Lotz , F. , and Singer , C. Handbook of Driver Assistance Systems Cham Springer International Publishing 2016 567 603 978-3-319-12351-6
  60. Bock , F. , Siegl , S. , and German , R. Mathematical Test Effort Estimation for Dependability Assessment of Sensor-Based Driver Assistance Systems 2016 42st Euromicro Conference on Software Engineering and Advanced Applications (SEAA) Limassol, Cyprus 2016
  61. Musicki , D. and Evans , R. Joint Integrated Probabilistic Data Association: JIPDA IEEE Transactions on Aerospace and Electronic Systems 40 3 1093 1099 2004
  62. Bar-Shalom , Y. , Daum , F. , and Huang , J. The Probabilistic Data Association Filter IEEE Control Systems Magazine 29 6 82 100 2009
  63. Straub , D. 2017
  64. Leveson , N. Engineering a Safer World: Systems Thinking Applied to Safety Cambridge, MA MIT Press 2011
  65. IEC 1990
  66. Wachenfeld , W. and Winner , H. Virtual Assessment of Automation in Field Operation: A New Runtime Validation Method Uni-DAS e. V 10. Workshop Fahrerassistenzsysteme Walting Sept. 28-30, 2015 161 169
  67. Koenig , A. , Gutbrod , M. , Hohmann , S. , and Ludwig , J. Bridging the Gap between Open Loop Tests and Statistical Validation for Highly Automated Driving SAE Int. J. Trans. Safety 5 81 87 2017 https://doi.org/10.4271/2017-01-1403
  68. Hoye , B. , Lambert , D. , and Sutton , G. 2013
  69. Netter , F. Künstliche Intelligenz im Auto - Applikationen, Technologien und Herausforderungen ATZelektronik 1 20 24 2017
  70. Wang , S. , Heinrich , S. , Wang , M. , and Rojas , R. Shader-Based Sensor Simulation for Autonomous Car Testing 2012 15th International IEEE Conference on Intelligent Transportation Systems Anchorage, AK 224 229 2012
  71. Weiskopf , M. , Wohlfahrt , C. , and Schmidt , A. Integrationslösung zur Absicherung eines realen Radarsensors im Systemverbund mit der Hardware-in-the-Loop Testtechnologie Automotive-Safety & Security 2014 2015 2015
  72. Pharr , M. , Jakob , W. , and Humphreys , G. Physically Based Rendering: From Theory to Implementation Cambridge, MA Morgan Kaufmann 2016
  73. Hirsenkorn , N. , Kolsi , H. , Selmi , M. , Schaermann , A. et al. Learning Sensor Models for Virtual Test and Development Uni-DAS e. V 11. Workshop Fahrerassistenzsysteme und automatisiertes Fahren Walting Mar. 29-31, 2017 115 124 978-3-00-055656-2
  74. Hanke , T. , Hirsenkorn , N. , Dehlink , B. , Rauch , A. et al. Generic Architecture for Simulation of ADAS Sensors 2015 16th International Radar Symposium (IRS) Dresden, Germany June 24-26, 2015 125 130 978-3-9540-4853-3
  75. O’Brien , M.E. and Fouche , D.G. Simulation of 3D Laser Radar Systems Lincoln Laboratory Journal 15 1 37 60 2005
  76. Berk , M. , Dura , M. , Vargas Rivero , J.R. , Schubert , O. et al. A Stochastic Physical Simulation Framework to Quantify the Effect of Rainfall on Automotive Lidar SAE Technical Paper 2019-01-0134 2019 https://doi.org/10.4271/2019-01-0134

Cited By