Try Mobilus Beta
Search tips
 This content is not included in your SAE MOBILUS subscription, or you are not logged in.

A Combined Markov Chain and Reinforcement Learning Approach for Powertrain-Specific Driving Cycle Generation

Journal Article
2020-01-2185
ISSN: 2641-9645, e-ISSN: 2641-9645
DOI: https://doi.org/10.4271/2020-01-2185
Published September 15, 2020 by SAE International in United States
A Combined Markov Chain and Reinforcement Learning Approach for Powertrain-Specific Driving Cycle Generation
Sector:
Citation: Dietrich, M., Chen, X., and Sarkar, M., "A Combined Markov Chain and Reinforcement Learning Approach for Powertrain-Specific Driving Cycle Generation," SAE Int. J. Adv. & Curr. Prac. in Mobility 3(1):516-527, 2021, https://doi.org/10.4271/2020-01-2185.
Language: English

References

  1. Nyberg , P. , Frisk , E. , and Nielsen , L. Using Real-World Driving Databases to Generate Driving Cycles With Equivalence Properties IEEE Transactions on Vehicular Technology 65 6 4095 4105 2015 10.1109/TVT.2015.2502069
  2. Nyberg , P. , Frisk , E. , and Nielsen , L. Driving Cycle Equivalence and Transformation IEEE Transactions on Vehicular Technology 66 3 1963 1974 2017 10.1109/TVT.2016.2582079
  3. Attibele , P. , Makam , S. , and Lee , Y. 2013
  4. Gmbh , Mahle Motorische Erprobung Kolben und Motorische Erprobung Wiesbaden Springer Fachmedien 2015 10.1007/978-3-658-09558-1
  5. Pisu , P. , and Rizzoni , G. A Comparative Study Of Supervisory Control Strategies for Hybrid Electric Vehicles IEEE Transactions on Control Systems Technology 15 3 506 518 2007 10.1109/tcst.2007.894649
  6. Schwarzer , V. , Ghorbani , R. , and Rocheleau , R. Drive Cycle Generation for Stochastic Optimization of Energy Management Controller for Hybrid Vehicles presented at 2010 IEEE International Conference on Control Applications Japan September 8-10, 2010 10.1109/cca.2010.5611150
  7. Onoda , S. , and Emadi , A. PSIM-Based Modeling of Automotive Power Systems: Conventional, Electric, and Hybrid Electric Vehicles IEEE Transactions on Vehicular Technology 53 2 390 400 2004 10.1109/tvt.2004.823500
  8. Wolfson , R.P. , and Gower , J.H. The Role of Computer Modeling and Simulation in Electric and Hybrid Vehicle Research and Development IEEE Transactions on Vehicular Technology 32 1 62 73 1983 10.1109/t-vt.1983.23945
  9. André , M. , Joumard , R. , Vidon , R. , Tassel , P. , and Perret , P. Real-World European Driving Cycles, for Measuring Pollutant Emissions from High- and Low-Powered Cars Atmospheric Environment 40 31 5944 5953 2006 10.1016/j.atmosenv.2005.12.057
  10. Fontaras , G. , Franco , V. , Dilara , P. , Martini , G. , and Manfredi , U. Development and Review of Euro 5 Passenger Car Emission Factors Based on Experimental Results Over Various Driving Cycles Science of The Total Environment 468-469 1034 1042 2014 10.1016/j.scitotenv.2013.09.043
  11. Pelkmans , L. , and Debal , P. Comparison of On-Road Emissions with Emissions Measured on Chassis Dynamometer Test Cycles Transportation Research Part D: Transport and Environment 11 4 233 241 2006 10.1016/j.trd.2006.04.001
  12. European Council Directive Council Directive 91/441/EEC of 26 June 1991 Amending Directive 70/220/EEC on the Approximation of the Laws of the Member States Relating to Measures to be taken against Air Pollution by Emissions from Motor Vehicles Official Journal L 242 1991
  13. European Commission Regulation COMMISSION REGULATION (EU) 2017/1151 of 1 June 2017 supplementing Regulation (EC) No 715/2007 of the European Parliament and of the Council on type-approval of motor vehicles with respect to emissions from light passenger and commercial vehicles (Euro 5 and Euro 6) and on access to vehicle repair and maintenance information, amending Directive 2007/46/EC of the European Parliament and of the Council, Commission Regulation (EC) No 692/2008 and Commission Regulation (EU) No 1230/2012 and repealing Commission Regulation (EC) No 692/2008 Official Journal L 175 2017
  14. European Commission Regulation COMMISSION REGULATION (EU) 2016/427 of 10 March 2016 amending Regulation (EC) No 692/2008 as regards emissions from light passenger and commercial vehicles (Euro 6) Official Journal L 82 2016
  15. European Commission Regulation COMMISSION REGULATION (EU) 2016/646 of 20 April 2016 amending Regulation (EC) No 692/2008 as regards emissions from light passenger and commercial vehicles (Euro 6) Official Journal L 109 2016
  16. European Commission Regulation COMMISSION REGULATION (EU) 2017/1151 of 1 June 2017 supplementing Regulation (EC) No 715/2007 of the European Parliament and of the Council on type-approval of motor vehicles with respect to emissions from light passenger and commercial vehicles (Euro 5 and Euro 6) and on access to vehicle repair and maintenance information, amending Directive 2007/46/EC of the European Parliament and of the Council, Commission Regulation (EC) No 692/2008 and Commission Regulation (EU) No 1230/2012 and repealing Commission Regulation (EC) No 692/2008 Official Journal L 175 2017
  17. European Commission Regulation COMMISSION REGULATION (EU) 2018/1832 of 5 November 2018 amending Directive 2007/46/EC of the European Parliament and of the Council, Commission Regulation (EC) No 692/2008 and Commission Regulation (EU) 2017/1151 for the purpose of improving the emission type approval tests and procedures for light passenger and commercial vehicles, including those for in-service conformity and real-driving emissions and introducing devices for monitoring the consumption of fuel and electric energy Official Journal L 301 2018
  18. Schwarzer , V. , and Ghorbani , R. Drive Cycle Generation for Design Optimization of Electric Vehicles IEEE Transactions on Vehicular Technology 62 1 89 97 2013 10.1109/tvt.2012.2219889
  19. Bielaczyc , P. , Woodburn , J. , and Szczotka , A. A Comparison of Carbon Dioxide Exhaust Emissions and Fuel Consumption for Vehicles Tested over the NEDC, FTP-75 and WLTC Chassis Dynamometer Test Cycles SAE Technical Paper 2015-01-1065 2015 https://doi.org/10.4271/2015-01-1065
  20. Maschmeyer , H. , and Beidl , C. Real Driving Emissions Methodology Library for Engine Testbeds presented at 7th International Symposium on Development Methodology Germany November 14-15, 2017
  21. Silvas , E. , Hereijgers , K. , Peng , H. , Hofman , T. , and Steinbusch , M. Synthesis of Realistic Driving Cycles With High Accuracy and Computational Speed, Including Slope Information IEEE Transactions on Vehicular Technology 65 6 4118 4128 2016 10.1109/TVT.2016.2546338
  22. Huertas , J.I. , Díaz , J. , Cordero , D. , and Cedillo , K. A New Methodology to Determine Typical Driving Cycles for the Design of Vehicles Power Trains International Journal on Interactive Design and Manufacturing 12 319 326 2018 10.1007/s12008-017-0379-y
  23. Esser , A. , Zeller , M. , Foulard , S. , and Rinderknecht , S. Stochastic Synthesis of Representative and Multidimensional Driving Cycles SAE Technical Paper 2018-01-0095 2018 https://doi.org/10.4271/2018-01-0095
  24. Kent , J.H. , Allen , G.H. , and Rule , G. A Driving Cycle for Sydney Transportation Research 12 3 147 152 1978 10.1016/0041-1647(78)90117-x
  25. Ashtari , A. , Bibeau , E. , and Shahidinejad , S. Using Large Driving Record Samples and a Stochastic Approach for Real-World Driving Cycle Construction: Winnipeg Driving Cycle Transportation Science 48 2 170 183 2014 10.1287/trsc.1120.0447
  26. Watkins , C.J.C.H. , and Dayan , P. Q-Learning Machine Learning 8 279 292 1992 10.1007/BF00992698
  27. Serfozo , R. Markov Chains Basics of Applied Stochastic Processes Berlin, Heidelberg, Springer 2009 10.1007/978-3-540-89332-5
  28. Kaelbling , L.P. , Littman , M.L. , and Moore , A.W. Reinforcement Learning: A Survey Journal of Artificial Intelligence Research 4 237 285 1996
  29. Sutton , R.S. , and Barto , A.G. Finite Markov Decision Processes Reinforcement Learning Cambridge, London The MIT Press 2018
  30. Sutton , R.S. , and Barto , A.G. Introduction Reinforcement Learning Cambridge, London The MIT Press 2018
  31. Bellman , R. Dynamic Programming Princeton University Press Princeton 1957
  32. Sutton , R.S. , and Barto , A.G. On-Policy Prediction with Approximation Reinforcement Learning Cambridge, London The MIT Press 2018
  33. Sutton , R.S. , and Barto , A.G. Monte Carlo Methods Reinforcement Learning Cambridge, London The MIT Press 2018
  34. Sutton , R.S. , and Barto , A.G. Gradient Bandit Algorithms Reinforcement Learning Cambridge, London The MIT Press 2018
  35. Sutton , R.S. , and Barto , A.G. Thermal Soaring Reinforcement Learning Cambridge, London The MIT Press 2018
  36. Mayer , W. , Wiedemann , J. , and Neubeck , J. Road Load Determination in Real Road Tests ATZ worldwide 5 18 21 2002
  37. MATLAB (Version 8.6.0.267246 (R2015b)) Natick, MA The MathWorks Inc. 2015
  38. Simulink (Version 8.6.0.267246 (R2015b)) Natick, MA The MathWorks Inc. 2015
  39. Sutton , R.S. , and Barto , A.G. Multi-armed Bandits Reinforcement Learning Cambridge, London The MIT Press 2018

Cited By

Recommended Content

Technical Paper Industry 4.0 and Automotive 4.0: Challenges and Opportunities for Designing New Vehicle Components for Automated and/or Electric Vehicles
Technical Paper FD&E Total Life T-Sample Residual Stress Analytical Predictions and Measured Results
Technical Paper Crack Initiation and Propagation Fatigue Life Prediction for an A36 Steel Welded Plate Specimen