This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
A Framework for Benchmarking Feedback-Based Dynamic Data Collection Methods in Connected Vehicle Networks
Technical Paper
2021-01-0184
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Event:
SAE WCX Digital Summit
Language:
English
Abstract
Supervised, unsupervised and active learning techniques can be used to develop prognostics and diagnostics in connected vehicle networks, where a wide variety of sensors are available for data collection. However, constraints placed by the on-board equipment, vehicle network, time, and human resources limit the amount of sensor data and labels for machine learning. When no prior information about the data distribution or domain knowledge is available, it becomes a challenging task to collect limited and relevant data to train a machine learning model matching the desired performance threshold. To tackle this challenge, techniques such as experimental design, feature selection, and active learning can be applied, and the data collection process can be advanced to a closed-loop system where new data collection decisions are made based on the feedback from collected data. In this paper, an iterative design and evaluation procedure is considered to develop and deploy these feedback-based decision-making algorithms. So far, no simulation-based benchmarking frameworks are available for evaluating and testing the performance of these methods in a connected vehicle network setting that can impose the real-world conditions. In this work, we propose a simulation platform that makes use of static datasets to simulate dynamic data collection process and provide comprehensive evaluations of feedback-based dynamic data collection decision-making algorithms. The platform provide means for stepwise input of desired dynamic data collection decisions and delayed return of corresponding data to mimic the real-world data collection procedure. Compliant experimental design, feature selection, and active learning strategies can be used within the framework to determine the data to be collected at each step. We also provide an implementation example of a wrapper-based feature selection algorithm using greedy search and exploration components along with a random feature selector for comparative analysis.
Topic
Citation
Sahin, A. and Zeng, X., "A Framework for Benchmarking Feedback-Based Dynamic Data Collection Methods in Connected Vehicle Networks," SAE Technical Paper 2021-01-0184, 2021, https://doi.org/10.4271/2021-01-0184.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 | ||
Unnamed Dataset 3 | ||
Unnamed Dataset 4 | ||
Unnamed Dataset 5 |
Also In
References
- Shafi , U. , Safi , A. , Shahid , A.R. , Ziauddin , S. et al. Vehicle Remote Health Monitoring and Prognostic Maintenance System Journal of Advanced Transportation 10 2018 https://doi.org/10.1155/2018/8061514
- Theissler , A. 2014
- Prytz , R. 2014
- Prytz , R. , Sławomir , N. , Thorsteinn , R. , and Stefan , B. Predicting the Need for Vehicle Compressor Repairs Using Maintenance Records and Logged Vehicle Data Engineering Applications of Artificial Intelligence 41 May 139 150 2015 https://doi.org/10.1016/j.engappai.2015.02.009
- Svensson , O. , Thelin , S. , Byttner , S. , and Fan , Y. Indirect Tire Monitoring System - Machine Learning Approach IOP Conference Series: Materials Science and Engineering 252 1 1 8 2017 https://doi.org/10.1088/1757-899X/252/1/012018
- Nuhic , A. , Tarik , T. , Thomas , S. , Michael , B. et al. Health Diagnosis and Remaining Useful Life Prognostics of Lithium-Ion Batteries Using Data-Driven Methods Journal of Power Sources 239 Oct. 680 688 2013 https://doi.org/10.1016/j.jpowsour.2012.11.146
- Panahandeh , G. , Erik , E. , and Nasser , M. Road Friction Estimation for Connected Vehicles Using Supervised Machine Learning IEEE Intelligent Vehicles Symposium, Proceedings 1262 1267 2017 https://doi.org/10.1109/IVS.2017.7995885
- Ye , H. , Le , L. , Geoffrey , Y.L. , Joonbeom , K. et al. Machine Learning for Vehicular Networks: Recent Advances and Application Examples IEEE Vehicular Technology Magazine 13 2 94 101 2018 https://doi.org/10.1109/MVT.2018.2811185
- Chandrashekar , G. , and Sahin , F. A Survey on Feature Selection Methods Comput. Electr. Eng. 40 1 16 28 2014
- Cai , J. , Luo , J. , Wang , S. , and Yang , S. Feature Selection in Machine Learning: A New Perspective Neurocomputing 300 70 79 2018
- Li , J. , Cheng , K. , Wang , S. , Morstatter , F. et al. Feature Selection: A Data Perspective ACM Comput. Surv. 50 2017
- Li , Y. , Li , T. , and Liu , H. Recent Advances in Feature Selection and Its Applications Knowl. Inf. Syst. 53 3 551 577 2017
- Hoi , S.C.H. Wang , J. , Zhao , P. , and Jin , R. Online Feature Selection for Mining Big Data Proc. First Int’l Workshop Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications (BigMine ’12) 93 100 2012
- Wang , J. , Zhao , P. , Hoi , S.C.H. , and Jin , R. Online Feature Selection and Its Applications IEEE Trans. Knowl. Data Eng. 26 3 698 710 Mar. 2014
- Perkins , S. , and Theiler , J. Online Feature Selection Using Grafting ICML 2003
- Yu , K. , Wu , X. , Ding , W. , and Pei , J. Towards Scalable and Accurate Online Feature Selection for Big Data Proceedings - IEEE International Conference on Data Mining, ICDM, 2014 2015 660 669
- Zhou , P. , Hu , X. , Li , P. , and Wu , X. Online Feature Selection for High Dimensional Class-imbalanced Data Knowledge-Based Syst. 136 187 199 2017
- Settles , B. 2009
- Zhang , L. , Member , S. , Chen , C. , Bu , J. et al. A Unified Feature and Instance Selection Framework Using Optimum Experimental Design IEEE Trans. Image Process. 21 5 2012
- Li , C. , Wang , X. , Dong , W. , Yan , J. et al. Joint Active Learning with Feature Selection via CUR Matrix Decomposition IEEE Trans. Pattern Anal. Mach. Intell. 41 6 1382 1396 2019
- Venanzi , M. , Parson , O. , Rogers , A. , and Jennings , N. The ACTIVECROWDTOOLKIT: An Open-Source Tool for Benchmarking Active Learning Algorithms for Crowdsourcing Research The Third AAAI Conference on Human Computation and Crowdsourcing (HCOMP-2015) United States 2015 10
- Urbanowicz , R.J. , Olson , R.S. , Schmitt , P. , Meeker , M. et al. Benchmarking Relief-Based Feature Selection Methods for Bioinformatics Data Mining Journal of Biomedical Informatics 85 Sept. 168 188 2018 https://doi.org/10.1016/j.jbi.2018.07.015
- Reis , M.S. , Estrela , G. , Ferreira , C.E. , and Barrera , J. Featsel: A Framework for Benchmarking of Feature Selection Algorithms and Cost Functions SoftwareX 6 Jan. 193 197 2017 https://doi.org/10.1016/j.softx.2017.07.005
- Barddal , J. , Gomes , H.M. , Britto , A.D.S. Enembreck , F. A Benchmark of Classifiers on Feature Drifting Data Streams Proceedings - International Conference on Pattern Recognition 2016 https://doi.org/10.1109/ICPR.2016.7899959
- Nushi , B. , Singla , A. , Krause , A. , and Kossmann , D. Learning and Feature Selection under Budget Constraints in Crowdsourcing HCOMP 2016
- Contardo , G. , Denoyer , L. , and Artieres , T. Sequential Cost-Sensitive Feature Acquisition International Symposium on Intelligent Data Analysis 284 294 Springer 2016
- Shim , H. , Hwang , S.J. , and Yang , E. 2017
- Kachuee , M. , Goldstein , O. , Karkkainen , K. , Darabi , S. et al. Opportunistic Learning: Budgeted Cost-Sensitive Learning from Data Streams 7th Int. Conf. Learn. Represent. ICLR 2019 1 12 2019
- Dua , D. and Graff , C. 2019 http://archive.ics.uci.edu/ml