This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Efficient Testing of Multivariable Systems
Technical Paper
2017-01-1676
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Language:
English
Abstract
Software systems, and automotive software in particular, are becoming increasingly configurable to fulfill customer needs. New methods such as product line engineering facilitate the development and enhance the efficiency of such systems. In modern, versatile systems, the number of theoretically possible variants easily exceeds the number of actually built products. This produces two challenges for quality assurance and especially testing. First, the costs of conventional test methods increase substantially with every tested variant. And secondly, it is no longer feasible to build every possible variant for the purpose of testing. Hence, efficient criteria for selecting variants for testing are necessary.
In this contribution, we propose a new test design method that enables systematic sampling of variants from test cases. We present six optimization criteria to enable control of test effort and test quality by sampling variants with different characteristics. This approach is inherently different to conventional design methods, where firstly variants are selected for testing and then test cases are designed for each variant. Finally, we demonstrate and discuss the feasibility of our approach and compare the results to established test methods for multivariable systems.
Recommended Content
Citation
Lackner, H., "Efficient Testing of Multivariable Systems," SAE Technical Paper 2017-01-1676, 2017, https://doi.org/10.4271/2017-01-1676.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 | ||
Unnamed Dataset 3 | ||
Unnamed Dataset 4 |
Also In
References
- Pohl , K. , Böckle , G. , and Linden , Frank J. van der Software Product Line Engineering: Foundations, Principles and Techniques Springer-Verlag New York, Inc Secaucus, NJ, USA 3540243720 2005
- Perrouin , G. , Sen , S. , Klein , J. , Baudry , B. Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines ICST ’10: International Conference on Software Testing, Verification and Validation: Proceedings of the Third IEEE International Conference on Software Testing, Verification, and Validation Paris, France 7–9 April 2010 IEEE Computer Society; IEEE Los Alamitos, Calif, Piscataway, N.J 978-1-4244-6435-7 459 468 2010
- Perrouin , G. , Oster , S. , Sen , S. , Klein , J. Pairwise testing for software product lines: comparison of two approaches Software Qual J 20 3–4 605 643 2012 10.1007/s11219-011-9160-9
- Lackner , H. and Schmidt , M. Potential Errors and Test Assessment in Software Product Line Engineering Pakulin , N.V. , Petrenko , A.K. , and Schlingloff , B.-H. Proceedings Tenth Workshop on Model Based Testing, MBT 2015, London, UK, 18th April 2015 , EPTCS 180 57 72 2015
- Kang , K.C. , Cohen , S.G. , Hess , J.A. , Novak , W.E. Feature-Oriented Domain Analysis (FODA) Feasibility Study CMU/SEI-90-TR-021 1990
- Batory , D. Feature models, grammars, and propositional formulas Proceedings of the 9th international conference on Software Product Lines , SPLC’05 Springer-Verlag Berlin, Heidelberg 3-540-28936-4 7 20 2005
- Czarnecki , K. and Antkiewicz , M. Mapping Features to Models: A Template Approach Based on Superimposed Variants Glück , R. Generative programming and component engineering: 4th international conference, GPCE 2005 Tallinn, Estonia September 29 - October 1, 2005 Lecture Notes in Computer Science, vol. 3676 Springer Berlin [u.a.] 3-540-29138-5 422 437 2005
- Weißleder , S. Simulated Satisfaction of Coverage Criteria on UML State Machines ICST ’10: International Conference on Software Testing, Verification and Validation: Proceedings of the Third IEEE International Conference on Software Testing, Verification, and Validation Paris, France 7–9 April 2010 IEEE Computer Society IEEE Los Alamitos, Calif, Piscataway, N.J 978-1-4244-6435-7 117 126 2010
- Chilenski , J.J. and Miller , S.P. Applicability of modified condition/decision coverage to software testing Softw. Eng. J. UK 9 5 193 1994 10.1049/sej.1994.0025
- Henard , C. , Papadakis , M. , Perrouin , G. , Klein , J. Assessing Software Product Line Testing Via Model-Based Mutation: An Application to Similarity Testing ICSTW '13: IEEE 6th International Conference On Software Testing, Verification and Validation Workshops 2013 Luxembourg, Luxembourg 978-1-4799-1324-4 188 197 2013
- Cichos , H. , Oster , S. , Lochau , M. , and Schürr , A. Model-Based Coverage-Driven Test Suite Generation for Software Product Lines Hutchison , D. , Kanade , T. , Kittler , J. , Kleinberg , J.M. Model Driven Engineering Languages and Systems Lecture Notes in Computer Science Springer Berlin Heidelberg, Berlin, Heidelberg 978-3-642-24484-1 425 439 2011
- Kuchcinski , K. and Szymanek , R. JaCoP - Java Constraint Programming Solver 2013
- Oster , S. , Zorcic , I. , Markert , F. , and Lochau , M. MoSo-PoLiTe: tool support for pairwise and model-based software product line testing VaMoS ’11 79 82 2011
- Lochau , M. , Schaefer , I. , Kamischke , J. , and Lity , S. Incremental Model-Based Testing of Delta-Oriented Software Product Lines Hutchison , D. , Kanade , T. , Kittler , J. , Kleinberg , J.M. Tests and Proofs Lecture Notes in Computer Science Springer Berlin Heidelberg, Berlin, Heidelberg 978-3-642-30472-9 67 82 2012
- Beohar , H. and Mousavi , M.R. Spinal Test Suites for Software Product Lines France, 6 April 2014 Schlingloff , H. and Petrenko , A.K. Proceedings Ninth Workshop on Model-Based Testing, MBT 2014 Grenoble, France 6 April 2014 141 44 55 2014