This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Calibre - A Novel Approach to Assessment of Software Test Effectiveness and Efficiency
Technical Paper
2021-01-0135
ISSN: 0148-7191, e-ISSN: 2688-3627
This content contains downloadable datasets
Annotation ability available
Sector:
Event:
SAE WCX Digital Summit
Language:
English
Abstract
In recent years, testing and validation have become crucial in the automotive ECU design process. Requirements of security and functional safety in addition to ever increasing connectivity have led to added complexity in the testing process. Testing is not only a mandatory base practice across the entire product development lifecycle, it also has a direct impact on product quality.
Several commercial frameworks (like GTest) are available to ease the process of testing. However, there are no mechanisms or tools available to evaluate the effectiveness of the test cases across the development lifecycle. Consider for example, a standard SDLC process model where a host of mandatory base practices for testing are defined at all levels. Although such a standard development model defines the process, it does not mandate any criteria or mechanisms to measure the effectiveness of the test cases and associated frameworks.
In addition, the assessment also serves as an indicator of quality by providing error propagation data across the product lifecycle.
In conclusion, the suggested approach is scalable and can be used at all levels of the development, thus progressively improving the efficiency and effectiveness of testing.
Topic
Citation
Abhyankar, R., "Calibre - A Novel Approach to Assessment of Software Test Effectiveness and Efficiency," SAE Technical Paper 2021-01-0135, 2021, https://doi.org/10.4271/2021-01-0135.Data Sets - Support Documents
Title | Description | Download |
---|---|---|
Unnamed Dataset 1 | ||
Unnamed Dataset 2 |
Also In
References
- https://www.softwaretestingclass.com/what-is-test-effectiveness-and-test-efficiency/
- https://saucelabs.com/blog/measuring-the-effectiveness-of-your-testing-strategy
- Grano , G. , Palomba , F. , and Gall , H.C. Lightweight Assessment of Test-Case Effectiveness Using Source-Code-Quality Indicators IEEE Transactions on Software Engineering 10.1109/TSE.2019.2903057
- Chernak , Y. Validating and Improving Test-Case Effectiveness IEEE Software 18 1 Jan/Feb 2001
- Wasif , A. https://www.researchgate.net/publication/228679262_Metrics_in_software_test_planning_and_test_design_processes
- https://www.theverge.com/2019/5/16/18627766/tesla-autopilot-fatal-crash-delray-florida-ntsb-model-3