This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Advanced System Testing Incorporating Math-based, Attack-based, and Model-based Techniques Supported by the New Test Standards of the World
Technical Paper
2014-01-2148
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
System testing can, in part, be defined as the application of concepts as an attempt to demonstrate that the implementation does not meet its intended use. Unfortunately, some industry verification test efforts only show that a system meets requirements which while necessary, are not sufficient to fully address a product's system-software testing. Managers, engineers, and testers may not be familiar with the wide variety of test concepts, approaches, and standards available for system-software testing-many of which can save projects money and effort in the long run. Newer software test standards and advanced techniques can offer a wealth of knowledge and improvement opportunities for software products. This paper offers a review of emerging software test concepts and standards in which teams will find potential value toward their improvement efforts including:
- Math-based techniques which apply combinatorial, statistical, Design of Experiments (DOE), or domain-based concepts
- Attack-based testing which focuses on common industry error taxonomies
- Independent model-based testing using tools and standards
- New standards-driven testing to address verification and validation (V&V), testing, and documentation.
This paper reviews these recent developments in system-software testing concepts with sufficient references to allow readers to find the details of these extensive subjects when actually undertaking improvement efforts.
Authors
Citation
Hagar, J., "Advanced System Testing Incorporating Math-based, Attack-based, and Model-based Techniques Supported by the New Test Standards of the World," SAE Technical Paper 2014-01-2148, 2014, https://doi.org/10.4271/2014-01-2148.Also In
References
- IEEE 1012 Standard for System and Software Verification and Validation http://standards.ieee.org/findstds/standard/1012-2012.html IEEE press 2012
- ISO 29119 Software Test Standard http://www.softwaretestingstandard.org/
- Hagar , J. Software Test Attacks to Break Mobile and Embedded Devices CRC press 2013
- Kuhn , Kacker, Lei Introduction to Combinatorial Testing CRC press 2013
- Tool: Hexawise app.hexawise.com
- Tool: rdExpert www.phadkeassociates.com/
- Tool: PICT msdn.microsoft.com/en-us/library/cc150619.aspx
- Reagan , Kiemele Tool: DOE Pro XL - Design for Six Sigma Air Academy Associates 2000
- DOE++ www.reliasoft.com/
- SAS www.sas.com/
- Kaner , Hoffman, Padmanabhan The Domain Testing Workbook 2013
- Bailey Design of Comparative Experiments Cambridge University Press 2008
- Kacker , Kuhn , Hagar , Wissink Introducing Combinatorial Testing to a Large System-Software Organization scheduled-2014, IEEE Software
- Whittaker , James 2003 How to Break Software Pearson Addison Wesley
- Whittaker , James and Thompson , Herbert How to Break Software Security Pearson Addison Wesley 2004
- Andrews , Whittaker How to Break Web Software Pearson Addison Wesley 2006
- Levy Tools of Critical Thinking: Metathoughts for Psychology 1996
- Bach , Bolton Testing vs. Checking www.developsense.com/blog/2009/08/testing-vs-checking/
- Hagar Why didn't testing find the embedded GM Truck fire system error? www.breakingembeddedsoftware.wordpress.com/
- OMG UTP 1.2 www.omg.org/spec/UTP/1.2/
- Baker , Dai , Grabowski , Schieferdecker, Williams Model-Driven Testing:Using the UML Testing Profile 2008
- Green , Hagar Testing Critical Software: Practical Experiences IFAC Conference 1995
- Boden , Hagar How to Build a 20-Year Successful Independent Verification and Validation (IV&V) Program for the Next Millennium Quality Week Conference 1999
- Port , Nakao , Katahira , Motes Challenges of COTS IV & V Springer press 2005