Advanced System Testing Incorporating Math-based, Attack-based, and Model-based Techniques Supported by the New Test Standards of the World

System testing can, in part, be defined as the application of concepts as an attempt to demonstrate that the implementation does not meet its intended use. Unfortunately, some industry verification test efforts only show that a system meets requirements which while necessary, are not sufficient to fully address a product's system-software testing. Managers, engineers, and testers may not be familiar with the wide variety of test concepts, approaches, and standards available for system-software testing-many of which can save projects money and effort in the long run. Newer software test standards and advanced techniques can offer a wealth of knowledge and improvement opportunities for software products. This paper offers a review of emerging software test concepts and standards in which teams will find potential value toward their improvement efforts including:

• Math-based techniques which apply combinatorial, statistical, Design of Experiments (DOE), or domain-based concepts
• Attack-based testing which focuses on common industry error taxonomies
• Independent model-based testing using tools and standards
• New standards-driven testing to address verification and validation (V&V), testing, and documentation.

This paper reviews these recent developments in system-software testing concepts with sufficient references to allow readers to find the details of these extensive subjects when actually undertaking improvement efforts.