This functional testing example illustrates how 262,144 unique hardware-software integration tests could be reduced to 32 with a 96% coverage of two factor compatibilities.
Consider a couple example situations to describe application benefits of the Multidimensional Testing (MDT) testing methodology.
Functional Testing Example: Multidimensional Testing Illustration 1
First, a cell phone manufacturer is to introduce a new version of its phone operating system. Before it is initially released, the company would like confidence that the new software will work in various hardware and software configurations across all customers and mobile phone operators. The following 14 factors were to be considered in this evaluation:
- 4 languages
- GPS (yes, no)
- 4 network protocols (2g, 3g, HPSA+, LTE)
- 4 cell communication frequencies
- Two communication types (GSM CDMA)
- WIFI (two types)
- Function A (yes, no)
- Function B (yes, no)
- Function C (yes, no)
- Function D (yes, no)
- Function F (yes, no)
- Function G (yes, no)
- Function H (yes, no)
- Function I (yes, no)
An all-combinations test for this set of conductions would require 262,144 unique hardware-software integration tests. Using MDT, the prior list of factors could be tested with 32 unique tests and cover 96% of the two factor compatibilities and 85 % of the three factor compatibilities. MDT provides over 99.98% testing reduction, while providing very good coverage to the types of problems frequently encountered; e.g., the product fails when I do X with Y and Z – group size of 3 factors has 85% coverage of all possible combinations.
Now look at MTD Example 2, Evaluating a new pc for compatibility with current hardware and networks
An Enhanced Business Management System
MDT is one methodology that is available in the Integrated Enterprise Excellence (IEE) enhanced business management system. IEE addresses the business scorecard and process improvement issues described in a 1- minute video:
Contact Us to set up a time to discuss with Forrest Breyfogle how your organization might gain much from an Integrated Enterprise Excellence (IEE) Business Process Management System and its Multidimensional Testing approach, as illustrated in this Functional Testing Example.