An assessment of extended finite state machine test selection criteria

• The first comprehensive assessment of many extended finite state machine (EFSM) based test suites using typical types of EFSM faults.• Considered types of faults include single transfer, double transfer, single output parameter, and single assignment faults.• Eleven types of EFSM based test suites are considered in the assessment.• Ranking of the test suites is carried out with respect to their fault coverage and length.• Obtained results are summarized and dispersion of test suites coverage is provided.

Extended finite state machines (EFSMs) provide a rigorous model for the derivation of functional tests for software systems and protocols. Various types of data-flow, control-flow, graph-based, and state machine based test selection criteria can be used for deriving tests from a given EFSM specification. Also, traditional types of state machine based notions of faults, such as transfer and output parameter faults, and common types of assignment faults can be used to describe the fault domains of EFSMs. We present an assessment of the most known types of EFSM test selection criteria such as test suites that cover single transfer faults, double transfer faults, single output parameter faults, and many types of single assignment faults of a given EFSM specification. Also, test suites that cover edge-pair, prime path, prime path with side trip, and all-uses criterion are derived from the graph and flow-graph representations of the specification. We also consider transition tour and random test suites. The assessment ranks the considered test suites in terms of their length and their coverage of single transfer, double transfer, and different type of single assignment faults. Dispersion of the obtained results is assessed and results are summarized.