Metamorphic Testing: A Review of Challenges and Opportunities

Authors

Tsong Yueh Chen, Swinburne University of TechnologyFollow
Fei-Ching Kuo, Swinburne University of TechnologyFollow
Huai Liu, Victoria UniversityFollow
Pak-Lok PoonFollow
Dave Towey, United International College, University of Nottingham China Campus
T. H. Tse, University of Hong KongFollow
Zhi Quan Zhou, University of WollongongFollow

RIS ID

118535

Publication Details

Chen, T., Kuo, F., Liu, H., Poon, P., Towey, D., Tse, T. H. & Zhou, Z. Q. (2018). Metamorphic Testing: A Review of Challenges and Opportunities. ACM Computing Surveys, 51 (1), 4:1-4:27.

Abstract

Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and their expected outputs. Since its first publication, we have witnessed a rapidly increasing body of work examining metamorphic testing from various perspectives, including metamorphic relation identification, test case generation, integration with other software engineering techniques, and the validation and evaluation of software systems. In this article, we review the current research of metamorphic testing and discuss the challenges yet to be addressed. We also present visions for further improvement of metamorphic testing and highlight opportunities for new research.