Title

Metamorphic testing for software quality assessment: a study of search engines

RIS ID

106843

Publication Details

Zhou, Z., Xiang, S. & Chen, T. (2016). Metamorphic testing for software quality assessment: a study of search engines. IEEE Transactions on Software Engineering, 42 (3), 260-280.

Abstract

Metamorphic testing is a testing technique that can be used to verify the functional correctness of software in the absence of an ideal oracle. This paper extends metamorphic testing into a user-oriented approach to software verification, validation, and quality assessment, and conducts large scale empirical studies with four major web search engines: Google, Bing, Chinese Bing, and Baidu. These search engines are very difficult to test and assess using conventional approaches owing to the lack of an objective and generally recognized oracle. The results are useful for both search engine developers and users, and demonstrate that our approach can effectively alleviate the oracle problem and challenges surrounding a lack of specifications when verifying, validating, and evaluating large and complex software systems.

Grant Number

ARC/LP100200208

Please refer to publisher version or contact your library.

Share

COinS