Metamorphic Testing Harness for the Baidu Apollo Perception-Camera Module
Publication Name
Proceedings - 2023 IEEE/ACM 8th International Workshop on Metamorphic Testing, MET 2023
Abstract
As the complexity of autonomous driving systems (ADSs) increases, the question of how to organize testing in an efficient manner has become a serious issue. This study investigates the potential for metamorphic testing (MT) to evaluate the perception-camera module of an open-source autonomous driving system (ADS), namely Baidu's Apollo ADS. The experiments revealed inconsistent obstacle identification results when increasing the brightness of a specific region of the driving scenarios, both in individual and sequential frames, demonstrating the ability of MT to address the oracle problem when testing the perception module of ADSs. Furthermore, this paper presents an MT harness to facilitate ADS testing, which would increase efficiency and help testers to better organize the testing procedure. We also present an industry case study to demonstrate its use in actual production phases.
Open Access Status
This publication is not available as open access
First Page
9
Last Page
16
Funding Number
61872167
Funding Sponsor
Fakultas Sains dan Teknik, Universitas Nusa Cendana