Logo Logo
Switch Language to German

Sharma, Arnab; Melnikov, Vitalik; Hüllermeier, Eyke ORCID logoORCID: https://orcid.org/0000-0002-9944-4108 and Wehrheim, Heike (2022): Property-driven testing of black-box functions. 10th International Conference on Formal Methods in Software Engineering (FormaliSE '22), Pittsburgh Pennsylvania, May 18 - 22, 2022. In: Proceedings of the IEEE/ACM 10th International Conference on Formal Methods in Software Engineering, New York: Association for Computing Machinery. pp. 113-123

Full text not available from 'Open Access LMU'.


Testing is one of the most frequent means of quality assurance for software. Property-based testing aims at generating test suites for checking code against user-defined properties. Test input generation is, however, most often independent of the property to be checked, and is instead based on random or user-defined data generation.

In this paper, we present property-driven unit testing of functions with numerical inputs and outputs. Alike property-based testing, it allows users to define the properties to be tested for. Contrary to property-based testing, it also uses the property for a targeted generation of test inputs. Our approach is a form of learning-based testing where we first of all learn a model of a given black-box function using standard machine learning algorithms, and in a second step use model and property for test input generation. This allows us to test both predefined functions as well as machine learned regression models. Our experimental evaluation shows that our property-driven approach is more effective than standard property-based testing techniques.

Actions (login required)

View Item View Item