System level testing of industrial data processing software poses several challenges. Input data can be very large, even in the order of gigabytes, and with complex constraints that define when an input is valid. Generating the right input data to stress the system for robustness properties (e.g. to test how faulty data is handled) is hence very complex, tedious and error prone when done manually. Unfortunately, this is the current practice in industry. In previous work, we defined a methodology to model the structure and the constraints of input data by using UML class diagrams and OCL constraints. Tests were automatically derived to cover predefined fault types in a fault model. In this paper, to obtain more effective system level test cases, we developed a novel search-based test generation tool. Experiments on a real-world, large industrial data processing system show that our automated approach can not only achieve better code coverage, but also accomplishes this using significantly smaller test suites.

Di Nardo, D., Pastore, F., Arcuri, A., Briand, L. (2016). Evolutionary robustness testing of data processing systems using models and data mutation. In Proceedings - 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015 (pp.126-137). Institute of Electrical and Electronics Engineers Inc. [10.1109/ASE.2015.13].

Evolutionary robustness testing of data processing systems using models and data mutation

PASTORE, FABRIZIO
Secondo
;
2016

Abstract

System level testing of industrial data processing software poses several challenges. Input data can be very large, even in the order of gigabytes, and with complex constraints that define when an input is valid. Generating the right input data to stress the system for robustness properties (e.g. to test how faulty data is handled) is hence very complex, tedious and error prone when done manually. Unfortunately, this is the current practice in industry. In previous work, we defined a methodology to model the structure and the constraints of input data by using UML class diagrams and OCL constraints. Tests were automatically derived to cover predefined fault types in a fault model. In this paper, to obtain more effective system level test cases, we developed a novel search-based test generation tool. Experiments on a real-world, large industrial data processing system show that our automated approach can not only achieve better code coverage, but also accomplishes this using significantly smaller test suites.
Si
paper
Software
English
30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015 9-13 Nov
9781509000241
Di Nardo, D., Pastore, F., Arcuri, A., Briand, L. (2016). Evolutionary robustness testing of data processing systems using models and data mutation. In Proceedings - 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015 (pp.126-137). Institute of Electrical and Electronics Engineers Inc. [10.1109/ASE.2015.13].
Di Nardo, D; Pastore, F; Arcuri, A; Briand, L
File in questo prodotto:
File Dimensione Formato  
DiNardo-EvolutionaryRobustnessTesting-ASE-2015.pdf

Solo gestori archivio

Descrizione: Articolo
Dimensione 234 kB
Formato Adobe PDF
234 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/128934
Citazioni
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 2
Social impact