Field failures, that is, failures caused by faults that escape the testing phase leading to failures in the field, are unavoidable. Improving verification and validation activities before deployment can identify and timely remove many but not all faults, and users may still experience a number of annoying problems while using their software systems.This paper investigates the nature of field failures, to understand to what extent further improving in-house verification and validation activities can reduce the number of failures in the field, and frames the need of new approaches that operate in the field.We report the results of the analysis of the bug reports of five applications belonging to three different ecosystems, propose a taxonomy of field failures, and discuss the reasons why failures belonging to the identified classes cannot be detected at design time but shall be addressed at runtime. We observe that many faults (70%) are intrinsically hard to detect at design-time.

Gazzola, L., Mariani, L., Pastore, F., Pezze, M. (2017). An Exploratory Study of Field Failures. In Proceedings of the International Symposium on Software Reliability Engineering (ISSRE) (pp.67-77). IEEE Computer Society [10.1109/ISSRE.2017.10].

An Exploratory Study of Field Failures

Gazzola, L
Membro del Collaboration Group
;
Mariani, L;Pastore, F;Pezze, M
Membro del Collaboration Group
2017

Abstract

Field failures, that is, failures caused by faults that escape the testing phase leading to failures in the field, are unavoidable. Improving verification and validation activities before deployment can identify and timely remove many but not all faults, and users may still experience a number of annoying problems while using their software systems.This paper investigates the nature of field failures, to understand to what extent further improving in-house verification and validation activities can reduce the number of failures in the field, and frames the need of new approaches that operate in the field.We report the results of the analysis of the bug reports of five applications belonging to three different ecosystems, propose a taxonomy of field failures, and discuss the reasons why failures belonging to the identified classes cannot be detected at design time but shall be addressed at runtime. We observe that many faults (70%) are intrinsically hard to detect at design-time.
paper
Failure context; Field failures; Field faults; Field testing; Fieldintrinsic faults; Software testing; Software; Safety, Risk, Reliability and Quality
English
IEEE International Symposium on Software Reliability Engineering, ISSRE 2017
2017
Gazzola, L; Mariani, L; Pastore, F; Pezzè, M
Proceedings of the International Symposium on Software Reliability Engineering (ISSRE)
9781538609415
2017
2017-
67
77
8109074
reserved
Gazzola, L., Mariani, L., Pastore, F., Pezze, M. (2017). An Exploratory Study of Field Failures. In Proceedings of the International Symposium on Software Reliability Engineering (ISSRE) (pp.67-77). IEEE Computer Society [10.1109/ISSRE.2017.10].
File in questo prodotto:
File Dimensione Formato  
6-ISSRE.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 310.93 kB
Formato Adobe PDF
310.93 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/187234
Citazioni
  • Scopus 21
  • ???jsp.display-item.citation.isi??? 18
Social impact