Test suites should test exceptional behavior to detect faults in errorhandling code. However, manually-written test suites tend to neglect exceptional behavior. Automatically-generated test suites, on the other hand, lack test oracles that verify whether runtime exceptions are the expected behavior of the code under test. This paper proposes a technique that automatically creates test oracles for exceptional behaviors from Javadoc comments. The technique uses a combination of natural language processing and run-time instrumentation. Our implementation, Toradocu, can be combined with a test input generation tool. Our experimental evaluation shows that Toradocu improves the fault-finding effectiveness of EvoSuite and Randoop test suites by 8% and 16% respectively, and reduces EvoSuite's false positives by 33%.
Goffi, A., Gorla, A., Ernst, M., & Pezze', M. (2016). Automatic generation of oracles for exceptional behaviors. In ISSTA 2016 - Proceedings of the 25th International Symposium on Software Testing and Analysis 18 July 2016 (pp.213-224). Association for Computing Machinery, Inc.
Citazione: | Goffi, A., Gorla, A., Ernst, M., & Pezze', M. (2016). Automatic generation of oracles for exceptional behaviors. In ISSTA 2016 - Proceedings of the 25th International Symposium on Software Testing and Analysis 18 July 2016 (pp.213-224). Association for Computing Machinery, Inc. |
Tipo: | paper |
Carattere della pubblicazione: | Scientifica |
Presenza di un coautore afferente ad Istituzioni straniere: | Si |
Titolo: | Automatic generation of oracles for exceptional behaviors |
Autori: | Goffi, A; Gorla, A; Ernst, M; Pezze', M |
Autori: | |
Data di pubblicazione: | 2016 |
Lingua: | English |
Nome del convegno: | International Symposium on Software Testing and Analysis, ISSTA 2016 - 18-20 July |
ISBN: | 9781450343909 |
Appare nelle tipologie: | 02 - Intervento a convegno |