Graphical User Interfaces (GUIs) are typically designed to simplify data entering, data processing and visualization of results. However, GUIs can also be exploited for other purposes. For instance, automatic tools can analyze GUIs to retrieve information about the data that can be processed by an application. This information can serve many purposes such as ease application integration, augment test case generation, and support reverse engineering techniques. In the last years, the scientific community provided an increasing attention to the automatic extraction of information from interfaces. For instance, in the domain of Web applications, learning techniques have been used to extract information from Web forms. The knowledge about the data that can be processed by an application is not only relevant for the Web, but it is also extremely useful to support the same techniques when applied to desktop applications. In this paper we present a technique for the automatic extraction of descriptive information about the data that can be handled by widgets in GUI-based desktop applications. The technique is grounded on mature standards and best practices about the design of GUIs, and exploits the presence of textual descriptions in the GUIs to automatically obtain descriptive data for data widgets. The early empirical results with three desktop applications show that the presented algorithm can extract data with high precision and recall, and can be used to improve generation of GUI test cases.

Becce, G., Mariani, L., Riganelli, O., Santoro, M. (2012). Extracting Widget Descriptions from GUIs. In Fundamental Approaches to Software Engineering (FASE) (pp.347-361). Berlin : Springer [10.1007/978-3-642-28872-2_24].

Extracting Widget Descriptions from GUIs

MARIANI, LEONARDO;RIGANELLI, OLIVIERO;SANTORO, MAURO
2012

Abstract

Graphical User Interfaces (GUIs) are typically designed to simplify data entering, data processing and visualization of results. However, GUIs can also be exploited for other purposes. For instance, automatic tools can analyze GUIs to retrieve information about the data that can be processed by an application. This information can serve many purposes such as ease application integration, augment test case generation, and support reverse engineering techniques. In the last years, the scientific community provided an increasing attention to the automatic extraction of information from interfaces. For instance, in the domain of Web applications, learning techniques have been used to extract information from Web forms. The knowledge about the data that can be processed by an application is not only relevant for the Web, but it is also extremely useful to support the same techniques when applied to desktop applications. In this paper we present a technique for the automatic extraction of descriptive information about the data that can be handled by widgets in GUI-based desktop applications. The technique is grounded on mature standards and best practices about the design of GUIs, and exploits the presence of textual descriptions in the GUIs to automatically obtain descriptive data for data widgets. The early empirical results with three desktop applications show that the presented algorithm can extract data with high precision and recall, and can be used to improve generation of GUI test cases.
paper
GUI analysis, GUI testing
English
International Conference on Fundamental Approaches to Software Engineering (FASE) (held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2012)
2012
de Lara, J; Zisman, A
Fundamental Approaches to Software Engineering (FASE)
978-3-642-28871-5
2012
7212
347
361
reserved
Becce, G., Mariani, L., Riganelli, O., Santoro, M. (2012). Extracting Widget Descriptions from GUIs. In Fundamental Approaches to Software Engineering (FASE) (pp.347-361). Berlin : Springer [10.1007/978-3-642-28872-2_24].
File in questo prodotto:
File Dimensione Formato  
Becce-Widget-FASE-2012.pdf

Solo gestori archivio

Tipologia di allegato: Other attachments
Dimensione 671.17 kB
Formato Adobe PDF
671.17 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/42636
Citazioni
  • Scopus 18
  • ???jsp.display-item.citation.isi??? 14
Social impact