GUI reverse engineering with machine learning

Author

Morgado, I.C. ; Paiva, A.C.R. ; Faria, J.P. ; Camacho, R.

Author_Institution

Dept. of Inf. Eng., Univ. of Porto, Porto, Portugal

fYear

2012

fDate

5-5 June 2012

Firstpage

27

Lastpage

31

Abstract

This paper proposes a new approach to reduce the effort of building formal models representative of the structure and behaviour of Graphical User Interfaces (GUI). The main goal is to automatically extract the GUI model with a dynamic reverse engineering process, consisting in an exploration phase, that extracts information by interacting with the GUI, and in a model generation phase that, making use of machine learning techniques, uses the extracted information of the first step to generate a state-machine model of the GUI, including guard conditions to remove ambiguity in transitions.

Keywords

finite state machines; graphical user interfaces; inductive logic programming; information retrieval; learning (artificial intelligence); reverse engineering; GUI model; GUI reverse engineering; dynamic reverse engineering process; exploration phase; formal models; graphical user interfaces; inductive logic programming; information extraction; machine learning techniques; model-based testing; state-machine model generation; Buildings; Data mining; Encoding; Graphical user interfaces; Logic programming; Machine learning; Reverse engineering; Inductive Logic Programming; Machine Learning; Model-Based Testing; Reverse Engineering;

fLanguage

English

Publisher

ieee

Conference_Titel

Realizing Artificial Intelligence Synergies in Software Engineering (RAISE), 2012 First International Workshop on

Conference_Location

Zurich

Print_ISBN

978-1-4673-1752-8

Type

conf

DOI

10.1109/RAISE.2012.6227966

Filename

6227966