An Approach to GUI Test Scenario Generation Using Machine Learning

Publication Date

1-1-2022

Document Type

Conference Proceeding

Publication Title

Proceedings - 4th IEEE International Conference on Artificial Intelligence Testing, AITest 2022

DOI

10.1109/AITest55621.2022.00020

First Page

79

Last Page

86

Abstract

With the fast advance of artificial intelligence technology and data-driven machine learning techniques, more and more AI approaches are applied in software engineering activities, such as coding, testing and etc. Conventionally, test engineers use manual testing tools to test mobile apps and deliver products. Object detection technology like YOLO is widely used in image processing these days. Inspired from this, on the basis of detecting GUI elements using machine learning models, we propose an automated approach to GUI test scenario generation based on mockup diagrams. The list of possible scenarios can be visualized using NetworkX which can indicate the feasibility and effectiveness of the proposed approach.

Keywords

deep learning, GUI test, machine learning, mobile app test automation, mockup diagram, test scenario generation

Department

Computer Engineering

Share

COinS