Model-Based Test Modeling and Automation Tool for Intelligent Mobile Apps

Publication Date

8-1-2021

Document Type

Conference Proceeding

Publication Title

Proceedings - 15th IEEE International Conference on Service-Oriented System Engineering, SOSE 2021

DOI

10.1109/SOSE52839.2021.00028

First Page

1

Last Page

10

Abstract

Functionalities of AI-powered mobile Apps or systems heavily depend on the given training dataset. The challenge in this case is that a learning system will change its behavior due to a slight change of dataset. While current alternative approaches for evaluating these apps either focus on individual performance measurement such as accuracy etc. Inspired by principles of the decision tree test method in software engineering, we introduce a 3D decision tree testing model for AI testing, a combined AI feature input tree, context tree, and output tree methodology for testing AI-powered applications. We report a newly developed AI test automation tool (known as AITest), which is built and implemented based on an innovative 3D AI Test model for AI-powered functions in intelligent mobile apps to support model-based AI function testing, test data generation, and auto test scripting and execution, and adequate test coverage analysis. Furthermore, the tool infrastructure, components, sample applications, and case study results are presented.

Keywords

AI test automation, AI testing, AI testing and analysis, intelligent system testing

Department

Applied Data Science; Computer Engineering

Link to Full Text

Share

COinS