Publication Date
Summer 2021
Degree Type
Master's Project
Degree Name
Master of Science in Computer Science (MSCS)
Department
Computer Science
First Advisor
Nada Attar
Keywords
Human-centered computing, Visualization, Computing methodologies, Machine learning algorithms
Abstract
Studies have shown the possibility to classify user tasks from eye-movement data. We present a new way to determine the optimal model for different visual attention tasks using data that includes two types of visual search tasks, a visual exploration task, a blank screen task, and a task where a user needs to fixate at the center of any scene. We used deep learning and SVM models on RGB images generated from fixation scan paths from these tasks. We also used AdaBoost on filtered eye movement data as a baseline. Our study shows that deep learning gives the best accuracy for classifying between visual search tasks but misclassified between visual search and visual exploration tasks. Machine learning-based methods performed with high accuracy classifying tasks that involve minimal visual attention. Our study gives insight on the best model to choose by type of visual task using eye movement data.
Recommended Citation
Thentu, Siddartha, "Task Classification during Visual Search with Deep Learning Neural Networks and Machine Learning Methods" (2021). Master's Projects. 1028.
DOI: https://doi.org/10.31979/etd.2vac-qhu5
https://scholarworks.sjsu.edu/etd_projects/1028
