Master of Science in Computer Science (MSCS)
Gesture Recognition, Pose Estimation, Machine Learning, Computer Vision, Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM)
Gesture recognition is a machine learning and computer vision application where gestures are detected from videos. This project uses pose estimation to find the coordinates of important joints as a preprocessing step before trying to classify the gesture. Machine learning layers such as Convolutional Neural Network and Long Short-Term Memory are used. Various types of machine learning models are trained. The accuracy and f1 score of each model are compared. Feature selection is done by testing with different subsets of features. The results show that pose estimation as a preprocessing step provides good accuracy for gesture recognition. The results also show that the polar angle and velocity are more important than polar acceleration in recognizing the gesture.
Chang, Chaz, "Gesture Recognition with Deep Learning" (2023). Master's Projects. 1327.
Available for download on Friday, December 20, 2024