Application of Video-Based Technology in Tracking Hand Movements for Medical Training Simulations
Open Access
Author:
Budzinski, Cynthia
Area of Honors:
Mechanical Engineering
Degree:
Bachelor of Science
Document Type:
Thesis
Thesis Supervisors:
Jason Zachary Moore, Thesis Supervisor Daniel Humberto Cortes Correales, Thesis Honors Advisor
Keywords:
Medical Training Simulation Training Hand Tracking Endotracheal Intubation MediaPipe Laryngoscope
Abstract:
This thesis explores the need for individualized feedback in medical simulation training for procedures such as endotracheal intubations. Current pass-fail assessments lack the specificity required for skill refinement, leading to potential complications in critical procedures. This thesis investigates the application of visual hand tracking technology, specifically Google's MediaPipe, to offer quantitative feedback. Using a wooden hand model on a linear motor with a depth camera, this experiment explores tracking hand movements in real time. Google's MediaPipe software tracks 3D hand motions, generating data points for analysis. Results demonstrated consistent patterns in hand movements corresponding to linear motor actions. Total distance traveled by each point of interest and error analysis provided insights into the accuracy of visually measured hand movements. Visual hand tracking, such as MediaPipe, may prove to be a promising tool for refining operator techniques in critical medical procedures. The experiments explore the technology's accuracy and underscores its potential application in medical training, addressing a gap in current practices and emphasizing the importance of tailored feedback for improved patient outcomes.
