THE GLOVE PROJECT: ALLOWING THE VISUALLY IMPAIRED TO UNDERSTAND AND INTERACT WITH THEIR ENVIORNMENT
Open Access
Author:
De Matheu De Lima, David Jose
Area of Honors:
Computer Engineering
Degree:
Bachelor of Science
Document Type:
Thesis
Thesis Supervisors:
Dr. Vijaykrishnan Narayanan, Thesis Supervisor Chitaranjan Das, Thesis Honors Advisor
Keywords:
human computer interaction computer engineering feather haptic feedback glove visual cortex on silicon grocery assistance system GAS MDL HoloLens microcontroller C# C flex sensor gestures PCB
Abstract:
The Grocery Assistance System (GAS), as part of the NSF expedition Visual Cortex on Silicon, seeks to help visually impaired people to be more independent using technology. The GAS system relies on various subsystems including a Computer Vision module to understand the environment around the user as well as a user interface for the system to communicate with the user. The user interface allows the system to send feedback to the user as well as receive inputs that can aid it.
This thesis explores the process of designing and building a solution that combines hardware and software to solves the communication needs of the system. It introduces the concept of the glove, a device that fits on the user’s hand and enables communication between the system and the user. The glove combines the use of off-the-shelf hardware with custom software written in C and C# to enable the system to send haptic feedback to the user and receive input. The goal of this exploration that encompasses 3 iterations of the glove was to test different methods of interaction and communication techniques. Through each of the iterations the text looks at the strengths and weaknesses that each had and how they can be improved. Finally, the text explores the future away from the glove, moving into new and more innovative solutions.
