Augmenting functional vision using automated tactile guidance

I joined feelSpace, based in Osnabrück, on the 1st of June 2023 under the supervision of Silke Kärcher. During the project I will closely cooperate with the team from Universität Osnabrück supervised by Prof. Peter König.

Personal Background and Interest:

I completed two Bachelor’s degrees: Automation and Robotics at Warsaw University of Technology and Cognitive Science at University of Warsaw. Afterward, I finished my Master’s studies in Psychology, Neuroscience, and Human Sciences at University of Pavia. Throughout my career, I have worked in academia (at Polish Academy of Sciences) as well as in the private sector. My main research interests are visual perception and awareness, computer vision, and the usage of machine-learning algorithms in real-life environments.

Aim of the project:

The aim of the project is to create a system combining a tactile bracelet, camera, and object detection machine learning algorithm which could help people with visual impairments effectively grasp objects of interest. A tactile bracelet - designed and created in-house - would be placed on the wrist of participants and it would vibrate in the direction in which the hand should move in order to grab a given object. The solution will be evaluated in terms of its accessibility and compared with audio commands in terms of speed and accuracy in a series of experiments.

My first (planned) steps towards achieving this aim:

The first working version of the tactile bracelet has already been developed. Multiple conducted experiments have shown that participants using proof of concept of the proposed solution can achieve similar performance when navigated with voice commands. Currently, two main aims are: (1) development of a neural network that will detect objects of interest and provide navigation input to the bracelet, (2) construction of a more advanced version of the bracelet.