Augmenting functional vision using automated tactile guidance

Update Nov. 2024

I joined feelSpace, based in Osnabrück, on the 1st of June 2023 under the supervision of Silke Kärcher. During the project I will closely cooperate with the team from Universität Osnabrück supervised by Prof. Peter König.

Personal Background and Interest:

I completed two Bachelor’s degrees: Automation and Robotics at Warsaw University of Technology and Cognitive Science at University of Warsaw. Afterward, I finished my Master’s studies in Psychology, Neuroscience, and Human Sciences at University of Pavia. Throughout my career, I have worked in academia (at Polish Academy of Sciences) as well as in the private sector. My main research interests are visual perception and awareness, computer vision, and the usage of machine-learning algorithms in real-life environments.

Aim of the project:

The aim of the project is to create a system combining a tactile bracelet, camera, and object detection machine learning algorithm which could help people with visual impairments effectively grasp objects of interest. A tactile bracelet - designed and created in-house - would be placed on the wrist of participants and it would vibrate in the direction in which the hand should move in order to grab a given object. The solution will be evaluated in terms of its accessibility and compared with audio commands in terms of speed and accuracy in a series of experiments.

My first (planned) steps towards achieving this aim:

The first working version of the tactile bracelet has already been developed. Multiple conducted experiments have shown that participants using proof of concept of the proposed solution can achieve similar performance when navigated with voice commands. Currently, the main aims are evaluation of a newly developed AI-based automated hand navigation solution and development of a new version of the bracelet.

Future directions:

In the next steps, the current solution will be optimized to mobile usage in real-world contexts by integrating navigation algorithms with a mobile app utilizing LLM interface (under development). Later, we aim to evaluate the long-term effects of bracelet usage.

My OptiVisT experience:

I can confidently say that joining the OptiVisT network was the best career decision of my life. Not only was I able to conduct my project in a wonderful environment, but also I was able to create new friendships that I am convinced will outlast the consortium. All in all, I could not imagine pursuing my PhD in a better environment.