Polish Sign Language Gestures to Text Conversion Using Machine Learning

Lemieszewski, Ł., Nowak, M. & Becker, J.

In B. Marcinkowski, A. Przybylek, A. Jarzębowicz, N. Iivari, E. Insfran, M. Lang, H. Linger, & C. Schneider (Eds.), Harnessing Opportunities: Reshaping ISD in the post-COVID-19 and Generative AI Era (ISD2024 Proceedings). Gdańsk, Poland: University of Gdańsk

This paper addresses the communication challenges faced by the deaf community in Poland by developing an intelligent application to convert Polish sign language (PJM) gestures into text. The research focuses on adapting hybrid deep neural network models, selected based on studies of other sign languages, and fine-tuning them through transfer learning using a dataset of Polish sign language.