The application
The Sign Language Translator is a bidirectional Android application developed from February to May 2024. It converts text into visual signs and recognizes hand gestures as text using Kotlin, Jetpack Compose, and Google MediaPipe.
Recognition
I trained the real-time sign-recognition model on more than 34,200 images across over 57 sign classes. The dataset covers alphabet letters and commonly used dictionary words, while MediaPipe hand landmarks support real-time gesture detection and classification.
Visual output
I also created 3D sign-language visualizations in Blender for integration into the application, providing a visual output path alongside gesture-to-text recognition.