The Development of a Sign Language Detection System Using TensorFlow and CVzone
DOI:
https://doi.org/10.62205/mjgcs.v3i2.50Keywords:
SIBI, Sign Language Detection, TensorFlow, CVzone, Hand Gesture Recognition, Computer VisionAbstract
Sign language is a communication system used to help deaf people interact with each other. In Indonesia, there are two main sign languages, namely Indonesian Sign Language (BISINDO) and Indonesian Sign Language System (SIBI), each of which has differences in the use of hands. This research develops a SIBI-based sign language recognition system using TensorFlow and CVzone. This system uses computer vision technology and machine learning to recognize SIBI alphabet hand gestures. The model is developed using a dataset captured by a camera and trained with TensorFlow to enable real-time gesture recognition, while CVzone facilitates effective gesture tracking. Test results show that the average accuracy in recognizing the SIBI alphabet reaches more than 90%, which reflects the system's good performance in recognizing the alphabet. It is expected that the accuracy of detecting hand gestures in sign language will be improved to support communication for the deaf community in Indonesia.
References
D. Rofifah, Empratikta Zulpicha, and M. Rofiandaru, “Sistem Pembelajaran Bahasa Isyarat (Sibi) Menggunakan Metode Komunikasi Total Untuk Penyandang Tunarungu Di Slbn Semarang,” J. Anal. Sosiol., vol. 6, no. 1, pp. 100–109, 2020, [Online]. Available: https://core.ac.uk/download/pdf/35378171.pdf
E. Nurul Azizah, M. Gito Resmi, and S. Alam, “Penerapan Metode Design Thinking Pada Perancangan User Interface Aplikasi Mobile Pengenalan Bahasa Isyarat Indonesia (Bisindo),” J. Mnemon., vol. 6, no. 1, pp. 71–76, 2023, doi: 10.36040/mnemonic.v6i1.5711.
Muhammad Azka Imaddudin, Ida Wahidah Hamzah, and Sri Astuti, “Simulasi Penerjemah SIBI (Sistem Isyarat Bahasa Indonesia) Menggunakan Tensorflow Dan Convolutional Neural Network (CNN),” e-Proceeding Eng., vol. 8, no. 6, pp. 3911–3918, 2022.
A. S. Nugraheni, A. P. Husain, and H. Unayah, “Optimalisasi Penggunaan Bahasa Isyarat Dengan Sibi Dan Bisindo Pada Mahasiswa Difabel Tunarungu Di Prodi Pgmi Uin Sunan Kalijaga,” J. Holistika, vol. 5, no. 1, p. 28, 2023, doi: 10.24853/holistika.5.1.28-33.
M. B. Subkhi, M. Y. Trinurais, R. K. A. Wibowo, and B. R. Prakosa, “Deteksi Bahasa Isyarat Berdasarkan SIBI (Sistem Bahasa Isyarat) menggunakan Transfer Learning,” Semin. Nas. Teknol. Sains, vol. 3, no. 1, pp. 361–369, 2024, doi: 10.29407/stains.v3i1.4347.
I. B. A. Peling, I. M. P. A. Ariawan, and G. B. Subiksa, “Deteksi Bahasa Isyarat Menggunakan Tensorflow Lite dan American Sign Language (ASL),” J. Krisnadana, vol. 3, no. 2, pp. 90–100, 2024, doi: 10.58982/krisnadana.v3i2.534.
D. Permana and J. Sutopo, “APLIKASI PENGENALAN ABJAD SISTEM ISYARAT BAHASA INDONESIA (SIBI) DENGAN ALGORITMA YOLOv5 MOBILE APPLICATION ALPHABET RECOGNITION OF INDONESIAN LANGUAGE SIGN SYSTEM (SIBI) USING YOLOv5 ALGORITHM,” J. SimanteC, vol. 11, no. 2, pp. 231–240, 2023.
I. Maryati, “Website Perpustakaan ‘Library HUB’ dengan Pencarian Buku Berdasarkan Gambar Menggunakan Google MLKit,” JATISI (Jurnal Tek. Inform. dan Sist. Informasi), vol. 8, no. 4, pp. 1821–1831, 2021, doi: 10.35957/jatisi.v8i4.1269.
A. For and C. H. Kacorri, “Achines for,” no. 119, pp. 10–18, 2017.
M. I. Vol, “Media Informatika Vol.23 No.3 (2024) 161,” vol. 23, no. 3, pp. 161–169, 2024.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Dinda Putri Ramadani, Prayitno, Praditya Oktanza Djaduk Wibisono, Mochammad Rizky Abadi Sutoyo
This work is licensed under a Creative Commons Attribution 4.0 International License.
