Sign Language Translation Into Text

by majed.asa123 in Circuits > Electronics

4309 Views, 2 Favorites, 0 Comments

Sign Language Translation Into Text

20210417_154224.jpg
IMG-20210415-WA0046.jpg

The deaf and mute are considered a class and a part of society, and they need easy and quick communication with all members of society anywhere.

So our project is the use of artificial intelligence in order to translate the hand movement through the camera and it is translated into text on the screen, which makes communication easier, faster and clearer between the deaf and the mute and other members of society.

Supplies

1- Raspberry pi 4 (8GB RAM) Kit.

2- 7 Inch Touchscreen for Raspberry Pi 4, 1024 x 600 HD Display Touch Screen.

3- Webcam full HD.

4- Laptop stand.

Raspbian Installation on Raspberry Pi

First, you must install the system running the Raspberry pi (Raspbian)

Install Python 3

We need to install python 3 because the project works with python 3

This video explains how to install python 3 on Raspberry pi

Install Open SV

2021-03-18-002249_1920x1080_scrot.png
2021-03-18-002308_1920x1080_scrot.png
2021-03-18-004251_1920x1080_scrot.png

We will use open cv library for object detection Because we want to use it to read palm movement.

Install method and steps :

http://mitchtech.net/raspberry-pi-opencv/

Install Hand Detector Code

IMG-20210331-WA0014.jpg

After install open SV we installed hand detector code from https://github.com/Shubhamai/face-hand-detector

Install Hand Gesture Recognition Code

We need to install Hand Gesture Recognition code because the project idea is Reading the hand movement of the deaf and mute and converting it into a text

Source of the code

Assembly and Final Design

IMG-20210408-WA0026.jpg
IMG-20210408-WA0002 (2).jpg
IMG-20210408-WA0024 (1).jpg
IMG-20210408-WA0023 (1).jpg
IMG-20210408-WA0022 (2).jpg
IMG-20210408-WA0002.jpg
IMG-20210408-WA0024.jpg
IMG-20210408-WA0023.jpg
IMG-20210408-WA0022.jpg
IMG-20210408-WA0003.jpg
IMG-20210408-WA0012.jpg
IMG-20210408-WA0011.jpg
IMG-20210408-WA0010.jpg
IMG-20210408-WA0009.jpg
IMG-20210408-WA0008.jpg
IMG-20210408-WA0007.jpg
IMG-20210408-WA0021.jpg
IMG-20210408-WA0005.jpg

After making sure that the project works well, we connect the project parts together and make the final design of the project.

Difficulties and Solutions

Install Tensor Flow Library

The solution is to replace it with open CV library

Video of the Project

Sign Language Translation Into Text

Thanks and Appreciation

Our sincere thanks and gratitude to Dr. Jaber Al-Yamani for his support and guidance that helped us in the completion of this project, and we also thank the College of Telecom and Electronics for all the assistance and guidance provided to us.

Thank you very much