Real Time Sign Language Recognition

About

  Nearly 5% of the world’s population is said to be hearing impaired, this creates a major problem for the communication with the deaf and the dumb, specially abled persons. To decrease the communication gap between hearing impaired community and the normal persons, we have designed a Sign Language Recognition System. Our application allows users to show a sign on a webcam and that sign gets converted to its respective alphabet and displayed on the screen.

---

Functionalities

• Detecting a sign and displaying the corresponding alphabets from A to Z ( Excluding J and Z)
• Detecting a sign indicated by user on a live feed and displaying corresponding alphabet
• Forming a word/sentence from the individual signs shown by user on a live webcam and displaying that word on a screen
• Recording and storing a video of user showing signs on a webcam with its respective results in a local machine

---

Dataset used : ASL Dataset

Colab notebook : https://colab.research.google.com/drive/1ObDUs0TZ_iXrsWTY5St536yy1ZR-cGMM?usp=sharing

Link to different Pickle files used in colab notebook : https://drive.google.com/drive/folders/18tBtniXy8X6Bg-PsSijzQalPIudTJjES?usp=sharing

---

To run this project :

Clone the project -

  $ git clone https://github.com/Patrickbro13/Real-Time-Sign-Language-Recognition.git

Install all the reqirements -

  $ pip install -r requirements.txt

Download the CNN model from this link and store it in your machine. Then update that model's path in model.py file

model = load_model("YOUR_MODEL_PATH")

Move to the skinMask200/code/ directory

Run the following commands -

python main.py

---

Keyboard commands :

• Press R to start recording
• Press D to add predicted sign to previous displayed result
• Press S to add space to previous displayed result
• Press A to delete last displayed result
• Press C to clear the all displayed results
• Press T to stop recording
• Press Q to exit

---

This project still has scope of development, so you can also contribute to this Project as follows:

• Fork this Repository.
• Clone your Fork on a different branch:
  • git clone -b <name-of-branch> https://github.com/Patrickbro13/Real-Time-Sign-Language-Recognition.git
• After adding any feature:
  • Goto your fork and create a pull request.
  • We will test your modifications and merge changes.

---

Developed with ❤️ by Pathik Ghugare and Mayank Chopra ,

---