madad initiative- An Assistive smart wearable and application designed for people with hearing disabilities
kazi haque
Kolkata, West Bengal
- 0 Collaborators
AI and IoT based Accessibility Track for specially abled people for 1. Public Announcement Decipher and Emergency situation awareness 2. Navigation of new areas for deaf and mute people 3. Sharing SOS signals in case of emergency ...learn more
Project status: Under Development
Mobile, Internet of Things, Artificial Intelligence
Groups
DeepLearning,
Internet of Things
Intel Technologies
DevCloud,
Movidius NCS,
OpenVINO,
Intel Python
Overview / Usage
Challenges faced by people with hearing disability in day to day life can be categorized into :
1. Difficulty in hearing announcements in public places++
Imagine a situation where a deaf and mute person is not able to hear any Emergency announcement , such as "There is a Fire! Please evacuate the premise"** **or any generic announcement of importance such as while traveling in a metro or bus to "Please get down in the next station , the metro will change tracks" ,a normal person with hearing ability would do as per the announcements ,but imagine a deaf persons ordeal .
Solution : Announcement Interpretation
A smart wearable device with a complementary iOS app that provides assistance during emergency situations by interpreting announcements and generating alerts in Sign language .
Please go through the link below for a demo of the application:
https://drive.google.com/file/d/1eFZOc7P0pMIg2hRNj8y8KLaG86ZI7L3h/view?usp=sharing
2. Navigation of new areas
Imagine a deaf person going to a new place and as he or she is not able to understand the different announcements such as timing of the place or to find the ticket counter, he faces a lot of difficulty . A stats also suggest that more then 90% of deaf and mute people are not able to read or write and understand sign language only .
Solution :Know Your Surrounding
Shows important instructions in sign language specific to the users' location.
3.Sharing SOS signals in emergency
Imagine a situation where a deaf and mute person is not able to communicate an emergency situation like fire or some sort of violence because of his disability.
Solution:SOS Signals
Sends SOS signals to concerned authorities with current location and messages as per situation.
Also a feature is enable for the users to record there videos in Sign Language whoch will be interpreted as text and send to concerned authorities
Please go through the link below for a demo of the application:
https://drive.google.com/file/d/1eGB3ui-fzU1pNNLeUnev9800mmmr32v4/view?usp=sharing
Prototype is developed for the above three solutions with a smart wearable and a complimentary iOs app for all the solutions.
Please go through the link below for the product details:
Methodology / Approach
Technologies & Features
- iOs application “madad”
- IoT based smart wearable for real time analysis
- Digital Signal Processing(DSP) algorithm for noise reduction
- Artificial Intelligence algorithms for transcribing, translation and announcement categorization
- GPS based tracking for emergency alerts
Technologies Used
- Intel Optimized python version is used for the complete development of the application
- Intel OpenVino toolkit is used for gesture and facial recognition
- up squared AI Vision kit is used for inferencing and deployment
Please visit the below link for a demonstration :