RE: speaking microcontroller for deaf and dumb
||SPEAKING MICRO CONTROLLER FOR DEAF AND DUMB
SPEAKING MICRO.docx (Size: 1.66 MB / Downloads: 48)
“Speech” and “gestures” are the expressions, which are mostly used in communication between human beings. Learning of their use begins with the first years of life. In human communication, the use of speech and gestures is completely coordinated. Machine gesture and sign language recognition is about recognition of gestures and sign language using gloves. A number of hardware techniques are used for gathering information about body positioning; typically either image-based (using cameras, moving lights etc) or device-based (using instrumented gloves, position trackers etc.), although hybrids are beginning to come about. However, getting the data is only the first step. The second step, that of recognizing the sign or gesture once it has been captured is much more challenging, especially in a continuous stream. In fact currently, this is the focus of the research.
The data is analyzed from an instrumented data glove for use in recognition of some signs and gestures. A system is developed for recognizing these signs and their conversion into speech. The results will show that despite the noise and accuracy constraints of the equipment, the reasonable accuracy rates have been achieved.
The system objective was to develop a computerized Indian Sign Language (ISL) recognition system. The system considers only single handed gestures; therefore a subset of ISL has been selected for the implementation of Boltay Haath. The basic concept involves the use of computer interfaced data gloves worn by a disabled person who makes the signs. The computer analyzes these gestures, minimizes the variations and synthesizes the sound for the corresponding word or letter for normal people to understand. The basic working of the project is depicted in the following figure.
The above diagram clearly explains the scope and use of the Boltay Haath system. The system aims at bridging communication gaps between the deaf community and other people. When fully operational the system will help in minimizing communication gaps, easier collaboration and will also enable sharing of ideas and experiences.
The following performance parameters were kept in mind during the design of the project:
• Recognition time: A gesture should take approximately 0.25 to 0.5 second in the recognition
Process in order to respond in real time.
• Continuous and automatic recognition: To be more natural the system must be capable of
Recognizing the gestures continuously without any manual indication or help for demarcating
The consecutive gestures.
• Recognition Accuracy: The system must recognize the gestures accurately between80 to 90 percent.
ISL SIGNS USED IN BOLTAY HAATH
The sign language into Sub-domains that is English. This is because of the similarity of some gestures. Moreover English contain gestures of words and letters. Gestures have been categorized into Dynamic and Static. In English there are 26 letters. In which two are dynamic and words are of both types one-handed and two-handed. ISL also contains domain specific signs for example computer terms, Environmental terms and Traffic terms.
The P89V51RD2 is an 80C51 microcontroller with 64 kB Flash and 1024 bytes of data RAM. Key feature of the P89V51RD2 is its X2 mode option. The design engineer can choose to run the application with the conventional 80C51 clock rate (12 clocks per machine cycle) or select the X2 mode (6 clocks per machine cycle) to achieve twice the throughput at the same clock frequency.
Another way to beneﬁt from this feature is to keep the same performance by reducing the clock frequency by half, thus dramatically reducing the EMI. The Flash program memory supports both parallel programming and in serial In-System Programming (ISP). Parallel programming mode offers gang-programming at high speed, reducing programming costs and time to market. ISP allows a device to be reprogrammed in the end product under software control.
The capability ﬁeld/update the application ﬁrmware makes a wide range of applications possible. The P89V51RD2 is also In-Application Programmable (IAP), allowing the Flash program memory to be reconﬁgured even while the application is running.
ALE/PROG (ADDRESS LATCH ENABLE):-
ALE is the output signal for latching the low byte of the address during an access to external memory. This pin is also the programming pulse input (PROG) for flash programming. Normally the ALE is emitted at a constant rate of 16 the crystal frequency and can be used for external timing and clocking. One ALE pulse is skipped during each access to external data memory. However, if AO is set to ‘1’, ALE is disabled.