Sign language processing method by mobile terminal and sign language processing mobile terminal

A technology of a mobile terminal and a processing method, applied in the direction of special services for subscribers, etc., can solve the problems of inability to use voice calls normally, difficulty in contacting relatives and friends with mobile terminal devices, etc., and achieve the effect of convenient communication

Inactive Publication Date: 2009-12-02
ZTE CORP
View PDF0 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for the deaf-mute or speech-impaired people, since they cannot use the voice call function normally, it becomes very difficult to use ordinary mobile terminal devices to communicate with relatives and friends

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language processing method by mobile terminal and sign language processing mobile terminal
  • Sign language processing method by mobile terminal and sign language processing mobile terminal
  • Sign language processing method by mobile terminal and sign language processing mobile terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0092] Such as Figure 4 As shown, this example includes a sign language processing module, which further includes a camera, an image processing unit, a sign language codec unit, an audio processing unit, an audio sending unit, an audio receiving unit, a display unit and a memory.

[0093] Wherein, the camera records the sign language actions of the user, stores them as corresponding image information, and inputs them to the image processing unit.

[0094] The image processing unit samples the received image information, extracts useful sign language animation information, and processes the sign language animation information into specific sign language symbols.

[0095] The sign language codec unit completes two functions of encoding and decoding. On the one hand, phonetic symbol information can be compiled into corresponding sign language symbol information; on the other hand, sign language symbol information can be decoded into voice information, that is, two-way conversio...

Embodiment approach

[0112] Another embodiment of the method of the present invention includes the process of converting the received voice information into sign language actions, and the process includes the following steps:

[0113] Step A2. The mobile terminal converts the received voice information into sign language action animation;

[0114] Step B2. The mobile terminal displays the sign language animation.

[0115] Step A2 specifically performs the following operations:

[0116] Step A21. The mobile terminal converts the received voice information into sign language symbol information;

[0117] Step A22. The mobile terminal converts the sign language symbol information into sign language action animation.

[0118] Step A21 specifically converts the received voice information into specific audio information through the mobile terminal, and then converts the audio information into sign language symbol information;

[0119] This embodiment also includes the process of storing the correspond...

Embodiment 2

[0141] The flow of this example is as follows Figure 5 As shown, it mainly includes two processes. Process 1 is to translate the captured sign language image information into voice information, play it out through the speaker, or send it to the voice channel during the call; process 2 is to convert the received voice information into Sign language animation information is displayed on the display screen of the wireless terminal device for user identification.

[0142] Step 501. The user turns on the sign language processing function;

[0143] For process 1,

[0144] Step 502. The mobile terminal device first captures the user's sign language movements through the camera, and converts the captured sign language movement information into corresponding sign language animations;

[0145] Step 503. Perform corresponding image processing on the sign language animation information, convert it into sign language symbol information, and input it to the sign language codec unit, and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sign language processing method by a mobile terminal, which comprises a process of capturing actions of the sign language and converting the actions into voice, and the process comprises the following steps that: A1, the mobile terminal captures images of the actions of the sign language; B1, the mobile terminal converts the images of the actions of the sign language into voice messages corresponding to the actions of the sign language; and C1, the mobile terminal sends the voice messages after conversion to a called terminal through a mobile network. The invention discloses a sign language processing mobile terminal. The method and the mobile terminal realize the translation from the sign language to the voice by capturing the images of the actions of the sign language and converting the images into the corresponding voice messages, and send the voice messages to the called terminal by establishing communication through the mobile terminal, so that the deaf mute or people with language barrier can also use the mobile terminal to communicate with other people.

Description

technical field [0001] The invention relates to a mobile terminal, in particular to a sign language processing method of the mobile terminal and a sign language processing terminal based on the method. Background technique [0002] Deaf-mute or language-impaired people usually communicate through sign language in their daily lives. Understanding sign language is not an easy task. When encountering the other party who does not understand sign language, there are great obstacles in their communication. [0003] With the improvement of people's living standards, the popularity of mobile terminal devices is also increasing. However, for the deaf-mute or speech-impaired people, since they cannot normally use the voice call function, it is very difficult to make use of common mobile terminal devices to communicate with relatives and friends. Contents of the invention [0004] The technical problem to be solved by the present invention is to provide a mobile terminal sign langua...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04M3/42
Inventor 汶丽
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap