Mobile terminal and system for realizing sign language identification, and conversation realization method of the mobile terminal

A technology of a mobile terminal and an implementation method, which is applied in the field of communication to meet user requirements and improve user experience

Inactive Publication Date: 2015-11-25
NUBIA TECHNOLOGY CO LTD
View PDF3 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to propose a mobile terminal, system and call implementation method for realizing sign language recognition, s

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mobile terminal and system for realizing sign language identification, and conversation realization method of the mobile terminal
  • Mobile terminal and system for realizing sign language identification, and conversation realization method of the mobile terminal
  • Mobile terminal and system for realizing sign language identification, and conversation realization method of the mobile terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0071] Such as image 3 As shown, the mobile terminal 300 in the first embodiment includes the following functional units:

[0072] The database unit 310 is used to store standard sign language semantics and self-defined sign language semantic information; among them, the standard sign language semantic information is suitable for deaf-mute special groups, can be downloaded from the network server, and can be updated at any time; the custom sign language semantic information is provided by the local user Custom settings, in order to meet the individual needs of users, users can set according to their own preferences and habits.

[0073] The gesture collection and recognition unit 320 is used to collect and recognize gesture information, and may specifically include a camera and an image recognition unit to recognize the gesture information in the video through motion detection technology and send it to the voice conversion unit 330 .

[0074] The voice conversion unit 330 is ...

Embodiment 2

[0080] Such as Figure 4 As shown, the system for implementing speech recognition in the second embodiment includes: a mobile terminal 300 ′ and a gesture recognition device 400 .

[0081] The mobile terminal 300' in this embodiment is slightly different from the mobile terminal 300 in Embodiment 1. It does not have the gesture collection and recognition function, but still includes the following functional units:

[0082] The database unit 310 is used to store standard sign language semantics and self-defined sign language semantic information; among them, the standard sign language semantic information is suitable for deaf-mute special groups, can be downloaded from the network server, and can be updated at any time; the custom sign language semantic information is provided by the local user Custom settings, in order to meet the individual needs of users, users can set according to their own preferences and habits.

[0083] The voice conversion unit 330 is used to convert t...

Embodiment 3

[0090] Such as Figure 5 As shown, the present embodiment provides a method for communicating based on sign language, including the following steps:

[0091] Step 501, pre-store standard sign language semantics and custom sign language semantic information as the basis for subsequent gesture conversion.

[0092] Among them, the semantic information of standard sign language conforms to the usage norms of special groups of the deaf, can be downloaded from the network server, and can be updated at any time.

[0093] Custom sign language semantic information is set by the local user. In order to meet the individual needs of the user, the user can set it according to his own preferences and habits.

[0094] For example, the user can pre-record the gesture information of "waving", "drawing a circle", and "high-five", and define their semantics as "wait a moment, I will reply you later", "good luck", "you are amazing, for you Applause". In this way, non-deaf-mute people, even if ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mobile terminal and system for realizing sign language identification, and a conversation realization method of the mobile terminal. The method comprises the following steps: storing sign language semantic information in advance; a local end establishing a communication link with an opposite end; and in a conversion process with the opposite end, the local end obtaining gesture information in real time, and according to the prestored sign language semantic information, converting currently identified gesture information into voice information for sending to the opposite end. According to the invention, sign language is identified by use of a front camera and is then converted into voice signals for sending to the mobile phone of an opposite side; and the sign language can also be identified by use of an apparatus worn on the hand of a user, then conversion and transmission are carried out, the identification and voice conversion process is carried out at a local place, waste of too much data flow like video conversation is unnecessary, a sign-language-based indirect voice conversation function is also realized, the application demand of a special group is met, the application demands of other users in special environments are also met, and the application experience of the user is greatly improved.

Description

technical field [0001] The invention relates to the field of communication technology, in particular to a mobile terminal, a system and a method for implementing sign language recognition. Background technique [0002] With the continuous development of mobile terminals, more and more functions are integrated on mobile terminals, providing users with more and more personalized and humanized services, but a special user group is ignored, namely the deaf-mute, deaf The communication of dumb people is based on dumb language, so the mobile terminals in the current market cannot meet the needs of deaf people. On the other hand, in some special environments or occasions where voice calls are inconvenient, users can only input information through voice input or manual text input, and cannot directly automatically recognize and input information through gestures, which is not convenient enough. Contents of the invention [0003] The main purpose of the present invention is to pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04M1/725H04M1/247H04M1/72454
Inventor 武光维
Owner NUBIA TECHNOLOGY CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap