Unlock instant, AI-driven research and patent intelligence for your innovation.
Sign language interaction method and device and computer medium
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
An interactive method and computer technology, applied in the field of artificial intelligence, can solve problems such as ordinary people's ignorance of sign language, achieve smooth communication and improve accuracy
Active Publication Date: 2019-12-20
TENCENT TECH (SHENZHEN) CO LTD
View PDF6 Cites 10 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
On the one hand, text communication is limited by conditions such as reading ability and pen and paper writing ability. On the other hand, sign language is only mastered by some deaf-mute people and very few professionals. Ordinary people do not understand sign language, and it is difficult to communicate with deaf-mute people exchange
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
example 1
[0151] Example 1: Communication between a deaf person and an ordinary person who does not understand sign language expression
[0152] Such as Figure 11 As shown, it specifically includes the following steps:
[0153] Step S1100, the sign language conversion device acquires the video of the deaf-mute's sign language to be recognized;
[0154] Step S1101, the sign language conversion device recognizes and acquires the semantic text expressed in the sign language video to be recognized;
[0155] Step S1102, the sign language conversion device displays the above semantic text to ordinary people;
[0156] The above-mentioned semantic text can be directly displayed to ordinary people, and the above-mentioned semantic text can also be converted into a voice signal for playback.
[0157] Step S1103, the sign language conversion device obtains the response text of ordinary people responding to the above semantic text;
[0158] The response text that ordinary people respond to can...
example 2
[0161] Example 2: Human-computer interaction between the deaf and the smart TV
[0162] Such as Figure 12 As shown, it specifically includes the following steps:
[0163] Step S1200, when the sign language interaction is triggered, the smart TV collects and sends the deaf-mute sign language video to be recognized;
[0164] Optionally, switching from the voice interaction mode or the non-interaction mode to the sign language interaction mode can be realized through the above-mentioned interaction mode switch button for switching the human-computer interaction mode in this embodiment, and the description will not be repeated here.
[0165] In step S1201, the sign language conversion device receives and recognizes the sign language video to be recognized, and determines the semantic text expressed by the sign language video to be recognized.
[0166] The method for determining the semantic text of the sign language video expression to be recognized will not be described here. ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
PUM
Login to View More
Abstract
The invention provides a sign language interaction method and device and a computer medium, and relates to the technical field of artificial intelligence, for solving the problem of how to smoothly communicate with deaf-mutes. The sign language interaction method comprises the steps: obtaining a to-be-recognized sign language video; performing semantic text recognition on the to-be-recognized signlanguage video to obtain a semantic text expressed by the to-be-recognized sign language video; obtaining a response text of the semantic text; and converting the response text into a response sign language animation video taking a preset animation image as a main body. According to the sign language interaction method, the response text displayed to the deaf-mute is converted into the response sign language animation video, and the deaf-mute can know the semanteme of the response text according to the sign language of the preset animation image, so that the deaf-mute can smoothly communicatewith the deaf-mute.
Description
technical field [0001] The present application relates to the technical field of artificial intelligence, in particular to a sign language interaction method, device and computer medium. Background technique [0002] Deaf-mute people have hearing and speaking barriers when communicating with ordinary people. The traditional solution is to let deaf-mute people communicate through sign language or text, but it has certain limitations. On the one hand, text communication is limited by conditions such as reading ability and pen and paper writing ability. On the other hand, sign language is only mastered by some deaf-mute people and very few professionals. Ordinary people do not understand sign language, and it is difficult to communicate with deaf-mute people communicate. [0003] Therefore, how to communicate smoothly with the deaf-mute is a problem that needs to be considered. Contents of the invention [0004] The embodiment of the present application provides a sign lang...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to View More 
Login to View More 
