Sign language recognition system and method based on space-time semantic features

A technology of spatio-temporal semantics and recognition systems, applied in the field of sign language recognition, can solve problems such as communication barriers between deaf and dumb people and the general public

Pending Publication Date: 2020-10-20
NANJING UNIV
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the deficiencies of the above-mentioned prior art, the purpose of the present invention is to provide a sign language recognition system and

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language recognition system and method based on space-time semantic features
  • Sign language recognition system and method based on space-time semantic features
  • Sign language recognition system and method based on space-time semantic features

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0072] In order to facilitate the understanding of those skilled in the art, the present invention will be further described below in conjunction with the embodiments and accompanying drawings, and the contents mentioned in the embodiments are not intended to limit the present invention.

[0073] refer to figure 1 As shown, a sign language recognition system based on spatiotemporal semantic features of the present invention includes: a video data acquisition module, a video data preprocessing module and a sign language recognition module; wherein,

[0074] The video data acquisition module collects sign language video data through common surveillance cameras, external cameras, smart devices (such as smart phones, smart glasses, etc.) built-in cameras or other camera modules;

[0075] The video preprocessing module includes: a video frame resizing module, a data normalization module and a video framing module;

[0076] The video frame resizing module scales the size of the acq...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sign language recognition system and method based on space-time semantic features. The sign language recognition system comprises a video data acquisition module, a video data preprocessing module and a sign language recognition module, wherein the video data acquisition module is used for acquiring sign language video data; the video data preprocessing module preprocesses the video data; and the sign language recognition module performs sign language recognition and outputs a prediction result. According to the sign language recognition system and the method, the semantic gap between the sign language image data and text data is eliminated, the convenient communication with the deaf-mute is realized, and the frontier neural network algorithm is used as a translation tool, so that the correctness of translation is ensured. In addition, the sign language recognition system and the method can further be used as a medium for man-machine interaction, analysis is performed through continuous gestures of the user, and instruction control is performed on intelligent equipment.

Description

technical field [0001] The invention belongs to the technical field of sign language recognition, and specifically refers to a sign language recognition system and method based on spatiotemporal semantic features. Background technique [0002] According to the World Health Organization (WHO), about 466 million people worldwide suffer from hearing impairment in 2018, and it is estimated that by 2050, the number of people suffering from hearing impairment will exceed 900 million. Hearing-impaired people and deaf-mute people use sign language as a medium of communication, but very few ordinary people can master sign language and communicate with it, which makes it difficult for deaf-mute people to communicate with the general public. [0003] Current solutions mainly include human translation, sign language translation based on gloves of different colors and translation based on smart watches. The feasibility of human translation is limited to certain formal occasions, it is d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/42G06N3/04
CPCG06V40/28G06V20/40G06V10/32G06N3/044G06N3/045
Inventor 殷亚凤甘世维谢磊陆桑璐
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap