Dynamic sign language semantic recognition system and method based on depth image

A deep image and semantic recognition technology, applied in the field of semantic recognition, to achieve the effect of low system coupling

Inactive Publication Date: 2019-07-09
哈尔滨拓博科技有限公司
View PDF7 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the existing technical problems and pr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic sign language semantic recognition system and method based on depth image
  • Dynamic sign language semantic recognition system and method based on depth image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0050] combine figure 1 , the present invention proposes a dynamic sign language semantic recognition system based on depth images, including:

[0051] The image capture module is used to capture the operator's depth image video data and transmit each frame of depth image to the image analysis module;

[0052] The image analysis module is used to process the depth image video data, obtain the 3D coordinates of the hand joints and output them to th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a dynamic sign language semantic recognition system and method based on a depth image. According to the system and the method, depth image video information of an operator is acquired; the video information is processed to obtain hand joint information, sign language words are analyzed through the joint information; inputting each word into a semantic analysis model; and judging whether the semantic expression is complete or not, and directly outputting or converting control commands to other control units when the intention expression is complete, so that the sign language actions are translated into characters, a machine or an operating system is controlled, and hearing impairment people can be better integrated into social life.

Description

technical field [0001] The invention belongs to the technical field of semantic recognition, in particular to a system and method for dynamic sign language semantic recognition based on depth images. Background technique [0002] In principle, sign language recognition control can be divided into binocular camera-based and depth image-based three-dimensional regression. In gesture analysis, only simple gesture recognition and simple sign language words are supported. Among them, based on the binocular camera, the method of calculating the depth information of the feature points of the object by simultaneously shooting the object with the binocular camera is used for image recognition, thereby analyzing the gesture information. The 3D regression scheme based on depth images mainly relies on the image captured by the depth camera for the gesture and the distance information between each point in the shooting scene and the depth camera to establish a 3D model of the gesture. G...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/06
CPCG06N3/049G06V40/28G06N3/044
Inventor 刘禹欣李文越杜国铭赵雪洁宁可
Owner 哈尔滨拓博科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap