A human posture regression method and system based on point cloud semantic enhancement

A regression method and hand gesture technology, applied in the computer field, can solve problems such as large memory usage, low performance of gesture regression, and unfavorable hand gesture estimation.

Active Publication Date: 2018-12-25
TSINGHUA UNIV
View PDF4 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, 3D voxels need to quantify the continuous coordinate information, which introduces quantization errors, which is not good for accurate hand pose estimation.
At the same time, the 3D CNN method takes up a lot of memory, especially when the 3D voxel re

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A human posture regression method and system based on point cloud semantic enhancement
  • A human posture regression method and system based on point cloud semantic enhancement
  • A human posture regression method and system based on point cloud semantic enhancement

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0022] Using computer vision to obtain human information in the process of human-computer interaction in virtual operation has great advantages in the naturalness and cost of interaction, which is the main trend of future development. Since the information of the human hand cannot be directly obtained by the computer, the estimation of human hand pose parameters has become a basic work. Only by obtaining accurate human hand posture parameters can the virtual hand in the scene be driven to ensure the virtual-real consistency of human-computer interaction.

[0023] Existing human hand pose estimation methods need to convert the depth image into a voxel representation and th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method and system for human posture regression based on semantic enhancement of point cloud is provided in that embodiment of the present invention. The method comprises steps extracting the point cloud features of the hand point cloud data, and classifying them point by point, obtaining semantic segmentation information of hand point cloud data, Hand-point cloud data being semantically enhancebased on semantic segmentation information, based on the hand point cloud data after semantic enhancement, and geometrically transforming the hand posture prediction result, so that that regression result of the hand posture are obtained. The method of geometric transformation of input data and output data by network learning makes the method of human pose estimation more robust to the geometric transformation of input data. The semantic information of input point cloud classification sub-network and attitude regression sub-network are fused effectively, and the performance of human pose estimation is further improved.

Description

technical field [0001] The present invention relates to the field of computer technology, more specifically, to a method and system for hand gesture regression based on point cloud semantic enhancement. Background technique [0002] In vision-based human-computer interaction, hand pose estimation refers to accurately predicting the three-dimensional coordinate position of the skeleton nodes of the human hand, which has broad application prospects in the fields of virtual reality, augmented reality, and human-computer interaction. The problem of hand pose estimation has been a hot research point in the field of computer vision in the past ten years. [0003] Vision-based hand pose estimation methods can be divided into two categories: one is the appearance-based method; the machine learning is used to establish a mapping from the two-dimensional image feature space to the three-dimensional hand pose space to estimate the state of the hand, and the advantages of the appearance...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/107G06V40/28G06F18/24
Inventor 王贵锦陈醒濠杨华中
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap