Method for hand posture estimation from single color image based on attention mechanism

A color image, pose estimation technology, used in image enhancement, image analysis, image data processing and other directions
CN110210426AActive Publication Date: 2019-09-06NAT UNIV OF DEFENSE TECH
11 Cites 5 Cited by

Patent Information

Authority / Receiving Office
CN ยท China
Patent Type
Applications(China)
Current Assignee / Owner
NAT UNIV OF DEFENSE TECH
Publication Date
2019-09-06

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a method for carrying out hand posture estimation from a single color image based on an attention mechanism, which comprises the following steps of: obtaining the single color image with a hand state through an image obtaining device, and cutting out a hand region image from the single color image; extracting a 2D joint heat map according to the hand region image; cascadingthe 2D joint heat map and the hand area image, and obtaining a 3D hand joint point position and a rotation angle of the image acquisition device under an image acquisition device coordinate system according to an attention mechanism; and carrying out hand state estimation according to the position of the 3D hand joint point and the rotation angle. According to the invention, the 2D articulation point and the characteristics of the RGB image are fused in the channel level. The features of the color image and the 2D articulation point are cascaded and weight is replanned and the features of eachpart are reasonably planned and utilized. A channel attention mechanism is also introduced, so that the fusion effect of different types of feature maps is improved. Hand postures are accurately estimated through a fusion channel attention mechanism.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to a hand pose estimation method, in particular to a method for hand pose estimation from a single color image based on an attention mechanism. Background technique

[0002] Gesture estimation plays an important role in computer science to allow computers to understand human gestures algorithmically. Gesture estimation based on computer vision enables people to communicate with machines more naturally. Its advantage is that it is less affected by the environment. Let the computer understand the instructions issued by people in a timely and accurate manner without any mechanical assistance. Gestures are timely, vivid, intuitive, flexible and vivid in the process of human-computer interaction, and can complete human-computer interaction silently, successfully breaking the gap between reality and virtuality.

[0003] With the development of computer vision, gesture estimation no longer relies on traditional wearable devices, but di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More