Human body key point detection method based on deep learning

A deep learning and detection method technology, applied in the field of computer vision, to achieve the effect of strong mechanism robustness, high precision and fast speed

Active Publication Date: 2019-09-24
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF8 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the shortcomings of traditional detection methods that are difficult to balance accuracy and complexity, the present invention proposes a human body key point detection method based on deep learning, and designs a new expanded convolution residual network to build a human body key point detection network. High detection accuracy can be achieved without using a large network, and the mechanism is robust, so this method has high practical value

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body key point detection method based on deep learning
  • Human body key point detection method based on deep learning
  • Human body key point detection method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0034] Such as figure 1 Shown is a flow chart of a human body key point detection method based on deep learning proposed by the present invention, including steps such as data acquisition, network construction, model training and evaluation, and optimal model prediction. The present invention constructs a stacked expanded convolution pyramid network structure SDPN for prediction, including model training and prediction using a trained model.

[0035] Model training includes the following steps:

[0036] Step 1) Get data. The training data includes pictures and tag files, and the annotation includes two parts, the pedestrian detection frame and the coordinates of key points of the human body, mainly using public data sets. The public data set refers to the data related to the human body key point detection task of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human body key point detection method based on deep learning. The method comprises the steps of data acquisition, network construction, model training and evaluation, optimal model prediction and the like. According to the method, the ResNet50 network is improved, an expanded convolution residual network is provided, and a two-stage expanded convolution residual network is adopted to construct a human body key point detection network. During model training, feature extraction is performed on training data by the first-stage network, prediction is performed by using four channels, loss of all key points in a prediction result are calculated, and the loss is returned to adjust network parameters; the input feature map, the output feature map and the prediction result of the first-stage network are added by adopting an intermediate stage, and are transmitted to a second stage; and feature extraction is performed by the second-level network, prediction is performed on the finally obtained feature map after two-layer transposition, key point loss of a prediction result is calculated, the key point loss is sorted according to a descending order, and the first K * B losses are selected to return and adjust network parameters. An optimal training model is selected to predict human body key points of the to-be-detected image, the precision is high, and the practicability is good.

Description

technical field [0001] The invention belongs to the field of computer vision technology, and has wide application requirements in the fields of public security, somatosensory game entertainment, human-computer interaction, standard action analysis, etc., and is precisely a human body key point detection method based on deep learning. Background technique [0002] Human body key point detection is an important topic in the field of computer vision. The main task is to detect human body key points (usually some joint points or parts) in a given image, input an image containing pedestrians, and output the image Including all key point coordinates of all people, the current pose can be obtained from these coordinate information. Due to the different scales of each pedestrian, the interaction between pedestrians is also very complicated, such as mutual occlusion or occlusion by other objects, as well as background and clothing interference, complex and variable human body movemen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62
CPCG06V40/23G06V10/40G06F18/241G06F18/214
Inventor 李纯明胡保林
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products