Model training method, human body posture detection method and device, equipment and medium

A technology of model training and posture, which is applied in the field of equipment and media, model training methods, human posture detection methods, and devices. It can solve the problems of lack of high-quality unconstrained scene labeling data, difficulties in model convergence, and inability to realize accurate detection of human body three-dimensional postures, etc. question

Pending Publication Date: 2021-02-02
有半岛(北京)信息科技有限公司
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the existing pose detection neural network model for human body 3D pose detection has the following problems: 1) Due to the lack of effective natural scene 3D human body labeling methods in the industry, there is currently a lack of high-quality unconstrained scene labeling data; 2) The model has problems with convergence difficulties
As a result, it is impossible to accurately detect the three-dimensional posture of the human body in natural scenes based on the existing posture detection neural network model.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model training method, human body posture detection method and device, equipment and medium
  • Model training method, human body posture detection method and device, equipment and medium
  • Model training method, human body posture detection method and device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0055] figure 2 A schematic flow chart of a model training method provided in Embodiment 2 of the present invention is given. This Embodiment 2 is optimized based on the above-mentioned embodiment. In this embodiment, further according to the data form of the image training sample, The first loss function corresponding to the current iteration is optimized as follows: when the data form of the image training sample is the labeled form of natural scene sample image-key point two-dimensional coordinates, the current output from the pose detection network model Extract the first current probability heat map from the results; obtain a predetermined first standard probability heat map, and obtain the corresponding first probability heat map under the current iteration according to the first standard probability heat map and the first current probability heat map A loss function; wherein, the first standard probability heat map is determined by converting the two-dimensional coordi...

Embodiment 3

[0108] image 3 It is a schematic flowchart of a human body posture detection method provided by Embodiment 3 of the present invention. The method can be executed by a human body posture detection device, wherein the device can be implemented by software and / or hardware, and generally can be integrated into a computer device. like image 3 As shown, the method includes:

[0109] S301. Acquire a real-scene image of a person to be detected.

[0110] Exemplarily, the real-scene image of the person can be obtained by a conventional image capture device, and the image capture device can be a mobile phone, a notebook or a tablet with a camera, and the like. When there is a requirement for human body posture detection, this step can be used to obtain the real-scene image of the person to be detected first.

[0111] S302. Input the real-scene image of the person into a preset pose detection network model.

[0112] Wherein, the preset posture detection network model is trained by a...

Embodiment 4

[0123] Figure 4 It is a structural block diagram of a model training device provided by Embodiment 4 of the present invention. The device can be implemented by software and / or hardware, and generally can be integrated into a computer device, and model training can be performed by executing a model training method. like Figure 4 As shown, the device includes: a first information determination module 41 , a second information determination module 42 and a model training module 43 .

[0124] Wherein, the first information determination module 41 is configured to input the image training samples corresponding to the current iteration into the current posture detection network model, and obtain the corresponding first image training samples under the current iteration according to the data form of the image training samples. loss function;

[0125] The second information determination module 42 is configured to perform reprojection processing on the current output result of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a model training method, a human body posture detection method and device, equipment and a medium, and the method comprises the steps: inputting a corresponding image trainingsample under the current iteration into a current posture detection network model, obtaining a corresponding first loss function under the current iteration according to the data form of the image training sample, carrying out reprojection processing on a current output result of the attitude detection network model according to the obtained camera parameters, acquiring a corresponding second lossfunction under current iteration based on a reprojection processing result, and performing back propagation on the attitude detection network model based on a fitting loss function formed by the first loss function and the second loss function to obtain an attitude detection network model for the next iteration. By utilizing the method, the collection difficulty of training samples is reduced, the easiness in implementation of network training is ensured, and meanwhile, the whole model training is completed in an image domain, so that the stability and the rapid convergence of the model training are facilitated.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of spatial position detection, and in particular to a model training method, a human body posture detection method, a device, a device, and a medium. Background technique [0002] With the rapid development of artificial intelligence technology, artificial neural networks have been widely used. Artificial neural network, also known as neural network, is a model that simulates the structure of brain synaptic connections for information processing. In the field of three-dimensional space position detection, neural network technology can be used to construct a pose estimation neural network model for human three-dimensional pose detection. [0003] The detection of the three-dimensional posture of the human body has become an important problem in the field of computer vision. This type of technology can be considered as the basis for computers to understand human behavior. It has bro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04
CPCG06V40/20G06N3/045G06F18/214G06N3/084G06N3/04G06N3/08G06V10/82G06V40/23
Inventor 贾森
Owner 有半岛(北京)信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products