三维人体关键点检测方法、装置、电子设备及存储介质

By using a separate 3D human keypoint prediction model and generating pixel coordinate and depth coordinate heatmaps through convolutional neural networks, the problems of speed and accuracy of 3D human keypoint detection are solved, making it suitable for mobile terminals.

CN115965996BActive Publication Date: 2026-07-17JINGDONG TECH HLDG CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
JINGDONG TECH HLDG CO LTD
Filing Date
2023-01-09
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

In existing technologies, three-dimensional human key point detection methods have the problem of balancing speed and accuracy. Three-dimensional heat map prediction models have many parameters and large computational load, making them unsuitable for mobile terminals. Regression prediction models have low prediction accuracy.

Method used

A separate 3D human key point prediction model is adopted. Image features are extracted through convolutional neural networks to generate pixel coordinates and depth coordinate heatmaps of human key points, which are then fused to obtain 3D coordinates. The training process and the inference process are separated, which reduces the amount of computation and improves accuracy.

Benefits of technology

It achieves fast and accurate 3D human key point detection, reduces the number of model parameters and computational load, and is suitable for mobile terminals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115965996B_ABST
    Figure CN115965996B_ABST
Patent Text Reader

Abstract

本公开提供一种三维人体关键点检测方法、装置、电子设备及存储介质,其中,所述方法包括获取待检测人体图片;将所述待检测人体图片输入至检测模型,得到所述检测模型输出的人体关键点像素坐标热力图和人体关键点深度坐标,其中,所述检测模型至少包括已训练第一卷积核和已训练第二卷积核,所述已训练第一卷积核用于卷积生成所述人体关键点像素坐标热力图,所述已训练第二卷积核用于基于所述人体关键点像素坐标热力图卷积生成所述人体关键点深度坐标;基于所述人体关键点像素坐标热力图和所述人体关键点深度坐标,得到所述待检测人体图片中的人体关键点三维坐标。通过本公开能够快速且准确的检测三维人体关键点。
Need to check novelty before this filing date? Find Prior Art