Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device, electronic equipment and storage medium

A data processing and 3D technology, applied in the information field, can solve the problem of low accuracy and achieve the effect of precise posture

Active Publication Date: 2020-03-24
BEIJING SENSETIME TECH DEV CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the 3D posture in related technologies has the problem of low accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0193] This example provides a data processing method, including:

[0194] For each frame of 3D image, use the two-dimensional key point detection tool of the human body to obtain the coordinates of 14 key points on the image;

[0195]Using the two-dimensional key point coordinates obtained in the first step as input, the 3D key point extraction network is used to obtain the corresponding three-dimensional human skeleton (17 key points, where the position of the key point at the pelvis is fixed as 0).

[0196] The obtained two human body key point models are aligned so that each key point is physically consistent.

[0197] Project the 3D posture back to the 2D imaging plane to obtain the projected 2D coordinates, compare them with the 2D coordinates extracted above, and optimize the 3D posture; at the same time, based on the depth value of the projected 3D features and from the 2D image Compare the depth values ​​extracted in , and further optimize the 3D pose.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data processing method and device, electronic equipment and a storage medium. The data processing method comprises the steps of obtaining 3D features of a target support according to a 3D image of a target, wherein the 3D image comprises a 2D image and a depth image; determining a 3D posture of the target stent according to the 3D features; projecting the3D attitude into a 2D imaging plane to obtain a first 2D coordinate; and optimizing the 3D posture based on the difference between the first 2D coordinate and a second 2D coordinate determined basedon the 2D image.

Description

technical field [0001] The present invention relates to the field of information technology, in particular to a data processing method and device, electronic equipment and a storage medium. Background technique [0002] In somatosensory scenes such as somatosensory games, it is generally necessary for the human body to wear a somatosensory device. The somatosensory device collects the 3D posture of the human body and transmits it to the controlled device for control of the controlled device. However, the control of this controlled device requires the use of somatosensory devices on the one hand. The hardware costs are high and the corresponding devices must be worn, which is not very good for the user experience. In the related art, a depth image collected by a depth camera is used to estimate a 3D pose. However, the 3D pose in the related art has the problem of low accuracy. Contents of the invention [0003] In view of this, the embodiments of the present invention exp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T7/73
CPCG06T7/73G06T2207/20081G06T2207/20084G06T2207/10028G06T2207/10004G06V40/10Y02T10/40
Inventor 谢符宝邹壮刘文韬钱晨
Owner BEIJING SENSETIME TECH DEV CO LTD