Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for generating real color data of complex interaction between hands with labels and objects

A technology for color data and objects, applied in the field of neural networks

Active Publication Date: 2020-08-25
TSINGHUA UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are few mature real color data generation schemes that do not destroy visual information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for generating real color data of complex interaction between hands with labels and objects
  • Method and device for generating real color data of complex interaction between hands with labels and objects
  • Method and device for generating real color data of complex interaction between hands with labels and objects

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0048] The following describes the method and device for generating real color data of complex interactions between hands and objects with annotations according to the embodiments of the present invention with reference to the accompanying drawings.

[0049] Firstly, a method for generating real color data of complex interactions between a hand and an object with labels according to an embodiment of the present invention will be described with reference to the accompanying drawings.

[0050] figure 1 It is a flow chart of a meth...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for generating real color data of complex interaction between a hand with a label and an object. The method comprises the following steps: using two RGBDcameras which are oppositely arranged to collect the interaction process of a human hand and an object; obtaining two groups of color-depth data pair sequences, reconstructing an interaction process by using depth data, obtaining a human hand posture, an object geometry and an object posture, converting the human hand posture, the object geometry and the object posture into a color camera coordinate system, and establishing a data set of monocular RGB and the human hand posture and the object geometry and the object posture. According to the method, the human hand and object interaction part is segmented on the depth sequence, the human hand posture and the object geometry and posture are reconstructed, and color data cannot be damaged.

Description

technical field [0001] The invention relates to the technical field of neural networks, in particular to a method and device for generating real color data of complex interaction between a marked hand and an object. Background technique [0002] Interaction between human hands and objects is a very common scene in daily life, and the interaction process between hands and objects contains a wealth of information. Reconstructing the interaction process between human hands and objects is an important research field of computer vision, and it has very important application value for industries such as AR / VR, HCI and intelligent robots. In the field of computer vision and vision-related industries, color cameras are the most widely used vision sensors. With the development of artificial intelligence, using neural networks to process monocular color image sequences to reconstruct the interaction process between human hands and objects is a hot research issue and the most promisin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00
CPCG06T2207/10016G06T2207/10024G06T2207/10028G06T2207/30196G06T2207/20081G06T2207/20084G06T5/77
Inventor 徐枫张浩杨东
Owner TSINGHUA UNIV