Real-time reconstruction method and device for hand and object interaction process

An object and object segmentation technology, applied in the input/output of user/computer interaction, the input/output process of data processing, 3D modeling, etc., can solve problems such as insufficient research, and achieve the effect of solving real-time reconstruction problems

Active Publication Date: 2019-07-12
TSINGHUA UNIV
View PDF10 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the current research on motion reconstruction of opponent-object interaction is very insufficient.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time reconstruction method and device for hand and object interaction process
  • Real-time reconstruction method and device for hand and object interaction process
  • Real-time reconstruction method and device for hand and object interaction process

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0058] The following describes the real-time reconstruction method and device of the hand-object interaction process according to the embodiments of the present invention with reference to the accompanying drawings. First, the real-time reconstruction method of the hand-object interaction process according to the embodiments of the present invention will be described with reference to the accompanying drawings.

[0059] figure 1 It is a flow chart of the real-time reconstruction method of the hand-object interaction process accor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time reconstruction method and device for a hand and object interaction process, and the method comprises the following steps: carrying out the data segmentation of to-be-processed depth image data, obtaining a hand and object segmentation result, and obtaining gesture posture prediction data, and the hand and object segmentation result comprising object data and hand data; dividing the prediction data and the hand and object into constraint terms to optimize the unified energy function, so as to obtain a hand motion sequence and an object non-rigid motion sequence; and fusing the object data into the object model to obtain an object static model, and obtaining a real-time reconstruction result of the hand and object interaction process according to the handmotion sequence, the object non-rigid motion sequence and the object static model. The method can effectively solve the real-time reconstruction problem of hand and object interactive motion, and canobtain hand motion, object motion and object geometric models in real time.

Description

technical field [0001] The invention relates to the technical fields of computer vision and computer graphics, in particular to a real-time reconstruction method and device for the interaction process between a hand and an object. Background technique [0002] The interactive motion of hands and objects is a very common activity in people's daily life, and the reconstruction of the interactive motion between hands and objects is a problem that must be solved for the full 3D reconstruction of human activities. Moreover, the interaction between hands and objects not only contains human intentions, but also reflects a person's health status. [0003] Therefore, it is of great scientific significance to reconstruct the interaction process between the opponent and the object. Gesture tracking and object motion and model reconstruction are two problems directly related to hand-object interaction motion reconstruction, and they are also two important and basic problems in the fiel...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T17/00
CPCG06F3/011G06F3/017G06T17/00
Inventor 徐枫张浩杨东
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap