Hand three-dimensional model reconstruction method and device, electronic equipment and storage medium

A 3D model and hand technology, applied in the field of computer vision, can solve the problems of low efficiency of 3D model construction, and achieve the effect of rich details, easy implementation, and simple equipment

Pending Publication Date: 2021-03-16
TSINGHUA UNIV +1
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method of building a 3D model of the human hand is inefficient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hand three-dimensional model reconstruction method and device, electronic equipment and storage medium
  • Hand three-dimensional model reconstruction method and device, electronic equipment and storage medium
  • Hand three-dimensional model reconstruction method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0071] It should be noted that the terms "first" and "second" in the specification and claims of the present disclosure and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of computer vision, and discloses a hand three-dimensional model reconstruction method and device, electronic equipment and a storage medium, which are used for improving the reconstruction efficiency of a hand three-dimensional model. According to the embodiment of the invention, the method comprises the steps of collecting a hand region of a target object through a single RGBD camera, and obtaining an RGB image and a depth image corresponding to the hand region; determining three-dimensional coordinate information of hand key points in the hand region according to the RGB image and the depth image; geometric calibration is carried out based on the three-dimensional coordinate information of the hand key points to obtain shape parameters of a hand geometric contour; extracting textures of the hand region from the RGB image to generate a skin texture map; and generating a hand three-dimensional model according to the shape parameters and the skin texture map. Because the hand three-dimensional model is reconstructed based on the single RGBD camera, the hand three-dimensional model reconstruction process is simplified; and the hand three-dimensional model generated by adopting the hand three-dimensional model reconstructed by the embodiment of the invention is more vivid and has richer details.

Description

technical field [0001] The present disclosure relates to the field of computer vision, in particular to a reconstruction method, device, electronic equipment and storage medium of a three-dimensional model of a hand. Background technique [0002] In recent years, due to the rapid development of three-dimensional sensors and three-dimensional application scenarios such as augmented reality (Augmented Reality, AR), virtual reality (Virtual Reality, VR), games and animations, the application of three-dimensional vision has gradually become popular. 3D modeling is an important application direction of computer vision. [0003] In fields such as AR, VR, games, and animation, it is necessary to reconstruct 3D animation from single-view or multi-view 2D images. In order to generate more realistic animations including the hands of characters and improve the user experience, it is necessary to construct a 3D model of the human hands. However, in the fields of AR, VR, games, and ani...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T7/55G06T7/529G06T7/73G06T7/80
CPCG06T17/00G06T7/529G06T7/55G06T7/73G06T7/80
Inventor 徐枫张浩刘裕峰郭小燕郑文
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products