Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional reconstruction and related interaction and measurement methods and related devices and equipment

A technology for 3D reconstruction and preset images, applied in the field of computer vision, can solve the problems of affecting the effect of 3D models and increasing the calculation load

Pending Publication Date: 2021-05-07
ZHEJIANG SENSETIME TECH DEV CO LTD
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, when the camera device scans and shoots objects in the real scene, the images obtained from the camera device have different degrees of noise, and the current mainstream camera pose parameter solution method will inevitably introduce some errors. Errors accumulate with scanning and shooting, which affects the effect of the 3D model. In addition, as the field of view of scanning and shooting expands during the entire 3D reconstruction process, newly captured images are continuously integrated, and the calculation load is gradually increasing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional reconstruction and related interaction and measurement methods and related devices and equipment
  • Three-dimensional reconstruction and related interaction and measurement methods and related devices and equipment
  • Three-dimensional reconstruction and related interaction and measurement methods and related devices and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The solutions of the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.

[0057] In the following description, for purposes of illustration rather than limitation, specific details, such as specific system architectures, interfaces, and techniques, are set forth in order to provide a thorough understanding of the present application.

[0058] The terms "system" and "network" are often used interchangeably herein. The term "and / or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the character " / " in this article generally indicates that the contextual objects are an "or" relationship. In addition, "many" herein means two or more than two.

[0059] see figure 1 , figure 1 It ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a three-dimensional reconstruction and related interaction and measurement method, a related device and equipment, and the method comprises the steps of obtaining a plurality of to-be-processed images obtained by scanning a to-be-reconstructed target through a camera device; determining target pixel points and camera pose parameters of each frame of to-be-processed image belonging to the to-be-reconstructed target by using each frame of to-be-processed image and the calibration parameters of the camera device; dividing the image data of each frame of to-be-processed image into a corresponding data set in sequence; determining a pose optimization parameter of the data set by using the image data of the data set and the image data and pose optimization parameters of the data set of which the time sequence is located before the image data of the data set; adjusting a camera pose parameter of the to-be-processed image to which the image data contained in the data set belongs by using the pose optimization parameter of the data set; and performing reconstruction processing on the image data of the to-be-processed image to obtain a three-dimensional model of the to-be-reconstructed target. According to the scheme, the three-dimensional reconstruction effect can be improved, and the calculation load of three-dimensional reconstruction is reduced.

Description

technical field [0001] The present application relates to the technical field of computer vision, in particular to a three-dimensional reconstruction and related interaction, measurement method and related devices and equipment. Background technique [0002] With the development of information technology and the improvement of electronic technology, people are more and more fond of using mobile terminals such as mobile phones and tablet computers integrated with camera devices to perform 3D reconstruction of objects in real scenes, so that the 3D images obtained by 3D reconstruction The model implements augmented reality (Augmented Reality, AR), games and other applications on mobile terminals. [0003] However, when the camera device scans and shoots objects in the real scene, the images obtained from the camera device have different degrees of noise, and the current mainstream camera pose parameter solution method will inevitably introduce some errors. Errors accumulate w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T7/73G06T7/55
CPCG06T17/00G06T7/73G06T7/55G06T2207/10016G06T2200/08
Inventor 项骁骏齐勇章国锋鲍虎军余亦豪姜翰青
Owner ZHEJIANG SENSETIME TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products