Method and system for real-time large-scale scene three-dimensional scanning modeling

A technology of 3D scanning and modeling method, which is applied in the field of 3D modeling and can solve problems such as affecting the scanning quality and practicability, weak camera tracking method, and inability to achieve real-time.

Active Publication Date: 2017-06-16
SHANGHAI YUNNI TECH CO LTD
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Real-time correction is the key to ensuring the consistency of the global model, which poses a huge challenge
[0007] 4. Stable camera tracking: In addition to the increased error per frame, camera tracking may fail in areas where features are not obvious
Updating the model while updating the camera position is a huge challenge
[0009] 6. Real-time: Fast real-time is an indispensable element in many virtual/augmented reality and robotics appli

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for real-time large-scale scene three-dimensional scanning modeling
  • Method and system for real-time large-scale scene three-dimensional scanning modeling

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0070] Hereinafter, exemplary embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0071] The core of the technology of the present invention is a global camera position optimization algorithm, which is suitable for large-scale three-dimensional reconstruction systems. For each frame, the present invention optimizes the camera pose, and updates the reconstructed model according to the new camera prediction. The present invention does not strictly depend on the continuity of time, thereby a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and a system for real-time large-scale scene three-dimensional scanning modeling. The method comprises the following steps: an RGB-D video stream is acquired; global camera pose optimization is carried out on the above video stream to acquire a global camera prediction position; and according to the global camera prediction position, globally-optimized three-dimensional scanning modeling is carried out. Real-time and terminal-to-terminal modeling can be realized. Local camera tracking does not need to rely on, but the globally-optimized camera positioning is kept constantly. A parallel optimization modeling system combining sparse feature points, dense geometry, and color information is brought forward and developed, the globally-optimized camera position can be predicted in real time, camera repositioning is supported, a globally-consistent optimal three-dimensional model can be updated in real time, the system of the invention is applied to large-scale indoor scanning, and a high-quality three-dimensional model can be acquired.

Description

technical field [0001] The present invention relates to the field of three-dimensional modeling, in particular, the present invention relates to a method and system for real-time large-scale scene three-dimensional scanning modeling. Background technique [0002] Real-time high-quality 3D scanning of large-scale scenes is an important application in the field of virtual augmented reality and robotics. The popularity of RGB-D cameras has brought about a huge revolution in 3D scanning. 3D printing, virtual and augmented reality, games, and robotics fields have important requirements for large-scale real-time 3D scanning: robots or ordinary users can instantly obtain synthetic 3D models through real-time scanning, which can be applied to robot navigation and integrate the physical world Introduce a virtual environment, or provide real-time information feedback to users. [0003] However, although 3D reconstruction systems have been developed for a long time, there is still no...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T19/00
CPCG06T17/00G06T19/006
Inventor 黄经纬
Owner SHANGHAI YUNNI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap