Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method, system and device for three-dimensional reconstruction of monocular image based on reference plane

A reference plane and three-dimensional reconstruction technology, applied in the field of measurement, can solve problems such as large matching errors of corresponding points, complex structure of binocular stereo vision, and difficulty in precise calibration process, etc., to achieve easy implementation, good scene usability, and simple structure Effect

Active Publication Date: 2019-01-04
JINQIANMAO TECH CO LTD
View PDF8 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Binocular stereo vision simulates the function of human eyes and completes 3D reconstruction through parallax. Compared with monocular vision, it can perform 3D reconstruction of all objects in the image, but binocular stereo vision has complex structure, difficult precise calibration process, and corresponding point matching errors. The big disadvantage is that in scenes where the feature points on the surface of the object are sparse, it is difficult to obtain an accurate shape to complete the 3D reconstruction
Structured light cameras need to cooperate with core components such as laser projectors, optical diffraction elements, and infrared cameras to capture diffuse infrared speckle through infrared cameras and calculate the depth information of each point. bear

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system and device for three-dimensional reconstruction of monocular image based on reference plane
  • Method, system and device for three-dimensional reconstruction of monocular image based on reference plane
  • Method, system and device for three-dimensional reconstruction of monocular image based on reference plane

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0067] Please refer to figure 1 , Embodiment 1 of the present invention is:

[0068] The monocular image three-dimensional reconstruction method based on the reference plane provided by the present invention comprises steps:

[0069] S1. A two-dimensional image is obtained by shooting, and the content of the two-dimensional image is a scene requiring three-dimensional reconstruction;

[0070] S2. Segment the two-dimensional image to obtain multiple reference planes corresponding to the three-dimensional space;

[0071] S3. Complete the three-dimensional reconstruction corresponding to the two-dimensional image according to multiple reference planes;

[0072] S4. Extract projection points of all objects in the two-dimensional image on their corresponding reference planes, and complete three-dimensional reconstruction of all objects.

[0073] It should be noted that the three-dimensional image reconstruction described in the present invention refers to obtaining the coordinat...

Embodiment 2

[0109] refer to figure 2 , the second embodiment of the present invention is:

[0110] A monocular image three-dimensional reconstruction system based on a reference plane provided by the present invention includes one or more processors and a memory, the memory stores a program, and the program implements the following steps when executed by the processor:

[0111] S1. A two-dimensional image is obtained by shooting, and the content of the two-dimensional image is a scene requiring three-dimensional reconstruction;

[0112] S2. Segment the two-dimensional image to obtain multiple reference planes corresponding to the three-dimensional space;

[0113] S3. Complete the three-dimensional reconstruction corresponding to the two-dimensional image according to multiple reference planes;

[0114] S4. Extract projection points of all objects in the two-dimensional image on their corresponding reference planes, and complete three-dimensional reconstruction of all objects.

[0115]...

Embodiment 3

[0151] The present invention also provides a monocular image three-dimensional reconstruction device based on a reference plane, including a camera connected to each other and a three-dimensional reconstruction unit, the camera is configured to capture a two-dimensional image, and the content of the two-dimensional image is as required 3D reconstructed scene;

[0152] The three-dimensional reconstruction unit is configured to segment the two-dimensional image to obtain a plurality of reference planes corresponding to the three-dimensional space; complete the three-dimensional reconstruction corresponding to the two-dimensional image according to the plurality of reference planes; extract the two-dimensional image The projection points of all objects on their corresponding reference planes complete the three-dimensional reconstruction of all objects.

[0153] The camera is specifically configured to rotate the camera to the scene area requiring three-dimensional reconstruction,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the measurement field, in particular to a method, a system and a device for three-dimensional reconstruction of a monocular image based on a reference plane. The method for three-dimensional reconstruction of a monocular image comprise that following step of: capturing a two-dimensional image; dividing the two-dimensional image to obtain a plurality of reference planes ina corresponding three-dimensional space; completing three-dimensional reconstruction corresponding to the two-dimensional image according to a plurality of reference planes; extracting projection points of all objects in the two-dimensional image on their corresponding reference planes, and completing three-dimensional reconstruction of all objects. The invention provides a method, a system and adevice for three-dimensional reconstruction of a monocular image based on a reference plane, which firstly creates a reference plane by utilizing the three-dimensional reconstruction ability of the monocular to the plane, and then maps each object point in the image to each simulation plane based on the reference plane to obtain the depth of each object point, thereby completing three-dimensionalreconstruction of the whole image. The structure is simple, easy to implement and easy to use.

Description

technical field [0001] The present invention relates to the field of measurement, in particular to a method, system and device for three-dimensional reconstruction of a monocular image based on a reference plane. Background technique [0002] Image 3D reconstruction is used in various fields. Monocular vision has a simple structure and is easy to apply. Without the help of known standard objects, it can only perform three-dimensional reconstruction of objects on a single plane specified in the image. Binocular stereo vision simulates the function of human eyes and completes 3D reconstruction through parallax. Compared with monocular vision, it can perform 3D reconstruction of all objects in the image, but binocular stereo vision has complex structure, difficult precise calibration process, and corresponding point matching errors. The biggest disadvantage is that in scenes with sparse feature points on the surface of objects, it is difficult to obtain accurate shapes to comp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T15/10
CPCG06T15/10
Inventor 郑敏忠黄宗荣江世松林大甲
Owner JINQIANMAO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products