A pre-background separation method based on three-dimensional reconstruction results

A technology of front-background separation and 3D reconstruction, applied in the field of dense triangular patch generation, which can solve the problem of inability to separate stationary objects in natural backgrounds

Active Publication Date: 2019-02-15
SOUTHEAST UNIV
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Technical problem: In view of the problems existing in the prior art, the purpose of the present invention is to provide a foreground-background separation method based on three-dimensional reconstruction results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A pre-background separation method based on three-dimensional reconstruction results
  • A pre-background separation method based on three-dimensional reconstruction results
  • A pre-background separation method based on three-dimensional reconstruction results

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The key technologies and specific implementation methods in the present invention will be described in detail below in conjunction with the drawings and specific embodiments.

[0055] figure 1 Shown is a schematic flow chart of the method of the present invention.

[0056] Step S1: Take a series of photos of the target object, use the cylinder separation background generated by the pose information of the camera and the fitting method vector information of the camera trajectory, and construct a sparse point cloud for the target object. The specific steps are:

[0057] S1.1. Take a picture every 10°-20° around the target object, make the camera pose and the normal vector of the camera trajectory form a cylinder to separate the background, and obtain the 360° image information of the target object;

[0058] S1.2. Preprocess the photos, filter out image noise, and use the SIFT algorithm to extract feature points on each photo;

[0059] S1.3. Calibrate the camera, match t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a pre-background separation method based on three-dimensional reconstruction results. A target object is taken by a photo every 10-20 angles with a camera. The camera's motiontrajectory is a circle. The two-dimensional limited Delaunay triangulation algorithm is used to construct the initial spatial triangle mesh. The mesh is diffuse and encrypted and then reconstructed using three-dimensional reconstruction. The algorithm (PMVS) performs patch optimization and filtering to obtain a dense point cloud, and then constructs a dense triangular mesh; the pixels surrounded by the triangular patches of the target object are assigned according to the texture, and the surface shape information of the target object is obtained through the bump mapping; The weight of the target object is projected onto the blank photo, and the depth buffer matrix of the photo is set. By comparing the depth buffer value of the pixel with the triangle patch depth value on the target object,the depth information is retained or discarded, and finally a clean foreground photo is obtained. The present invention can separate stationary foreground objects in a natural background.

Description

technical field [0001] The invention relates to the generation of dense triangular faces to realize a front-background separation technology based on three-dimensional reconstruction results. Background technique [0002] Foreground and background separation technology is to separate the foreground object in the image or video from the background as accurately as possible. The foreground and background here are generalized. The foreground is any part we are interested in, while the background is the part we are not interested in. . Foreground and background separation technology has been widely used in the production of digital images and videos. Almost all image and video production software, film special effects production, and TV lens synthesis will use this technology, so its research is very important. [0003] So far, scholars at home and abroad have proposed a variety of effective image foreground and background separation techniques, and the research results are qui...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/194G06T7/80G06T17/30
CPCG06T17/30G06T2207/10004G06T2207/30244G06T7/194G06T7/80
Inventor 张小国
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products