Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Augmented reality occlusion method based on image segmentation and custom layer method

An image segmentation and augmented reality technology, applied in 3D image processing, image data processing, instruments, etc., can solve the problem of difficulty in obtaining scene depth information, and achieve the goal of overcoming poor real-time performance, reducing difficulty and separation accuracy. Effect

Active Publication Date: 2020-06-05
COMMUNICATION UNIVERSITY OF CHINA
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In the process of realizing the present invention, the inventor found that there are at least defects in the prior art, such as the problem that it is difficult for the traditional mobile terminal to obtain scene depth information.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality occlusion method based on image segmentation and custom layer method
  • Augmented reality occlusion method based on image segmentation and custom layer method
  • Augmented reality occlusion method based on image segmentation and custom layer method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The preferred embodiments of the present invention will be described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.

[0039] Specifically, the augmented reality occlusion method based on image segmentation and custom layer method includes:

[0040] Step 1: Obtain prior knowledge, which includes the spatial position information of the virtual object in the real scene and the object attribute information of the real object;

[0041] Step 2: Define the spatial position relationship of each layer in the scene according to the prior knowledge obtained in step 1, and fill in the corresponding content;

[0042] Step 3: Extract real occluders;

[0043] Step 4: Occlusion rendering.

[0044] Specifically, Step 1 is to collect the spatial position information of the virtual object in the re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an augmented reality shielding method based on image segmentation and the customized layer method. The method mainly comprises steps of acquiring prior knowledge, self-defining a space position relation of each layer in a scene according to the acquired prior knowledge and carrying out corresponding content filling; extracting a true shielding object; and carrying out shielding rendering. According to the invention, the defect of quite poor timeliness of a shielding method of depth calculation in an operation process in the prior art can be overcome; the defect that three-dimensional modeling and coverage completion of true objects are mainly achieved depending on manual setting of markers in a model reconstruction-based shielding method due to the high difficulty are overcome; and it is achieved that difficulty in effectively separating a background in a real scene from a to-be-shielded foreground target is reduced and the method is characterized by the separation accuracy.

Description

technical field [0001] The invention relates to the technical field, in particular to an augmented reality occlusion method based on image segmentation and a custom layer method. Background technique [0002] In the augmented reality scene, the occlusion relationship between virtual and real objects can be divided into two categories: (1) the occlusion of the virtual object to the real scene; (2) the occlusion of the real object to the virtual scene. The former effect is achieved in most augmented reality systems. In addition to the existence of real objects in the real scene, the augmented reality scene with the real background as the background must also be considered, so when realizing the occlusion of the virtual scene by the real object, how to effectively combine the background in the real scene with the occluded foreground target Separation has become a research focus. Among the virtual and real occlusion methods proposed so far, they can be roughly divided into thr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T15/40G06T19/00
CPCG06T15/40G06T19/006
Inventor 吕朝辉阳星芸张岳
Owner COMMUNICATION UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products