Method for reducing reconstruction distortion degree of viewpoint in light field drawing

A distortion degree and viewpoint technology, which is applied in the field of reducing the reconstruction distortion degree of viewpoints, can solve the problems of extremely complex changes in occlusion phenomena, difficult mathematical quantification modeling of occlusion phenomena, and no rules to follow, etc., so as to improve the quality of viewpoint rendering and improve the Effects of interactivity and stereoscopic experience

Active Publication Date: 2019-10-18
GUANGXI NORMAL UNIV
View PDF14 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003]The current sampling and reconstruction theory of light field rendering technology is based on the assumption that the scene has no occlusion phenomenon, the main reason is that the occlusion phenomenon varies with the scene and position The change of occlusion is extremely complex and has no rules to follow, which brings difficulties to the mathematical quantitative modeling of the occlusion phenomenon. However, in the actual three-dimensional scene, the occlusion phenomenon always exists in various forms, based on the ideal assumption of no occlusion Light field rendering technology is usually difficult to meet the needs of practical applications, so there will always be some distortion in viewpoint reconstruction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for reducing reconstruction distortion degree of viewpoint in light field drawing
  • Method for reducing reconstruction distortion degree of viewpoint in light field drawing
  • Method for reducing reconstruction distortion degree of viewpoint in light field drawing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] refer to figure 1 , a method for reducing the reconstruction distortion of a viewpoint applied in light field rendering, comprising the following steps:

[0047] 1) Construct a 3D scene with occlusion: Use 3dMAX to construct a 3D scene with foreground objects and background objects. The foreground objects partially block the background objects visually, thereby causing background objects to appear during the scene information capture process The lack of partially occluded edge information, such as figure 2 The Buddha statue in the foreground blocks the trees in the background. In a 3D scene with occlusion, a set of cameras is used to shoot the scene at different positions to obtain a set of multi-viewpoint images of the scene. Since the scene will be occluded, when using the camera In the process of shooting scenes at different locations, there will always be large differences in the captured information, and even some key information is missing. Therefore, the phenom...

Embodiment 2

[0067] The occlusion mathematical model in Embodiment 1 can be applied to fields involving stereoscopic information capture and rendering, especially computational imaging, computational vision and virtual reality, etc. This example is an example of applying the occlusion model in Embodiment 1 to light field sampling The application, first, determines the optimal depth of view for the camera using the formula:

[0068]

[0069] Then, the occlusion quantization model in Example 1 can be applied to the calculation of the light field sampling rate, that is, the calculation of the sampling interval of (t, v), where t is used to represent the position of the camera,

[0070] For a given 2D light field p(t,v), its Fourier transform can be written as:

[0071]

[0072] Here ω t ,ω v are the frequencies along the camera position axis t and the imaging plane axis v, respectively. Based on the occlusion mathematical model in Embodiment 1, the ray expression considering the occlu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for reducing the reconstruction distortion degree of a viewpoint in light field drawing, and the method comprises the following steps: 1) constructing a 3D scene witha shielding phenomenon; 2) carrying out quantitative description of shielding; 3) obtaining the camera position with the minimum shielding degree; and 4) reconstructing a new viewpoint at any positionand in any direction. According to the method, data acquisition and multi-view drawing in an actual complex scene can be realized; compensation of edge information loss in computational imaging and virtual reality caused by a shielding phenomenon can be solved, the method can even be applied to quantitative description of a three-dimensional scene shielding phenomenon of a 3D video technology, and the interactivity and the three-dimensional experience of the 3D video technology can be improved.

Description

technical field [0001] The invention relates to technologies in the field of computational imaging and virtual reality, in particular to a method for improving viewpoint quality in light field rendering, that is, reducing viewpoint reconstruction distortion. Background technique [0002] With the progress of society and the development of science and technology, computational imaging and virtual reality are playing an increasingly important role in people's lives. The application of computational imaging and virtual reality in 3D video technology can improve the quality of imaging and enhance the sense of three-dimensional experience. Therefore, computational imaging and virtual reality technology can be applied to entertainment, national life, industrial applications, military and other fields. Light field rendering technology (light field rendering, LFR for short) is a common method for computing imaging and virtual reality. It obtains a set of multi-viewpoint images by pl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T15/20G06T15/50
CPCG06T15/205G06T15/503
Inventor 刘燕祝常健曾艺君苏允菲卫慧吴琪芳
Owner GUANGXI NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap