Shading judgment method and device based on depth layer

A depth layer and depth technology, which is applied in the field of occlusion judgment method and device based on depth layer, can solve the problems of visual quality decline of virtual viewpoints, unsatisfactory filling effect, distortion, etc., to achieve good image rendering effect and speed up rendering , the effect of enhancing the accuracy

CN103337081AActive Publication Date: 2013-10-02NANJING UNIV
4 Cites 15 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
Publication Date
2013-10-02

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a shading judgment method and a device based on a depth layer, and belongs to the field of computer vision. The method comprises the steps that a depth image of an original image is subjected to histogram counting; the number of pixels corresponding to all gray-scale values of the depth image is counted; envelope detection is performed according to a histogram; a depth counting envelope diagram is obtained, and subjected to neighborhood smoothing filtering; a minimum depth hop is computed according to the smooth depth counting envelope diagram; the minimum position translation quantity on a virtual view is computed accordingly, and serves as a cavity size threshold; and different cavity filling strategies are adopted for cavities with different sizes. The device comprises a depth histogram counting module, an envelope diagram computation module, a depth layer computation module, a cavity size computation module and a cavity size judgment module. The method and the device simplify the complexity of the existing rendering algorithm, accelerate rendering, and greatly improve the accuracy of cavity type judgment.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to the field of computer vision, in particular to a depth layer-based occlusion judgment method and device thereof. Background technique

[0002] In recent years, with the continuous breakthrough of free viewpoint technology in hardware and software research, free viewpoint display has been favored more and more in the fields of medicine, exploration or entertainment.

[0003] In order to make the effect of free view point display better, a variety of image rendering algorithms have emerged. Common rendering algorithms are roughly divided into two categories:

[0004] The first type is the original image plus depth map rendering algorithm (2D plus Z), which is mainly based on the depth value corresponding to the scene point in the depth map, using the internal and external parameter matrix of the camera to calculate, first projecting and then retroreflecting to render a new virtual viewpoint view .

[0005] The second ca...

Examples

Embodiment 1

[0038] This embodiment provides a method for judging the type of voids appearing in a rendered virtual view: selecting a reference image and a depth map of a video frame; performing statistical histogram calculation on the depth image to obtain a histogram corresponding to the view Carry out envelope detection according to the histogram to obtain an envelope; Neighborhood smoothing filtering is carried out on the envelope to obtain a smooth envelope with obvious peak divisions; set the peak division threshold, and The sub-peaks greater than the threshold are regarded as a depth layer; the difference between all the depth layers is calculated in pairs, and the minimum depth layer interval is calculated; the depth threshold is set, and the minimum depth layer interval and the depth threshold are compared; if the minimum depth layer interval greater than the depth threshold, then take the minimum depth layer interval as a parameter; if the minimum depth layer interval is greater t...

Embodiment 2

[0056] see Figure 4 , an embodiment of the present invention provides a device for judging a hole type, which is used for judging the type of a graphic hole, including:

[0057] The depth histogram statistical module 301 is used to generate a depth histogram of images and video frames to count the number of pixels at different depths, and the X-axis represents the depth gray value, and the Y-axis represents the number of pixels.

[0058] Among them, there are many implementation algorithms for the depth histogram. For example, both matlab and opencv have corresponding hist functions. The specific implementation idea is to classify the size of all pixel values ​​​​of the entire image, and then according to the number of pixels each value has Number of plots, with a larger number of pixels has a higher height in the histogram. No specific limitation is made in this embodiment.

[0059] Depth envelope generation module 302, this module obtains the data generated by the depth h...