Panoramic Image Rendering Depth Buffer Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Panoramic image rendering technologies face high rendering overheads and resource wastage due to repeated rendering of overlapping parts between foreground and background images, which affects rendering efficiency and resource utilization.

Innovation Solution

An image rendering method that sets depth values for pixels on a canvas, using a first depth value for pixels occupied by the foreground image and a depth reference value for pixels not occupied, allowing for efficient rendering by stopping redundant pixel rendering based on these values, thereby improving rendering efficiency and reducing resource wastage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the layer principle is used to superimpose foreground image on panoramic background image, then the foreground elements can be displayed on the panoramic image, but the overlapping parts need to be rendered repeatedly, resulting in very high rendering overheads

Engineering Contradiction:
Improvecapability to superimpose foreground elementsVSAvoidrendering efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The rendering process is segmented into two distinct phases: first rendering the background panoramic image to the display buffer, then rendering the foreground image with depth testing to determine which pixels should be updated. This segmentation avoids redundant rendering by separating the rendering operations and using depth information to control foreground pixel updates.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The background panoramic image is rendered in advance to the display buffer before the foreground image rendering begins. The depth buffer is also prepared with depth values from the background rendering. This preliminary action allows the foreground rendering to efficiently determine which pixels need updating without re-rendering the entire background.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If the layer principle is used to render background and foreground images, then both images can be displayed together, but the overlapping part needs to be rendered repeatedly, resulting in resource wastes

Engineering Contradiction:
Improvecapability to display layered imagesVSAvoidrendering resource consumption
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The depth buffer provides feedback information about which pixels have already been rendered with closer depth values. During foreground rendering, the depth test uses this feedback to determine whether a foreground pixel should overwrite the background pixel, thereby avoiding redundant rendering operations and reducing energy consumption.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The depth buffer, populated during background rendering, serves dual purposes: it enables correct depth-based compositing of the foreground image and simultaneously acts as a filter to prevent redundant foreground pixel rendering. This self-service mechanism reduces overall rendering resource consumption without requiring additional dedicated structures.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If color information of foreground image pixels is filled into display buffer for overlapping parts, then the foreground covers the background correctly, but repeated rendering causes high rendering overheads

Engineering Contradiction:
Improveimage compositing accuracyVSAvoidrendering throughput
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The rendering process dynamically determines which foreground pixels should be rendered by performing depth tests against the background depth buffer. Instead of statically rendering all foreground pixels, the system adapts the rendering decisions based on depth comparisons, rendering only those foreground pixels that should visually cover the background, thus maintaining accuracy while improving throughput.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11954787B2Image rendering method in panoramic application and terminal device
Publication Date: 2024.04.09 HUAWEI TECH CO LTD
  • US11954787B2 patent drawing
  • US11954787B2 patent drawing
  • US11954787B2 patent drawing

AI summary

The disclosure provides image rendering methods and apparatuses. One example method includes that a foreground image is first rendered, and then a panoramic image used as a background is rendered. A pixel corresponding to the foreground image has a corresponding depth value. When the panoramic image is rendered, content corresponding to the panoramic image may be rendered at a pixel corresponding to a depth standard value based on a depth value of a pixel on a canvas. The depth reference value is a depth value of a pixel other than the pixel corresponding to the foreground image.