AR/VR Image Display via Synthesized Frame Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing technologies require each image to be rendered and transmitted separately by the processing terminal, leading to high rendering operations and transmission volumes, which is inefficient, especially in scenarios like Augmented Reality (AR) or Virtual Reality (VR) where continuous and high-quality image display is needed.

Innovation Solution

The method involves predicting posture data at specific time points to clip and transmit original images from a processing terminal to a display terminal, allowing the display terminal to extract and display multiple images from a single original image, reducing rendering and transmission loads by optimizing image content based on user's line of sight and posture data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If each image is rendered and transmitted separately by the processing terminal, then the display terminal can display images in real-time, but the rendering operations and transmission volume are relatively large

Engineering Contradiction:
Improveimage display speedVSAvoidprocessing terminal workload
Core Design Contradiction:
SpeedVSProductivity

Solution Approach 1:

The patent merges multiple adjacent images into a single synthesized image that contains multiple sub-images. The processing terminal renders one synthesized image instead of multiple separate images, reducing rendering operations and transmission volume while enabling the display terminal to extract and display multiple images sequentially, thus maintaining real-time display performance while reducing processing terminal workload.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The synthesized image is segmented into multiple sub-images that can be extracted independently. The display terminal divides the received synthesized image into multiple separate images through clipping operations, allowing each image to be displayed at the appropriate time while the processing terminal only needs to transmit one consolidated image.

Inventive Principle:
Principle #1Segmentation

2Productivity

If multiple images are transmitted separately, then each image can be optimized for its specific display time, but the transmission volume and network bandwidth consumption increase

Engineering Contradiction:
Improveimage processing efficiencyVSAvoidtransmission volume
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

Multiple images are merged into a single synthesized image containing all sub-images. This consolidation reduces transmission volume and network bandwidth consumption because only one image file needs to be transmitted instead of multiple separate files, while the display terminal can still extract and display each image individually with proper timing.

Inventive Principle:
Principle #5Merging (Combining)

3Manufacturing precision

If the processing terminal renders images at high resolution for all possible viewing angles, then image quality is maintained, but the rendering complexity and computation increase

Engineering Contradiction:
Improveimage qualityVSAvoidrendering complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The synthesized image uses local quality optimization where different regions of the image can have different resolutions or quality levels. The display terminal extracts only the relevant portion needed for current display requirements, allowing the processing terminal to render high-quality images only where necessary while reducing overall rendering complexity for areas that don't require maximum detail.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11574613B2Image display method, image processing method and relevant devices
Publication Date: 2023.02.07 BEIJING BOE OPTOELECTRONCIS TECH CO LTD
  • US11574613B2 patent drawing
  • US11574613B2 patent drawing
  • US11574613B2 patent drawing

AI summary

The present disclosure provides an image display method, an image processing method and related devices. The image display method includes: receiving and storing an original image from a processing terminal, the original image being an image rendered by the processing terminal; acquiring a first image from the original image; displaying the first image between a first time point and a second time point; acquiring a second image from the original image; and displaying the second image between the second time point and a third time point.