Parallel Image Drawing with Previous Frame Fallback for HMDs

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Displaying high-resolution images on head-mounted displays (HMDs) is challenging due to the difficulty in drawing high-resolution images with a single apparatus, leading to potential delays in image display as multiple apparatuses may not synchronize their processing results in time.

Innovation Solution

An image processing system with multiple drawing sections, an image synthesis section, and a display control section that divides the screen into regions, allowing parallel image drawing and synthesis, with the ability to use previous frame images in delayed regions to maintain timely display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple apparatuses are used to draw images in parallel for high-resolution display, then image resolution is improved, but display timing reliability deteriorates due to potential delays in collecting drawing results

Engineering Contradiction:

Improveimage resolutionVSAvoiddisplay timing reliability

Core Design Contradiction:

Manufacturing precisionVSReliability

Solution Approach 1:

The display screen is divided into multiple regions, with each region assigned to a different drawing apparatus. This segmentation allows parallel processing of image data across multiple apparatuses, achieving high resolution while managing complexity through distributed responsibility.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

When a drawing result is delayed, the system applies the individual image from the previous frame to the affected region. This preliminary preparation of backup image data ensures that display timing is maintained without waiting for the delayed drawing result, resolving the reliability issue.

Inventive Principle:

Principle #10Preliminary action

2Productivity

If multiple apparatuses process images in parallel, then processing productivity is improved, but time loss increases due to delays in collecting and synthesizing drawing results

Engineering Contradiction:

Improveimage processing throughputVSAvoidtime delay in image synthesis

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system prepares individual images from previous frames in advance as fallback options. When drawing results are delayed, these pre-prepared images are immediately substituted, eliminating waiting time and reducing overall time loss in the synthesis process.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent converts the harmful effect of drawing delays into a beneficial mechanism by using delayed regions to display previous frame images. This not only eliminates time loss but also maintains continuous display output, turning the delay problem into a feature that preserves processing throughput.

Inventive Principle:

Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS10755675B2Image processing system, image processing method, and computer program

Publication Date: 2020.08.25 SONY INTERACTIVE ENTERTAINMENT LLC

AI summary

A plurality of drawing nodes 34 draw, in parallel, a plurality of individual images to be displayed in a plurality of individual regions obtained by dividing a frame display region. A display control node 36 generates a synthetic image obtained by synthesizing together the plurality of individual images drawn by the plurality of drawing nodes 34 and causes the synthetic image to be displayed on a display device 38. In the case where the individual image of at least one individual region is delayed at a frame processing timing, the display control node 36 generates a synthetic image as an individual image of that individual region by applying the individual image of the previous frame.