Image Generating Device Rendering via Pre-computed Reference Viewpoints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image display technologies face challenges in balancing responsiveness to changes in the viewing point with maintaining high image quality, leading to impaired presence due to increased image processing load and latency.

Innovation Solution

An image generating device that stores reference images from multiple viewing points and uses pixel value determination to combine pixel values from these images, allowing for accurate and responsive image rendering without the need for real-time high-latency calculations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complicated calculations are performed to raise resolution and heighten the sense of presence, then image quality is improved, but image processing load increases causing latency

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent pre-calculates and stores pixel values for multiple viewing points before the actual display operation. When the viewing point changes, the system retrieves pre-computed pixel values from storage and combines them using blending ratios, avoiding the need for real-time complicated calculations. This preliminary action resolves the contradiction by shifting computational work from the display timing to the preparation phase.

Inventive Principle:
Principle #10Preliminary action

2Speed

If real-time image processing is performed for every viewing point change, then responsiveness is improved, but image quality deteriorates due to processing load

Engineering Contradiction:
ImproveresponsivenessVSAvoidimage quality
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The system performs image processing in advance for multiple predetermined viewing points and stores the results. When a viewing point change occurs, pre-computed pixel values are retrieved and combined using blending ratios based on the degree of change. This approach achieves both responsiveness (by avoiding real-time computation) and high image quality (by using pre-computed high-resolution data).

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent dynamically adjusts the blending ratio of pixel values from different reference viewing points based on the degree of viewing point change. When the viewing point changes significantly, pixel values from reference points farther away are blended in with appropriate weighting. This dynamic adjustment maintains image quality while adapting to different viewing conditions without requiring re-computation.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If high resolution images are generated through complicated calculations, then the sense of presence is heightened, but the image cannot keep pace with movement of the viewing point

Engineering Contradiction:
Improveimage resolutionVSAvoidresponsiveness to viewing point movement
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent pre-computes high-resolution pixel values for multiple viewing points in advance and stores them in memory. When the viewing point moves, the system retrieves the appropriate pre-computed pixel values and combines them using blending ratios. This eliminates the delay caused by real-time computation while maintaining high resolution, allowing the image to keep pace with viewing point movement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically selects and blends pixel values from multiple reference viewing points based on the current viewing point position and movement degree. By adjusting blending ratios dynamically, the system maintains high resolution images that respond quickly to viewing point changes without requiring re-computation at each moment.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3509037B1Image generating device and method of generating an image
Publication Date: 2021.10.06 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3509037B1 patent drawingFigure 1~2
  • EP3509037B1 patent drawingFigure 3
  • EP3509037B1 patent drawingFigure 4

AI summary

An image generating device comprises a rendering section that renders test images each representing an image when a space including an object to be displayed is viewed from one of a plurality of candidate reference viewing points; a candidate reference viewing point evaluation section that evaluates an importance value for the candidate reference viewing points as a function of at least their comparative coverage of points in the space; and an update section that changes the position of one or more candidate reference viewing points that have a low imporantance value, obtains a re-evaluation from the candidate reference viewing point evaluation section, and does not revert the position of a candidate reference viewing point if its comparative coverage of points in the space has increased.