Image Processing Device Rendering High-Definition Content Responsively

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-definition image rendering and manipulation require significant processing power, leading to operability and responsiveness issues, especially when dealing with complex or high-definition content, and existing methods often manipulate regions without considering the image's structure, resulting in unintended or unnatural processing results.

Innovation Solution

An image processing device and method that includes a rendering block for rendering objects with alpha values, a shading processing block for estimating ambient occlusion, and an image manipulation section using a Z-buffer to extract and manipulate regions based on depth and surface projections, allowing for efficient rendering and natural image manipulation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If high-definition image rendering is performed with complex display contents, then image quality is improved, but processing load is increased leading to degraded responsiveness

Engineering Contradiction:
Improveimage qualityVSAvoidresponsiveness
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The rendering process is divided into two separate stages: a low-definition preview rendering that provides immediate visual feedback, and a high-definition final rendering that ensures image quality. This segmentation allows the system to maintain responsiveness during preview while achieving high definition in the final output, thus resolving the contradiction between image quality and responsiveness.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If alpha blending processing is performed on a large number of minute objects, then transparency expression is improved, but processing load is increased

Engineering Contradiction:
Improvetransparency expressionVSAvoidprocessing load
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts and pre-calculates alpha values for transparent objects during the low-definition preview rendering phase. By separating the alpha value calculation from the final high-definition rendering, the system reduces the processing load during the critical final rendering stage while maintaining accurate transparency expression, thus resolving the contradiction between transparency quality and processing complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If image manipulation is performed on rectangular regions based on image plane, then manipulation flexibility is improved, but natural processing result is degraded

Engineering Contradiction:
Improvemanipulation flexibilityVSAvoidprocessing result naturalness
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies different manipulation strategies to different regions of the image based on their characteristics. For regions containing transparent objects or fine details, it uses adaptive manipulation that respects the local structure and content, rather than applying uniform rectangular cropping. This local quality approach maintains both manipulation flexibility and natural processing results by adapting to the specific needs of each image region.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9697642B2Image processing device and image processing method
Publication Date: 2017.07.04 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9697642B2 patent drawing
  • US9697642B2 patent drawing
  • US9697642B2 patent drawing

AI summary

In an image processing device, an information processing section performs information processing according to an instruction input by a user. An alpha buffer generating block of an image processing section generates an alpha buffer representing, in an image plane, the alpha value of each pixel when designated objects formed by a plurality of objects are collectively regarded as one object. A rendering block reads each piece of model data from an image data storage section, and renders an image also including other objects than the designated objects. A shading processing block approximately calculates degrees of occlusion of ambient light on the image plane, and subjects the rendered image to shading processing on a basis of a result of the calculation.