Image Processing Apparatus Residual Rendering for Visual Clarity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for creating an overlaid presentation of multiple images in a single output image are insufficiently intuitive, overwhelming viewers with excessive visual information and confusing differences between images, as they highlight both relevant and predictable differences.

Innovation Solution

An image processing apparatus that uses a first mapping function to render a first input image and a second mapping function to render a residual image, where the residual image represents prediction errors and is visually distinguished from the first input image, thereby highlighting only unpredictable information and reducing visual overload.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a color overlay method is used to combine multiple images in a single output image, then all visual information of each image is preserved and displayed, but the overlaid presentation becomes insufficiently intuitive and overwhelms viewers with excessive visual information

Engineering Contradiction:
Improvevisual informationVSAvoidintuitiveness
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent segments the visual information by separating it into two distinct components: the original first image and a residual image representing prediction errors. This segmentation allows the output image to display all visual information while organizing it into distinguishable parts, with the residual image highlighting only unpredictable differences rather than overwhelming the viewer with undifferentiated overlay data

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies color changes by rendering the residual image using a second mapping function that assigns specific colors to residual values. This color coding visually distinguishes the residual image from the first input image, making unpredictable information intuitively recognizable while preserving all original visual information

Inventive Principle:
Principle #32Color changes

2Loss of information

If all differences between images are highlighted in the overlaid presentation, then complete information is provided, but predictable differences create visual clutter and reduce intuitiveness

Engineering Contradiction:
Improveinformation completenessVSAvoidvisual clutter
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent extracts only the unpredictable information from the second image by calculating prediction errors. The residual image contains only the differences that cannot be predicted from the first image, effectively taking out and highlighting only the relevant new information while eliminating visual clutter from predictable differences

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the parameter representation by using a second mapping function specifically for residual values, which is different from the first mapping function used for the original image. This parameter differentiation allows the system to preserve complete information while visually organizing it to reduce clutter, as viewers can easily distinguish between original and residual components

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8934697B2Image processing apparatus
Publication Date: 2015.01.13 KONINKLIJKE PHILIPS NV
  • US8934697B2 patent drawing
  • US8934697B2 patent drawing
  • US8934697B2 patent drawing

AI summary

Image processing apparatus (100) for creating an overlaid presentation of a first input image (101) and a second input image (102) in an output image (108), the first input image comprising input values, the output image comprising vectors of output values, the vectors of output values representing colors of the output image, and the apparatus comprising an input (110) for obtaining the first input put image and the second input image, a rendering unit (140) configured for rendering the first input image in the output image by using a first mapping function for representing the input values in the vectors of output values, a predictor (120) configured for predicting the second input image from the first input image for obtaining a predicted second input image (104), a residual calculator (130) configured for calculating a residual image (106) from the second input image and the predicted second input image, the residual image comprising residual values representing prediction errors of the predicted second input image, and the rendering unit being further configured for rendering the residual image in the output image by using a second mapping function for representing the residual values in the vectors of output values, the second mapping function being different from the first mapping function for distinguishing the residual image from the first input image.