Image Processing Apparatus Maintaining Aspect Ratio During Resolution Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing systems cause discomfort when converting game images from low resolution to high resolution, as the aspect ratio change from horizontally-long pixels to square pixels results in vertically-long image displays, differing from the original monitor aspect ratio, leading to an unnatural viewing experience.

Innovation Solution

The system generates two intermediate image data sets with a higher number of pixels in the horizontal direction by dividing the original image into areas and mixing colors of corresponding pixels, ensuring the aspect ratio is maintained by setting end pixels to match the original image colors and intermediate pixels based on adjacent colors, thereby creating an output image that mimics the original aspect ratio.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the image is converted from low resolution to high resolution by changing pixel aspect ratio, then the resolution is improved, but the original aspect ratio is distorted causing vertical elongation

Engineering Contradiction:
ImproveresolutionVSAvoidaspect ratio
Core Design Contradiction:
Manufacturing precisionVSShape

Solution Approach 1:

The patent divides the image processing into multiple segments: generating two intermediate images with different transparency settings, then compositing them together. This segmentation allows each intermediate image to handle specific color interpolation tasks while maintaining the overall aspect ratio through their combination

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediate images as mediators between the original low-resolution image and the final high-resolution output. These intermediate images contain color information at different transparency levels, allowing the system to achieve high resolution without directly distorting the original aspect ratio

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If pixels are increased in number to achieve high resolution, then the detail quality is improved, but the image appears vertically elongated and unnatural

Engineering Contradiction:
Improvedetail qualityVSAvoidvisual discomfort
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent changes the transparency parameter of pixels in intermediate images to control how color information is combined. By adjusting transparency values and compositing multiple intermediate images, the system achieves high detail quality while preventing the vertical elongation that would otherwise occur with simple pixel interpolation

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11699221B2Image processing apparatus, storage medium and image processing method
Publication Date: 2023.07.11 NINTENDO CO LTD
  • US11699221B2 patent drawing
  • US11699221B2 patent drawing
  • US11699221B2 patent drawing

AI summary

An information processing apparatus that functions as a non-limiting example image processing apparatus includes a processor. When an original image drawn with horizontally-long first pixels is to be drawn by square second pixels, the processor generates two intermediate image data in each of which the number of second pixels is 1.2 times the number of first pixels of the original image data, by generating a second area formed with six (6) second pixels arranged in a horizontal direction for each of first areas that are formed dividing the original image by every five (5) first pixels arranged in the horizontal direction, and outputs the two intermediate image data to a display control device. The display control device generates output image data by synthesizing the two intermediate image data, and outputs the generated output image data to a display. The output image data is generated in each of the second areas with colors that include colors of the second pixels at both ends, which are in agreement with colors of the first pixels at both ends in each corresponding first area and colors of the second pixels other than the both ends, each of which is generated based on colors of adjacent two first pixels in corresponding first area.