Brightness-Compensating Pixel Art Upscaler

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Higher resolution displays render lower resolution pixel art in an unsatisfactory manner, often highlighting its blocky nature, and existing upscaling techniques can introduce brightness modifications that may cause photosensitivity issues.

Innovation Solution

A filtering algorithm that compensates for brightness changes introduced by pixel art upscaling, ensuring the original and upscaled images have identical low frequency components, thereby preserving the aesthetic quality and safety from photosensitivity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pixel art images are upscaled to higher resolution displays, then the display resolution is improved, but the blocky pixelated appearance is highlighted making the images aesthetically pleasing

Engineering Contradiction:
Improvedisplay resolutionVSAvoidpixelated appearance
Core Design Contradiction:
Measurement precisionVSShape

Solution Approach 1:

The upscaling process divides the original pixel art into a grid of super-pixels, where each original pixel is expanded into a block of multiple higher-resolution pixels. This segmentation allows the system to maintain the blocky aesthetic while achieving higher display resolution through controlled pixel expansion rather than simple scaling

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different filtering operations are applied to different regions of the image based on their characteristics. Edge regions receive different treatment compared to flat color regions, allowing the system to preserve sharp boundaries while smoothing areas that would otherwise appear blocky, thus maintaining aesthetic quality at higher resolution

Inventive Principle:
Principle #3Local quality

2Measurement precision

If upscaling algorithms are applied to pixel art, then the image resolution is increased, but brightness modifications are introduced causing photosensitivity concerns

Engineering Contradiction:
Improveimage resolutionVSAvoidbrightness modification
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system incorporates brightness analysis as a feedback mechanism during the upscaling process. By monitoring the brightness values of the original and upscaled images, the algorithm dynamically adjusts filtering parameters to compensate for any brightness modifications, ensuring that the final output maintains consistent brightness characteristics with the original pixel art while achieving the desired resolution increase

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The upscaling algorithm modifies filtering parameters such as kernel coefficients and smoothing factors to compensate for brightness changes. By adjusting these parameters in real-time based on the image content and detected brightness variations, the system maintains photosafety while achieving high-resolution output

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10957015B2Brightness-compensating safe pixel art upscaler
Publication Date: 2021.03.23 NINTENDO CO LTD
  • US10957015B2 patent drawing
  • US10957015B2 patent drawing
  • US10957015B2 patent drawing

AI summary

Low spatial frequencies of an original image and an upscaled filtered image are analyzed. Differences will be observed in the low frequency components of the two images in the general case since the pixel art upscaler filter as a side effect introduces low frequency changes. A modification to images produced by the PAU is applied to attempt to match the brightness of the original images in the low frequency spectrum. From a viewer perspective (e.g., based on typical blurring visual effects), the original image and the modified filtered image will look the same—demonstrating that there is no low frequency brightness creep or resulting increased photosensitivity concerns.