Super-Resolution Model Selection for Compressed Image Recovery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image resolution conversion techniques fail to effectively increase the resolution of images that have been compressed using irreversible data compression methods, resulting in lower object resolution compared to original images.

Innovation Solution

A resolution converter that selects a super-resolution model corresponding to the capturing conditions under which an image was generated, among a plurality of models, and generates a high-resolution image by inputting the image into the selected model, thereby improving the resolution of objects in the image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If irreversible data compression is applied to reduce image data size, then the amount of image data is reduced, but the resolution of objects in the image deteriorates

Engineering Contradiction:
Improveamount of image dataVSAvoidresolution of objects
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The system performs preliminary classification of capturing conditions (indoor/outdoor, daytime/nighttime, weather) before applying super-resolution processing. By pre-categorizing the image characteristics, the system can select the most appropriate super-resolution model in advance, ensuring optimal resolution recovery while maintaining efficient data processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the parameter of resolution enhancement by selecting different super-resolution models based on capturing conditions. Each model is optimized for specific conditions (e.g., nighttime images use one model, daytime images use another), allowing the system to adapt the degree and method of resolution enhancement to match the original image characteristics, thereby effectively recovering object resolution.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If a single super-resolution model is used for all images, then the device complexity is reduced, but the resolution enhancement effectiveness deteriorates

Engineering Contradiction:
Improvenumber of super-resolution modelsVSAvoidresolution enhancement effectiveness
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The system segments the super-resolution processing task by dividing images into different categories based on capturing conditions (indoor/outdoor, daytime/nighttime, weather conditions). Each segment is then processed by a specialized super-resolution model optimized for that specific condition, thereby improving overall resolution enhancement effectiveness while keeping each individual model relatively simple.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements dynamic model selection by automatically classifying the capturing condition of each input image and selecting the corresponding super-resolution model in real-time. This dynamic adaptation allows the system to maintain high resolution enhancement effectiveness across varying image conditions without requiring a fixed, overly complex multi-model architecture.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If image resolution is increased after irreversible compression, then object resolution can be improved, but information loss from compression cannot be fully recovered

Engineering Contradiction:
Improveobject resolutionVSAvoiddetail information lost during compression
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The super-resolution models generate a high-resolution copy of the compressed low-resolution image by learning the statistical relationships between low-resolution and high-resolution images. Rather than attempting to perfectly reconstruct the original, the model creates an optimized copy that preserves essential object details and structural information, effectively compensating for compression losses in the most critical aspects.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system converts the harmful effect of compression artifacts into a benefit by training super-resolution models specifically on compressed image data. The models learn to recognize and reconstruct meaningful object information that survives compression, effectively transforming the degraded input into a useful high-resolution output that prioritizes semantically important features over pixel-perfect fidelity.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS20240127395A1Resolution converter, resolution conversion method, and resolution conversion computer program
Publication Date: 2024.04.18 TOYOTA JIDOSHA KK
  • US20240127395A1 patent drawing
  • US20240127395A1 patent drawing
  • US20240127395A1 patent drawing

AI summary

A resolution converter includes a processor configured to select a super-resolution model corresponding to a capturing condition under which an image was generated, among a plurality of super-resolution models for improving resolution, the plurality of super-resolution models corresponding to different capturing conditions, and generate a high-resolution image having a higher resolution than the image by inputting the image into the selected super-resolution model.