Image Decoding Apparatus Segmentation Metadata Super-Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image decoding and coding apparatuses lack efficient methods for performing image processing, particularly in enhancing image quality through super-resolution processing, which is essential for improving the quality of decoded images in video transmission and recording systems.

Innovation Solution

The proposed solution involves an image decoding apparatus with a decoding unit that decodes coded data into a decoded image and segmentation metadata, and an image processing unit that performs super-resolution processing using the segmentation information. Additionally, an autoencoder is used to enhance the image processing capabilities, enabling the generation of high-quality super-resolution images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video coding schemes are used to transmit and record videos, then the videos can be efficiently transmitted and recorded, but the image processing capabilities of the decoding apparatus are insufficient

Engineering Contradiction:
Improveimage processing capabilityVSAvoiddecoding apparatus structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the decoding apparatus into distinct functional units: a decoding unit for decoding coded data, a segmentation metadata decoding unit for generating segmentation information, and an image processing unit for performing image processing. This segmentation allows each unit to specialize in specific tasks, improving overall image processing capability while maintaining manageable system complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The image processing unit is designed to perform multiple image processing functions including super-resolution processing, segmentation-based processing, and other prescribed image processing operations. This multi-functionality enables the decoding apparatus to handle various image processing needs without requiring separate dedicated hardware for each function, thus improving productivity while controlling device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If super-resolution processing is added to enhance decoded image quality, then image quality improves, but the decoding apparatus requires additional processing units and metadata handling

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing unit structure
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent incorporates super-resolution metadata and segmentation metadata into the coded data during the encoding phase. This preliminary action prepares all necessary information in advance, allowing the decoding apparatus to perform super-resolution processing efficiently without requiring complex real-time analysis or additional hardware components beyond what is already integrated into the modular decoding structure.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If segmentation metadata and super-resolution metadata are incorporated into coded data, then image processing precision improves, but the data transmission and storage requirements increase

Engineering Contradiction:
Improveimage processing precisionVSAvoiddata amount
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent extracts and separates metadata (segmentation metadata and super-resolution metadata) from the main video data, incorporating it as distinct elements within the coded data structure. This extraction allows the metadata to be handled independently, enabling efficient compression and selective processing. The metadata carries essential information for high-precision image processing without requiring the transmission of additional full-resolution image data, thus improving processing precision while controlling data quantity.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11328451B2Image decoding apparatus and image coding apparatus
Publication Date: 2022.05.10 SHARP KK
  • US11328451B2 patent drawing
  • US11328451B2 patent drawing
  • US11328451B2 patent drawing

AI summary

An image decoding apparatus includes a decoding unit configured to decode coded data into a decoded image and segmentation metadata, a segmentation metadata decoding unit configured to generate segmentation information, and an image processing unit configured to perform prescribed image processing on the decoded image with reference to the segmentation information.