Video Frame Group Correction for Parallel Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing technologies lack random accessibility and parallelism, making it difficult to efficiently access and process video data, especially when only specific frames are needed, and they struggle with maintaining continuity in decoded images, leading to unnatural results.

Innovation Solution

An image processing apparatus that corrects frame groups by using feature quantities from adjacent frames to enhance subjective image quality, allowing for random accessibility and parallel processing by incorporating a decoding unit that adjusts weights based on feature quantities and performs corrections using nearby frame data to maintain continuity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video data is processed sequentially from the beginning to maintain continuity between frames, then image quality is improved, but random accessibility and processing efficiency deteriorate

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent divides video data into multiple frame groups that can be processed independently in parallel. Each frame group contains a specific number of frames and can be decoded without sequential dependency on previous frame groups, enabling random accessibility and parallel processing while maintaining continuity through correction units that use feature quantities from adjacent frames.

Inventive Principle:
Principle #1Segmentation

2Productivity

If data is divided into multiple elements for parallel processing, then processing efficiency is improved, but continuity at boundary portions deteriorates

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidcontinuity
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent incorporates correction units that use feature quantities from adjacent frame groups (previous and subsequent frame groups) to correct the current frame group. This feedback mechanism ensures continuity at boundary portions by referencing neighboring data, allowing parallel processing of divided frame groups while maintaining natural transitions at boundaries.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If recursive input of nearby decoded data is used to maintain continuity, then image quality is improved, but random accessibility and parallelism deteriorate

Engineering Contradiction:
Improveimage qualityVSAvoidrandom accessibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent performs preliminary encoding of all frame groups before decoding, storing encoded data that can be randomly accessed. During decoding, frame groups are decoded in parallel using preliminary encoded data and correction units that reference adjacent frame groups, enabling both random accessibility and parallelism while maintaining continuity through the correction mechanism.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11516515B2Image processing apparatus, image processing method and image processing program
Publication Date: 2022.11.29 NIPPON TELEGRAPH & TELEPHONE CORP
  • US11516515B2 patent drawing
  • US11516515B2 patent drawing
  • US11516515B2 patent drawing

AI summary

An image processing apparatus for performing correction for each frame group including a predetermined number of frames into which video data is divided includes a decoding unit configured to obtain a corrected frame group by correcting a second frame group, which is a frame group continuous with a first frame group in time, using a feature quantity of the first frame group. The decoding unit performs the correction so that subjective image quality based on a relationship between the second frame group and a frame group subsequent to the second frame group in time is increased and so that a predetermined classifier classifies that a frame group in which the second frame group is concatenated with the frame group subsequent to the second frame group in time is the same as a frame group in which the corrected frame group is concatenated with a corrected frame group obtained by correcting the frame group subsequent to the second frame group in time.