Image Encoding Region Quality Control via Preliminary Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in accurately controlling the quality of specific regions in images without delaying the encoding process, particularly in real-time monitoring applications, due to processing delays and inaccuracies in detecting and encoding important regions like faces in video streams.

Innovation Solution

An image processing apparatus that includes a detection unit for identifying specific regions, a delay calculation unit to assess processing delays, and a determination unit to adjust the detected regions based on delay and specific region information, allowing for real-time encoding without additional buffer memory or delays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the encoding process is delayed to synchronize with the completion of the detection process, then the accuracy of specific region detection is improved, but the real-time performance required for monitoring applications deteriorates

Engineering Contradiction:
Improvedetection accuracyVSAvoidreal-time performance
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The detection process is performed in advance on a previous frame before the encoding process starts on the current frame. This preliminary detection allows the system to prepare specific region information ahead of time, reducing the need for delays while maintaining detection accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the timing relationship between detection and encoding processes by using delay information to calculate the appropriate previous frame. This dynamic adaptation allows the system to maintain real-time performance while ensuring accurate specific region detection through frame synchronization.

Inventive Principle:
Principle #15Dynamics

2Stability of the object's composition

If the encoding process is delayed to wait for detection completion, then the synchronization between detection and encoding is improved, but the encoding efficiency and processing speed deteriorate

Engineering Contradiction:
Improveprocess synchronizationVSAvoidencoding efficiency
Core Design Contradiction:
Stability of the object's compositionVSProductivity

Solution Approach 1:

Detection is performed preliminarily on a previous frame before encoding begins on the current frame. This advance detection ensures that specific region information is ready when encoding starts, achieving synchronization without delaying the encoding process and maintaining high encoding efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system resolves the timing conflict by transitioning from a single-frame sequential processing to a multi-frame parallel processing approach. Detection on frame n-1 runs concurrently with encoding on frame n, utilizing the time dimension to overlap operations and eliminate delays while maintaining synchronization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Manufacturing precision

If high accuracy detection of specific regions is performed, then the image quality control precision is improved, but the processing burden and complexity increase

Engineering Contradiction:
Improveimage quality control precisionVSAvoidprocessing burden
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Specific region detection is performed in advance on a previous frame, preparing detection results before encoding begins. This preliminary action allows high-precision detection to be completed ahead of time, reducing real-time processing burden while maintaining image quality control precision through advance computation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Delay information acts as an intermediary that bridges the detection and encoding processes. By using delay information to identify the appropriate previous frame, the system mediates the timing difference between detection and encoding, enabling high-precision detection without increasing real-time processing complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10477221B2Image processing apparatus for controlling image quality of a specific region in an image while minimizing delay of the encoding process
Publication Date: 2019.11.12 CANON KK
  • US10477221B2 patent drawing
  • US10477221B2 patent drawing
  • US10477221B2 patent drawing

AI summary

In order to appropriately control the image quality of an intended specific region in an image without delaying an encoding process, an image processing apparatus includes a determination unit configured to determine a specific region in a first image targeted for the encoding process on the basis of (a) a time difference between a first time associated with the first image and a second time associated with a second image in which an object has been detected by a detection unit before the encoding process is executed on the first image, and (b) information on a region corresponding to the object detected by the detection unit in the second image, and executes, on the first image, the encoding process of varying image quality between a region corresponding to the specific region determined by the determination unit, and any other region.