Image Processing Apparatus Backward Tracking for Hidden Faces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies can only record images when a face image extracted using face authentication technology meets specific photographic conditions, limiting the recording of images that do not satisfy these conditions, such as those with poor orientation or hidden faces.

Innovation Solution

An image processing apparatus and method that includes an acquisition unit, an object recognition unit, a tracking unit, and a storage controller, which allows for the sequential acquisition and storage of images, with the tracking unit performing backward tracking of recognized objects in stored images and storing them in a separate storage device, enabling the recording of images even if the object was not initially recognized or was partially hidden.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If face authentication technology is used to extract face images and record only when photographic conditions are satisfied, then recording reliability is improved, but image capture completeness deteriorates

Engineering Contradiction:
Improverecording reliabilityVSAvoidimage capture completeness
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system performs preliminary actions by continuously acquiring and temporarily storing images in a buffer before face authentication is completed. This allows the system to have images ready for recording before the authentication result is known, preventing loss of images that might otherwise be missed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A buffer memory is introduced as an intermediary storage device between the image acquisition unit and the recording medium. This buffer temporarily holds images while face authentication is being performed, allowing seamless continuation of image capture without waiting for authentication results, thus maintaining both reliability and completeness.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If face authentication is performed on sequentially acquired images, then image quality control is improved, but processing time increases

Engineering Contradiction:
Improveimage quality controlVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Images are acquired and stored in the buffer in advance, before face authentication is completed. This preliminary storage action allows the system to prepare images for potential recording without waiting for the authentication process to finish, reducing the perceived processing time while maintaining quality control.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The image acquisition process continues uninterrupted in the background while face authentication is being performed on previously acquired images. This continuity ensures that no useful action (image capture) is lost during the authentication process, effectively masking the processing time delay.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If images are stored only after successful face recognition, then storage efficiency is improved, but image retention completeness deteriorates

Engineering Contradiction:
Improvestorage efficiencyVSAvoidimage retention completeness
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The buffer memory performs preliminary storage of images before face authentication results are finalized. This ensures that images are preserved in the buffer during the authentication process, and can be transferred to permanent storage if authentication succeeds, maintaining retention completeness without compromising storage efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The buffer acts as an intermediary storage layer that temporarily holds images awaiting authentication results. This intermediate storage allows the system to maintain a queue of images for potential recording, ensuring that no images are lost during processing while managing storage resources efficiently through selective transfer to permanent storage.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10839198B2Image processing apparatus, image processing method, and program
Publication Date: 2020.11.17 CANON KK
  • US10839198B2 patent drawing
  • US10839198B2 patent drawing
  • US10839198B2 patent drawing

AI summary

There are provided an object recognition unit of recognizing a target object in sequentially acquired images, a tracking unit of performing tracking on the sequentially acquired images for the recognized target object, and a storage controller of controlling so as to store in a first storage device the sequentially acquired images. The tracking unit further performs tracking for the target object on stored images, that are acquired before the target object is recognized by the object recognition unit in the sequentially acquired images, and are stored in the first storage device. The storage controller controls so as to store in a second storage device different from the first storage device, images in which the target object is tracked by the tracking unit of the sequentially acquired images, and images in which the target object is tracked by the tracking unit of the stored images.