Image Sensor Area Segmentation for Recognition Support Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In imaging apparatuses, the image processing unit bears a heavy load during image recognition processing, leading to increased power consumption and circuit size, as it solely relies on image data from the image sensor without additional support information.

Innovation Solution

The image sensor outputs image recognition support information, such as divided illuminance data, temperature, distance, and hue, for each area of the imaging surface, allowing the image processing unit to focus processing on specific regions and reduce overall load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the image processing unit performs image recognition processing using only image data from the image sensor, then the processing can be performed, but the processing load on the image processing unit increases, leading to increased power consumption and circuit size

Engineering Contradiction:
Improveimage recognition accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The imaging apparatus segments the imaging surface into multiple areas and generates image recognition support information for each area separately. This allows the system to process only relevant regions rather than the entire image, reducing the computational load on the image processing unit while maintaining recognition accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The image sensor performs preliminary processing to generate image recognition support information (such as illuminance data, temperature, distance, hue) before the data reaches the image processing unit. This preliminary action prepares the data in a format that facilitates more efficient subsequent processing, reducing the burden on the image processing unit.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the image processing unit performs image recognition processing using only image data from the image sensor, then the processing can be performed, but the circuit size of the image processing unit increases

Engineering Contradiction:
Improveimage recognition accuracyVSAvoidcircuit size
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The imaging surface is divided into multiple areas with image recognition support information generated for each area. This segmentation allows the image processing unit to focus on processing specific regions of interest rather than analyzing entire images, thereby reducing the required circuit size while preserving recognition accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Image recognition support information acts as an intermediary between the image sensor and the image processing unit. This intermediary data structure contains pre-processed information (illuminance, temperature, distance, hue) that facilitates more efficient processing in the image processing unit, reducing its complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the entire image is periodically set as the search range to detect new recognition objects, then new objects can be detected, but the processing load on the image processing unit increases

Engineering Contradiction:
Improvedetection capabilityVSAvoidprocessing efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The search range is segmented into multiple areas rather than processing the entire image periodically. The system uses image recognition support information to identify and process only those areas where new objects are likely to appear, maintaining detection capability while significantly improving processing efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of periodically processing the entire image, the system performs partial processing on specific areas identified through image recognition support information. This partial action approach is sufficient to detect new objects while avoiding the excessive processing burden of analyzing the complete image.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces the processing load on the image processing unit, enabling efficient image recognition and tracking while minimizing power consumption and circuit size.

Implementation Method 1

pixel signals generated in accordance with incident light by photoelectric conversion elements

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10306153B2Imaging apparatus, image sensor, and image processor
Publication Date: 2019.05.28 SONY GROUP CORP
  • US10306153B2 patent drawing
  • US10306153B2 patent drawing
  • US10306153B2 patent drawing

AI summary

The present disclosure relates to an imaging apparatus, an image sensor, and an image processor capable of reducing a load on an image processing unit related to image recognition processing.An imaging apparatus according to a first aspect of the present disclosure includes: an image sensor adapted to output image data including pixel signals generated in accordance with incident light by photoelectric conversion elements vertically and horizontally arranged on an imaging surface, adapted to divide the imaging surface into a plurality of areas, and adapted to generate image recognition support information for each of the areas on the basis of the pixel signals generated by the photoelectric conversion elements belonging to the area; and an image processing unit adapted to apply predetermined image processing to the image data output from image sensor by using the image processing support information output from the image sensor. The present disclosure is applicable to, for example, a camera having a face detection function.