Color-Filter-Aware Pixel Readout for Partial-Image Recognition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Recognition processing using data from partial regions of image data can lead to a decrease in recognition rate due to varying positions and numbers of filters in each region.

Innovation Solution

An information processing apparatus and system that sets readout pixels based on color filter array information, utilizing external information such as recognition results, map information, vehicle information, or external sensor information, and arranges polarizing, spectral, or infrared filters to prioritize pixel selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If recognition processing is performed using data from a partial region of image data, then processing speed and energy consumption are improved, but the recognition rate decreases due to varying positions and numbers of filters in each region

Engineering Contradiction:

Improveprocessing speedVSAvoidrecognition rate

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent applies local quality by setting different readout pixel patterns for different regions of the pixel array based on their specific color filter compositions. Each region is analyzed individually, and readout pixels are selected according to the local filter distribution, ensuring optimal recognition performance for each region while maintaining overall system efficiency.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent changes the parameter of readout pixel selection by dynamically adjusting which pixels are read out based on the color filter array information of each region. The reading control unit modifies the readout pattern parameters according to the specific composition of filters in each region, optimizing the balance between processing speed and recognition accuracy.

Inventive Principle:

Principle #35Parameter changes

2Use of energy by moving object

If recognition processing is performed using data from a partial region of image data, then energy consumption is reduced, but the recognition rate decreases due to varying positions and numbers of filters in each region

Engineering Contradiction:

Improveenergy consumptionVSAvoidrecognition rate

Core Design Contradiction:

Use of energy by moving objectVSReliability

Solution Approach 1:

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent applies partial action by selectively reading out only the necessary pixels in each region based on the color filter composition, rather than reading out all pixels uniformly. This partial reading approach reduces energy consumption while maintaining sufficient data for accurate recognition processing.

Inventive Principle:

Principle #16Partial or excessive action

3Device complexity

If a fixed readout pattern is used for all pixel regions, then device complexity is reduced, but the recognition rate decreases due to not accounting for varying filter positions and numbers

Engineering Contradiction:

Improvereadout control complexityVSAvoidrecognition rate

Core Design Contradiction:

Device complexityVSReliability

Solution Approach 1:

The patent applies preliminary action by pre-storing color filter array information for each region of the pixel array in advance. This pre-stored information is then used by the reading control unit to determine the appropriate readout pixel pattern, eliminating the need for complex real-time analysis and simplifying the control logic while improving recognition accuracy.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system applies self-service by using the stored color filter array information to automatically determine the optimal readout pattern for each region without requiring external intervention or complex control algorithms. The reading control unit autonomously selects readout pixels based on the pre-stored filter composition data.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS12452551B2Information processing apparatus, information processing system, information processing method, and information processing program

Publication Date: 2025.10.21 SONY GROUP CORP

AI summary

An aspect of the present disclosure provides an information processing apparatus, an information processing system, an information processing method, and an information processing program which can suppress a decrease in a recognition rate of recognition processing even in a case where recognition processing is performed using data of a partial region of image data.An information processing apparatus includes a reading unit that sets a readout pixel as a part of a pixel region in which a plurality of pixels is arranged in a two-dimensional array, and controls reading out of a pixel signal from the pixel included in the pixel region; and a setting unit that sets the readout pixel on the basis of color filter array information of the pixel region.