Array Camera with Dedicated Bayer Sensor for Power Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Array cameras face high computational load and power consumption when capturing images, particularly when determining depth information and increasing resolution, which is not necessary for all applications like image previewing and video recording.

Innovation Solution

Implementing a dedicated Bayer camera in an array camera system that selectively activates sensors based on the application, using a grid of cameras with a Bayer filter for high-resolution and depth information capture, and single-colored filters for reduced power consumption in applications like video recording and image previewing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If all sensors in the array camera are activated to capture high resolution images and depth information, then image quality and resolution are improved, but computational load and power consumption increase significantly

Engineering Contradiction:
Improveimage resolutionVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The sensor array is segmented into multiple independent sensors, each capable of being activated or deactivated individually. The system selectively activates only the necessary number of sensors based on application requirements, dividing the full array into active and inactive segments to reduce power consumption while maintaining required image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the number of active sensors based on real-time application requirements. For high-resolution imaging, more sensors are activated; for lower-resolution applications like video recording or preview, fewer sensors are activated. This dynamic configuration allows the system to optimize the balance between power consumption and image quality adaptively.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If all sensors are activated for high resolution capture, then image resolution is improved, but computational load increases

Engineering Contradiction:
Improveimage resolutionVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The computational task is segmented according to the number of active sensors. When fewer sensors are activated for lower-resolution applications, the computational load for processing is reduced proportionally. The system processes only the data from active sensors, avoiding the computational overhead of processing data from all sensors regardless of application needs.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes operational parameters including the number of active sensors and the resolution level based on application requirements. For video recording or preview applications, the system operates at lower resolution with fewer active sensors, thereby reducing computational load. For high-resolution photography, the system activates more sensors and increases processing complexity only when necessary.

Inventive Principle:
Principle #35Parameter changes

3Use of energy by moving object

If a dedicated Bayer camera is used for video recording and preview, then power consumption is reduced, but high resolution capability is lost

Engineering Contradiction:
Improvepower consumptionVSAvoidresolution capability
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The sensor array is designed to serve multiple functions through selective activation. The same physical sensors can be used for high-resolution imaging when activated, or for lower-resolution video recording and preview when fewer are activated. This multi-functionality allows a single hardware configuration to support diverse application requirements without needing separate dedicated cameras for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically switches between different operational modes by activating or deactivating sensors based on the current application. For video recording and preview, the system activates fewer sensors to reduce power consumption. For high-resolution photography, the system activates more sensors to provide full resolution capability. This dynamic switching allows the system to optimize power consumption for each specific function while maintaining the capability to provide high resolution when needed.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3031201B1Array camera design with dedicated bayer camera
Publication Date: 2020.08.19 SONY GROUP CORP
  • EP3031201B1 patent drawingFigure 1
  • EP3031201B1 patent drawingFigure 2

AI summary

The invention is directed to systems, methods and computer program products for capturing an image using an array camera. A method comprises determining an application associated with capturing an image using an array camera, wherein the array camera comprises a first sensor and at least one second sensor, wherein the first sensor comprises a red filter, a green filter, and a blue filter, and wherein each second sensor comprises a red filter, a green filter, or a blue filter; determining whether the application requires the image to have a first resolution equal to or greater than a predetermined resolution; determining whether the application requires depth information associated with the image; and in response to determining the application does not require the image to have the first resolution and does not require depth information, activating the first sensor, and capturing the image using the first sensor.