Single Pixel Array Image Processing for Dual Vision Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging systems requiring separate image sensors for computer vision (CV) and human vision (HV) necessitate dual camera modules, leading to increased size and cost due to the need for two camera modules and additional components.

Innovation Solution

An image processing device that assigns identification information to images based on imaging conditions, allowing a single pixel array to output images suitable for both CV and HV, thereby eliminating the need for multiple camera modules by distinguishing and processing images accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If two image sensors are used to perform optimal sensor setting for CV and HV images, then image quality for both purposes is improved, but device size and cost increase

Engineering Contradiction:
Improveimage qualityVSAvoiddevice size
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies universality by enabling a single image sensor to perform multiple functions - capturing both CV images (for computer vision processing) and HV images (for human vision display) using the same imaging element. The sensor is configured with different imaging conditions (such as different exposure times, gains, or filtering) to produce images optimized for different purposes, eliminating the need for separate dedicated sensors for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent employs parameter changes by modifying imaging conditions (exposure time, gain, filter settings, etc.) of a single image sensor to generate different types of images. By changing these parameters, the same sensor can produce images with different characteristics suitable for either CV processing or HV display, thereby resolving the contradiction between maintaining image quality and reducing device complexity.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If two image sensors are used to perform optimal sensor setting for CV and HV images, then image quality for both purposes is improved, but manufacturing cost increases

Engineering Contradiction:
Improveimage qualityVSAvoidmanufacturing cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent reduces manufacturing cost by making the image sensor universal - capable of producing both CV-optimized and HV-optimized images. This eliminates the need to manufacture and assemble two separate camera modules, thereby reducing component costs, assembly complexity, and overall manufacturing expenses while maintaining the ability to deliver high-quality images for both purposes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the functions of two separate image sensors into a single sensor unit. By combining CV image capture and HV image capture capabilities into one sensor, the system reduces the number of components that need to be manufactured and assembled, directly lowering manufacturing costs while preserving the dual-functionality required for different image quality requirements.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If two camera modules are prepared, then optimal imaging conditions for CV and HV are achieved, but installation space is required

Engineering Contradiction:
Improveimaging condition optimizationVSAvoidinstallation space
Core Design Contradiction:
ReliabilityVSArea of stationary object

Solution Approach 1:

The patent eliminates the space requirement for two separate camera modules by creating a universal image sensor that can operate under different imaging conditions. The single sensor unit occupies minimal space while being capable of capturing images optimized for both CV and HV applications through configurable imaging parameters, thereby resolving the contradiction between achieving optimal imaging conditions and minimizing installation space.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240323561A1Image processing device, image processing method, and image processing system
Publication Date: 2024.09.26 SONY SEMICON SOLUTIONS CORP
  • US20240323561A1 patent drawing
  • US20240323561A1 patent drawing
  • US20240323561A1 patent drawing

AI summary

An image processing device of an embodiment according to the present disclosure includes: an obtaining section (10B) that sequentially obtains images based on pixel signals respectively for a plurality of pixels which pixel signals are output from a pixel array section including the plurality of pixels; a setting section (10C) that assigns the same identification information to the plurality of images having the same imaging condition and assigns different pieces of identification information to the plurality of images having different imaging conditions; and an output section (10D) that outputs the plurality of images to which the identification information is assigned.