Image Sensor Feature Extraction for Privacy-Safe Visual Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image capturing systems face a risk of personal information leakage during communication when transmitting captured images to the cloud for safety monitoring, as they require transmitting images that may contain sensitive information, compromising communication safety.

Innovation Solution

An image capturing device that extracts and encodes feature amounts from captured images instead of transmitting the images themselves, allowing for secure communication by outputting only the encoded feature data, which is more difficult to reverse-engineer and reduces data transmission load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a lens with large aperture ratio is used to improve low-light performance, then the amount of light entering the sensor increases, but spherical aberration and coma aberration increase, degrading image quality

Engineering Contradiction:
Improvelight intensity on sensorVSAvoidimage quality
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent divides the single lens into multiple lens elements (first lens, second lens, third lens) with different refractive indices and curvature characteristics. Each lens element is optimized to correct specific aberrations, allowing the system to achieve both high light intake and high image quality by segmenting the optical path into controlled segments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different lens elements are assigned different optical properties: the first lens has high refractive index for strong light gathering, the second lens has specific curvature to correct spherical aberration, and the third lens addresses coma aberration. This local optimization of optical quality at different positions in the optical path resolves the contradiction between light intensity and image quality.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If telephoto zoom function is added to the camera lens, then the imaging range is extended, but the structure becomes more complex and weight increases

Engineering Contradiction:
Improveimaging rangeVSAvoidlens structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent designs a lens structure that can perform multiple functions: the combination of three lens elements with specific optical characteristics enables both wide-angle and telephoto zoom capabilities. The lens system is configured to achieve 2x optical zoom while maintaining compact structure, making a single lens unit serve multiple imaging range requirements without requiring separate lens assemblies.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The lens elements are arranged in a nested configuration where the first, second, and third lenses are positioned in sequence along the optical axis with specific spacing relationships. This nested arrangement allows the telephoto zoom function to be integrated within a compact form factor, reducing overall device complexity while maintaining extended imaging range.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Manufacturing precision

If the lens structure is made more complex to correct aberrations, then image quality improves, but the focal plane shifts and requires refocusing

Engineering Contradiction:
Improveimage qualityVSAvoidfocusing operation
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The lens elements are pre-designed with specific curvature radii and spacing relationships that are optimized to maintain a fixed focal plane. The second and third lenses are specifically configured to compensate for focal plane shifts caused by the first lens, eliminating the need for refocusing operations while maintaining high image quality across the entire imaging range.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The lens system incorporates a feedback mechanism where the optical path is designed to automatically compensate for aberrations and focal plane shifts. The specific arrangement of lens elements creates an self-correcting optical system that maintains image quality without requiring manual intervention or refocusing, resolving the contradiction between optical precision and operational ease.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances communication safety by preventing personal information leakage, maintaining image recognition accuracy, and reducing the computational and power loads associated with signal processing, while also minimizing the risk of data exposure and costs related to encryption.

Implementation Method 1

a first lens having a high refractive index and a specific curvature radius, wherein an optical path difference between a paraxial ray and a marginal ray passing through the first lens is within a predetermined range

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

a second lens having a specific curvature radius, wherein optical paths of paraxial rays and marginal rays passing through the second lens are within a predetermined range

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 3

a third lens having a specific curvature radius, wherein optical paths of paraxial rays and marginal rays passing through the third lens from a subject are within a predetermined range

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentEP3886423B1Image capturing element, image capturing device and method
Publication Date: 2024.01.24 SONY GROUP CORP
  • EP3886423B1 patent drawingFigure 1
  • EP3886423B1 patent drawingFigure 2
  • EP3886423B1 patent drawingFigure 3

AI summary

The present disclosure relates to an image capturing element, an image capturing device, and a method that are capable of preventing a reduction in communication safety. By capturing an image of a subject, and generating a captured image, a predetermined feature amount to be output to the outside is extracted from the generated captured image. For example, an image capturing section that captures an image of a subject to generate a captured image, and a feature amount extracting section that extracts, from the captured image generated by the image capturing section, a predetermined feature amount to be output to the outside, are packaged and are formed in respective substrates different from each other. The present disclosure can be applied to, for example, an image capturing element, an image capturing device, an image processing device, a transmission device, or a communication device.