Vehicle Image Sensor Scene Recognition With On-Chip Privacy Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing systems require direct output of captured images to external processors, compromising security and privacy, as they lack the capability to perform complex processing like face authentication within the image sensor chip.
Innovation Solution
An image capturing device equipped with an image sensor that includes an image capturing unit, a scene recognition unit, and a drive control unit, enabling fabrication processing within the chip to recognize scenes and control image capture based on recognized data, thus allowing secure and private processing of image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If image data is directly output from the image sensor to external processors, then processing simplicity is maintained, but security and privacy are compromised
Solution Approach 1:
The patent merges the image processing functionality directly into the image sensor chip by integrating a DSP (Digital Signal Processor) and memory within the same chip. This allows the image sensor to perform fabrication processing independently, eliminating the need to output raw image data to external processors. The merging of processing capabilities within the chip maintains security and privacy while still enabling complex processing operations.
Solution Approach 2:
The patent introduces an intermediary processing layer within the image sensor chip itself. Instead of directly transmitting image data to external devices, the integrated DSP acts as an intermediary that processes the image data internally and outputs only the necessary processed information. This intermediary processing layer protects security and privacy by preventing raw image data from leaving the chip.
2Reliability
If fabrication processing is executed within the image sensor chip, then security and privacy are enhanced, but device complexity increases
Solution Approach 1:
The patent implements a universal processing architecture within the image sensor chip that can handle multiple types of image processing tasks. The integrated DSP is designed to perform various fabrication processing operations (noise removal, face authentication, etc.) using a single processing unit, rather than requiring separate dedicated hardware for each function. This multi-functionality reduces overall chip complexity while maintaining security and privacy benefits.
Solution Approach 2:
The patent enables the image sensor chip to serve itself by integrating all necessary processing components (DSP, memory) within the chip. The chip performs its own fabrication processing internally without requiring external processing assistance, thereby achieving security and privacy enhancement. The self-service capability is implemented through the integrated processing units that operate autonomously within the chip.
3Productivity
If simple noise removal is executed at the DSP, then processing efficiency is maintained, but complex processing like face authentication cannot be performed
Solution Approach 1:
The patent implements a dynamic processing capability within the integrated DSP that can adapt its processing power based on the task requirements. The DSP can switch between simple processing modes (for noise removal) and complex processing modes (for face authentication) as needed. This dynamic adaptability allows the system to maintain high processing efficiency for simple tasks while also being capable of performing complex processing operations when required.
Solution Approach 2:
The patent utilizes parameter changes in the processing pipeline to enable both simple and complex processing operations. By adjusting processing parameters such as data flow rate, processing depth, and algorithm complexity, the integrated DSP can efficiently handle both noise removal and face authentication tasks. The system changes processing parameters dynamically based on the specific task being performed, thereby maintaining efficiency while expanding versatility.
Data Source
AI summary
Fabrication processing is executed in a chip of an image sensor. An image capturing device includes an image capturing unit (11) mounted on a vehicle and configured to generate image data by performing image capturing of a peripheral region of the vehicle, a scene recognition unit (214) configured to recognize a scene of the peripheral region based on the image data, and a drive control unit (12) configured to control drive of the image capturing unit based on the scene recognized by the scene recognition unit.