Pixel-Level Analog Imaging Circuit for In-Sensor Neural Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current imaging devices lack the capability for efficient image processing, recognition, and compression within the device itself, leading to increased power consumption, higher communication loads with external devices, and reduced convenience.
Innovation Solution
An imaging device with a pixel block structure that allows data retention and arithmetic processing within the pixels, enabling image processing, recognition, and compression. This includes a circuit that performs parallel-serial conversion and can incorporate a neural network for image recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If image data is converted to digital data and processed externally, then processing capability is achieved, but communication load and power consumption increase
Solution Approach 1:
The patent merges the image processing functions directly into the imaging device, combining the pixel array with integrated circuits that perform analog-to-digital conversion, image processing, and data compression. This integration eliminates the need for separate external processing devices, reducing communication loads and power consumption while maintaining processing capabilities.
Solution Approach 2:
The imaging device is designed with multi-functional circuits that can perform multiple operations including photoelectric conversion, analog-to-digital conversion, image processing, and data compression within the same device. This universal design allows the device to handle various image processing tasks internally, reducing dependency on external devices and lowering overall system power consumption.
2Adaptability or versatility
If image data is processed externally, then processing can be performed, but communication load with external devices increases
Solution Approach 1:
The patent combines image processing functions directly within the imaging device, integrating photoelectric conversion, analog-to-digital conversion, and image processing circuits into a single unified device. This eliminates the need for complex communication interfaces with external processing devices, reducing communication load and system complexity.
3Loss of time
If data processing is performed in analog state, then conversion time is reduced, but processing complexity increases
Solution Approach 1:
The patent performs preliminary analog-to-digital conversion directly at the pixel level before image processing operations. By converting analog signals to digital data early in the processing chain, the system simplifies subsequent processing operations while minimizing conversion time, as the conversion occurs in parallel across multiple pixels simultaneously.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The proposed solution enables faster and more efficient image processing directly within the imaging device, reducing power consumption, communication loads, and enhancing user convenience while maintaining high reliability and sensitivity.
Implementation Method 1
The pixels have a function of obtaining a first signal by photoelectric conversion
Data Source
AI summary
An imaging device capable of image processing is provided. The imaging device can retain analog data (image data) obtained by an image-capturing operation in a pixel and perform a product-sum operation of the analog data and a predetermined weight coefficient in the pixel to convert the data into binary data. When the binary data is taken in a neural network or the like, processing such as image recognition can be performed. Since enormous volumes of image data can be retained in pixels in the state of analog data, processing can be performed efficiently.