Photo-Memory Optical Sensor for In-Pixel Image Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image capture devices require transferring image data to separate processing devices, leading to delays and inefficiencies in real-time processing, particularly in applications like neuro-robotics and computer vision, due to the inability of photo-sensors to store data and the generation of redundant data that requires significant computing and power consumption.
Innovation Solution
An imaging device with an optical sensor exhibiting a photo-memory effect, allowing it to act as both a light sensor and memory device, capable of storing and processing data optically using electromagnetic radiation, eliminating the need for electronic write and erase procedures and enabling in-pixel data storage and processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If images are transferred between separate capture and processing devices, then data storage and processing can be performed, but processing speed and real-time performance deteriorate
Solution Approach 1:
The patent merges the image capture function and data storage function into a single device by integrating a photo-memory sensor that can both capture images and store them temporarily. This eliminates the need to transfer images between separate capture and processing devices, thereby improving processing speed and enabling real-time performance while reducing system complexity.
Solution Approach 2:
The photo-memory sensor serves dual functions: capturing images and storing them temporarily within the same device. This self-service capability allows the sensor to act as its own short-term memory device, eliminating the need for external transfer operations and enabling immediate processing.
2Loss of time
If images are transferred between separate devices, then data can be stored, but time delays and inefficiencies increase
Solution Approach 1:
By combining image capture and temporary storage in the photo-memory sensor, the system eliminates the time-consuming transfer step between devices. The sensor retains captured images temporarily, allowing immediate processing without transfer delays, thus reducing time loss and improving processing efficiency.
Solution Approach 2:
The photo-memory sensor enables continuous operation by maintaining captured images in memory for immediate processing. This eliminates interruptions caused by transfer operations, ensuring continuous useful action and improving overall processing efficiency.
3Loss of information
If conventional photo-sensors are used, then image capture is achieved, but data storage capability is lost
Solution Approach 1:
The photo-memory sensor is designed to perform multiple functions: capturing images and temporarily storing them. This universal sensor replaces the need for separate capture and storage components, maintaining data retention capability while actually reducing overall system complexity rather than increasing sensor complexity.
Solution Approach 2:
The sensor merges image capture and data storage functions into a single component. The photo-memory effect enables the sensor to retain captured images temporarily without requiring external storage devices, preventing information loss while simplifying the system architecture.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables faster data processing with high bandwidth, low power consumption, and scalability, facilitating neuromorphic pre-processing, image recognition, and in-pixel image pre-processing, suitable for applications in automation, security, and bionics.
Implementation Method 1
an optical sensor responsive to electromagnetic radiation, wherein the sensor exhibits a photo-memory effect causing the sensor to act as a short-term memory device
Implementation Method 2
data stored in the sensor acting as a short-term memory device is erasable by exposing the photo-sensor to electromagnetic radiation
Data Source
AI summary
An imaging device described herein for capturing image data comprises an optical sensor responsive to electromagnetic radiation, wherein the sensor exhibits a photo-memory effect causing the sensor to act as a short-term memory device; an exposure control device configured to adopt a first mode, wherein electromagnetic radiation reaches the sensor and a second mode, wherein electromagnetic radiation is restricted from reaching the sensor; a processor configured to receive sensor data from the sensor, and to cause the exposure control device to selectively adopt the first mode and the second mode; and a long term memory device accessible to the processor, wherein the processor is configured to read executable instructions from the long term memory and to write sensor data to the long term memory. Data stored in the sensor acting as a short-term memory device is erasable by exposing the photo-sensor to electromagnetic radiation.