Image Sensor Event Data Line Information Frame Structure
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional Event-based Vision Sensors (EVS) face challenges in data output format determination due to their event-driven nature, requiring new evaluation systems to process data effectively.
Innovation Solution
An image sensor system that includes an event detecting unit and a data transmitting unit, which sets event data as payload data and adds line information to a frame structure, allowing for efficient data processing by a data processing device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If event data is transmitted in a conventional event-driven format without frame structure, then the sensor can detect luminance changes in real-time, but the data output format is undetermined and requires new evaluation systems
Solution Approach 1:
The patent applies universality by making the image sensor compatible with both conventional frame-based systems and event-driven systems. The sensor can output data in multiple formats (frame-based YUV data and event data with line information) simultaneously, allowing it to work with various evaluation systems without requiring separate hardware designs for each format.
Solution Approach 2:
The patent introduces line information as an intermediary element that bridges the gap between event-driven data and conventional frame-based processing systems. This line information, which includes timing and identification data, acts as a mediator that enables conventional evaluation systems to properly interpret and process event data without requiring fundamental system changes.
2Adaptability or versatility
If line information is added to frame structure for event data transmission, then data processing versatility is enhanced, but device complexity increases
Solution Approach 1:
The patent merges event data with line information within the existing frame structure, combining multiple data types into a unified transmission format. By integrating line information (which includes timing, identification, and control data) with event data in the same transmission buffer, the system reduces the need for separate data structures and simplifies the overall transmission architecture.
Solution Approach 2:
The patent segments the data transmission into distinct but organized sections: frame headers, line information blocks, and event data payloads. This segmentation allows the complex data structure to be managed systematically, with each section serving a specific function while maintaining overall organization and ease of processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the versatility of the image sensor system by enabling effective data processing and transmission of event data with line information, improving the handling of luminance changes in real-time.
Implementation Method 1
an event detecting unit configured to detect an occurrence of an event that is a luminance change of light received by a photodiode
Data Source
AI summary
The present disclosure relates to an image sensor, a data processing device, and an image sensor system capable of further improving versatility.An image sensor includes: an event detecting unit configured to detect an occurrence of an event that is a luminance change of light received by a photodiode; and a data transmitting unit configured to set event data representing details of the event as a part of payload data and transmit line information that is added to a line and relates to the event data in a frame structure in which the line information is stored in a beginning part of the payload data. In addition, a luminance detecting unit configured to detect luminance of light received by the photodiode and output a luminance signal representing a luminance value and an additional information generating unit configured to generate the line information added to a line as additional information that is additionally disposed in the event data on the basis of the event data are further included. The present technology for example, can be applies to an event-based vision sensor (EVS).