Dynamic Vision Sensor Edge Detection for RGB Image Motion Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image sensors, such as RGB sensors, struggle to accurately track the moving line of a moving object due to limitations in shooting speed and excessive resource consumption, and often synthesize unwanted movements, especially when multiple objects or background movement is present.
Innovation Solution
An electronic device equipped with both an RGB sensor and a dynamic vision sensor, where a processor detects signals, captures images, identifies object edges from dynamic vision sensor data, and generates a synthesized image with edge-related effects applied to the RGB image, allowing precise representation of moving lines with low power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If an RGB sensor is used to track the moving line of a moving object, then the image quality and color information are improved, but the shooting speed is limited and resource consumption is excessive
Solution Approach 1:
The patent segments the image processing task by using the RGB sensor only for capturing the main image while delegating the moving line detection to the dynamic vision sensor. This division allows each sensor to operate in its optimal performance range, with the RGB sensor providing high-quality color images and the dynamic vision sensor providing high-speed motion detection data.
Solution Approach 2:
The processor acts as an intermediary that combines data from both sensors. It integrates the high-speed motion detection results from the dynamic vision sensor with the high-quality color image from the RGB sensor to generate the final output with moving lines overlaid on the original image.
2Measurement precision
If an RGB sensor is used to track the moving line of a moving object, then the image quality is improved, but the resource consumption is excessive
Solution Approach 1:
The patent segments the computational workload by assigning moving line detection to the dynamic vision sensor which is optimized for this task, rather than using the RGB sensor for both image capture and motion detection. This reduces the overall computational resources required while maintaining image quality.
Solution Approach 2:
The system uses the dynamic vision sensor to create a simplified representation of motion (moving lines) that is then overlaid on the RGB image. This copying approach allows motion tracking without requiring the RGB sensor to perform computationally intensive motion analysis.
3Measurement precision
If an RGB sensor is used to synthesize moving lines, then the color information is preserved, but unwanted movements are synthesized including multiple objects and background movement
Solution Approach 1:
The patent applies local quality by using the dynamic vision sensor specifically for detecting the moving lines of interest, while the RGB sensor provides the color information. The processor then selectively overlays only the relevant moving lines from the dynamic vision sensor data onto the RGB image, ensuring that only desired objects are tracked with high reliability.
Data Source
AI summary
According to various embodiments, an electronic device is provided. The electronic device includes a display, a RGB sensor including a plurality of first pixels, a dynamic vision sensor including a plurality of second pixels, and a processor electrically connected with the display, the RGB sensor, and the dynamic vision sensor. The processor may be configured to detect a first signal to request to capture an image, obtain a first image including a first object using the RGB sensor, based on the detection of the first signal, identify at least one edge of the first object corresponding to at least one second image obtained during a first period specified by a time of detecting the first signal, among a plurality of second images obtained using the dynamic vision sensor, generate a synthesized image in which an effect related to the at least one edge of the first object is applied to the first image, and control the display to display the synthesized image.