Multi-channel Image Sensor for Simultaneous HD Video and Full-Resolution Snapshot Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image sensors face challenges in processing high-resolution snapshot and high-definition video data simultaneously due to data rate limitations and power consumption issues, leading to valuable image data loss through JPEG compression and video resizing.
Innovation Solution
A multi-channel image sensor system that uses a high-speed serial interface to deliver multiple image data streams, including full-resolution and resized video data, over separate channels to an image signal processor, enabling efficient processing and reducing power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If full-resolution snapshot images and HD video are delivered simultaneously over a single channel, then complete image data is provided, but data rate exceeds processor capacity and power consumption increases
Solution Approach 1:
The patent divides the image data stream into multiple separate channels: one channel carries full-resolution snapshot images while another channel carries resized HD video. This segmentation allows the image signal processor to receive complete image data without being overwhelmed by a single high-data-rate stream, as the processor can handle multiple lower-rate streams simultaneously.
Solution Approach 2:
The patent transitions from a single-dimensional data stream to a multi-dimensional approach by using multiple parallel data channels. Instead of trying to fit all data into one stream, the system uses spatial separation of data flows (different physical or logical channels) to deliver both full-resolution and resized video data simultaneously to the processor.
2Productivity
If JPEG compression is applied to snapshot images, then data rate is reduced, but valuable image information is lost
Solution Approach 1:
The patent applies different quality levels to different data streams based on their intended use. Full-resolution snapshot images are delivered without compression to preserve maximum image quality for tasks requiring detailed analysis (e.g., facial recognition, code scanning). Meanwhile, HD video is delivered at a reduced resolution appropriate for video playback, optimizing data rate for that specific application without compromising the quality needed for snapshot processing.
3Productivity
If video resolution is reduced before processing, then data processing load is decreased, but image detail is lost
Solution Approach 1:
The patent segments the video processing pipeline into two separate paths: one path delivers full-resolution snapshot images for detailed analysis, while another path delivers resized HD video for general video processing. This allows the system to maintain image detail where needed while reducing processing load for video streams, without forcing a compromise on either front.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution allows for the simultaneous processing of high-resolution snapshot and resized video data without losing valuable image information, enhancing data handling capacity and reducing power consumption, thereby supporting advanced image processing tasks like facial recognition and code scanning.
Implementation Method 1
a high-speed serial interface circuit coupled to the image pixel arrays and configured to transmit multiple streams of image data over separate channels from the image sensor array to the image signal processor
Data Source
AI summary
An imaging system may include a multi-channel image sensor. In a multi-channel image sensor, multiple image streams from a common pixel array may be provided to a common interface transport for output on multiple logic channels. Image streams may include high-definition (HD) video and snapshot image data. Video image data may be resized using resize circuitry on the image sensors. Snapshot image data may be processed by the image sensor. Full-resolution portions of snapshot images may be output concurrently with resized HD video image data on multiple logic channels to an image signal processor. In an alternative embodiment, stack memory on the image sensor may be used to store full-resolution snapshot image data. Full-resolution snapshot image data may then be output concurrently with resized HD video image data at a slower data rate than the video image data.