Multi-Crop Image Sensor Bandwidth Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The limitation of bandwidth in the interface through which image data from image sensors are transmitted makes it impossible to obtain ultra-high definition (UHD) image data every frame and provide a video in real time, despite the increasing number of pixels in image sensors.
Innovation Solution
An electronic device is configured with multiple image sensors and an image signal processor that generate and crop image data to provide a method for transmitting UHD video streams within a limited bandwidth by using a multi-crop function, allowing for efficient delivery of UHD images associated with specific objects by switching between whole low-resolution and partial ultra-high-resolution image streams based on user input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If UHD image data is transmitted every frame, then image quality is improved, but bandwidth consumption increases beyond available limits
Solution Approach 1:
The image data is segmented into multiple crops, where only specific regions of interest are extracted and transmitted at UHD quality, while other regions are transmitted at lower resolutions. This segmentation allows the system to provide high-quality images of specific objects without transmitting the entire UHD frame, thereby reducing overall bandwidth consumption while maintaining image quality for important regions.
2Area of stationary object
If multiple image sensors are used to capture different fields of view, then image coverage is improved, but device complexity increases
Solution Approach 1:
Multiple image sensors are configured to serve different functional purposes: one sensor captures a wide field of view for overview and context, while another sensor captures a narrow field of view for detailed close-up shots. This multi-functionality allows the system to handle both wide-scene and close-up scenarios without requiring complex mechanical zoom or focus mechanisms, thereby improving field of view coverage while managing device complexity through functional specialization.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the real-time provision of UHD video streams within limited bandwidth constraints by efficiently managing image data transmission, ensuring that UHD images of specific objects are selectively provided to users without the need for continuous high-bandwidth transmission.
Implementation Method 1
The CMOS image sensor includes pixels including CMOS transistors and converts light energy to an electrical signal by using a photoelectric conversion element included in each pixel
Data Source
AI summary
An electronic device includes first and second image sensors, an image signal processor, and a main processor. The first and second image sensors photograph an object in first and second FOVs to generate first and second signals, respectively. The image signal processor generates first image data based on the first signal, generates second image data based on the second signal, and generates cropped image data based on cropping ROI from the second image data. The main processor generates a first video stream based on the first image data, generates a second video stream based on the cropped image data, and outputs the first video stream to a display device. The main processor stops outputting the first video stream to the display device and initiates outputting the second video stream to the display device in response to receiving a user input command.