Stereo Camera Image Encoding for Depth-Color Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Stereo camera systems face challenges in simultaneously transmitting depth and color images with different resolutions and formats, leading to issues with image synchronization and transmission.
Innovation Solution
An image processing apparatus and camera module that includes sensor units for capturing left and right images, a pre-processing unit for separating brightness and chrominance information, and an image processing unit for generating, encoding, and synchronizing depth and color images, allowing for simultaneous transmission with adjusted bit allocation and size adjustment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If depth image and color image are transmitted with different resolutions and formats, then image quality and detail are preserved, but simultaneous transmission and synchronization cannot be achieved
Solution Approach 1:
The patent changes the resolution parameter of the color image to match the depth image resolution. The color image resolution is adjusted from its original high resolution (e.g., 1280×960) to match the depth image resolution (e.g., 640×480), enabling simultaneous transmission while maintaining depth image quality. This parameter adjustment resolves the contradiction by sacrificing some color image detail to achieve synchronized transmission.
Solution Approach 2:
The patent segments the transmission process into two parts: first transmitting the depth image at its original high resolution to preserve quality, then transmitting the color image at a reduced resolution that matches the depth image dimensions. This segmentation allows each image type to be optimized independently while ensuring simultaneous arrival at the receiver.
2Measurement precision
If high resolution camera is used for stereo camera system, then image detail and quality are improved, but different image resolutions and output formats between depth and color images cannot be simultaneously transmitted
Solution Approach 1:
The patent dynamically adjusts the color image resolution based on the depth image resolution requirements. Rather than using a fixed high resolution for color images, the system adaptively changes the color image dimensions to match the depth image, enabling flexible transmission that accommodates both high-detail depth imaging and compatible color image transmission.
Solution Approach 2:
The patent applies different quality levels to different image types locally. The depth image maintains its original high resolution and full detail for precise measurement applications, while the color image is locally adjusted to a lower resolution that matches the depth image parameters, ensuring transmission compatibility without compromising depth image quality.
3Reliability
If color image and depth image have different output formats (YCbCr 16 bits vs Y 8 bits), then各自 image characteristics are optimized, but simultaneous transmission to host system cannot be achieved
Solution Approach 1:
The patent makes the transmission system universal by adjusting the color image format and resolution to match the depth image parameters. This allows the transmission interface to handle both image types with the same parameters (640×480 resolution), enabling a single transmission channel to carry both depth and color images simultaneously without requiring separate optimized channels for each format.
Data Source
AI summary
An image processing apparatus and a camera module using the same are provided, the camera module comprises first and second sensor units each outputting left and right images, and an image processing unit configured to simultaneously encoding a depth image and a color image generated from the left and right images.