Video Pass-Through System Using Grayscale and Color Cameras
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video pass-through systems using a single color camera for mixed reality applications face limitations due to a narrow field of view, leading to incomplete and imperfect real-world views, and higher costs compared to dual-camera systems.
Innovation Solution
A video pass-through system incorporating at least one grayscale camera and one color camera, with a processor to capture grayscale and color images, process them, and generate a color pass-through view, enhancing the field of view and reducing costs by utilizing a single color camera.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If a single color camera is used to implement video pass-through function, then cost is reduced, but field of view is limited and real-world view is incomplete
Solution Approach 1:
The patent combines grayscale cameras and color cameras into a unified video pass-through system. The grayscale cameras capture a broader field of view while the color camera provides color information, and their data is merged through image fusion algorithms to produce a complete color pass-through view that exceeds the capabilities of either camera type alone.
Solution Approach 2:
The system assigns multiple functions to different camera types: grayscale cameras serve both as primary wide-angle capture devices and as depth/structure sensors, while the color camera provides color information that is applied across the entire fused view. This multi-functional approach allows a single color camera to effectively cover a broader visual scope.
2Area of moving object
If two color cameras are used to implement video pass-through function, then field of view is improved, but cost increases
Solution Approach 1:
The patent applies different quality levels to different parts of the imaging system: grayscale cameras (lower cost, higher resolution for structure) are used for broad coverage while a single color camera (higher cost, lower resolution) is used strategically to provide color information. This local differentiation optimizes the balance between cost and performance.
Solution Approach 2:
The system creates a virtual color representation of the entire scene by copying color information from the color camera onto the grayscale imagery from multiple grayscale cameras. This copying process, enhanced by image fusion algorithms, allows the system to simulate what two color cameras would capture using only one color camera and multiple grayscale cameras.
3Quantity of substance
If a single color camera is used, then cost is reduced, but measurement precision of real-world view deteriorates
Solution Approach 1:
The patent segments the imaging task into different components: grayscale cameras handle spatial resolution, depth perception, and wide-area coverage, while the color camera handles color accuracy. Image fusion algorithms then integrate these segmented data streams, allowing each camera type to optimize for its strength while contributing to overall measurement precision.
Solution Approach 2:
The system creates a composite visual output by combining grayscale imagery and color imagery into a unified color pass-through view. This composite approach leverages the high spatial precision of grayscale cameras and the color accuracy of the color camera, achieving measurement precision that exceeds what a single color camera could provide alone.
Data Source
AI summary
A real-world view display method applied to a video pass-through system, wherein the video pass-through system includes at least one grayscale camera, a color camera and at least one processor. The real-world view display method includes: by the at least one grayscale camera, capturing at least one grayscale image of a physical environment for generating a grayscale pass-through view corresponding to the physical environment; by the color camera, capturing at least one color image of the physical environment; and by the at least one processor, processing the grayscale pass-through view according to the at least one color image to render a color pass-through view in an immersive content, wherein the color pass-through view is corresponding to the physical environment.