AR Depth Sensing via Dual Camera CamCom Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Single camera Camera Communications (CamCom) setups in augmented reality (AR) systems face challenges in providing both visual images and data extraction from modulated lights, as they can either offer slow communications or fast communications but not both, and lack depth information extraction, which affects the AR user experience due to latency and mode switching.
Innovation Solution
A dual camera receiver system that includes an image data receiver, a modulated light detector, a representation generator, a region matcher, and a distance estimator to detect modulated lights, generate visual representations, match them with AR camera data, and estimate distances, allowing simultaneous depth information and data extraction from modulated light sources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single camera is used for CamCom, then data extraction from modulated lights is achieved, but communication speed is slow and depth information is lost
Solution Approach 1:
The system divides the camera functionality into two separate cameras: one dedicated to communication (CamCom) and another to augmented reality (AR) imaging. This segmentation allows each camera to specialize in its respective function, enabling the CamCom camera to achieve high-speed data extraction while the AR camera captures visual depth information, thereby resolving the contradiction between communication speed and depth measurement capability
Solution Approach 2:
The invention transitions from a two-dimensional image capture approach to a three-dimensional depth sensing approach by introducing a second camera. The disparity between corresponding points in the left and right camera images provides the third dimension (depth), enabling accurate depth measurement while maintaining high-speed communication capabilities through the specialized CamCom camera
2Adaptability or versatility
If a single camera switches between visual mode and communication mode, then both functions are achieved, but latency increases and user experience deteriorates
Solution Approach 1:
The system segments the camera functions into two permanent, specialized cameras rather than requiring one camera to switch modes. The CamCom camera remains dedicated to high-speed data extraction from modulated lights, while the AR camera continuously captures visual imagery. This eliminates mode-switching latency and provides continuous, simultaneous operation of both functions
Solution Approach 2:
The dual-camera system achieves multi-functionality at the system level rather than at the individual camera level. While each camera is specialized, the combined system provides both high-speed communication and visual imaging capabilities simultaneously, eliminating the need for any camera to switch between modes and thereby reducing latency
3Measurement precision
If a dual camera system is used, then depth information and data extraction are achieved simultaneously, but device complexity increases
Solution Approach 1:
The system segments the complex task of depth sensing and communication into two simpler, specialized camera functions. Each camera has a dedicated purpose, simplifying the processing requirements for each individual camera while achieving the complex overall goal of simultaneous depth measurement and high-speed communication through their coordinated operation
Solution Approach 2:
The invention uses a stereoscopic copying approach where the second camera creates a duplicate view of the scene from a slightly different position. By comparing the disparities between these copied views, the system extracts depth information without requiring complex single-camera processing, thereby reducing overall system complexity while maintaining accurate depth measurement
Data Source
AI summary
An example apparatus for depth sensing includes an image data receiver to receive image data from a communication camera and an augmented reality (AR) camera. The apparatus also includes a modulated light detector to detect one or more modulated lights in the image data from the communication camera. The apparatus further includes a representation generator to generate a visual representation of a local image region for each of the detected modulated lights. The apparatus includes a region matcher to match the visual representation for each of the detected modulated lights with a region in the image data received from the AR camera. The apparatus also further includes a distance estimator to estimate a distance between a dual camera receiver and the one or more modulated lights based on a disparity between a position of the visual representation and a position of the matched region in the image data.