Stereoscopic 3D Video Capture and Rendering with HMD Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current simulated reality systems, such as VR and AR, lack the ability to capture and render immersive, real-time video feeds of remote real-world environments, and existing video cameras only capture single-view feeds, limiting user experience and application potential.
Innovation Solution
The development of techniques to capture and render stereoscopic 3D video feeds using multiple cameras, which are controlled remotely by a head-mounted display (HMD) device, allowing users to experience immersive 3D environments and enabling real-time stitching of video streams into a single 180-degree panoramic view, along with the ability to pair service providers with services over networks for remote interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple video cameras are used to capture stereoscopic 3D video feeds, then immersive 3D environment experience is improved, but device complexity and processing requirements increase
Solution Approach 1:
The video processing system is segmented into multiple independent channels, each handling a specific subgrid region of the stereoscopic video feed. This allows parallel processing of different spatial regions, managing the complexity of handling multiple camera feeds by dividing the overall processing task into manageable, independent segments that can be handled simultaneously.
Solution Approach 2:
The system transitions from processing complete video frames to processing subdivided subgrids, adding a spatial dimension to the processing architecture. By organizing video data into a grid structure and processing individual subgrids, the system manages the complexity of stereoscopic 3D video from multiple cameras through dimensional decomposition of the processing space.
2Adaptability or versatility
If real-time stitching of multiple camera video feeds is performed, then immersive panoramic view is improved, but processing time and computational load increase
Solution Approach 1:
The panoramic stitching process is segmented into independent subgrid processing operations. Each subgrid from multiple camera feeds is processed separately and simultaneously, allowing the system to stitch together immersive panoramic views in real-time by parallelizing the stitching operations across different spatial regions rather than processing the entire panoramic image sequentially.
Solution Approach 2:
The system maintains continuous real-time processing of video feeds by continuously stitching subgrids from multiple cameras without interruption. The parallel processing architecture ensures that the useful action of video stitching continues uninterrupted, delivering real-time immersive panoramic views by maintaining constant processing flow across all camera feeds simultaneously.
3Adaptability or versatility
If video feeds are transmitted over network channels, then remote service interactions are enabled, but transmission efficiency and bandwidth usage worsen
Solution Approach 1:
Video feeds are segmented into subgrids that are transmitted as separate channels over the network. This segmentation allows for more efficient bandwidth utilization by enabling selective transmission of only those subgrids that contain relevant or changed information, reducing overall bandwidth consumption while still enabling comprehensive remote service interactions through the aggregated subgrid data.
Solution Approach 2:
The system transmits only the necessary portions of video data (specific subgrids) rather than complete video feeds. By transmitting partial video information corresponding to specific regions of interest or changed areas, the system reduces bandwidth consumption while maintaining the capability for effective remote service interactions through the transmitted subgrid channels.
Data Source
AI summary
The disclosed techniques involve simulated reality systems, which can include a head mounted display (HMD) device that can remotely control a three-dimensional (3D) stereoscopic camera rig based on position, motions, and/or orientation data of the HMD device. The system may include multiple video cameras arranged side-by-side on a rig to capture video feeds of a real-world environment that can be stitched together in real-time to create a single stereoscopic 3D, 180 degree video rendered with a HMD as a panoramic video. An example of a use case includes pairing automotive body shops and insurance claims adjusters, and allowing them to perform insurance claim adjustments remotely via a live peer-to-peer video. Further, a process of creating an algorithm that pairs vehicle damages with insurance claim adjusters who have experience with particular vehicle makes and models is disclosed.