Real-time Spherical Video Stitching and Immersive Display Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional digital video cameras allow for real-time adjustments of camera settings, but omnidirectional video cameras with spherical fields of view face complexity due to distortion in equirectangular projections, making it difficult to implement real-time changes effectively.
Innovation Solution
A system comprising a video source and a computing device that performs stitching operations on multiple video streams to generate a spherical field of view, allowing real-time adjustments of camera and stitching parameters in response to user commands, enabling immersive display and sharing of spherical videos across multiple platforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If equirectangular projection is used to display spherical scene on rectangular display, then the spherical scene can be displayed on conventional displays, but the distortion hides issues with omnidirectional video camera settings
Solution Approach 1:
The patent transitions from 2D rectangular display to 3D spherical/immersive display, allowing the spherical video content to be viewed without equirectangular projection distortion. This dimensional change enables accurate representation of the spherical scene geometry while maintaining display compatibility through multiple viewing angles and projections.
2Ease of operation
If conventional digital video camera is used, then real-time adjustments of camera settings are straightforward, but the field of view is limited and cannot capture spherical scenes
Solution Approach 1:
The patent combines multiple video feeds from omnidirectional cameras into a single spherical video stream, merging multiple limited fields of view into a complete 360-degree spherical view. This allows the system to capture the entire spherical scene while maintaining real-time adjustability through the immersive display interface.
Solution Approach 2:
The immersive display system provides multiple functions: it can display spherical video in various projections (equirectangular, cubic, etc.), allow real-time camera parameter adjustments, and adapt to different viewing orientations. This multi-functionality replaces the simple single-function adjustment of conventional cameras.
3Area of moving object
If omnidirectional video camera is used to capture spherical scene, then the field of view is expanded to 360 degrees, but changing camera settings becomes more complex due to equirectangular projection distortion
Solution Approach 1:
The patent introduces an immersive display as an intermediary between the omnidirectional camera and the user. This intermediary provides a natural interface for adjusting camera parameters by allowing the user to navigate the spherical scene visually and select regions of interest, replacing complex technical parameter adjustments with intuitive spatial interactions.
Data Source
AI summary
A system includes a video source and a computing device. The video source may be configured to generate a plurality of video streams that capture a view of an environment. The computing device generally includes one or more processors configured to (i) perform a stitching operation on the plurality of video streams to generate a video signal representative of a spherical field of view of the environment, (ii) transmit a display signal that represents a projection of the video signal to be displayed to a user utilizing an immersive display, (iii) receive a plurality of commands from the user while the user observes the environment in the immersive display and (iv) adjust a plurality of parameters in one or more of the video source and the stitching operation in real time in response to the commands.