3D Omnidirectional Video Parallax Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D omnidirectional video acquisition equipment is large, costly, and not portable, making it unsuitable for everyday use by individual users due to the need for multiple cameras and sufficient stereo baseline length to cover a full range of view.
Innovation Solution
A method and device that acquire two omnidirectional videos with stereoscopic parallax in a first direction, converting this parallax to a second direction to generate a third omnidirectional video, allowing for a 3D omnidirectional video effect with only two video acquisition equipment, reducing equipment size and cost.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple video acquisition equipments are arranged to form stereo pairs to cover full omnidirectional field of view, then the 3D omnidirectional video quality is improved, but the device size and cost increase
Solution Approach 1:
The patent transforms the traditional approach of using multiple cameras arranged in stereo pairs across two dimensions (horizontal and vertical) into a single-camera system that captures omnidirectional video in three-dimensional space. By using a fisheye lens with a specific field of view (e.g., 180 degrees or more) and processing the captured video through geometric transformation and warping techniques, the system generates multiple virtual camera views from a single physical camera, effectively solving the contradiction between video quality and device complexity
Solution Approach 2:
The patent creates virtual copies of camera views through computational processing. Instead of using multiple physical cameras, the system captures one omnidirectional video and generates multiple virtual camera perspectives by applying geometric transformations, warping, and rendering algorithms. These virtual camera views replicate what multiple physical cameras would capture, thereby maintaining 3D video quality while eliminating the need for multiple expensive camera components
2Reliability
If multiple video acquisition equipments are arranged to form stereo pairs to cover full omnidirectional field of view, then the 3D omnidirectional video quality is improved, but the cost increases
Solution Approach 1:
The patent makes a single video acquisition equipment perform multiple functions that traditionally required multiple cameras. The single camera captures omnidirectional video and through computational processing generates multiple virtual camera views, performs 3D rendering, and creates stereoscopic effects. This multi-functionality eliminates the need for multiple specialized camera components, thereby reducing cost while maintaining video quality
Solution Approach 2:
The patent creates virtual copies of camera views through computational processing. Instead of using multiple physical cameras, the system captures one omnidirectional video and generates multiple virtual camera perspectives by applying geometric transformations, warping, and rendering algorithms. These virtual camera views replicate what multiple physical cameras would capture, thereby maintaining 3D video quality while eliminating the need for multiple expensive camera components
3Measurement precision
If multiple video acquisition equipments are used to ensure sufficient stereo baseline length, then the stereo image disparity is improved, but the device size increases
Solution Approach 1:
The patent transitions from physical baseline separation in two dimensions to virtual baseline creation in three-dimensional computational space. By capturing omnidirectional video and applying geometric transformations, the system can generate virtual camera views with any desired baseline length and orientation without physically moving cameras apart. This allows sufficient stereo image disparity to be achieved through computational means rather than physical separation
Solution Approach 2:
The patent creates virtual copies of camera views at different positions and orientations through computational processing. The system generates virtual camera perspectives that simulate having cameras positioned at various locations with appropriate baseline lengths, thereby achieving sufficient stereo image disparity without the need for large physical device dimensions
Data Source
AI summary
The method of the present invention for processing a video comprises: acquiring a first and a second omnidirectional videos having a stereoscopic parallax in a first direction which is a corresponding column direction when the first and the second omnidirectional videos are unfolded by longitude and latitude; and, determining one or two third omnidirectional videos according to the first and the second omnidirectional videos, the second and the third omnidirectional videos having a stereoscopic parallax in a second direction, wherein, if one third omnidirectional video is determined, the second and the third omnidirectional videos have a stereoscopic parallax in the second direction; if two third omnidirectional videos are determined, the two third omnidirectional videos have a stereoscopic parallax in the second direction; and, the second direction is a corresponding row direction when the first and the second omnidirectional videos are unfolded by longitude and latitude.