Hemispheric Multicamera System for Immersive VR Parallax
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 360-degree capture and display technologies require multiple cameras to cover a full sphere, leading to increased cost, size, and complexity, and struggle with achieving free-angle parallax between eye views, especially when used with head-mounted displays that allow free rotation.
Innovation Solution
A multicamera system with cameras arranged to cover a hemispheric field of view, using overlapping wide-angle lenses and carefully selected camera placements to reduce the number of cameras needed, allowing for arbitrary selection of left and right eye cameras and achieving vertical parallax, along with methods for smooth view switching and synthesis to maintain user orientation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple cameras are used to cover a full sphere for 360-degree capture, then the field of view coverage is improved, but the cost, size, and device complexity increase
Solution Approach 1:
The patent segments the full spherical field of view into a hemispheric portion and uses multiple cameras strategically positioned to cover only the hemispheric area. This segmentation approach reduces the number of cameras needed while still providing sufficient coverage for stereoscopic viewing, thereby reducing device complexity and cost.
Solution Approach 2:
The patent makes the captured content adaptable to multiple display scenarios by capturing hemispheric content that can be presented both in VR mode (where the user looks around) and non-VR mode (where specific views are selected). This multi-functionality allows the same camera system to serve different purposes, reducing the need for specialized equipment.
2Area of stationary object
If multiple cameras are used to cover a full sphere, then the field of view coverage is improved, but the cost and size increase
Solution Approach 1:
The patent segments the full spherical field of view into a hemispheric portion and uses multiple cameras strategically positioned to cover only the hemispheric area. This segmentation approach reduces the number of cameras needed while still providing sufficient coverage for stereoscopic viewing, thereby reducing device complexity and cost.
3Area of stationary object
If traditional multicamera systems are used, then field of view coverage is achieved, but free-angle parallax between eye views cannot be achieved
Solution Approach 1:
The patent captures hemispheric content that includes both horizontal and vertical angular dimensions, enabling the system to provide parallax effects in multiple directions. By capturing in this extended angular space, the system can synthesize views with free-angle parallax that traditional planar camera arrays cannot achieve.
Solution Approach 2:
The patent changes the angular parameters of the captured content by recording hemispheric views that encompass a wider range of angles than traditional camera systems. This parameter change in the captured data enables subsequent synthesis of views with arbitrary parallax angles, providing the desired adaptability.
4Adaptability or versatility
If view switching is implemented in 360-degree content, then different perspectives can be provided, but user orientation may be lost
Solution Approach 1:
The patent introduces synthesized intermediate views that serve as transitional content between different captured perspectives. These intermediary views maintain spatial continuity and help users understand their orientation during transitions, preventing disorientation while still enabling view switching.
Solution Approach 2:
The patent pre-processes the captured hemispheric content to identify and mark transition regions where view switching can occur. By preparing these transition paths in advance, the system can smoothly guide users between perspectives while maintaining their sense of orientation, rather than making abrupt transitions.
Data Source
Figure 1
Figure 2a~2b
Figure 3
AI summary
The invention relates to a method and apparatus for implementing the method. The method comprises receiving a first captured stream of an event from a first multicamera; providing on a head mounted display a presentation of the first captured stream; receiving at least a second captured stream of the event from at least a second multicamera, wherein the first and the second captured streams have been captured simultaneously from different perspectives of the event; switching the presentation of the first captured stream on the head mounted display to a presentation of the second captured stream, wherein the switching comprises rendering on the head mounted display a presentation of at least one view between the first and second multicameras, wherein the rendering depends on the intrinsic and extrinsic parameters of the at least two multicameras.