Interactive 360 Video Playback via Spatial Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 360 video recording technologies restrict viewer interaction and freedom in exploring virtual environments, as they are bound to the recording sequence and directions of the cameraman, limiting the ability to move around and explore surroundings interactively.
Innovation Solution
A system and method that record a geographical area into multiple video sections from different directions, associating time points with virtual locations, allowing viewers to choose their path by head movement or graphical overlays, enabling seamless integration of new video sections based on viewer decisions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 360 video is recorded from a fixed viewpoint position, then the video can be captured completely, but the viewer cannot move around or explore the surroundings interactively
Solution Approach 1:
The geographical area is divided into multiple area portions, and the video is recorded in separate video sections for each area portion. This segmentation allows the system to provide interactive navigation between different locations while maintaining manageable recording and processing complexity.
Solution Approach 2:
The patent transitions from traditional 2D video or 360-degree fixed viewpoint to a multi-dimensional virtual environment where viewers can navigate in six degrees of freedom (6DoF). This is achieved by recording from multiple viewpoints and enabling spatial navigation across different area portions.
2Adaptability or versatility
If 360 video is recorded from different positions to enable viewer movement, then viewer freedom increases, but multiple versions of content must be recorded from different positions
Solution Approach 1:
The system creates a universal virtual environment that can serve multiple viewing preferences and navigation paths. A single set of recorded video sections from different area portions can be combined to create a unified 6DoF experience, eliminating the need to create separate complete versions for different viewpoints.
3Ease of operation
If the viewer must follow the recording sequence, then the video playback is simple, but the viewer cannot choose their own path or explore surroundings interactively
Solution Approach 1:
The video playback system transitions from a static, linear sequence to a dynamic, interactive navigation system. Viewers can dynamically change their viewing path by navigating to different area portions based on their interests, while the system dynamically selects and plays back the appropriate video sections in real-time.
4Area of stationary object
If the camera moves in multiple directions to capture all area portions, then complete coverage is achieved, but the recording time and complexity increase
Solution Approach 1:
The system performs preliminary recording of multiple video sections from different area portions and directions before playback. During playback, the system efficiently assembles the appropriate sections based on viewer navigation, avoiding the need for real-time camera movement and reducing overall time loss.
Data Source
AI summary
A system, method, and Head-Mounted Display, HMD, apparatus for recording a video and playing back the video to a viewer in a Virtual Reality, VR, environment. A geographical area is recorded with an omnidirectional video recording camera by dividing the geographical area into a plurality of area portions and recording in separate video sections, each of the area portions while moving the camera in different directions. Time points in each video section are associated with virtual locations of the view. At a time point providing the viewer with a choice of directions to proceed, the system receives the viewer's choice and presents to the viewer, a video section corresponding to the virtual location of the viewer and the desired direction of movement. The viewer's choice may be indicated by detecting a direction of the viewer's field of view or by receiving from the viewer, a response to a banner notification.