3D Video Rendering Beyond the Screen for VR/AR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current techniques for rendering 3D videos in VR/AR environments fail to present a realistic and interactive experience, as the videos often appear flat and lack depth when displayed.
Innovation Solution
The method involves generating and rendering 3D models outside the display screen, using stereoscopic 3D videos with animations that extend beyond the planar surface, incorporating depth information, and utilizing a video file format with control data to trigger rendering at appropriate times, along with a display system that includes modules for processing and rendering 3D models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional 3D video rendering techniques are used in VR/AR environments, then the display process is simple, but the videos appear flat and lack depth
Solution Approach 1:
The patent transitions from traditional 2D video rendering to volumetric 3D modeling, where videos are represented as three-dimensional voxel data structures. This dimensional transformation enables objects to extend beyond the screen plane into the virtual space, creating true depth perception in VR/AR environments by adding the Z-dimension to the traditional X-Y video plane.
Solution Approach 2:
The patent introduces 3D models as intermediary elements between the video content and the VR/AR display system. These 3D models serve as mediators that translate flat video frames into spatially-aware volumetric representations, allowing video objects to interact with the virtual environment and user space while maintaining the original video content integrity.
2Adaptability or versatility
If 3D videos are displayed in VR/AR environments, then the viewing experience is enhanced, but interactivity is reduced
Solution Approach 1:
The patent transforms static video playback into a dynamic, interactive experience by enabling 3D video objects to move freely in the virtual space, respond to user gestures, and change states based on user input. The volumetric 3D models can be manipulated, examined from different angles, and integrated with other virtual objects, creating a versatile interactive environment while maintaining playback stability through controlled animation sequences.
Data Source
AI summary
Disclosed is an approach for displaying 3D videos in a VR and/or AR system. The 3D videos may include 3D animated objects that escape from the display screen. The 3D videos may interact with objects within the VR and/or AR environment. The 3D video may be interactive with a user such that based on user input corresponding to decisions elected by the user at certain portions of the 3D video such that a different storyline and possibly a different conclusion may result for the 3D video. The 3D video may be a 3D icon displayed within a portal of a final 3D render world.