AR View Generation for Seamless Physical-Virtual Camera Transitions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) and extended reality (XR) film sets are limited by the inability to seamlessly transition between physical and virtual cameras, and extending the environment beyond the boundaries of physical LED screens, particularly in creating a 360-degree immersive experience.
Innovation Solution
A system that utilizes rail systems to guide virtual camera movements, allowing seamless transitions between physical and virtual cameras by using the same tracking data, and extends the environment to all sides of the LED screen, including above and below, using both physical and virtual camera feeds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a physical LED screen is used to display XR background, then the background can be displayed, but the environment cannot be extended seamlessly beyond the LED screen boundaries
Solution Approach 1:
The patent merges physical LED screen display with augmented reality visualization by combining the two camera systems (practical camera for physical set and virtual camera for XR environment) into a unified tracking and rendering system. This integration allows seamless transition between physical and virtual environments, extending the display area beyond physical boundaries while maintaining visual continuity.
Solution Approach 2:
The patent introduces an intermediary system consisting of tracking data processing and rendering engines that mediate between the physical camera feeds and virtual camera paths. This intermediary layer enables seamless blending of physical LED screen content with augmented reality extensions, creating a continuous environment that transcends physical display boundaries.
2Adaptability or versatility
If camera movement is limited to physical set boundaries, then the physical environment can be captured, but a 360-degree immersive experience cannot be achieved
Solution Approach 1:
The patent implements dynamic camera movement by switching between practical camera (physical set) and virtual camera (XR environment) based on the desired viewpoint. The system dynamically adjusts the camera path and rendering content to provide 360-degree immersion while maintaining manageable system complexity through automated tracking and blending.
Solution Approach 2:
The patent creates a universal camera system that can operate in multiple modes: physical camera mode for capturing real-world sets, virtual camera mode for XR environments, and blended mode for seamless transitions. This multi-functional approach enables 360-degree immersion without requiring separate complex systems for each mode.
3Length of stationary object
If AR extension is added above LED screen, then the environment can be extended vertically, but seamless transition between LED top and AR content is difficult
Solution Approach 1:
The patent applies preliminary action by pre-defining virtual camera pathways and tracking zones that correspond to specific regions of the physical set. Before the actual rendering occurs, the system pre-calculates transition points and blending parameters, ensuring seamless connection between LED screen content and AR extensions without requiring high-precision real-time adjustments.
Data Source
AI summary
An apparatus, method, and computer-readable medium for generating a view of an augmented reality environment includes: generating an augmented reality (AR) environment based at least in part on one or more audiovisual feeds of a set captured by one or more physical cameras and one or more three-dimensional graphics models of a virtual environment; tracking a current viewpoint location within the AR environment, the current viewpoint location corresponding to one or more of a physical location of a physical camera in the one or more physical cameras or a virtual location of a virtual camera in the virtual environment; and generating a view of the AR environment based at least in part on the current viewpoint location.