Parametric Capture of Live-Streaming Events for XR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies for live-streaming events lack the capability to capture and render three-dimensional representations of discrete elements such as participants, objects, and environmental aspects in real-time, limiting the immersive experience offered by Extended Reality (XR) devices.
Innovation Solution
The method involves capturing discrete elements during a live event, processing image data to construct three-dimensional and two-dimensional representations, integrating these representations, and rendering a photorealistic image of the scene for display on XR devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional live-streaming technologies are used, then the system complexity is low, but the capability to capture and render three-dimensional representations in real-time is lacking
Solution Approach 1:
The system segments the live event scene into discrete elements (participants, objects, environmental aspects) and processes each element independently through specialized modules including image data capture, three-dimensional representation construction, and rendering modules. This segmentation enables the complex three-dimensional capture capability to be achieved through coordinated simpler subsystems.
Solution Approach 2:
The patent introduces intermediary processing modules that bridge traditional live-streaming and advanced three-dimensional rendering. These intermediaries include image data processing modules that construct three-dimensional representations from captured footage, and rendering modules that integrate these representations into the final broadcast, allowing gradual integration of complex capabilities.
2Reliability
If three-dimensional representations are constructed in real-time, then the immersive experience is enhanced, but the processing time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by pre-processing image data to extract key features and construct preliminary three-dimensional representations during the event setup and pre-broadcast phases. This allows the main real-time rendering to focus on updating and animating these pre-constructed models rather than building them from scratch, significantly reducing processing time during live broadcast.
Solution Approach 2:
The patent implements dynamic processing where the level of three-dimensional representation detail and processing intensity adapts based on scene complexity, available computational resources, and broadcast requirements. The system dynamically adjusts the fidelity of three-dimensional models and the frequency of updates to maintain immersive quality while managing processing time constraints.
Data Source
AI summary
Embodiments of the present disclosure may include a method for parametric capture of an event including capturing discrete elements. In some embodiments, the discrete elements may include at least one participant, a three dimensional object, and an environmental aspect of the event. Embodiments may also include filming a live event to create image data from a scene. In some embodiments, a frame of the image data from the scene may include a discrete element. In some embodiments, the discrete element includes at least one of the three dimensional object, at least one participant, or the environmental aspect of the event. Embodiments may also include receiving the image data of the scene. Embodiments may also include identifying at least one discrete element within the image data from the scene. In some embodiments, the discrete elements may be associated with one or more characteristics.