Volumetric Video Occlusion Mitigation via Object Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users experiencing volumetric video presentations often face obstructions that hinder their view of important objects due to occlusions, movements, or sizing issues within the scene, making it difficult to distinguish or focus on specific elements.
Innovation Solution
A method and system that detect objects of focus and apply manipulations such as transparency changes, rotation, or viewpoint adjustments to mitigate occlusions, allowing users to interactively improve their viewing experience by rendering new volumetric videos or 2D projections, with options based on user profiles and device capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If volumetric video is presented with multiple objects in a scene, then the scene complexity and information content increase, but occlusions and obstructions of important objects occur
Solution Approach 1:
The patent extracts and removes occluding objects from the volumetric video scene when they block important objects. The system identifies occlusions, selects the occluding object, and removes it from the presentation to improve visibility of the focused object, directly applying the extraction principle to eliminate harmful visual obstructions.
Solution Approach 2:
The patent applies local quality by making specific regions of the volumetric video (where important objects are located) have different visual properties than other regions. The system adjusts transparency, removes occlusions, and modifies rendering in localized areas to ensure important objects remain visible while preserving the rest of the scene.
2Manufacturing precision
If object manipulations are applied to mitigate occlusions, then the clarity of important objects improves, but the processing complexity and computational resources increase
Solution Approach 1:
The patent applies preliminary action by pre-processing volumetric video content to identify and prepare object models for potential manipulation. The system pre-identifies important objects, pre-detects potential occlusions, and pre-preps manipulation options before actual playback, reducing real-time processing complexity while maintaining high visibility quality.
Solution Approach 2:
The patent uses copying by creating and manipulating digital models of objects within the volumetric video. Instead of re-rendering entire scenes, the system works with copied object representations, applying transformations to occluding objects or their proxies to achieve the desired visual effect with reduced computational overhead.
3Ease of operation
If user-specific manipulations are provided to maintain focus on important objects, then the user experience improves, but the system complexity and storage requirements increase
Solution Approach 1:
The patent applies segmentation by dividing the volumetric video content into separate object models and scene components. This allows the system to store and manipulate individual objects independently, applying user-specific manipulations only to relevant portions rather than entire scenes, thereby reducing storage requirements while maintaining personalized user experience quality.
Solution Approach 2:
The patent uses parameter changes by storing and applying transformation parameters (rotation, translation, scaling, transparency) rather than storing multiple complete versions of manipulated videos. The system modifies object parameters dynamically based on user preferences and detected occlusions, reducing storage needs while providing customized viewing experiences.
Data Source
AI summary
A processing system having at least one processor may detect a first object in a volumetric video that is a focus of a user viewing a presentation of the volumetric video, detect an obstruction of a view of the user of at least a portion of the first object in the volumetric video, and perform at least one manipulation of the presentation of the volumetric video to the user to mitigate the obstruction of the view.