3GPP SDP Overlay Attributes for Occlude-Free 360 Conferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3GPP standards for 360 video conferencing do not provide a method for signaling occlude-free regions in 360 videos, which are regions containing important information that should not be obscured by overlays from other participants' videos.
Innovation Solution
A method is introduced to define and signal occlude-free regions in 360-degree videos using a Session Description Protocol (SDP) via a 3GPP overlay attribute, ensuring these regions are not overlaid by other images or videos, and update this information during the session as needed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If 360 video takes entire screen to maximize display utilization, then display area is improved, but overlay visibility from other participants deteriorates
Solution Approach 1:
The patent segments the 360 video display into occlude-free regions and occluded regions. The occlude-free regions are specifically identified areas where overlays should not be placed, while other regions can accommodate overlays from other participants. This segmentation allows the system to maintain full-screen 360 video display while preserving overlay visibility in specific areas.
Solution Approach 2:
The patent applies local quality by differentiating the display properties of different regions. In occlude-free regions, the display maintains the original 360 video content without overlays, while in other regions, overlays from other participants are displayed. This creates different visual qualities in different locations to satisfy both full-screen display and overlay visibility requirements.
2Quantity of substance
If overlays are added to 360 video to show multiple participants, then information completeness is improved, but visual clarity of important regions deteriorates
Solution Approach 1:
The patent segments the video content into occlude-free regions that maintain visual clarity and occluded regions that can contain overlays. This segmentation allows the system to preserve visual clarity in important regions while still providing overlay information from other participants in appropriate areas.
Solution Approach 2:
The patent introduces an intermediary mechanism through the occlude-free region definition that mediates between the desire to show multiple participants via overlays and the need to maintain visual clarity. The intermediary structure allows selective overlay placement while protecting important visual regions.
3Device complexity
If current 3GPP standard is used without occlude-free region signaling, then protocol simplicity is improved, but overlay placement accuracy deteriorates
Solution Approach 1:
The patent extends the existing 3GPP SDP protocol with a new attribute that serves multiple functions: it defines occlude-free regions, indicates overlay placement restrictions, and maintains compatibility with existing 3GPP video conferencing frameworks. This universal extension allows the protocol to handle both simple and complex overlay scenarios.
Solution Approach 2:
The patent modifies the SDP protocol by adding new parameters and attributes related to occlude-free regions. These parameter changes enable precise overlay placement control while maintaining the overall simplicity of the SDP framework. The new parameters provide detailed information about region boundaries and overlay restrictions.
Data Source
AI summary
A including receiving a first video input corresponding to a 360-degree video; receiving one or more second video inputs; defining one or more occlude-free regions in the first video input, each occlude-free region indicating an area of the video that is not overlayed by another image or video; signaling location information of the one or more occlude-free regions in a session description protocol (SDP) via a 3rd Generation Partnership Project (3GPP) overlay attribute, wherein the 3GPP overlay attribute signals whether a respective 3GPP overlay is intended for a occlude-free area or dedicated to a specific overlay; transmitting the SDP to a receiver; and rendering an output video that includes the first video input with the one or more second video inputs overlaid in a region not including the one or more occlude free regions.