Session Description Stream Association for Compatible 3DoF Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Media communication sessions with multiple media streams often face challenges due to device capability mismatches, leading to incompatible rendering and high complexity in managing multiple streams, especially in scenarios requiring three or more degrees of freedom (3DoF) like conversational virtual reality.
Innovation Solution
A session description is generated that includes media stream identifiers arranged to indicate a background media stream and associated overlay media streams, allowing devices to associate and render scenes with 3DoF by specifying synchronization sources, attributes, and playback modes, using protocols like SIP/SDP for session negotiation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple media streams are rendered to support diverse device capabilities, then adaptability is improved, but device complexity increases
Solution Approach 1:
The patent segments media streams into distinct types (e.g., background streams and overlay streams) and organizes them into separate groups. This segmentation allows devices to selectively process only the stream types their capabilities support, reducing overall complexity while maintaining adaptability across diverse device configurations
Solution Approach 2:
The session description protocol is designed to universally support multiple media stream types and rendering configurations through a standardized framework. This universal approach allows the same protocol to accommodate various device capabilities without requiring device-specific customizations, thereby improving adaptability without proportionally increasing complexity
2Quantity of substance
If all media streams are rendered regardless of device capability, then completeness of content delivery is improved, but rendering compatibility deteriorates
Solution Approach 1:
The patent implements preliminary capability exchange and stream classification during session establishment. Devices exchange information about their rendering capabilities before media streams are delivered, allowing the system to pre-determine which streams each device can handle. This preliminary action ensures complete content delivery to capable devices while preventing compatibility issues on incapable devices
Solution Approach 2:
The session description protocol acts as an intermediary between the media server and participant devices. It mediates the matching of media streams to device capabilities by translating server-side stream offerings into device-appropriate renderable formats, thereby ensuring both completeness of delivery and compatibility with receiving devices
3Manufacturing precision
If overlay media streams are associated with background media streams for 3DoF rendering, then scene rendering quality is improved, but synchronization complexity increases
Solution Approach 1:
The patent merges overlay media streams with their associated background media streams into unified rendering units for 3DoF scenes. By combining these streams with explicit association indicators in the session description, the system improves rendering quality through coordinated presentation while reducing synchronization complexity compared to handling independent streams
Data Source
AI summary
There is provided generating, at a control device of a media communication session between participant devices, a session description for the communication session, the session description including media stream identifiers and at least one element including an arrangement of the media stream identifiers indicating a background media stream and associated one or more overlay media streams, and sending, by the control device, the session description to the participant devices for indicating the participant devices to associate the background media stream with one or more overlay media streams for rendering a scene with at least three degrees of freedom.