Cloud Game Stream Segmentation for Dynamic Display Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data streaming services do not account for the display capabilities and network quality of devices, leading to undesirable display scenarios such as unreadable text or inappropriate aspect ratios, and network latency issues that cause user frustration, especially in applications sensitive to latency like video games.
Innovation Solution
A method that determines the display capabilities of an output device and formats separate data streams for video and user interface (UI) data, allowing for dynamic adjustment and delivery of optimized streams based on device specifications and network conditions, including separate rendering of video and UI data to ensure clarity and usability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data streaming services transmit data without considering device display capabilities, then network bandwidth utilization is maximized, but display quality and readability deteriorate
Solution Approach 1:
The patent segments the data stream into separate video stream and UI stream components, allowing independent optimization of each stream according to device capabilities. This enables selective quality adjustment for different data types while managing overall bandwidth usage efficiently.
Solution Approach 2:
The patent applies local quality by adjusting the quality parameters of video and UI streams differently based on the specific display capabilities of the target device. Each stream can have its resolution, bitrate, and format optimized independently for the device's screen characteristics.
2Manufacturing precision
If separate streams for video and UI data are formatted and delivered, then display quality and readability improve, but data stream complexity increases
Solution Approach 1:
By dividing the data stream into separate video and UI components, the patent enables targeted quality optimization for each type of data. This segmentation allows the system to apply appropriate compression and formatting techniques specific to each stream type, improving overall display quality while managing complexity through organized separation.
Solution Approach 2:
The patent implements dynamic stream formatting that adapts to the capabilities of the receiving device. The system can dynamically adjust the quality, resolution, and format of each stream based on real-time device information, allowing high quality output without requiring fixed complex processing for all scenarios.
3Speed
If network latency is reduced through various client device methods, then data transmission speed improves, but inconsistencies in latency experience persist across different devices
Solution Approach 1:
The patent changes key parameters of the data streams including resolution, bitrate, and format based on device capabilities and network conditions. By dynamically adjusting these parameters, the system optimizes transmission speed for each device while maintaining consistent latency performance across different hardware configurations.
Solution Approach 2:
The system incorporates feedback mechanisms that monitor network conditions and device performance, then adjust stream parameters accordingly. This feedback loop enables the system to maintain consistent latency by adapting to varying network conditions and device capabilities in real-time.
4Device complexity
If media is displayed without considering device orientation, then rendering simplicity is maintained, but viewing usability deteriorates in certain orientations
Solution Approach 1:
The patent implements dynamic stream formatting that adapts to the receiving device's orientation and display capabilities. The system can dynamically rotate or reorient the video and UI streams to match the device's current orientation, ensuring optimal viewing usability without requiring complex manual adjustments.
Data Source
AI summary
In dynamic adjustment of data streamed over a network for display on an output device, display capability information of an output device is requested and received. The display capability information includes information indicating whether the output device is in a horizontal or vertical orientation relative to a user. Two or more data streams configured for display on the output device are formatted such that in a manner consistent with the display capability information and formatted for either vertical or horizontal orientation of the output device. The data streams include a user interface data stream and a separate video data stream. The user interface data and the video data are scaled separately. The streams are delivered to the output device via a network connection by a server to a client device platform used in combination with the output device.