Graphical Command Token Modification for Real-Time Video Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video streaming methods in wireless display systems face challenges in modifying video data in real-time due to high bandwidth requirements and the inability to apply modifications without involving the original application, leading to a degraded streaming experience.
Innovation Solution
The method involves streaming video data in a graphics domain using graphical command tokens and texture elements, allowing real-time modification of these tokens at the sink device to generate modified video data without requiring the original application, using a graphics processing unit (GPU) to render the modified data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video data is modified in real-time during wireless streaming, then user interaction and customization are enhanced, but bandwidth requirements increase and system complexity increases
Solution Approach 1:
The video data is segmented into individual graphical command tokens that are transmitted separately. This allows the sink device to receive and modify individual tokens (such as color, position, or shape parameters) without needing to transmit and reprocess the entire video frame, thereby enabling real-time modification while reducing bandwidth requirements.
Solution Approach 2:
Graphical command tokens serve as an intermediary representation between the source video data and the final rendered output. These tokens contain essential graphical information that can be modified at the sink device, allowing real-time customization without direct manipulation of the original video stream, thus balancing adaptability with bandwidth efficiency.
2Adaptability or versatility
If video data is modified in real-time during wireless streaming, then user interaction and customization are enhanced, but the ability to maintain original application integrity is compromised
Solution Approach 1:
Instead of modifying the original video data directly, the system creates a copy in the form of graphical command tokens that represent the essential graphical information. Modifications are applied to these token copies at the sink device, preserving the original application data while enabling real-time customization through the token representation.
3Productivity
If graphical command tokens are used to represent video data, then real-time modification is enabled, but device complexity increases
Solution Approach 1:
The system changes the representation parameters of video data from pixel-based formats to graphical command token formats. These tokens encode graphical information in a structured manner that enables efficient real-time modification of specific parameters (such as color, position, or transformation) without requiring complex pixel-level processing, thus improving productivity while managing device complexity.
Data Source
Figure 1
Figure 2
Figure 3A~3B
AI summary
In one example, a method for processing video data includes receiving, by a sink device and from a source device, one or more graphical command tokens that are executable to render original video data; modifying, by the sink device, the graphical command tokens to generate modified graphical command tokens that are executable to render modified video data different from the original video data; and outputting, for presentation at a display operatively connected to the sink device, the modified video data.