Remote Display Pipeline Switching for Video and Document Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote connection services experience latency and reduced text visibility when transmitting video and document content due to the use of media codecs optimized for video, which adversely affect the quality of text-oriented document content.
Innovation Solution
A display apparatus and electronic device dynamically adjust transmission protocols based on content type, using streaming protocols for video and remote desktop protocols for documents to minimize latency and maximize text visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If media codec compression is used for video content transmission, then latency is reduced and video playback is improved, but text visibility is reduced when document content is processed
Solution Approach 1:
The system dynamically switches between streaming protocol and remote desktop protocol based on content type detection. For video content, streaming protocol is used to minimize latency; for document content, remote desktop protocol is used to ensure text visibility. This dynamic adaptation resolves the contradiction by selecting the appropriate protocol for each content type rather than using a fixed compression method.
Solution Approach 2:
The system changes the transmission protocol parameter based on content type. When video content is detected, streaming protocol parameters are applied for low-latency transmission. When document content is detected, remote desktop protocol parameters are applied for high-quality text rendering. This parameter change allows the system to optimize for either latency or text visibility depending on the content being transmitted.
2Loss of time
If streaming protocol is used for video content, then latency and loading time are decreased, but text-oriented document content quality deteriorates
Solution Approach 1:
The system segments content into different types (video vs. document) and applies different transmission protocols to each segment. Video content segments are transmitted using streaming protocol for fast loading, while document content segments are transmitted using remote desktop protocol for high quality. This segmentation allows simultaneous optimization for both fast loading and high quality where applicable.
Solution Approach 2:
The system applies different quality levels and transmission methods to different content types locally. Video content receives streaming protocol treatment with compression optimized for temporal and spatial redundancy, while document content receives remote desktop protocol treatment with higher fidelity for text rendering. This local quality adjustment ensures each content type receives the appropriate transmission treatment.
3Device complexity
If a single protocol is used for all content types, then system complexity is reduced, but performance deteriorates for specific content types
Solution Approach 1:
The system implements a universal content type detection mechanism that works across different protocols. The detection module identifies content type (video or document) and routes to the appropriate protocol handler. This multi-functionality allows a single system to support both streaming and remote desktop protocols, achieving high reliability for different content types without requiring separate systems for each protocol.
Data Source
AI summary
A display apparatus, including: a display; a communicator; at least one processor; and a memory configured to store one or more instructions which, when executed by the at least one processor, cause the display apparatus to: transmit, to an electronic device, a request for remote connection for receiving content; receive, from the electronic device, information about a protocol determined based on a type of the content; arrange a pipeline configured to process the content, based on the information about the protocol; and output, using the pipeline, the content received from the electronic device according to the protocol.