AV Bridging for Thin Client Graphics and Low-Latency KSM Return

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional communication networks face challenges in efficiently transmitting high-end graphics and multimedia data over LAN, particularly in maintaining time-correlated delivery of video and audio streams while accommodating latency jitter, and in enabling bidirectional data transfer for interactive multimedia applications.

Innovation Solution

The system employs AV Bridging capabilities to encapsulate and transmit digital video and audio data within Ethernet frames, ensuring time-correlated delivery and prioritized transport across the network, while also allowing keyboard and mouse data to be sent back to the video server via the network, using Display Port mini-packets and Ethernet protocols to maintain latency targets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If Display Port interface is used for transmitting video and audio data over network, then high-end graphics and multimedia data can be transmitted, but latency jitter occurs affecting time-correlated delivery

Engineering Contradiction:
Improvetime-correlated delivery precisionVSAvoidlatency stability
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent introduces an AV Bridging system as an intermediary layer between the Display Port interface and the network transmission. This bridging system encapsulates Display Port mini-packets and manages their transmission over the network, acting as a mediator that handles the conversion and timing synchronization to eliminate latency jitter while maintaining high-end graphics transmission capability

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary encapsulation of Display Port mini-packets into AV Bridging format before network transmission. By pre-processing the data packets and establishing timing correlations in advance, the system prepares the data for reliable time-synchronized delivery over the network, preventing latency issues during actual transmission

Inventive Principle:
Principle #10Preliminary action

2Productivity

If video and audio streams are transmitted separately over network, then network bandwidth is utilized, but time-correlation between video and audio is lost

Engineering Contradiction:
Improvenetwork bandwidth utilizationVSAvoidtime-correlation stability
Core Design Contradiction:
ProductivityVSStability of the object's composition

Solution Approach 1:

The patent segments the multimedia stream into separate video and audio packets for parallel network transmission, maximizing bandwidth utilization. Each packet type is independently routed through the network while the AV Bridging system maintains tracking of their original temporal relationships, enabling reassembly with correct time-correlation at the destination

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements feedback mechanisms where the AV Bridging monitors the transmission status of both video and audio packets, adjusting timing and synchronization based on network conditions. This feedback loop ensures that even when streams are transmitted separately, their time-correlation is maintained through dynamic synchronization adjustments

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If bidirectional data transfer is enabled for keyboard and mouse responses, then interactive multimedia applications can function, but network latency increases

Engineering Contradiction:
Improveinteractive application capabilityVSAvoidnetwork latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent applies different quality levels of service to different data types: video and audio streams receive high-priority, low-latency treatment through dedicated AV Bridging channels, while keyboard and mouse response data are handled through optimized bidirectional paths. This local quality differentiation ensures interactive responses are processed quickly without compromising the overall time-correlation of multimedia streams

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system maintains continuous bidirectional communication channels for keyboard and mouse responses throughout the multimedia session. By keeping these channels continuously open and optimized, the system enables seamless interactive applications while minimizing latency through persistent connection management rather than establishing new connections for each interaction

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS20080284621A1Method and system for keyboard, sound and mouse (KSM) over LAN a/v bridging and a/v bridging extensions for graphics thin client applications
Publication Date: 2008.11.20 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US20080284621A1 patent drawing
  • US20080284621A1 patent drawing
  • US20080284621A1 patent drawing

AI summary

Aspects of a system for keyboard, sound and mouse (KSM) over LAN A/V bridging and A/V bridging extensions for graphics thin client applications may include an I/O controller within an LAN subsystem, which enables generation of response data based on input signals from a keyboard device and/or mouse device that is coupled to a computing device. The generated response data may be encapsulated within an encapsulating PDU. The encapsulating PDU may comprise an Ethernet frame and/or and IP packet. The encapsulating PDU may be transmitted via a network based on a traffic class designation. The traffic class designation may enable the transmission of the generated response data via the network based on specified latency target values. A time stamp value may be generated for the encapsulating PDU. The encapsulating PDU may include at least one data type identifier, which indicates that the encapsulating PDU contains the generated response data.