Low-Latency Graphics Data Transmission Over Standard IP Networks

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for separating user interface devices from data processing components in computer systems suffer from high latency and increased maintenance costs due to reliance on proprietary or dedicated networks, and existing graphics transfer methods either constrain graphics capabilities or introduce significant processing overhead, leading to suboptimal user experience.

Innovation Solution

A method utilizing a pair of processing modules communicating over a standard IP/Ethernet network, with one module connected to the system bus and raster video output, and the other to user devices, employing a connectionless protocol, data sequencing, and transmission timing to minimize latency and ensure low latency communication, while also providing remote display synchronization and data recovery through sub-frame partitioning and feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If proprietary transmission links or dedicated digital links are used to separate user interface from data processor, then connection reliability is improved, but infrastructure cost and maintenance cost increase

Engineering Contradiction:

Improveconnection reliabilityVSAvoidinfrastructure cost

Core Design Contradiction:

ReliabilityVSEase of manufacture

Solution Approach 1:

The patent applies universality by enabling the network interface card to handle both traditional network communication and graphics data transmission through a single standard network infrastructure. The NIC processes both IP packets and graphics commands over the same physical network, eliminating the need for separate dedicated graphics networks while maintaining connection reliability through protocol-level handling.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary approach by using a standard network protocol stack as a mediator between the graphics system and the network infrastructure. The protocol translation layer converts graphics commands into network-compatible formats, allowing standard network equipment to carry graphics data without requiring proprietary transmission links.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If graphics commands are transferred over network to remote computing system, then user interface separation is achieved, but system latency increases

Engineering Contradiction:

Improveuser interface separationVSAvoidsystem latency

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-processing and optimizing graphics commands before network transmission. The system prepares graphics data in an efficient format and uses network buffer management to minimize transmission delays, ensuring that graphics commands are ready for immediate processing upon arrival at the remote system.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent changes key parameters of graphics command transmission by optimizing packet size, transmission timing, and protocol overhead. The system dynamically adjusts these parameters to minimize network latency while maintaining graphics quality, transforming the transmission characteristics to achieve lower latency over standard networks.

Inventive Principle:

Principle #35Parameter changes

3Adaptability or versatility

If frame buffer copy method is used for graphics transfer, then graphics capabilities are maintained, but processing overhead increases

Engineering Contradiction:

Improvegraphics capabilitiesVSAvoidprocessing overhead

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the graphics processing function from the remote computing system and places it back at the local data processor. Instead of copying the entire frame buffer to the remote system for rendering, the local processor generates graphics commands that are sent to the remote display, eliminating the heavy processing overhead of remote frame buffer management while maintaining graphics capabilities.

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS7516255B1Method and apparatus for providing a low-latency connection between a data processor and a remote graphical user interface over a network

Publication Date: 2009.04.07 HP TECHNOLOGY HOLDINGS LLC

AI summary

A pair of processing modules and methods that enable low latency communications between a data processing system and devices located at a remote graphic user interface across a standard shared network in accordance with the present invention is disclosed. The present invention provides a method for communicating graphics data in a synchronous manner from the data processing system to the user. This method is used in conjunction with a feedback error recovery method to provide lossless, low-latency communications of graphics data across the network.