Offloading Visual Frames to Edge Gateway Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to provide low latency for real-time display of offloaded visual frames and lack dynamic functionality for performing multiple client services at a single gateway device, especially in scenarios where client devices have limited processing power or battery life, and they often rely on data centers that are not optimized for edge computing.

Innovation Solution

The implementation offloads visual frames from client devices to network edge devices for processing, using an edge network manager to select and configure gateway devices with appropriate workload resources, ensuring real-time communication and dynamic resource management to support various data services, including object tracking, GAN processing, and augmented reality video processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Power

If visual frames are offloaded to data centers for processing, then processing capability is improved, but latency increases and real-time display performance deteriorates

Engineering Contradiction:
Improveprocessing capabilityVSAvoidlatency
Core Design Contradiction:
PowerVSLoss of time

Solution Approach 1:

The patent segments the centralized data center processing into distributed edge computing nodes positioned closer to client devices. This segmentation allows visual frames to be processed at multiple geographically distributed locations, reducing transmission distance and latency while maintaining processing capability through parallel operation of multiple edge nodes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces gateway devices as intermediary components between client devices and the core network. These gateway devices receive, buffer, and pre-process visual frames before transmission to edge computing resources, acting as intermediaries that optimize the data flow path and reduce end-to-end latency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If multiple client services are performed at a single gateway device, then resource utilization is improved, but device complexity increases

Engineering Contradiction:
Improveresource utilizationVSAvoidgateway device complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent designs gateway devices with multi-functional capabilities to handle diverse client services including visual frame processing, data buffering, and service routing. This universality allows a single gateway device to perform multiple functions that would traditionally require separate specialized devices, improving resource utilization while managing complexity through integrated design.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements a nested architecture where virtualized service functions are contained within gateway devices, which themselves are part of the broader edge computing infrastructure. This nesting allows complex service functionalities to be packaged as modular virtualized components within the gateway, making the system more manageable despite increased capabilities.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Loss of time

If edge computing resources are distributed across multiple devices, then latency is reduced, but system complexity increases

Engineering Contradiction:
ImprovelatencyVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent implements feedback mechanisms where the edge network manager continuously monitors system state including device availability, resource utilization, and performance metrics. This feedback enables dynamic adjustment of workload distribution across edge devices, optimizing latency performance while managing system complexity through automated control based on real-time conditions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent creates a dynamic edge computing system where workload allocation, resource provisioning, and service routing are continuously adapted based on changing system conditions. This dynamics allows the system to optimize for low latency under varying loads and device availabilities while managing complexity through adaptive rather than static configurations.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11588910B2Offloading visual frames to a gateway device
Publication Date: 2023.02.21 META PLATFORMS TECHNOLOGIES LLC
  • US11588910B2 patent drawing
  • US11588910B2 patent drawing
  • US11588910B2 patent drawing

AI summary

Implementations offload visual frames from a client device to a gateway or edge device for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to a gateway or edge device preloaded with a resource that corresponds to the requested data service. After the gateway or edge device processes the visual frames using the resource, the processed visual frames can be returned to the client device. In implementations, the offload device and client device are situated in a network such that a latency for the offload communications supports real-time video display. A gateway device manager can locate a gateway connected to the client device, and resources can be deployed (or the gateway can be prepopulated) so that the device can perform gateway services and edge processing services for the client device.