Secure Edge Accelerator Offloading for Latency-Sensitive Workloads
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Compute devices often face limitations in executing applications that require low latency, as they may not have sufficient resources or energy to perform tasks like real-time computer vision, leading to inefficiencies and potential failures in meeting performance parameters.
Innovation Solution
A system is implemented that securely offloads workloads from client compute devices to remote accelerators hosted on edge resources, using cryptographic keys to ensure secure transmission and processing, thereby leveraging edge computing to reduce latency and conserve energy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If compute devices use local resources (general purpose processor and/or accelerator devices) to execute applications, then they can maintain data processing security and control, but they cannot meet low latency requirements for latency-sensitive tasks like real-time computer vision
Solution Approach 1:
The patent segments the computing system into local compute devices and remote edge compute devices, each handling different processing tasks. The local device handles non-latency-sensitive tasks while the edge device handles latency-sensitive tasks, resolving the contradiction by distributing processing responsibilities across segmented system components.
Solution Approach 2:
The patent introduces an intermediary encrypted tunnel between the local compute device and edge compute device, mediated by cryptographic key pairs. This intermediary enables fast remote processing while maintaining security, resolving the contradiction between speed and device complexity.
2Speed
If compute devices utilize accelerator devices to execute tasks faster, then they can improve processing speed, but they deplete battery energy reserves
Solution Approach 1:
The patent extracts the energy-intensive acceleration functionality from the mobile compute device and relocates it to remote edge compute devices. This extraction allows the mobile device to maintain processing speed for latency-sensitive tasks while consuming minimal local energy, resolving the contradiction between speed and energy consumption.
Solution Approach 2:
The encrypted tunnel acts as an intermediary that enables the mobile device to access remote accelerator resources without directly consuming the energy required for high-speed processing. The mediator facilitates fast processing while the actual energy consumption occurs at the edge device.
3Productivity
If compute devices offload workloads to remote edge resources, then they can meet performance parameters and reduce latency, but they must ensure secure data transmission and processing
Solution Approach 1:
The patent implements an intermediary encrypted tunnel between local and edge compute devices, using cryptographic key pairs as mediators. This intermediary layer enables productive remote processing while the cryptographic mediation ensures security, resolving the contradiction between productivity and reliability.
Solution Approach 2:
The patent performs preliminary cryptographic key exchange and tunnel establishment before workload transmission. This preliminary action ensures that security measures are in place before productive processing begins, resolving the contradiction between productivity and security by preparing the secure channel in advance.
Data Source
AI summary
Technologies for securely providing one or more remote accelerators hosted on edge resources to a client compute device includes a device that further includes an accelerator and one or more processors. The one or more processors are to determine whether to enable acceleration of an encrypted workload, receive, via an edge network, encrypted data from a client compute device, and transfer the encrypted data to the accelerator without exposing content of the encrypted data to the one or more processors. The accelerator is to receive, in response to a determination to enable the acceleration of the encrypted workload, an accelerator key from a secure server via a secured channel, and process, in response to a transfer of the encrypted data from the one or more processors, the encrypted data using the accelerator key.