Synchronous Task Dispatch Controller for Portable Device Offloading
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional computing models face inefficiencies in managing task transfers between processing resources, often relying on asynchronous methods that incur latency and may not be cost-effective due to the overhead of managing transfers, limiting the ability to offload tasks efficiently.
Innovation Solution
The implementation of a synchronous task offloading mechanism that centralizes task offload requests from a primary processing resource to a secondary resource, using a dispatch controller to manage the transfer of threads between processing resources through a shared memory space, allowing for autonomous operation of components like GPUs and DSPs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If asynchronous task transfer is used between processing resources, then task offloading can be performed, but latency increases and power savings are reduced due to management overhead
Solution Approach 1:
The patent implements preliminary action by pre-configuring the shared memory space and establishing the dispatch controller's task offload request handling mechanism in advance. The host processing resource is pre-prepared to generate task offload requests, and the alternative processing resource is pre-configured to receive and execute these requests. This pre-establishment of the synchronous communication framework eliminates the need for complex asynchronous management protocols, thereby reducing task transfer latency while maintaining execution efficiency.
2Ease of operation
If task offloading is implemented with full management overhead, then task transfer is possible, but the overhead cost prevents recouping the latency and reduces overall efficiency
Solution Approach 1:
The patent extracts the task offload request management function from the complex asynchronous management overhead and consolidates it into a dedicated dispatch controller. This extraction isolates the essential task transfer management functions from unnecessary overhead, allowing the host processing resource to generate simple task offload requests without burdening the system with complex management protocols. The dispatch controller handles only the necessary coordination, thereby reducing management overhead costs while maintaining ease of operation.
Solution Approach 2:
The dispatch controller serves as an intermediary between the host processing resource and the alternative processing resource. It receives task offload requests from the host, manages the transfer of thread context and data through shared memory space, and coordinates the execution on the alternative processing resource. This intermediary approach simplifies the interaction between processing resources by providing a standardized interface, reducing the management overhead required for task transfers while maintaining ease of operation.
3Weight of stationary object
If processing resources are integrated on a single substrate (SoC), then device size and weight are reduced, but power management flexibility decreases
Solution Approach 1:
The patent applies segmentation by dividing the processing resources into distinct functional units (host processing resource, alternative processing resource, and dispatch controller) that operate independently but communicate through a unified shared memory space. This segmentation allows each processing resource to be powered on or off independently based on task requirements, providing power management flexibility despite physical integration on a single substrate. The host processing resource can be powered down during tasks that can be executed by the alternative processing resource, reducing overall power consumption while maintaining the compact SoC architecture.
Data Source
AI summary
A portable computing device synchronously offloads tasks from a first processing resource to an alternative processing resource. Offload requests are centralized and communicated to a dispatch controller. The request defines the alternative processing resource and the location of items in a common or shared memory related to a thread that is desired to be transferred or dispatched from the primary processing resource to the identified alternative processing resource. The dispatch controller, in response to the request, creates a task dispatch packet that provides the information required to switch the context of the thread that was previously executing on the primary processing resource to the alternative processing resource. The common or shared memory space is leveraged to provide desired performance. Results generated by the alternative processing resource are available in the shared memory space upon return to the primary processing resource.