Context Switching Format Selection Circuitry for Data Processing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data processing systems face challenges in efficiently managing context switching between interconnected processing elements, particularly in ensuring data consistency and reducing latency during task execution and resumption, especially when processing elements have different capabilities and require exclusive access to memory regions.

Innovation Solution

The implementation of format selection circuitry to determine a common set of data items for context data, along with coherent memory circuitry that allows exclusive write access to memory regions, ensures data consistency and efficient context switching by communicating format definition data between processing elements and storing context data in memory regions specific to each task.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If context data is saved and loaded during task switching between processing elements, then task migration capability is enabled, but data consistency and latency issues arise when processing elements have different capabilities

Engineering Contradiction:

Improvetask migration capabilityVSAvoiddata consistency

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The system dynamically determines a common set of data items for context data based on the capabilities of processing elements. Format selection circuitry communicates format definition data between processing elements and determines which data items should be included in context data, adjusting the context data structure according to the specific capabilities of the processing elements involved in task migration.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

Format selection circuitry acts as an intermediary between processing elements with different capabilities. It receives format definition data from processing elements, determines a common set of data items, and ensures consistent context data structure across different processing elements, thereby maintaining data consistency during task migration.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If multiple processing elements access memory regions simultaneously, then processing throughput increases, but data consistency and exclusive access conflicts occur

Engineering Contradiction:

Improveprocessing throughputVSAvoiddata consistency

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

Memory is divided into separate memory regions, with each memory region associated with a specific task. Processing elements take exclusive write access to the memory region corresponding to the task they are executing. This segmentation allows multiple processing elements to access different memory regions simultaneously without conflicts, maintaining both throughput and data consistency.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system dynamically manages memory access rights by assigning exclusive write access to the memory region corresponding to the currently executing task. When a processing element finishes a task, it releases exclusive write access to the memory region. This dynamic allocation allows efficient memory access patterns while ensuring data consistency.

Inventive Principle:

Principle #15Dynamics

3Reliability

If context data includes all possible data items, then complete task state is preserved, but context switching time and memory usage increase

Engineering Contradiction:

Improvetask state preservationVSAvoidcontext switching time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system changes the parameters of context data by determining a common set of data items based on processing element capabilities. This selective approach includes only the necessary data items for context switching, excluding redundant data, thereby reducing context switching time while maintaining complete task state preservation.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

Instead of including all possible data items in context data, the system uses partial action by selecting only the essential data items that are common to all processing elements. This partial approach suffices for correct task migration while significantly reducing the overhead of context switching.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS10671426B2Data processing

Publication Date: 2020.06.02 ARM LTD

AI summary

Data processing apparatus comprises one or more interconnected processing elements; each processing element being configured to execute processing instructions of program tasks; each processing element being configured to save context data relating to a program task following execution of that program task by that processing element; and to load context data, previously saved by that processing element or another of the processing elements, at resumption of execution of a program task; each processing element having respective associated format definition data to define one or more sets of data items for inclusion in the context data; the apparatus comprising format selection circuitry to communicate the format definition data of each of the processing elements with others of the processing elements and to determine, in response to the format definition data for each of the processing elements, a common set of data items for inclusion in the context data.