Parallel Data Integrity Processing for Multi-Processor Throughput
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data integrity algorithms in distributed computer architectures are limited by the use of a single processor, leading to underutilization of multi-processor systems and inefficient data integrity verification processes.
Innovation Solution
The implementation of a parallel processing method that initializes multiple threads to partition and calculate data integrity values across multiple processors, allowing simultaneous execution and utilization of all available processors for data integrity calculations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single processor is used for data integrity calculations, then the system is simple to implement, but the processing time is excessive and multi-processor systems remain under-utilized
Solution Approach 1:
The data stream is divided into multiple segments, with each segment processed by a separate thread on a different processor. This segmentation enables parallel processing of data integrity calculations across multiple processors, significantly improving verification speed while maintaining manageable system complexity through modular organization
Solution Approach 2:
The invention transitions from sequential single-processor processing to parallel multi-processor processing by adding the dimension of concurrent execution. Multiple threads execute simultaneously on different processors, transforming the processing model from one-dimensional sequential to multi-dimensional parallel execution
2Productivity
If multiple processors are available, then computing ability is increased, but conventional implementations leave additional processors under-utilized
Solution Approach 1:
The data stream is divided into multiple segments that can be independently processed, allowing each available processor to be assigned a specific segment. This ensures full utilization of all processor resources, converting previously idle computing capacity into productive work and maximizing throughput
Solution Approach 2:
Multiple processors continuously process different segments of the data stream simultaneously, eliminating idle time and ensuring that all computing resources are constantly engaged in useful work. This continuous utilization of all processors maximizes the throughput of data integrity calculations
Data Source
AI summary
According to one embodiment of the invention, a computer implemented method for computing a data integrity algorithm on a data stream comprises the acts of initializing a plurality of threads, partitioning the data stream into a plurality of data stream segments, calculating a number of data integrity values from the plurality of data stream segments, and verifying the integrity of the data stream using the data integrity values. The plurality of threads are executed at generally the same time. Each of the data integrity values are derived from an associated data stream segment.