Data Processing Apparatus Identity Identification Value Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In systems where a large number of data pieces are collected, the terminal functioning as a distributor faces increased processing load due to the need to calculate and compare hash values for each data piece, complicating processing and increasing communication traffic.
Innovation Solution
A data processing apparatus calculates at least one identity identification value from multiple data pieces and determines if current data is identical to previous data based on this value, only distributing updated data for processing, thereby simplifying the processing sequence and reducing load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If hash value calculation and comparison is performed for each data piece to determine data updates, then communication traffic is reduced, but processing load and device complexity increase
Solution Approach 1:
The patent combines multiple data pieces into a single data set and calculates one hash value for the entire data set rather than calculating separate hash values for each individual data piece. This merging approach reduces the number of hash calculations from N (for N data pieces) to 1, significantly lowering processing complexity while maintaining the ability to detect data updates.
Solution Approach 2:
The single hash value serves multiple functions: it represents the entire data set, enables update detection for all data pieces collectively, and reduces communication overhead. This universal hash value approach allows the system to handle multiple data pieces with a single processing operation.
2Measurement precision
If hash value calculation is performed for each data piece, then data update detection accuracy is maintained, but processing time increases
Solution Approach 1:
Multiple data pieces are merged into a single data set with one hash calculation, reducing processing time from O(N) to O(1) hash operations while still accurately detecting whether any data in the set has changed through the collective hash value comparison.
Solution Approach 2:
The system performs preliminary grouping of data pieces into data sets before hash calculation, preparing the data structure in advance to enable efficient batch processing. This preliminary organization allows rapid update detection without sequentially processing each data piece.
3Reliability
If individual data piece monitoring is implemented, then data freshness is ensured, but communication load increases
Solution Approach 1:
The patent merges multiple data pieces into a single data set that is monitored and transmitted as one unit. This reduces communication load by transmitting one hash value and one updated data set instead of multiple individual data pieces, while still ensuring data freshness through the collective hash value validation.
Solution Approach 2:
Instead of transmitting all raw data pieces individually, the system uses a hash value as a compact representation or copy of the data set's state. This hash copy enables verification of data freshness without transmitting the actual data content, significantly reducing communication load.
Data Source
AI summary
An identification value generator included in a data processing apparatus generates, from data pieces collected from an FA device, at least one identity identification value. The identity identification value is a value for determining an identity of the data pieces. The update determiner determines whether current data and previous data are identical based on a current identification value and a previous identification value. The current data includes the data pieces currently collected, and the previous data includes the data pieces previously collected. The current identification value includes the identity identification value generated from the current data, and the previous identification value includes the identity identification value generated from the previous data. A data distribution controller distributes the current data to a data processor when the update determiner determines that the current data and the previous data are not identical.