Measurement Data Traceability With Metadata Chain References
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data management systems in networked environments are inefficient in processing and tracing measurement data, as they primarily focus on generating meta-data without creating new data chunks, leading to significant resource utilization and storage challenges, especially when handling high volumes of measurement data that require multiple processing steps.
Innovation Solution
A system and method for measurement data management that involves a storage system and database in a distributed environment, where metadata is associated with raw and processed data to create chain relationships, allowing users to trace data through successive processing steps, and utilizing cloud computing for efficient data processing, with local storage options to reduce network usage and implement criteria for data retention and deletion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If data content is stored in a chain structure, then data tracing capability is improved, but data management resource consumption increases significantly
Solution Approach 1:
The patent extracts only the essential metadata (hash values, processing parameters, chain references) from the complete data content and stores them in the chain structure. This allows tracing capability while reducing storage requirements from storing entire data chunks to storing only their cryptographic fingerprints and processing metadata.
Solution Approach 2:
Instead of storing actual data content in the chain, the system creates cryptographic copies (hash values) that represent the data. These hash copies enable verification and tracing without requiring the original data to be stored in the chain structure, significantly reducing resource consumption.
2Reliability
If all intermediate processing results are stored, then data integrity and traceability are improved, but storage space consumption increases
Solution Approach 1:
The patent treats intermediate processing results as temporary objects that are stored only long enough to be processed and verified. Once a result is confirmed and integrated into the chain, the intermediate representation can be discarded or overwritten, reducing long-term storage requirements while maintaining integrity through the immutable chain structure.
Solution Approach 2:
The system performs preliminary hashing and validation of intermediate results before full storage. By pre-processing data to create compact hash representations and verifying integrity at each step, the system ensures data integrity without requiring proportional storage space for all intermediate states.
3Ease of operation
If processed data is transmitted over the network, then remote access capability is improved, but network usage increases
Solution Approach 1:
The patent extracts and transmits only the essential metadata and hash values over the network rather than complete processed data sets. This enables remote users to access and verify processing results while minimizing network bandwidth consumption by transmitting only the minimal necessary information for validation and tracing.
Solution Approach 2:
Instead of transmitting original processed data, the system transmits cryptographic hash copies that represent the data. Remote users can verify the authenticity and integrity of processed results through these hash copies without requiring transmission of the actual data content, significantly reducing network usage.
Data Source
AI summary
A system is provided for measurement data management in a distributed environment. The system comprises at least one storage system adapted to obtain raw measurement data or intermediate results from at least one measurement site via a network. In addition, the system further comprises a database, operatively connected to the said storage system, adapted to be accessed remotely by the measurement site via the network. The storage system or the measurement site is further adapted to perform successive processing steps on the raw measurement data along a process chain in order to generate measurement results, whereby associating metadata with the raw measurement data and with the measurement results. In this context, the metadata associated with each measurement result of the successive processing steps is provided with a new reference as well as a reference to the reference of the measurement result from the preceding processing step.