Data Merging History for Traceability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data merging techniques lack the ability to effectively trace back to original information sources, making merged data less reliable and difficult to use, especially when dealing with heterogeneous and less reliable data sources.
Innovation Solution
A method for digitally tracing data from multiple sources by maintaining a merging history that includes the origin and merging strategy of each element, allowing for the display and verification of the merging process, implemented through a computer program that stores and executes instructions for data processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data merging techniques are used to reduce redundancies and facilitate data analysis, then data analysis efficiency is improved, but the ability to trace back to original information sources deteriorates
Solution Approach 1:
The patent introduces a merging history record as an intermediary structure that bridges the merged data and original data sources. This record stores provenance information including source identifiers, merging timestamps, and merging criteria, allowing traceability without compromising data analysis efficiency. The intermediary layer enables users to trace back to original sources when needed while maintaining the benefits of merged data for routine analysis.
Solution Approach 2:
The patent implements a nested structure where merging history information is embedded within the merged data structure itself. Each merged data element contains nested provenance records that store information about original sources, merging operations, and transformation criteria. This nesting allows traceability information to be integrated seamlessly with the merged data, enabling both efficient analysis and complete traceability.
2Device complexity
If data merging is performed without monitoring operations, then device complexity is reduced, but data reliability deteriorates
Solution Approach 1:
The patent applies preliminary action by establishing a monitoring framework before data merging operations begin. The system pre-defines merging criteria, source reliability weights, and traceability requirements. This preliminary setup enables automated monitoring during merging operations without requiring complex real-time intervention, thereby maintaining data reliability while avoiding excessive operational complexity.
3Ease of operation
If merging criteria are not made transparent and verifiable, then ease of operation is improved, but understanding and verification of merging processes deteriorates
Solution Approach 1:
The patent implements feedback mechanisms that automatically generate and store information about merging operations in the merging history. The system provides feedback on which sources were merged, what criteria were applied, and what the results were. This automated feedback makes merging criteria transparent and verifiable without requiring complex manual tracking, thereby maintaining ease of operation while enabling complete verification.
Data Source
AI summary
A digital method for tracing data from a plurality of data sources includes the steps of: a. obtaining initial data originating from a plurality of data sources, each initial datum comprising initial elements and initial connections, each initial element having a type and a value, b. determining a final datum on the basis of at least two initial data following the merging with one another of initial elements of the initial data according to a merging strategy, the merged initial elements making it possible to obtain a merged element having a type and a value, and c. determining a merging history for each merged element, the merging history comprising the type and the value of each initial element from which the merged element originates, the type and the value of the merged element, and data relating to the merging strategy.