Data Transformation Device for Anomalous Data Correction
Solution Overview
Problem
Current data communication systems in ecosystems like freight networks suffer from human error, outdated information, and the presence of anomalous data, leading to inefficiencies, inaccuracies, and increased resource consumption in data processing, memory, and network usage.
Innovation Solution
A system and method for data mapping, transformation, correction, and communication that uses a data transformation device to identify and correct anomalous data by referencing a trusted dataset and historical information, ensuring accurate data transmission and reducing resource utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual evaluation and decisioning of data messages is performed by operators, then data communication can be conducted among entities, but human error and inconsistencies occur leading to incorrect or incomplete data transmission
Solution Approach 1:
The system enables entities to automatically validate and correct their own data messages using locally stored trusted datasets and historical information, eliminating reliance on manual operator review while maintaining data accuracy through self-correction mechanisms
Solution Approach 2:
The patent replaces the mechanical manual evaluation process with an automated computational system that uses processors to compare incoming data against trusted datasets and historical records, substituting human operators with machine-based validation logic
2Productivity
If entities use outdated or incorrect information about other entities, then data communication can proceed, but anomalous data is transmitted leading to operations being performed on wrong entities
Solution Approach 1:
The system performs preliminary validation of data messages by comparing them against trusted datasets and historical information before transmission, ensuring data correctness is established in advance rather than discovering errors after transmission occurs
Solution Approach 2:
The system uses historical information and trusted datasets as feedback mechanisms to continuously validate incoming data messages, comparing current data against established benchmarks to identify and correct anomalies before they cause operational errors
3Reliability
If manual correction of anomalous data is performed, then data accuracy can be improved, but processing time and resource consumption increase
Solution Approach 1:
The system automatically detects and corrects anomalous data through self-service mechanisms using processors that compare incoming messages against trusted datasets and historical information, eliminating the need for manual correction while maintaining high data accuracy
Solution Approach 2:
The patent replaces manual data correction processes with automated computational validation logic that uses processors to identify and remedy anomalous data in real-time, substituting human correction efforts with machine-based automated fixing
4Reliability
If extensive processing is performed to detect and remedy anomalous data, then data communication reliability improves, but processing, memory, and network resources are consumed
Solution Approach 1:
The system implements local validation by storing trusted datasets and historical information locally at each entity, allowing processing to occur using locally available resources rather than requiring extensive network communication and centralized processing, thus reducing overall resource consumption while maintaining reliability
Data Source
AI summary
A system determines that a first data element in a first message is linked to a first data field in a first mapped dataset. The system receives a request to determine to which data field in a second mapped dataset a second data element in a second message should be mapped. The system extracts a first set of features from the first message. The system determines that the first data element is located on a first location within the first message. The system extracts a second set of features from the second message. The system determines that the second data element is location on a second location within the second message. The system determines a difference between the first location and the second location. If the difference is less than a threshold distance, the system associates the second data element to the first data element in the second mapped dataset.


