Customized Filter Lists for Faster Confidential Data Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data transmission systems face inefficiencies and potential confidentiality issues due to the need to transmit large volumes of raw data over networks, which can slow down processing and compromise privacy, especially when different entities manage the data locally and remotely.
Innovation Solution
Implementing a customized filter list at the local system to preprocess data before transmission, generated by a server system, which reduces the amount of data sent over the network and ensures only necessary information is processed remotely, thereby enhancing speed and maintaining data confidentiality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If large volumes of raw data are transmitted over the network, then the server system can process complete information, but network traffic increases and processing speed decreases
Solution Approach 1:
The local system performs preliminary filtering actions by comparing raw data against a filter list before transmission. This preprocessing step identifies and extracts only the necessary data elements that require remote processing, eliminating unnecessary data transmission and accelerating overall processing speed while maintaining data completeness for relevant items.
Solution Approach 2:
The system extracts only the essential data elements from the raw data by comparing against the filter list. This extraction process separates necessary data for remote processing from data that can be handled locally or does not require transmission, reducing network traffic while ensuring complete processing of critical information.
2Reliability
If large volumes of raw data are transmitted over the network, then all data can be processed remotely, but network bandwidth is consumed and transmission time increases
Solution Approach 1:
The local system performs preliminary filtering actions by comparing raw data against a filter list before transmission. This preprocessing step identifies and extracts only the necessary data elements that require remote processing, eliminating unnecessary data transmission and accelerating overall processing speed while maintaining data completeness for relevant items.
3Adaptability or versatility
If all raw data is transmitted to the server system, then centralized processing can be performed, but network dependency increases and bandwidth requirements grow
Solution Approach 1:
The system segments data processing into two parts: filtering operations performed locally at the client system using a filter list, and analysis operations performed remotely at the server system. This segmentation allows the client to handle data preprocessing independently, reducing network traffic to only essential data elements while preserving centralized processing capabilities for complex analysis tasks.
4Measurement precision
If comprehensive data is transmitted for analysis, then the server system can perform complete exception analysis, but data confidentiality is compromised and computational load increases
Solution Approach 1:
The system extracts only the essential data elements from the raw data by comparing against the filter list. This extraction process separates necessary data for remote processing from data that can be handled locally or does not require transmission, reducing network traffic while ensuring complete processing of critical information.
Solution Approach 2:
The local system performs preliminary filtering actions by comparing raw data against a filter list before transmission. This preprocessing step identifies and extracts only the necessary data elements that require remote processing, eliminating unnecessary data transmission and accelerating overall processing speed while maintaining data completeness for relevant items.
Data Source
AI summary
A system and method are presented to improve the speed of shared network processing by filtering data using a filter list. The filter list filters the data submitted for analysis to the server system. Some data is processed locally, but the filtered data is processed at the server system. The local systems process similar data, but they use distinct data hierarchies to classify the data. Hierarchy designations are utilized in the filter list to filter the data. Rules establish a unified hierarchy that is translated to local hierarchies in the filter lists. Tags are established at the server for exceptions. Tags are translated into data identifiers for inclusion in the filter lists. The size of the filter list is reduced by avoiding redundancies between the tagged data identifiers and the local hierarchy designations. The filter list creation process also creates pre-analysis data at the server to assist in its analysis.


