Edge Server Data Filtering for Distributed Processing Load Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing distributed data processing systems face inefficiencies in data collection from mobile terminals, leading to increased communication and processing loads due to redundant data transmission and unnecessary information collection.
Innovation Solution
A distributed data processing system that utilizes edge servers to manage data collection from mobile terminals by requesting only necessary data, integrating it, and suspending unnecessary data acquisition, thereby reducing communication and processing loads through hierarchical data management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If sensor information is constantly sent to a center server without specifying transmission data, then data collection completeness is improved, but communication load and processing load on the center server increase
Solution Approach 1:
The system divides the data collection process into two segments: edge servers perform preliminary data collection and filtering in the network edge, then only necessary filtered data is transmitted to the center server. This segmentation reduces the communication and processing load on the center server while maintaining data collection completeness.
Solution Approach 2:
Edge servers perform preliminary data filtering and processing before data reaches the center server. By conducting preliminary actions at the edge, the system reduces the volume of data that needs to be transmitted and processed centrally, thereby reducing communication and processing loads.
2Loss of information
If sensor information exchange between terminals is performed based on request position and vehicle attribute, then data relevance is improved, but unnecessary collection and transmission of information continues after data is obtained
Solution Approach 1:
The system implements a feedback mechanism where the center server monitors data collection status and sends suspension notifications to edge servers and terminals when required data has been obtained. This feedback loop prevents unnecessary continued collection and transmission of information, reducing wasted communication and processing resources.
3Productivity
If a hierarchical structure with edge servers and center server is implemented, then data collection efficiency is improved, but system complexity increases
Solution Approach 1:
Edge servers act as intermediary components between terminals and the center server. These intermediaries handle local data filtering and preliminary processing, improving data collection efficiency by reducing the burden on the center server while adding only moderate system complexity through standardized edge server functions.
Data Source
AI summary
An information request describing an attribute of necessary data is distributed from a center server to a mobile terminal via an edge server; the mobile terminal transmits data, which is requested in the information request, to the edge server; the edge server notifies the center server to the effect that the data, which is requested in the information request, has been acquired; the center server distributes, with respect to data acquired by the edge server from the mobile terminal, non-necessity information indicating that collection of the data is unnecessary to the edge server and to the mobile terminal via the edge server; and when the mobile terminal receives the non-necessity information, the mobile terminal suspends acquisition of data, of which collection is deemed unnecessary in the non-necessity information, and, when the data is stored, discards the data.