Data Processing Method for Web Server File Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing methods require additional components and increased system complexity, maintenance costs, and resource usage due to synchronous data writing to message queues, and face challenges in data communication between processes/threads, leading to inefficiencies in providing request results to users.
Innovation Solution
A data processing method that receives a file from a web server, encapsulates request data through a preset protocol, invokes a target process to generate a request result, stores it in a preset storage area, runs a request finishing function, and sends the result to the web server and cloud data center, eliminating the need for additional components and new threads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If synchronous data writing to message queue is used, then data reporting can be completed, but system complexity increases and maintenance costs increase
Solution Approach 1:
The patent extracts the data reporting function from the main service process by using a separate data reporting process that independently collects data from multiple services. This eliminates the need for message queue components while maintaining data reporting reliability, directly resolving the contradiction between reliable data reporting and system complexity.
Solution Approach 2:
The data reporting process serves multiple services simultaneously by collecting data from various sources through a unified interface. This multi-functional approach replaces the need for separate message queue systems for each service, reducing overall system complexity while ensuring reliable data reporting.
2Reliability
If synchronous data writing to message queue is used, then data can be reported to data center, but time taken by main process increases
Solution Approach 1:
The patent segments the data reporting function into a separate process that runs independently from the main service. The main service only needs to send data to the data reporting process through standard input, while the reporting process handles all data center communication. This separation eliminates synchronous blocking in the main process while ensuring complete data reporting.
Solution Approach 2:
The data reporting process acts as an intermediary between multiple services and the data center. Services communicate data to this intermediary through simple file input, and the intermediary handles all complex data center communication. This mediator approach ensures reliable data reporting without increasing main process time.
3Productivity
If single process/thread is used for data reporting, then data reporting can be performed, but data communication between processes becomes complex
Solution Approach 1:
The data reporting process is self-sufficient by directly reading data from files created by services through standard input mechanisms. It independently handles data processing, formatting, and transmission to the data center without requiring complex inter-process communication protocols. This self-service approach maintains high productivity while minimizing communication complexity.
4Productivity
If new process/thread is developed for reporting, then data reporting function is separated, but system resources are occupied
Solution Approach 1:
The patent merges the data reporting process with the existing service infrastructure by using standard file input mechanisms that are already part of the operating system. The reporting process shares the same runtime environment and system libraries as other services, eliminating the need for additional dedicated resources while maintaining functional separation.
Data Source
AI summary
A data processing method, an electronic device and a storage medium are related to the field of big data technologies. The solution is: receiving a file to be processed from a web server; invoking a target process to process the file to be processed, to generate a request result; storing the request result in a preset storage area; running a preset request finishing function; obtaining the request result from the preset storage area in response to the running the preset request finishing function; sending the request result to the web server; and reporting the request result to a cloud data center.