Distributed data processing method and system
A technology of distributed data and processing methods, applied in the field of data processing, can solve problems such as poor scalability, and achieve the effect of scalability and adaptability
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Example Embodiment
[0086] Example 1
[0087] As a distributed data processing method running on the server side according to the present invention, such as figure 2 As shown, including the following steps:
[0088] The server obtains the resource information of the client in real time.
[0089] The server determines a task that meets the processing capability of the client according to the resource information.
[0090] The server allocates and sends tasks that meet its processing capabilities for the client.
[0091] Wherein, the task includes the address of the data to be processed, the address of the plug-in library, and the type of processing instruction required to process the data to be processed. Plug-and-play plug-ins are stored in the plug-in library.
[0092] In the distributed data processing method operated by the server of the present invention, the distributed task contains the address of the plug-in needed to process the data to be processed. When the client processes the task, the data pr...
Example Embodiment
[0093] Example 2
[0094] As an embodiment of the present invention, on the basis of embodiment 1, the distributed data processing method running on the server side further includes the following steps of updating the plug-in library:
[0095] Store the new plug-in in the plug-in library.
[0096] The processing instruction type corresponding to the new plug-in is stored in the server.
[0097] The version corresponding to the new plug-in is stored in the server. Correspondingly, the task can also include plug-in version information, and the specific form of the task including plug-in version information is as follows: .
[0098] During the normal operation of the server, if a new type of data processing occurs, at this time, it is only necessary to update the plug-in library, and add the new type of data processing plug-in to the existing plug-in library. The task contains the address of the new plug-in. When the client processes the task, it only needs to call the new plug-in accord...
Example Embodiment
[0099] Example 3
[0100] As an embodiment of the present invention, on the basis of the above-mentioned embodiment 1 or embodiment 2, the server allocates and sends a task that meets the processing capability of the client to a client that meets the task processing conditions. It also includes the status of the data to be processed, and the status of the data to be processed further includes client information and tag information, where:
[0101] The client information is information of the client to which the data to be processed is allocated; the marking information is information that marks that the data to be processed is taken away.
[0102] When the server allocates a new task to fetch the data to be processed, those with the tag information indicate that the data to be processed has been taken away and cannot be taken away and distributed again; it is less effective or even avoids the same data to be processed being assigned to The occurrence of resource waste caused by repe...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2023 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap