Data processing method, data processing device and information processing system

A data processing device and data processing technology, applied in the network field, can solve problems such as high system complexity, manual investigation, and high system maintenance costs, and achieve the effects of improving processing efficiency, avoiding resource waste, and realizing asynchronous processing

Active Publication Date: 2017-06-20
ANT WEALTH (SHANGHAI) FINANCIAL INFORMATION SERVICES CO LTD
View PDF1 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the related technology, the process of asynchronous interaction between the information processing system and the external system is that the application system layer of the current node receives the business request, and puts the business data requested for processing into the existing thread pool of the operating system layer on the current node or the new thread pool of the operating system layer. On the thread started, the thread pool of the operating system layer or the newly started thread process the business data. Although asynchronous processing is realized, it is necessary to manage the resources and operation scheduling of the thread pool, or manage new threads outside the main thread. , the system complexity is high, the processing efficiency is low, and other node resources in the information processing system cannot be effectively utilized. When a problem occurs, manual investigation is required, and the system maintenance cost is relatively high.
[0004] To sum up, in the process of implementing this application, the inventor found that there is currently no good solution to the problems of high system complexity, ineffective use of other node resources, and high system maintenance costs in the asynchronous interaction of business processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, data processing device and information processing system
  • Data processing method, data processing device and information processing system
  • Data processing method, data processing device and information processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0078] Such as figure 1 As shown, the present application provides a data processing method, which is applied to a cluster, and the cluster includes multiple nodes, which may include:

[0079] Step 101, receiving a data processing request, where the data processing request includes a first data object to be processed;

[0080] Step 102, storing the first data object in the database of the cluster, and generating a task message, the task message carrying a task identifier associated with the first data object;

[0081] Step 103: Publish the task message to multiple nodes in the cluster, so that the nodes extract the first data object from the database according to the task identifier for processing.

[0082] In an implementation manner, before storing the first data object in the database of the cluster, a first status identifier may be set for the first data object, and the first status identifier is used to identify the The first data object is in a state to be processed; a...

Embodiment 2

[0104] Such as image 3 As shown, the present application also provides another data processing method, which is applied to a cluster, and the cluster includes multiple nodes; including:

[0105] The node receives a task message, and the task message carries a task identifier associated with the first data object to be processed;

[0106] The node extracts and processes the first data object from the database of the cluster according to the task identifier.

[0107] In an implementation manner, after the first data object is extracted from the database and before the processing, the node can also set a second status identifier for the first data object, and the second status identifier is used for identifying the first data object as being in-process. In this way, subsequent processing can be performed according to the state of the first data object.

[0108] In an implementation manner, the first data object may be extracted from the database when it is determined that the...

Embodiment 3

[0130] Such as Figure 5 As shown, the present application also provides an information processing system, which is applied to a cluster, and the cluster includes multiple nodes, and the multiple nodes include at least: a first node 51 and a second node 52; wherein,

[0131] The first node 51 is configured to receive a data processing request, and the data processing request includes a first data object to be processed; and is configured to store the first data object in the database of the cluster and generate a task message , the task message carries a task identifier associated with the first data object; and is used to issue the task message to multiple second nodes in the cluster;

[0132] The second node 52 is configured to receive the task message issued by the first node; and to extract and process the first data object from the database of the cluster according to the task identifier.

[0133] In this embodiment, the first node 51 may also be used to receive the task...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method, a data processing device and an information processing system. The data processing method is applied to a cluster, wherein the cluster comprises a plurality of nodes. The data processing method comprises the steps that a data processing request is received, wherein the data processing request comprises a to-be-processed first data object; the first data object is stored to a database of the cluster to generate a task message, wherein the task message carries task identification related to the first data object; and the task message is released to the nodes in the cluster, so that the nodes extract the first data object for processing from the database according to the task identification. According to the data processing method, the data processing device and the information processing system, asynchronous processing of data is realized; use of a new thread pool and a thread queue is avoided; the complexity is reduced; the processing efficiency is improved; a data processing flow is optimized and clear; an idle node resource in the cluster can be fully used; and resource waste is avoided.

Description

technical field [0001] The present application relates to the field of network technology, especially to a data processing method and device, and an information processing system. Background technique [0002] In the network, the real-time interactive transmission of business data between information processing systems generally adopts an asynchronous interactive method. [0003] In the related technology, the process of asynchronous interaction between the information processing system and the external system is that the application system layer of the current node receives the business request, and puts the business data requested for processing into the existing thread pool of the operating system layer on the current node or the new thread pool of the operating system layer. On the thread started, the thread pool of the operating system layer or the newly started thread process the business data. Although asynchronous processing is realized, it is necessary to manage the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/958
Inventor 韩涛袁自诚
Owner ANT WEALTH (SHANGHAI) FINANCIAL INFORMATION SERVICES CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap