Data processing method and device, electronic equipment and storage medium

A data processing and data technology, applied in the field of data processing, can solve problems such as task loss, service restart, and long time consumption, and achieve the effects of ensuring digestion speed, fast response, and reducing execution time consumption

Pending Publication Date: 2020-05-15
WUBA
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, for each data processing task, the corresponding task thread needs to complete the data query and processing operations in sequence, so it takes a long time, resulting in a long waiting time for the processing tasks in the task queue, resulting in a slow server response effect, which can easily lead to service restart, and once the service restarts, it will cause task loss

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0081] In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described The embodiments are only some of the embodiments of the present application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0082] figure 1 It is a schematic diagram of data interaction between a client and a server shown in this application according to an exemplary embodiment. Such as figure 1 As shown, there are multiple service nodes (ie, servers) and clients that can exchange data with one or more servers in the Internet. Multiple clients can initiate ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and device, electronic equipment and a storage medium. The method comprises: dividing a data task into a data query sub-task and a data processing sub-task to be executed respectively; caching the received data tasks by adopting a distributed task queue; acquiring a data task through a data query thread, performing data query to complete a data query sub-task, caching to-be-processed data queried by the data query thread by adopting a distributed data queue, and acquiring the to-be-processed data through a data processing thread to perform dataprocessing to complete a data processing sub-task. Through the method, the data query thread and the data processing thread only need to independently execute data query and data processing; and for each thread, the time consumption is greatly reduced, so that the digestion speed of the data tasks in the task queue can be ensured, the data tasks in the task queue do not need to wait for a long time, and the server can quickly respond to the data processing request of the client.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a data processing method, device, electronic equipment, and storage medium. Background technique [0002] In the information age, the number of clients that can interact with the server in the Internet is increasing. When the client initiates a data processing request to the server, its requirements for the response speed of the server are also getting higher and higher. [0003] Usually, after receiving the data processing request initiated by the client, the server adds the request message to the task queue and waits for execution; and for the data processing task in the task queue, the server calls the corresponding service to create a task thread to pass the task threads to execute the data processing tasks in the task queue; after the current processing task is completed, the next data processing task is received from the task queue for processing. [...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F9/48G06F9/54
CPCG06F16/24552G06F9/4843G06F9/546G06F2209/548
Inventor 亢伟楠刘炜东史忠伟
Owner WUBA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products