Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed data service processing method, system and device and storage medium

A distributed data and processing method technology, applied in the direction of electronic digital data processing, structured data retrieval, database distribution/replication, etc., can solve problems such as data loss and system performance impact

Pending Publication Date: 2019-12-31
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF0 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to overcome the strong dependence of the data reading and writing system on external components such as databases and external interfaces in the prior art, making the system performance easily affected by the operating performance of external components and prone to data loss defects, providing a distributed data service processing method, system, equipment and storage medium

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data service processing method, system and device and storage medium
  • Distributed data service processing method, system and device and storage medium
  • Distributed data service processing method, system and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0061] Such as figure 1 As shown, the processing method of the distributed data service involved in this embodiment includes the following steps:

[0062] S101. The application service module receives a data write service request initiated by a client, and obtains service data from the data write service request.

[0063] Wherein, the request type initiated by the client may be HTTP (HyperText Transfer Protocol, Hypertext Transfer Protocol), TCP (Transmission Control Protocol, Transmission Control Protocol), or other protocol agreed between the application service module and the client. request type.

[0064] S102. The application service module adds a synchronization status field to the business data, and initializes the synchronization status field, where the initial status value of the synchronization status field is set to 0;

[0065] S103. The application service module generates a global ID of the service data, and adds the global ID to the service data.

[0066] Amon...

Embodiment 2

[0083] Such as image 3 As shown, the distributed data service processing system involved in this embodiment includes an application service module 1 , an asynchronous service module 2 and a work process module 3 . Among them, the asynchronous service module 2 is idempotent. The application service module 1 includes a business data acquisition unit 11, a field addition unit 12, an ID generation unit 13, and an asynchronous processing unit 14. The asynchronous service module 2 includes a monitoring unit 21 and an asynchronous writing data unit. 22 and an update unit 23, the working process module 3 includes a local data acquisition unit 31, a cache data acquisition unit 32, a judgment unit 33, a data deletion unit 34 and an asynchronous retransmission unit 35;

[0084] The business data acquisition unit 11 is used to receive the write data service request initiated by the client, and obtain business data from the write data service request; the field adding unit 12 is used to a...

Embodiment 3

[0096] Figure 4 It is a schematic structural diagram of the electronic equipment involved in this embodiment. The electronic device includes a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the distributed data service processing method described in Embodiment 1 when executing the program. Figure 4 The electronic device 50 shown is only an example, and should not limit the functions and scope of use of the embodiments of the present invention.

[0097] Such as Figure 4 As shown, electronic device 50 may take the form of a general-purpose computing device, which may be a server device, for example. Components of the electronic device 50 may include, but are not limited to: at least one processor 51 , at least one memory 52 , and a bus 53 connecting different system components (including the memory 52 and the processor 51 ).

[0098] The bus 53 includes a data bus, an address bus and a control bu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed data service processing method, system and device and a storage medium. The processing method comprises the steps that an application service module obtains service data from a received write service request, adds a synchronization state field and a global ID in the service data to serve as target service data, and stores the target service data into a distributed cache, a local memory and a message queue; an asynchronous service module monitors the message queue, obtains target service data from the asynchronous message, stores the target service data into a database, updates a synchronous state field of the target service data after successful storage, and updates the updated target service data to a distributed cache; and a work process module regularly polls the data of the local memory, acquires the corresponding data in the distributed cache according to the global ID and judges whether the synchronization state field is updated or not, deletes the local data if so, and retransmits the local data to the message queue if not. The method can effectively ensure that each write data service request can be responded without omission.

Description

technical field [0001] The present invention relates to the technical field of distributed data processing, in particular to a processing method, system, equipment and storage medium of distributed data services. Background technique [0002] With the rapid development of information technology, data requests submitted by users such as orders and comments are extremely precious. However, as the complexity of the business increases, the complexity of the database and the external interfaces it depends on will gradually increase. In scenarios where traffic increases and complexity increases, the system needs to ensure interface performance and high availability. [0003] At present, the processing system of most data services is to directly write data into the database in the application server, or store the data in mysql (a relational database management system) wide table or cache in order to ensure performance, and then send the data asynchronously. Message to mq (message...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/27G06F9/54
CPCG06F9/546
Inventor 王巍王飞
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com