Data processing method and system

A data processing system and data processing technology, applied in the computer field, can solve problems such as database crashes, limited concurrency performance, and poor concurrency performance, and achieve the effects of ensuring consistency and integrity, enhancing concurrency processing, and avoiding bottleneck problems

Active Publication Date: 2014-06-25
西安京迅递供应链科技有限公司
View PDF2 Cites 60 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The transaction concurrency performance (TPS) of the database is limited, so it can lead to a bottleneck risk in the concurrency performance of OLTP application systems
Practice also shows that no matter how you optimize query SQL (Structured Query Language, Structured Query Language), database configuration, etc., it is difficult to meet the high concurrency requirements of the above-mentioned preemptive application scenarios;
[0013] 2) In high-concurrency application scenarios, existing technical solutions are prone to database deadlocks. If the deadlocks are not handled properly, it is easy to cause database crashes, which in turn lead to serious consequences such as system unusability;
[0014] 3) The concurrency performance is poor, and the user experience is not good. It often takes several seconds to return the result after the client initiates a claim request

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and system
  • Data processing method and system
  • Data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail below with reference to the accompanying drawings and examples.

[0055] like figure 2 As shown, the data processing method provided by the present invention includes a data writing stage and a data processing stage, wherein:

[0056] The data writing stage includes:

[0057] Step 1. Receive the data information sent by the client;

[0058] Step 2, creating a database connection, and opening a database transaction, and persisting the data information to the database;

[0059] Step 3. Write the data to be processed in the data information into the Redis cache, and then submit the database transaction;

[0060] The data processing stages include:

[0061] Step 4. Obtain the data to be processed from the Redis cache, process the data to be processed, and send the processed result data to a message queue (MQ);

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and system. The data processing method comprises the first stage of data writing, wherein data information sent by a client-side is received, persistence is carried out on the data information into a database, and to-be-processed data in the data information are written into a Redis cache; the second state of data processing, wherein the to-be-processed data are obtained from the Redis cache and are processed, processed result data are sent to an information queue, the result data are obtained from the information queue, and persistence is carried out the result data into the database. As the Redis cache stores the to-be-processed data, concurrent preemption and processing of the to-be-processed data in the Redis cache are achieved, and persistence on the processed result data into the database is achieved in a serialization mode through the information queue. According to the data processing method and system, concurrency processing of the data is enhanced, good experience is brought to clients, the bottleneck problem brought to the database under the condition of high concurrency is avoided, the deadlock problem of the database is avoided, and consistency and completeness of the data are ensured.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data processing method and system with high concurrent performance. Background technique [0002] After-sales service is a very important part of business behavior. Whether it is a traditional retailer or an e-commerce enterprise, a complete after-sales service system must be established to ensure the quality of the products sold and the legitimate rights and interests of customers, and the quality of after-sales service directly affects the shopping experience of customers. [0003] For e-commerce companies, if customers buy goods on an e-commerce website and find problems such as quality and wrong purchase after receiving the goods, they can directly submit relevant after-sales service applications on the e-commerce website, and the after-sales service application data will be sent to the in the after-sales service system of the e-commerce. The after-sales service special...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2308G06F16/2365G06Q30/016
Inventor 者文明
Owner 西安京迅递供应链科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products