Unlock instant, AI-driven research and patent intelligence for your innovation.

A data processing method and device

A data processing and data technology, applied in the Internet field, can solve the problem of low performance of memory database and achieve the effect of meeting performance requirements

Active Publication Date: 2018-09-11
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention provides a data processing method and device to solve the problem of low performance of memory databases such as Redis in some highly concurrent application scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and device
  • A data processing method and device
  • A data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] A data processing method provided by an embodiment of the present invention is introduced in detail.

[0047] refer to figure 2 , shows a flowchart of steps of a data processing method in an embodiment of the present invention.

[0048] Step 100, the counting proxy entity receives the counting request instruction sent by the client.

[0049] The counting proxy entity can be an actual device, or a virtual module. The counting proxy entity can be located in the client, and can also be set in the counting server. The embodiment of the present invention has a specific form and location of the counting proxy entity No restrictions.

[0050] The counting request instruction includes the type of data and the counting quantity of data.

[0051] Step 102, using the counting proxy entity to perform a counting operation according to the counted quantity of data in the counting request instruction.

[0052] If the type A of the data is included in the counting request instruct...

Embodiment 2

[0061] A data processing method provided by an embodiment of the present invention is introduced in detail.

[0062] refer to image 3 , shows a flowchart of steps of a data processing method in an embodiment of the present invention.

[0063] Step 200, selecting a counting proxy entity corresponding to the type of data in the counting request instruction sent by the client.

[0064] The counting proxy entity can be an actual device, or a virtual module. The counting proxy entity can be located in the client, and can also be set in the counting server. The embodiment of the present invention has a specific form and location of the counting proxy entity No restrictions.

[0065] Different data types can correspond to different counting proxy entities, and the same counting proxy entity can also correspond to multiple different data types.

[0066] In step 202, the counting proxy entity receives the counting request instruction sent by the client.

[0067] The counting reque...

Embodiment 3

[0091] A data processing method provided by an embodiment of the present invention is introduced in detail.

[0092] refer to Figure 4 , shows a flowchart of steps of a data processing method in an embodiment of the present invention.

[0093] Step 300, sending a counting request instruction.

[0094] The client initiates a counting request command for the specified variable, requesting to execute the counting operation.

[0095] Step 302, perform a counting operation.

[0096] Select the specified counting proxy module to perform counting operations on specific variables.

[0097] Step 304, threshold judgment; when the count transition condition is met, step 306 is executed; when the count transition condition is not met, step 302 is repeatedly executed.

[0098] According to the preset threshold condition, it is judged whether the count transfer condition is reached.

[0099] Step 306, sending a count transfer instruction.

[0100] A counting transfer instruction is s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data processing method and device. The method includes the steps that a counting request instruction sent by a client terminal is received by a counting agent entity; the counting request instruction comprises the type of data and the counting quantity of the data; counting operation is executed through the counting agent entity according to the counting quantity of the data in the counting request instruction; whether the counting result meets a counting transfer condition or not is judged through the counting agent entity; if yes, a counting transfer entity sends a counting increasing instruction to a counting server, and thus the counting server conducts data processing according to the counting increasing instruction; the counting increasing instruction comprises the type of the data and the increasing quantity of the data. According to the data processing method and device, the mode of adding a middle layer agent in an in-memory database such as the client terminal and a Redis is adopted, the in-memory database such as the Redis can be used in a high concurrency counting application scene, and the performance requirement can be met.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a data processing method and device. Background technique [0002] Redis is a well-known in-memory database. Its advantages are stable operation, good performance and rich interfaces. But the biggest problem is that currently only supports single-point write data. Moreover, its architecture is single-process and single-threaded. This means that when the load reaches a certain level, no matter how many cores there are on the CPU, Redis will always show a computational bottleneck, because it can only use at most one of the cores. In fact, under the current hardware conditions, when the load exceeds 100,000 operations per second, Redis has already shown a serious performance bottleneck. As a result, in some high-concurrency application scenarios, in-memory databases such as Redis cannot meet performance requirements. Contents of the invention [0003] The present inventio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 牟盖东
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD