Data processing method and apparatus

A processing method and data technology, applied in the computer field, can solve problems such as poor reading performance, and achieve the effects of low cost, good performance and high reading efficiency

Active Publication Date: 2018-08-28
TENCENT TECH (SHENZHEN) CO LTD +1
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Traditional lists are usually implemented using MySQL (relational database). MySQL records are stored on disk, and a large amount of data needs to be read from disk for each query. The read performance is limited by the performance of the disk. Taking the post list as an example, the more posts in a forum, the larger the data table will be, the more data needs to be loaded each time, and the read performance will also decrease. Worse as data grows

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and apparatus
  • Data processing method and apparatus
  • Data processing method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, and do not limit the protection scope of the present invention.

[0033] figure 1 It is a schematic diagram of the application environment of the data processing method provided by an embodiment. Such as figure 1 As shown, the application environment includes a user terminal 101, a server 102 and a key-value database 103. The server 102 is provided with an in-memory database, an index list of data is stored in the in-memory database, and data content of the data is stored in the key-value database 1022. The key-value database in this embodiment is a distributed storage system, that is, data content can be stored on different storage ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and apparatus. The method comprises the steps of receiving a query operation request, wherein the query operation request comprises query parameters, and the query parameters include a first attribute identifier and a first attribute value; sending the first query request to a memory database; receiving a first query response returned by the memory database, wherein the first query response comprises a corresponding first content identifier queried in a index list corresponding to the first attribute identifier according to the query parameters by the memory database; sending a second query request to a key value database, wherein the second query request comprises a first content identifier; receiving a second query response returned by thekey value database, wherein the second query response comprises first data contents corresponding to the first content identifier and found in a key value record by taking the first content identifieras a key value through the key value database; and sending the first data contents to a requester of the query operation request. The method combines the advantages of the memory database and the keyvalue database, and has the advantages of good performance and low cost.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data processing method and device. Background technique [0002] A list refers to data stored in the form of a list. List data has a wide range of applications. Anything related to list display can be abstracted into a list. The specific meaning of the list varies according to different product scenarios. For example, the post list of Tieba; the news list of each category of news application software, the comment list under a piece of news; the user list and gift list in live broadcast software; the message list of instant messaging software, friend list, etc. [0003] Traditional lists are usually implemented using MySQL (relational database). MySQL records are stored on the disk, and a large amount of data needs to be read from the disk for each query. The read performance is limited by the performance of the disk. Take the post list as an example , the more posts in a fo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2425G06F16/24539
Inventor 姚俊刚宋立鑫
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products