Data processing method, device and system

A data processing and data technology, applied in the computer field, can solve the problems of multi-network bandwidth, occupancy, and long search time, and achieve the effects of reducing network bandwidth occupancy, improving data processing efficiency, and reducing data volume

Active Publication Date: 2019-11-12
SHENZHEN TENCENT COMP SYST CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing technology, the data before different servers are directly transmitted without compression, which has disadvantages such as low data transmission efficiency, excessive network bandwidth occupation, and too long time for a single problem search.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, device and system
  • Data processing method, device and system
  • Data processing method, device and system

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0031] see image 3 , is a flow chart of a data processing method provided in the first embodiment of the present invention. This embodiment is based on the description of a data processing method provided by the present invention based on the sending end 100 side. Such as image 3 As shown, the method includes the following steps:

[0032] S101. Obtain the transmitted target data;

[0033]The sending end 100 reads data from the database, and generates target data according to preset construction rules. Alternatively, the sending end 100 may also acquire target data from other devices. The target data contains multiple values ​​of different types, that is, the target data is composed of multiple values ​​of different types. Specifically, the target data may be numerical data. Preferably, the numerical data is stored based on an inverted index (inverted index), that is, it is composed of many inverted index items . The inverted index includes, for each item in the index ta...

no. 2 example

[0043] see Figure 4 , is a flow chart of a data processing method provided by the second embodiment of the present invention. This embodiment is based on the description of a data processing method provided by the present invention on the side of the sending end 100 . Such as Figure 4 As shown, the method includes the following steps:

[0044] S201. Obtain the transmitted target data;

[0045] The target data contains multiple values ​​of different types, that is, the target data is composed of multiple values ​​of different types. Specifically, the target data may be numerical data. Preferably, the numerical data is stored based on an inverted index (inverted index), that is, it is composed of many inverted index items . The inverted index includes, for each item in the index table, an attribute value and addresses of records with the attribute value. Since the attribute value is not determined by the record, but the position of the record is determined by the attribute...

no. 3 example

[0066] see Figure 8 , is a sequence diagram of a data processing method provided by the third embodiment of the present invention. This embodiment describes a data processing method provided by the present invention based on the perspective of interaction between the sending end 100 and the receiving end 200 . Such as Figure 8 As shown, the method includes the following steps:

[0067] S301. The sending end obtains the transmitted target data;

[0068] S302. Obtain a numerical list of multiple different types of numerical values ​​from the target data;

[0069] S303. Compress the numerical lists of different types of numerical values ​​respectively according to their corresponding compression rules, so that the lengths of the numerical value lists of the different types of numerical values ​​are shortened;

[0070] S304. Send the compressed data to the receiving end;

[0071] For details of steps S301 to S304, reference may be made to relevant content of the second embod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data processing method. The method includes the steps of obtaining transmitted target data, obtaining value lists of various different types of values from the target data, compressing the value lists of the different types of values according to corresponding compressing rules so that the lengths of the value lists of the different types of values can be decreased, and sending the compressed data to a receiving end. The invention further provides a data processing device and system. By means of the data processing method, device and system, the data process rate between servers can be effectively increased.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method, device and system. Background technique [0002] With the development of computer technology and Internet technology, network service operators provide more and more business services for users. In order to better manage business services, network service operators usually provide users with independent platform servers. In the consultation window, the background server needs to go through the collaborative work of multiple modules to complete a series of complex search operations. Take a game product that can intuitively display the game strategy related to the question for the user in rich forms such as text, pictures, and videos according to the question asked by the user on the client page. The functions provided by this product to external users, In fact, it is a search engine based on a large number of game guides. Every time a user asks...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22H03M7/30
CPCG06F16/2228H03M7/30
Inventor 杨建伟
Owner SHENZHEN TENCENT COMP SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products