Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method, apparatus and device and storage medium

A data processing device and data processing technology, applied in the computer field, can solve the problems of multiplying the amount of data, increasing the resources occupied by the computer processor of a statistical system, and increasing the number of statistics in the statistical system.

Active Publication Date: 2018-09-25
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] It can be seen from Table 1-Table 4 that although the common solutions solve the above problems, it is easy to cause the data volume of the associated table such as Table 4 to increase exponentially, resulting in an increase in the number of statistics in the statistical system, thereby increasing the number of statistical systems in the computer processor. resource usage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, apparatus and device and storage medium
  • Data processing method, apparatus and device and storage medium
  • Data processing method, apparatus and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0119] Example 1: The status code carried by the source data is shown in Table 5-8, where, in Table 5, N is the number of statistical items, and the number of prime codes is also N, and i is different from N-1 prime numbers In Table 6, the status codes before the current source data are all 1; Table 7 reflects the specific content of each statistical item in Table 5 for all the current source data in Table 6; Table 8 shows the association relationship of all the current source data in Table 6 for each statistical item in Table 5, and L is the number of current source data.

[0120] Table 5 Statistical Items

[0121] key ID

details

quality digital

Statistics item 1

Statistical item description

2

Statistics item 2

Statistical item description

3

……

……

……

Statistical item N

Statistical item description

i

[0122] Table 6 Current source data when not counted

[0123] key ID

details

status...

Embodiment approach

[0147] Judging whether the status code carried by the jth source data is 1;

[0148] If the status code carried by the j-th source data is 1, use the m-th statistical item to make statistics on the j-th source data, and update the status code of the j-th source data to the second data, which is the second data The product of prime numbers carried by m statistical items;

[0149] If the status code carried by the jth source data does not have 1, step S103 is performed.

[0150] In this embodiment, firstly, the unstated source data is filtered, and then the rest of the source data are counted. The setting of double judgment conditions forms split statistics, which not only improves the statistical speed, but also improves the statistical accuracy.

[0151] S103, judge whether the status code carried by the jth source data can divide the prime code carried by the mth statistical item; if the status code carried by the jth source data can divide the prime code carried by the mth ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data processing method, apparatus and device and a storage medium. The data processing method comprises the steps that the jth source data is read, the mth statistic item is read, and whether a state code carried by the jth source data can exactly divide a prime number code carried by the mth statistic item or not is judged; if the prime number code carried by the mth statistic item cannot be exactly divided, the mth statistic item is utilized to count the jth source data, the state code of the jth source data is updated into first data, whether the statistic item is completely read or not is judged according to an m value; if the statistic item is not completely read, 1 is subtracted from m or 1 is added to m according to an initial value of them, the processed m serves as a new m, and the step of reading the mth statistic item is repeated. By applying the scheme provided in the embodiment of the invention, decrease of source data and data quantity described by incidence relation of the statistic item is achieved, accordingly the data statistic complexity of a statistic system is reduced, the orderly statistic purpose is achieved, and the efficiency is improved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method, device, equipment and storage medium. Background technique [0002] In the current production environment, when the computer accurately counts various types of data, the same source data needs to be counted in multiple statistical items. The common problem is that it is easy to cause the source data to arrive at the statistical logic of each statistical item out of order, and it is easy to repeat . [0003] A common solution to the above problems is to associate the source data with the statistical items. After the source data has been counted, create a data row of the Cartesian product of the key ID (identification, identification number) of the source data and the ID of the statistical item. Now Take two statistical items to count two source data as an example, as shown in Table 1-Table 4. [0004] Table 1 Statistical items [0005] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 孙豪杰
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products