Data processing method, apparatus and device and storage medium

A data processing device and data processing technology, applied in the computer field, can solve the problems of multiplying the amount of data, increasing the resources occupied by the computer processor of a statistical system, and increasing the number of statistics in the statistical system.

Active Publication Date: 2018-09-25
BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] It can be seen from Table 1-Table 4 that although the common solutions solve the above problems, it is easy to cause the data volume of the associated table such as Table 4 to increase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, apparatus and device and storage medium
  • Data processing method, apparatus and device and storage medium
  • Data processing method, apparatus and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example

[0119] Example 1: The status code carried by the source data is shown in Table 5-8. In Table 5, N is the number of statistical items, so the number of prime numbers is also N, and i is different from N-1 prime numbers. In Table 6, the status code of the current source data before statistics is 1; Table 7 reflects the specific content of each statistical item in Table 5 for all current source data in Table 6; Table 8 reflects the association relationship of each statistical item in Table 5 after all the current source data in Table 6 is counted, and L is the number of current source data.

[0120] Table 5 Statistics

[0121] Key ID

[0122] Table 6 Current source data without statistics

[0123] Key ID

[0124] Table 7 Statistics items after the statistics of the current source data

[0125] Key ID

[0126] Table 8 The form of statistical items after statistics of current source data

[0127] Key ID

[0128] In order to highlight the effect of preventing repetitive statisti...

Example Embodiment

[0146] After S102, the following implementation manner may also be included:

[0147] Determine whether the status code carried by the j-th source data exists 1;

[0148] If the status code carried by the jth source data exists 1, use the mth statistical item to count the jth source data, and update the status code of the jth source data to the second data, and the second data is the The product of the quality numbers carried by m statistical items;

[0149] If the status code carried by the jth source data does not have 1, the step S103 is executed.

[0150] In this embodiment, the source data that has not been counted is filtered first, and then the remaining source data is counted. The setting of the dual judgment conditions forms the shunt statistics, which not only improves the statistics speed, but also improves the statistics accuracy.

[0151] S103: Determine whether the status code carried by the jth source data can divide the quality code carried by the mth statistical item; ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method, apparatus and device and a storage medium. The data processing method comprises the steps that the jth source data is read, the mth statistic item is read, and whether a state code carried by the jth source data can exactly divide a prime number code carried by the mth statistic item or not is judged; if the prime number code carried by the mth statistic item cannot be exactly divided, the mth statistic item is utilized to count the jth source data, the state code of the jth source data is updated into first data, whether the statistic item is completely read or not is judged according to an m value; if the statistic item is not completely read, 1 is subtracted from m or 1 is added to m according to an initial value of them, the processed m serves as a new m, and the step of reading the mth statistic item is repeated. By applying the scheme provided in the embodiment of the invention, decrease of source data and data quantity described by incidence relation of the statistic item is achieved, accordingly the data statistic complexity of a statistic system is reduced, the orderly statistic purpose is achieved, and the efficiency is improved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method, device, equipment and storage medium. Background technique [0002] In the current production environment, when the computer accurately counts various types of data, the same source data needs to be counted in multiple statistical items. The common problem is that it is easy to cause the source data to arrive at the statistical logic of each statistical item out of order, and it is easy to repeat . [0003] A common solution to the above problems is to associate the source data with the statistical items. After the source data has been counted, create a data row of the Cartesian product of the key ID (identification, identification number) of the source data and the ID of the statistical item. Now Take two statistical items to count two source data as an example, as shown in Table 1-Table 4. [0004] Table 1 Statistical items [0005] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 孙豪杰
Owner BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products