A data archiving method and device
A data archiving and data technology, applied in the field of big data, can solve problems such as inaccurate data statistics, and achieve the effect of solving inaccurate data statistics
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0032] In order to solve the problem of inaccurate data statistics caused by the data archiving method in the prior art, Embodiment 1 of the present application provides a data archiving method. The subject of execution of this method may be, but not limited to, the server statistics terminal.
[0033] For the convenience of description, the implementation of the method is introduced below by taking the execution subject of the method as the statistics terminal as an example. It can be understood that the fact that the execution subject of the method is the statistical terminal is only an exemplary description, and should not be construed as a limitation of the method.
[0034] The schematic diagram of the implementation process of this method is shown in the figure 1 shown, including the following steps:
[0035] Step 11: loading the first data into the first memory storing the second data;
[0036] In this embodiment, the first memory may be a volatile memory or a non-vol...
Embodiment 2
[0064] Embodiment 2 of the present application mainly introduces an application scheme of the above-mentioned method provided in Embodiment 1 of the present application in practice.
[0065] The data archiving method in Embodiment 2 of the present application is similar to the data archiving method described in Embodiment 1. For other functions of the data archiving method not introduced in Embodiment 2, please refer to the relevant description in Embodiment 1. Let me repeat.
[0066] Before introducing the implementation of the solution in detail, a brief introduction to the implementation scenario of the solution is given:
[0067] In the embodiment of the present application, the first storage is a memory, and the second storage is a data warehouse.
[0068] The data in Example 2 is log data, and the statistical terminal loads the received log data into the memory every 10 minutes according to its own operating system time, so that the memory computing framework always hol...
Embodiment 3
[0090] In order to solve the problem of inaccurate data statistics caused by out-of-order data in the prior art, an embodiment of the present application provides a data archiving device. The structure diagram of the data archiving device is as follows: image 3 As shown, it mainly includes the following functional units:
[0091] The data loading unit 31 is used to load the first data into the internal memory storing the second data; the first data is the data obtained by the statistics terminal in at least one time window; the second data is the time attribute The data represented by the time within the valid time interval;
[0092] The data calculation unit 32 is configured to archive the first data and the second data in the internal memory in a manner of archiving according to the time attribute of the data.
[0093] The data loading unit 31 is specifically configured to load the first data in the preset buffer into the memory.
[0094] Data writing unit 33: used to wr...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More 


