Data preprocessing and downloading method and system, computer equipment and readable storage medium
A data preprocessing and computer program technology, applied in the Internet field, can solve the problems of wasting network traffic, reducing user experience, long waiting time, etc., and achieve the effects of saving pressure, saving traffic, and improving damage rate
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0048] Such as figure 1 As shown, this embodiment provides a data preprocessing and downloading method. The server generates the sqlite database that the client needs to use in advance and deletes some unnecessary data. After compression, it is finally uploaded to the CDN, that is, Content Delivery Network content distribution network. The client obtains the CDN address by accessing the server interface for downloading. After the downloaded data is decompressed, it will be the database required locally. Specifically include the following steps:
[0049] The server loads the data required by each client, generates the corresponding sqlite database based on the data required by different clients, opens the WAL mode of the sqlite database, and writes to make the data write faster, and then process it when writing A good transaction is a unit of program execution that accesses and possibly updates various data items in a database. At the same time, it prevents incorrect data f...
Embodiment 2
[0055] This embodiment provides a data preprocessing and downloading system for implementing the data preprocessing and downloading method described in Embodiment 1, including a server subsystem and a client subsystem,
[0056] The server subsystem includes:
[0057] The loading module is used to load the data required by each client;
[0058] The database generation module is used to generate corresponding sqlite databases based on the data required by different clients, and enable the WAL mode of the sqlite database for writing. For the data required by the client that has already generated the database, the database generation module continues to use the generated database, and writes the required data incrementally into the generated database;
[0059] The compression module is used to carry out 7z compression processing on each generated database after checkpoint is performed on each database to form a standby file corresponding to the database;
[0060] The upload modu...
Embodiment 3
[0067] This embodiment provides a computer device, including a memory and a processor, where a computer program is stored in the memory, and the processor implements the method in any of the above embodiments when executing the computer program. Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing related hardware through computer programs. Accordingly, the computer program can be stored in a non-volatile computer-readable storage medium, and when the computer program is executed, the method described in any one of the above-mentioned embodiments can be realized. Wherein, any references to memory, storage, database or other media used in the various embodiments provided in the present application may include non-volatile and / or volatile memory. Nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More