Method, device, computer device and storage medium for data maintenance

By preprocessing and storing business data in a single table in the view layer, and then storing data that meets the conditions in the data pool, the problem of slow query speed caused by multi-table joins and frequent reads is solved, and real-time data validity and efficient access are achieved.

CN115374114BActive Publication Date: 2026-02-17SHANGHAI PUDONG DEVELOPMENT BANK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210966919.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-11
Publication Date
2026-02-17
Estimated Expiration
2042-08-11

AI Technical Summary

Technical Problem

Existing data monitoring and maintenance methods require joining multiple tables and frequently reading the database, resulting in slow data query speeds and excessively long response times.

Method used

By acquiring business data from the view layer, preprocessing it, and storing it in a single table, and then storing the data that meets the requirements into the data pool according to the filtering conditions, the business data in the data pool is dynamically maintained, reducing the repeated reading of the view layer.

Benefits of technology

It improved the efficiency of business data access, kept the data in the data pool valid in real time, reduced response time, and improved query speed.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115374114B_ABST
    Figure CN115374114B_ABST
Patent Text Reader

Abstract

The application relates to a data maintenance method, device, computer equipment and storage medium. The method comprises the following steps: acquiring business data associated with a view layer, wherein the business data has corresponding valid data time; storing the business data in a corresponding single table after preprocessing, wherein the preprocessing comprises at least one of the following instructions: extracting business data, converting business data and loading business data; storing business data meeting a filtering condition in the single table into a data pool; when data in a view layer associated table changes, judging whether the changed data needs to be added to the data pool according to a condition set in an index element; if the changed data meets the condition set in the index element, adding the changed data to the data pool to obtain an updated data pool. The method can dynamically maintain data in the data pool and improve data access efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of data supervision technology, and in particular to a method, apparatus, computer equipment, and storage medium for data maintenance. Background Technology

[0002] As user businesses grow in scale, numerous supervision and management platforms have emerged. These platforms are used to supervise and manage business data before, during, and after events. Existing data supervision and maintenance methods involve associating business data tables according to business rules, creating a view layer, filtering the business data that needs processing from the view layer based on business requirements, comparing the filtered business data with the corresponding investment rules, and determining whether the filtered business data conforms to investment instructions.

[0003] However, current data monitoring and maintenance methods require the association of multiple tables and frequent database reads, resulting in slow data query speeds and excessively long response times for the monitoring and management platform. Summary of the Invention

[0004] Therefore, it is necessary to provide a data maintenance method, apparatus, computer equipment, and storage medium to address the aforementioned technical problems. This method can filter out business data that meets business requirements from the view layer, preprocess the business data that meets business requirements, add it to the data pool, and then dynamically maintain the business data in the data pool, ensuring that the data in the data pool is valid in real time.

[0005] Firstly, this application provides a method for data maintenance. The method includes:

[0006] Obtain the business data associated with the view layer, wherein the business data has a corresponding valid data time;

[0007] The business data is preprocessed and then stored in the corresponding single table. The preprocessing includes at least one of the following instructions: extracting business data, transforming business data, and loading business data.

[0008] Store the business data that meets the filtering criteria in the single table into the data pool;

[0009] When the business data in the associated tables of the view layer changes, determine whether the changed business data should be added to the data pool based on the conditions set in the indicator element.

[0010] If the changed business data meets the conditions set in the indicator element, the changed business data is added to the data pool to obtain the updated data pool.

[0011] In one embodiment, during the preprocessing process, the business data generated after the execution of the instructions during the preprocessing process is stored in a temporary database.

[0012] In one embodiment, when the business data in the associated table of the view layer changes, the changed business data is obtained through aspect-oriented programming.

[0013] In one embodiment, the method further includes:

[0014] Based on the updated data pool, business data access is performed, including querying business data and generating page views.

[0015] Secondly, this application also provides a data maintenance apparatus. The apparatus includes:

[0016] The data acquisition module is used to acquire business data associated with the view layer, and the business data has a corresponding valid data time.

[0017] The preprocessing module is used to preprocess the business data and store it in the corresponding single table. The preprocessing includes at least one of the following instructions: extracting business data, transforming business data, and loading business data.

[0018] The first storage module is used to store the business data that meets the filtering conditions in the single table into the data pool;

[0019] The judgment module is used to determine whether the changed business data should be added to the data pool based on the conditions set in the indicator element when the business data in the related tables of the view layer changes.

[0020] The second storage module is used to add the changed business data to the data pool if the changed business data meets the conditions set in the indicator element, thereby obtaining an updated data pool.

[0021] In one embodiment, during the preprocessing process, the business data generated after the execution of the instructions during the preprocessing process is stored in a temporary database.

[0022] In one embodiment, when the business data in the associated table of the view layer changes, the changed business data is obtained through aspect-oriented programming.

[0023] In one embodiment, business data access is performed based on the updated data pool, and the business data access includes querying business data and generating page views.

[0024] Thirdly, this disclosure also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of a data maintenance method.

[0025] Fourthly, this disclosure also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements the steps of a data maintenance method.

[0026] Fifthly, this disclosure also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the steps of a data maintenance method.

[0027] The above-mentioned data maintenance methods have at least the following beneficial effects:

[0028] The embodiments provided in this disclosure can filter business data that meets business requirements from the view layer, preprocess the filtered business data, and store it in a data pool. As the amount of business data increases, the amount of business data stored in the data pool will also gradually increase. Deleting business data from the data pool according to business needs can maintain the real-time validity of the data in the data pool. It is possible to intercept business data in the view layer's associated tables and add changed business data to the data pool without rereading the view layer's business data. The business data in the data pool can be dynamically maintained, ensuring the real-time validity of the business data in the data pool and improving the efficiency of business data access.

[0029] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the embodiments or conventional technologies of this disclosure, the accompanying drawings used in the description of the embodiments or conventional technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0031] Figure 1 This is an application environment diagram of a data maintenance method in one embodiment;

[0032] Figure 2 This is a flowchart illustrating a data maintenance method in one embodiment;

[0033] Figure 3 This is a schematic diagram illustrating the storage of business data generated after executing instructions during preprocessing into a temporary database in one embodiment;

[0034] Figure 4 This is a schematic diagram illustrating the acquisition of changing business data through aspect-oriented programming in one embodiment.

[0035] Figure 5This is a schematic diagram of a business management system in one embodiment;

[0036] Figure 6 This is a structural block diagram of a data maintenance device in one embodiment;

[0037] Figure 7 This is an internal structural diagram of a computer device in one embodiment;

[0038] Figure 8 This is an internal structure diagram of a server in one embodiment. Detailed Implementation

[0039] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0040] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of business data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims. The terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, product, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, product, or apparatus. Without further limitations, the presence of other identical or equivalent elements in a process, method, product, or apparatus that includes said elements is not excluded. For example, the use of terms such as "first," "second," etc., is to denote names and does not indicate any specific order.

[0041] The data maintenance method provided in this disclosure can be applied to, for example... Figure 1In the application environment shown, terminal 102 communicates with server 104 via a network. A data storage system can store the business data that server 104 needs to process. The data storage system can be integrated onto server 104 or located on the cloud or other network servers. Terminal 102 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can include smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, etc. Portable wearable devices can include smartwatches, smart bracelets, head-mounted devices, etc. Server 104 can be implemented using a standalone server or a server cluster consisting of multiple servers.

[0042] In some embodiments of this disclosure, such as Figure 2 As shown, a data maintenance method is provided, which can be applied to... Figure 1 This method is illustrated using the example of a server processing business data. It is understood that this method can also be applied to servers, and to systems including terminals and servers, and is implemented through interaction between the terminal and the server. In a specific embodiment, the method may include the following steps:

[0043] S200: Obtain the business data associated with the view layer, wherein the business data has a corresponding valid data time.

[0044] A view layer serves as an entry point for viewing data. It doesn't store the actual data itself, but rather provides a unified interface for users to access it. Using a view layer simplifies data access operations, and users typically only see the data provided by the view layer. Compared to directly retrieving data from business tables, this improves data processing efficiency and security.

[0045] Business data can be obtained from business tables, which store basic information, information, market trends, and data generated during actual business operations. As market conditions and business operations dynamically change, the business data in these tables may also change. The view layer can be associated with the business tables; when the data in the business tables changes, the data in the view layer may also change. By setting the valid data time frame according to business requirements, the corresponding business data can be obtained.

[0046] S202: After preprocessing the business data, it is stored in the corresponding single table. The preprocessing includes at least one of the following instructions: extracting business data, transforming business data, and loading business data.

[0047] Data warehousing technology (Extract-Transform-Load, ETL) can be used for business data preprocessing, involving the extraction, transformation, and loading of business data according to business requirements. Business data extraction can include various methods, such as update extraction, full extraction, and incremental extraction. The extraction process can check the data type to ensure integrity, remove duplicate data, and ensure that the exported data attributes are consistent with the source data. Business data transformation generally includes two parts: cleaning and transformation. First, duplicate, incomplete, and erroneous business data in the business tables is cleaned. Finally, transformation operations are performed on the business data according to business requirements. Loading involves loading the transformed business data into a specified location, providing data that meets business needs for subsequent business data analysis and mining.

[0048] A single table can be considered a data table, storing business data extracted, transformed, and loaded from the view layer. In some embodiments of this disclosure, single-table queries can effectively solve the problem of low efficiency in processing multi-table joins. Single-table queries have higher caching efficiency, and many applications can easily cache the results of single-table queries. If a query is viewed as a task, this task can consist of a series of subtasks, each consuming a certain amount of time. To optimize the query and improve its efficiency, its subtasks can be optimized. This can be achieved by eliminating some subtasks or reducing the number of times subtasks are executed. In some embodiments of this disclosure, improving query efficiency by eliminating some subtasks is equivalent to a single-table query. Performing joins on a single table allows querying only a portion of the data once, thereby reducing network and memory consumption. If joins are performed directly on the business table, it may be necessary to repeatedly access a portion of the data.

[0049] In embodiments of this disclosure, business data is preprocessed using data warehouse technology to obtain preprocessed business data, which is then stored in a single table. In some embodiments of this disclosure, this data operation can be performed only once, eliminating the need for frequent readings of business data from the view layer, thereby improving the query speed of business data.

[0050] S204: Store the business data that meets the filtering criteria in the single table into the data pool.

[0051] Filtering criteria can include the validity period of business data, data volume, data type, etc. A data pool is essentially a database for storing data. In some embodiments of this disclosure, filtering criteria are set according to business needs, and business data that meets the filtering criteria in a single table is stored in the data pool.

[0052] S206: When the business data in the associated table of the view layer changes, determine whether the changed business data should be added to the data pool based on the conditions set in the indicator element.

[0053] The view layer can correspond to multiple related tables. Some business data can reside in multiple tables or in a single table. Conditions set in metric elements can include the time, quantity, and type of business data. Changed data can include newly added, modified, and deleted data. Aspect-based programming or interceptors can be used to intercept changed data.

[0054] In the embodiments of this disclosure, interceptors can be added to the tables involved in the view layer when business data in the associated tables of the view layer changes. For example, if some business data in the view layer exceeds its validity period, and the same business data in the data pool also exceeds its validity period, the interceptors can be used to intercept the changed data in the associated tables of the view layer and determine whether the changed data should be added to the data pool based on the conditions set in the indicator elements.

[0055] S208: If the changed business data meets the conditions set in the indicator element, add the changed business data to the data pool to obtain the updated data pool.

[0056] In the embodiments of this disclosure, if the condition set in the indicator element is a valid data time, the changed business data can be data deleted or modified in the view layer. Accordingly, the business data in the data pool is located, and the business data is deleted or modified. Dynamically maintaining the data in the data pool ensures that if the data in the view layer changes, the data in the data pool is also modified accordingly. When new data is added to the view layer, the new data is added to the data pool accordingly, always keeping the data in the data pool at a certain level.

[0057] The aforementioned data maintenance method first involves retrieving the business data associated with the view layer, preprocessing the business data, and storing the preprocessed business data in a data pool. The amount of business data in the view layer may change as the business data in the business tables changes; in this case, the changed business data needs to be added to the data pool. Instead of rereading the business data in the view layer, only a single read of the changes is performed, reducing the number of reads and improving query efficiency. Interceptors can be used to intercept changes in the associated tables of the view layer, dynamically maintaining the business data extracted from the view layer and reducing response time in the event of a surge in business data.

[0058] In some embodiments of this disclosure, such as Figure 3 As shown, during the preprocessing process, the business data generated after executing the instructions during the preprocessing process is stored in a temporary database.

[0059] A temporary database can be a user-created parallel data warehouse (PDW) database used to temporarily store data when it is loaded into the target database. The temporary database can store data generated at any step of extraction, transformation, or loading from the view layer or the database. Using a temporary database can reduce table fragmentation. Without a temporary database, data might be loaded into temporary tables in the target database. When temporary tables are created and deleted in the target database, pages of temporary and permanent tables become interleaved. Over time, this can lead to table fragmentation and degrade data processing performance. In some embodiments of this disclosure, a temporary database can be created to store a portion of the data.

[0060] In some embodiments of this disclosure, such as Figure 4 As shown, when the business data in the associated tables of the view layer changes, the changed business data is obtained through aspect-oriented programming.

[0061] Aspect-Oriented Programming (AOP) is a continuation of Object-Oriented Programming (OOP). OOP designs different methods for different classes, potentially distributing code across various classes and increasing code duplication. One approach is to encapsulate this code in a separate method within an independent class, which can then be called from different classes. However, this creates coupling between the different classes and the independent method, meaning changes to the independent method can affect other classes.

[0062] Aspect-oriented programming (AOP) allows code to be dynamically inserted into specified methods and locations within a class at runtime, thereby reducing coupling between different parts of the business logic, improving program reusability, and increasing development efficiency. In some embodiments of this disclosure, AOP can be used to obtain changing business data.

[0063] In some embodiments of this disclosure, such as Figure 5 As shown, business data access is performed based on the updated data pool, including querying business data and generating page views.

[0064] The business data in the data pool can be continuously added to, deleted from, and modified. The updated data pool contains the latest business data that meets the business requirements.

[0065] The business management system can include a Dispatcher, a JobManager, a ResourceManager, and a TaskManager. The business management system monitors and processes user tasks, submitting tasks to the Dispatcher. The JobManager starts, with one task corresponding to one JobManager; the Dispatcher submits tasks to the JobManager. Internally, the JobManager performs processing and requests a slot from the ResourceManager. The TaskManager starts and registers the slot with the ResourceManager. The ResourceManager then instructs the TaskManager to provide slots to the JobManager. The TaskManager executes the task within the slot.

[0066] In the embodiments of this disclosure, business data metrics are set, business data that conforms to the business data metrics is obtained from the updated data pool, a page view is generated based on the obtained business data, and the business data that conforms to the business data metrics is displayed in the business management system.

[0067] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0068] Based on the same inventive concept, this disclosure also provides a data maintenance apparatus for implementing the data maintenance method described above. The solution provided by this apparatus is similar to the implementation described in the above method; therefore, the specific limitations in the data maintenance apparatus embodiments provided below can be found in the limitations of the data maintenance method described above, and will not be repeated here.

[0069] The apparatus may include a system (including a distributed system), software (application), module, component, server, client, etc., that uses the methods described in the embodiments of this specification, combined with necessary hardware implementation. Based on the same innovative concept, the apparatuses in one or more embodiments provided in this disclosure are as described in the following embodiments. Since the implementation schemes and methods for solving the problem by the apparatus are similar, the implementation of the specific apparatus in the embodiments of this specification can refer to the implementation of the foregoing methods, and repeated details will not be repeated. As used below, the terms "unit" or "module" can refer to a combination of software and / or hardware that implements a predetermined function. Although the apparatuses described in the following embodiments are preferably implemented in software, hardware implementations, or a combination of software and hardware, are also possible and contemplated.

[0070] In one embodiment, such as Figure 6 As shown, a data maintenance device 600 is provided. The device can be the aforementioned server, or a module, component, device, or unit integrated into the server. The device 600 may include:

[0071] The data acquisition module 6000 is used to acquire business data associated with the view layer, and the business data has a corresponding valid data time.

[0072] The preprocessing module 6002 is used to preprocess the business data and store it in the corresponding single table. The preprocessing includes at least one of the following instructions: extracting business data, transforming business data, and loading business data.

[0073] The first storage module 6004 is used to store the business data that meets the filtering conditions in the single table into the data pool;

[0074] The judgment module 6006 is used to determine whether the changed business data should be added to the data pool based on the conditions set in the indicator element when the business data in the related view layer table changes.

[0075] The second storage module 6008 is used to add the changed business data to the data pool if the changed business data meets the conditions set in the indicator element, so as to obtain the updated data pool.

[0076] In one embodiment, during the preprocessing process, the business data generated after executing the instructions during the preprocessing process is stored in a temporary database.

[0077] In one embodiment, when business data in the associated table of the view layer changes, the changed business data is obtained through aspect-oriented programming.

[0078] In one embodiment, business data access is performed based on the updated data pool, and the business data access includes querying business data and generating page views.

[0079] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0080] Each module in the aforementioned data maintenance device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0081] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 7 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The database stores business data. The network interface communicates with external terminals via a network connection. When executed by the processor, the computer program implements a data maintenance method.

[0082] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 8 As shown, the computer device includes a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When executed by the processor, the computer program implements a data maintenance method. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the computer device casing, or an external keyboard, touchpad, or mouse.

[0083] Those skilled in the art will understand that Figure 7 , Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present disclosure and does not constitute a limitation on the computer device to which the present disclosure is applied. A specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0084] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the methods described in any embodiment of this disclosure.

[0085] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the methods described in any embodiment of this disclosure.

[0086] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this disclosure can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this disclosure may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this disclosure may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0087] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0088] The embodiments described above are merely illustrative of several implementations of this disclosure, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent disclosure. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this disclosure, and these all fall within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the appended claims.

Claims

1. A data maintenance method, characterized in that, The method includes: Obtain the business data associated with the view layer, wherein the business data has a corresponding valid data time; The business data is preprocessed and then stored in the corresponding single table. The preprocessing includes at least one of the following instructions: extracting business data, transforming business data, and loading business data. During the preprocessing process, the business data generated after the execution of the instructions during the preprocessing process is stored in a temporary database. The temporary database is used to store the data generated by any step of extraction, transformation, or loading from the view layer or the database. Store the business data that meets the filtering criteria in the single table into the data pool; When the business data in the associated tables of the view layer changes, determine whether the changed business data should be added to the data pool based on the conditions set in the indicator element. If the changed business data meets the conditions set in the indicator element, the changed business data is added to the data pool to obtain the updated data pool.

2. The method according to claim 1, characterized in that, When the business data in the associated tables of the view layer changes, the changed business data is obtained through aspect-oriented programming.

3. The method according to claim 1, characterized in that, The method further includes: Based on the updated data pool, business data access is performed, including querying business data and generating page views.

4. A data maintenance apparatus, characterized in that, The device includes: The data acquisition module is used to acquire business data associated with the view layer, and the business data has a corresponding valid data time. The preprocessing module is used to preprocess the business data and store it in the corresponding single table. The preprocessing includes at least one of the following instructions: extracting business data, transforming business data, and loading business data. During the preprocessing process, the business data generated after the execution of the instructions during the preprocessing process is stored in a temporary database. The temporary database is used to store the data generated by any step of extraction, transformation, or loading from the view layer or the database. The first storage module is used to store the business data that meets the filtering conditions in the single table into the data pool; The judgment module is used to determine whether the changed business data should be added to the data pool based on the conditions set in the indicator element when the business data in the related tables of the view layer changes. The second storage module is used to add the changed business data to the data pool if the changed business data meets the conditions set in the indicator element, thereby obtaining an updated data pool.

5. The apparatus according to claim 4, characterized in that, When the business data in the associated tables of the view layer changes, the changed business data is obtained through aspect-oriented programming.

6. The apparatus according to claim 4, characterized in that, Based on the updated data pool, business data access is performed, including querying business data and generating page views.

7. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 3.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 3.

9. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • A cross multiple-data source type data synchronization mode supporting distributed deployment

    CN112506938A

  • Data acquisition method and device, electronic equipment, storage medium and program product

    CN112685485A

  • Scientific and technological resource integration method and device based on data warehouse and middleware

    CN112966162A