Data configuration center index updating method, system, device and medium
By monitoring update events in the business data configuration center and dynamically adjusting the index relationships of the data namespace, the problem of inflexible index expansion between business data and namespaces is solved, achieving efficient and accurate data management and retrieval.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SHENZHEN LEXIN SOFTWARE TECH CO LTD
- Filing Date
- 2026-03-12
- Publication Date
- 2026-06-19
Smart Images
Figure CN122240614A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of data storage technology, and in particular to a data configuration center index update method, system, device, and medium. Background Technology
[0002] As the company's business continues to grow, the amount of business data will increase dramatically. For example, business data such as those from modules like contract templates, signature configurations, and channel basic information under the unified configuration platform will experience explosive growth. By establishing an index relationship between business data and corresponding data namespaces, all configurations under a specific namespace can be quickly located, effectively improving the efficiency of business data retrieval.
[0003] However, the current method for storing business data is mainly to create several fixed namespaces. The size of a single namespace is limited. For example, the maximum capacity of a single space is only 3M. Using a single namespace to store business data may lead to the risk of exceeding the capacity, which may result in serious consequences such as abnormal data storage and business interruption, thereby affecting the accuracy of the index relationship between business data and data namespaces.
[0004] Therefore, how to flexibly and accurately expand the index relationship between business data and namespaces has become an urgent problem to be solved. Summary of the Invention
[0005] This invention provides a data configuration center index update method, system, computer device, and medium to solve the problems of poor flexibility and accuracy in existing index expansion between business data and namespaces.
[0006] Firstly, a method for updating the index of a data configuration center is provided, including: Obtain the data namespace corresponding to the business data configuration center, and construct a data space index between each business data in the data namespace and the data namespace; Monitor business update events in the business data configuration center and identify the business modification data in the business update events; Calculate the available space size in the data namespace based on the business modification data; Calculate the target data index corresponding to the business modification data based on the available space size; The data space index is updated based on the target data index to obtain the target data space index.
[0007] Secondly, a data configuration center index update system is provided, including: The data space index building module is used to obtain the data namespace corresponding to the business data configuration center and build a data space index between each business data in the data namespace and the data namespace. The business modification data identification module is used to monitor business update events in the business data configuration center and identify business modification data in the business update events. The available space calculation module is used to calculate the available space size in the data namespace based on the business modification data. The target data index calculation module is used to calculate the target data index corresponding to the business modification data based on the available space size. The index update module is used to update the data space index according to the target data index to obtain the target data space index.
[0008] Thirdly, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the above-described data configuration center index update method.
[0009] Fourthly, a computer-readable storage medium is provided, which stores a computer program that, when executed by a processor, implements the steps of the above-described data configuration center index update method.
[0010] In the aforementioned data configuration center index update method, system, computer equipment, and storage medium, by establishing an index relationship between each business data item and the data namespace, a data space index is obtained. This allows for the determination of the storage space for each business data item, improving the efficiency and accuracy of business data management. Monitoring modified business data in the business data configuration center helps determine changes in business data. Based on the size of the modified business data, the available space size of the data namespace can be calculated, avoiding the risk of exceeding the data namespace's capacity and improving the rationality and accuracy of business data storage. The target data index corresponding to the modified business data can be calculated based on the available space size, enabling dynamic expansion and contraction of the data namespace for rational allocation. Updating the data space index based on the target data index yields the target data space index, allowing for precise business data retrieval. The data index is automatically maintained and expanded, improving the flexibility and accuracy of business data retrieval. Attached Figure Description
[0011] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0012] Figure 1 This is a schematic diagram of an application environment for a data configuration center index update method according to an embodiment of the present invention; Figure 2 This is a flowchart illustrating a data configuration center index update method according to an embodiment of the present invention; Figure 3 This is a schematic diagram of the structure of a data configuration center index update system in one embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of a computer device according to an embodiment of the present invention; Figure 5 This is another structural schematic diagram of a computer device according to one embodiment of the present invention. Detailed Implementation
[0013] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0014] The data configuration center index update method provided in this embodiment of the invention can be applied to, for example... Figure 1 In this application environment, the client communicates with the server via a network. The server can obtain the data namespace corresponding to the business data configuration center from the client, construct a data space index between each piece of business data in the data namespace and the data namespace; monitor business update events in the business data configuration center and identify the business modified data in the business update events; calculate the available space size in the data namespace based on the business modified data; calculate the target data index corresponding to the business modified data based on the available space size; and update the data space index based on the target data index to obtain the target data space index.
[0015] The system can calculate the available space of the data namespace in real time based on updates to business configurations, and then dynamically expand or shrink the data namespace to achieve reasonable allocation of namespaces. It updates the data space index based on the expanded data namespace set to obtain the target data space index, which allows for precise retrieval of business data. The system automatically maintains and expands the data index, improving the flexibility and accuracy of business data retrieval. The client can be, but is not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices. The server can be implemented using a standalone server or a server cluster consisting of multiple servers. The invention will be described in detail below through specific embodiments.
[0016] Please see Figure 2 As shown, Figure 2 A flowchart illustrating the data configuration center index update method provided in this embodiment of the invention includes the following steps: S1. Obtain the set of data namespaces corresponding to the business data configuration center, construct the index relationship between each business data in the set of data namespaces and the corresponding data namespace, and obtain the data space index of the business data configuration center.
[0017] In this embodiment of the invention, the business data configuration center is a business center for configuring enterprise business data. Through the business data configuration center, namespaces can be configured, such as the size and number of namespaces, the data storage location of business data, etc., and real-time business updates of the enterprise can be monitored.
[0018] For example, the business data configuration center can be a configuration center supported by Hippoj4's dynamic thread pool management tools, such as Nacos, Apollo, Polaris, Consul, and Zookeeper. Hippoj4 can use this configuration center for dynamic configuration management of thread pools and also for dynamic management of business configurations. For instance, a configuration monitoring mechanism can be developed in the project to listen for changes in business configurations in the configuration center. When configurations change, the new configuration information can be obtained promptly, and appropriate actions can be taken as needed, such as updating configuration objects in the application or reinitializing related components.
[0019] Among them, data namespaces are multiple namespaces used to manage enterprise business data. Namespaces can be used to organize and isolate different enterprise business data, such as different database objects (such as tables, views, stored procedures, etc.).
[0020] Specifically, a namespace is a mechanism used in programming to avoid naming conflicts. It allows identifiers with the same name (such as variables, functions, classes, etc.) to coexist in different spaces without conflict by dividing the space into different "naming scopes". Namespaces enable the organization and management of business data and the methods for manipulating that data, by giving the data a unique label, i.e., determining the data space index, to ensure that business data can be correctly identified and retrieved.
[0021] Specifically, constructing a data space index between each piece of business data in the data namespace and the data namespace includes: Perform data lineage analysis on the business data in the data namespace to obtain the data generation source of the business data; Create a data identifier and a namespace identifier for the business data based on the source of the data; Construct a mapping relationship between the data identifier and the namespace identifier; Generate a data space index corresponding to the business data configuration center based on the mapping relationship.
[0022] In this embodiment of the invention, data lineage analysis traces the flow path, transformation process, and relationships of data from its source to its final use. It can help understand the source, flow, processing, and relationships between data, similar to tracing a data "family tree." Through data lineage analysis, the data generation source of different business data in a data namespace set can be determined, which can be the business module that generates the business data.
[0023] Furthermore, based on the data source, a pre-defined unified business dictionary can be used to determine the business identifier corresponding to each data source and the namespace identifier corresponding to the namespace where the business data is located. The business identifier is used as the "key" and the namespace identifier is used as the "value" to perform a one-to-one mapping to obtain key-value pairs. Then, the data space index between the business data and the corresponding namespace can be obtained based on the mapping relationship. Through the "key" in the data space index, the namespace corresponding to the "value" can be mapped to determine the location of each business data storage.
[0024] In this embodiment of the invention, by constructing a data space index, the storage space where each piece of business data is located can be determined, thereby quickly extracting the corresponding business data from the namespace and improving the efficiency and accuracy of business data management.
[0025] S2. Monitor the business update events in the business data configuration center and identify the business modification data in the business update events.
[0026] In this embodiment of the invention, a business update event is a type of event that occurs in enterprise business due to changes in business data, business status, etc. caused by updates to business configuration. Examples include customer information update events, order status update times, product information update times, contract status update times, financial data update events, and supply chain update events.
[0027] Specifically, monitoring business update events in the business data configuration center includes: Configure a listening interface in the business data configuration center; Add an event listener to the business data configuration center according to the listening interface; The event listener is used to monitor business update events in the business data configuration center.
[0028] In this embodiment of the invention, the listening interface is a mechanism of the business data configuration center, used to enable clients to perceive changes in configuration data in real time, such as additions, deletions, and modifications. When a service is updated, the business data configuration center notifies the client through this interface, and the client can then update its own operating status according to the new configuration.
[0029] Specifically, different types of business data configuration centers have different listening interfaces. For example, when using Nacos as the business data configuration center, you can listen for changes in business configurations and obtain business update events through the configuration change listening interface ConfigChangedEvent provided by Nacos. When using Apollo as the configuration center, you can listen for business update events and other interfaces by implementing the ConfigurationListener interface and overriding the process method in the code.
[0030] Among them, the event listener is the specific implementation of the listening interface, which defines the specific processing logic when an event notification is received. The event listener contains one or more methods to listen for different types of business update events. A Config object can be injected with annotations, and an event listener can be added using the methods in the injected Config object to listen for business update events in the business data configuration center.
[0031] Furthermore, business modification data refers to data generated by business update events involving the addition or reduction of business data. It refers to data generated in the business system due to changes in business status or data caused by business transformation.
[0032] Specifically, identifying the business modification data in the business update event includes: Analyze the business execution logic of the business update event, and identify the business content of the business update event based on the business execution logic; The business data changes of the business update event are determined based on the business content; Identify the modified business data in the business update event based on the changes in the business data.
[0033] In this embodiment of the invention, business analysis involves analyzing business data increase events and business data decrease events that may occur in business update events. For example, business data decrease events are corresponding to business content such as user cancellation, order cancellation, product delisting, and scheduled data cleanup, while business data increase events are corresponding to business content such as user registration, order creation, content publishing, product listing, coupon redemption, payment success, user upgrade, customer service ticket creation, and inventory entry.
[0034] In detail, business data changes refer to changes in data during business update events. For example, whether the business content involves adding or reducing user data, or whether the business content does not involve any data changes.
[0035] In detail, the business execution logic can be determined based on the business execution process in the business update event. For example, by determining the flow path of business data during the business update process, starting from the source of data generation, through which processing links and storage locations, and how it is ultimately used, the business execution content in the business update event can be analyzed.
[0036] In this embodiment of the invention, the changes in business data of a business update event can be determined by the business modification data in the business update event, thereby analyzing the size of the business data and avoiding the inability to store business data due to the size of the namespace, thus ensuring accurate storage of business data.
[0037] S3. Calculate the available space size in the data namespace set based on the data size of the business modification data.
[0038] In this embodiment of the invention, the available space size is calculated based on the changes in business data corresponding to the modified business data, resulting in the total data size of all configuration business data in each data namespace. This includes the configuration file size of the data namespace configuration file itself. For example, a 10KB JSON configuration file and a 5KB Properties file will contribute 15KB of capacity. It also includes the text content data size of the "key" and "value" pairs corresponding to the data space index. For example, 1000 key-value pairs with an average size of 1KB will occupy approximately 1MB of data namespace size. Furthermore, it may include the data size of historical version data of the configuration. For example, if a configuration file has been modified 5 times, with each version size being 200KB, then the file will cumulatively occupy 1MB.
[0039] Since the core function of data namespaces is to manage lightweight, frequently changing configuration information rather than storing large files or redundant data, there are limitations on the storage capacity of data namespaces, such as 3 MB. If the storage capacity limit is exceeded, the configuration data of a single namespace will become excessively bloated, which will affect the read and write performance of the business data configuration center.
[0040] Specifically, calculating the available space size in the data namespace based on the business modification data includes: Construct the target data index corresponding to the business modification data; Calculate the size of the modified data corresponding to the modified business data based on the target data index, and obtain the current available space size of the data namespace; The size of the modified data is compared with the current available space size to obtain the available space size.
[0041] Specifically, constructing the target data index corresponding to the business modification data includes: The modified business data is written into a pre-built available storage space to obtain the target storage space corresponding to the modified business data; Create a target data index corresponding to the modified business data and the target storage space.
[0042] Furthermore, data lineage analysis can be performed based on the available storage space for the data modification fields to obtain the data identifier corresponding to the business modification data. Then, an index of the modified data corresponding to the business modification data can be constructed based on the data identifier and the unique namespace identifier of the data namespace. This involves mapping the business identifier as the "key" and the namespace identifier as the "value".
[0043] In detail, the modification data size can be calculated based on the byte size of the data fields in the target data index. For example, if the key-value pair in the target data index is an int32 field, the byte size is 4 bytes, 8 bytes (such as DATETIME type), CHAR(10) type field (assuming ASCII encoding, 10 bytes), etc. The number of bytes corresponding to the target data index can be calculated based on the byte size, and then the modification data size occupied by the target data index can be calculated based on the number of bytes.
[0044] In this embodiment of the invention, the current available space size includes the storage space occupied by the data space indexes already stored in the data namespace, the size of the configuration files, and the storage space occupied by the data size of historical versions of the data. The current available space size can be obtained based on the attribute information of the data namespace set.
[0045] Furthermore, the available space size can be obtained by subtracting the data modification size from the current available space size. For example, if the maximum storage space of each data namespace is 3MB (3,145,728 bytes), subtracting the data modification size from the current available space size will give the free storage space in the data namespace set, which is the available space size.
[0046] In this embodiment of the invention, the available space size can be used to determine whether the data namespace set has enough data space to store the data index and configuration file corresponding to the business modification data, thereby avoiding the risk of data namespace overcapacity, enabling business data to be stored normally, and improving the rationality and accuracy of business data storage.
[0047] S4. Calculate the target data index corresponding to the business modification data based on the available space size.
[0048] In this embodiment of the invention, the available space size can be negative, indicating that the available space size in the data namespace is insufficient to meet the organization and management of business data. Therefore, when the available space size is less than the preset space threshold, storing the modified data index corresponding to the modified business data in the data namespace may lead to data writing failure or partial writing, or even damage to the metadata in the data namespace. Therefore, it is necessary to create a new namespace as an expansion data namespace. When the available space size is greater than or equal to the preset space threshold, it is not necessary to expand the data namespace, and the modified business data corresponding to the modified business data can be directly stored in the free storage space of the data namespace set.
[0049] Further, the step of calculating the target data index corresponding to the business modification data based on the available space size includes: The available storage space corresponding to the business modification data is determined based on the available space size. Write the modified business data into the available storage space to obtain the target storage space corresponding to the modified business data; Create a target data index corresponding to the modified business data and the target storage space.
[0050] In this embodiment of the invention, the available storage space corresponding to the business modification data includes the expanded data namespace and the free storage space of the data namespace set. The size of the expanded space is the amount of additional storage capacity that the data namespace set needs to add. The required expanded space size is calculated according to the available space size within a preset range. For example, when the size of the expanded space in bytes is greater than 0.1M, a namespace is created as the expanded data namespace. When the size of the expanded space in bytes is greater than the storage space of one namespace, at least two namespaces are created as the expanded data namespace, and so on, creating expanded data namespaces that meet the requirements.
[0051] Specifically, new namespaces can be created as extended data namespaces based on the specific business platform of the data namespace. For example, in C++, the namespace keyword (namespace Math) can be used to directly create a new namespace as an extended data namespace.
[0052] Preferably, namespaces in Python can be implemented by creating modules or packages, while in databases, extended data namespaces can be created using PostgreSQL commands.
[0053] In this embodiment of the invention, when the size of the expanded space is greater than or equal to a preset space threshold, it is not necessary to expand the data namespace. The modified business data corresponding to the modified business data can be directly stored in the free storage space of the data namespace set.
[0054] In this embodiment of the invention, the available space of the data namespace set can be expanded or shrunk by the available space size. The available space of the data namespace set can be calculated in real time according to the update of business configuration, thereby dynamically expanding or shrinking the data namespace set, improving the scalability of the data namespace set, and at the same time storing business data reasonably and securely.
[0055] Furthermore, the target data index corresponding to the business modification data can be determined based on the data source and corresponding storage space of the business modification data.
[0056] S5. Update the data space index according to the target data index to obtain the target data space index.
[0057] In this embodiment of the invention, updating the data space index involves constructing a target data index from the newly added business data and the expanded data namespace, resulting in a target data space index that includes the updated business configuration of the business data configuration center.
[0058] Specifically, updating the data space index based on the target data index to obtain the target data space index includes: Identify duplicate and newly added data indexes in the target data index based on the data space index; The duplicate data indexes are removed, and the newly added data indexes are added to the data space index to obtain the target data space index.
[0059] In detail, by updating the data space index to obtain the target data space index, business data can be flexibly expanded and managed when business configuration updates generate business update events, ensuring the availability and stability of the business data configuration center, realizing the reasonable allocation of namespaces, and accurately retrieving business data based on the target data space index, automatically maintaining the data index, and improving the flexibility and accuracy of business data retrieval.
[0060] As can be seen, in the above scheme, by establishing the index relationship between each business data item and the data namespace in the constructed data namespace, a data space index is obtained. This allows for the determination of the storage space for each business data item, improving the efficiency and accuracy of business data management. Monitoring modified business data in the business data configuration center allows for the determination of changes in business data. Based on the size of the modified business data, the available space size of the data namespace can be calculated, avoiding the risk of data namespace overcapacity and improving the rationality and accuracy of business data storage. The target data index corresponding to the modified business data can be calculated based on the available space size, enabling dynamic expansion and contraction of the data namespace for reasonable allocation. Updating the data space index based on the target data index yields the target data space index, allowing for precise business data retrieval. The data index is automatically maintained and expanded, improving the flexibility and accuracy of business data retrieval.
[0061] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
[0062] In one embodiment, a data configuration center index update system is provided, which corresponds one-to-one with the data configuration center index update method in the above embodiments. For example... Figure 3As shown, the data configuration center index update system includes a data space index construction module 101, a business modification data identification module 102, an available space size calculation module 103, a target data index calculation module 104, and an index update module 105. Detailed descriptions of each functional module are as follows: The data space index construction module 101 is used to obtain the data namespace corresponding to the business data configuration center and construct a data space index between each business data in the data namespace and the data namespace. The business modification data identification module 102 is used to monitor business update events in the business data configuration center and identify business modification data in the business update events; The available space size calculation module 103 is used to calculate the available space size in the data namespace based on the business modification data. The target data index calculation module 104 is used to calculate the target data index corresponding to the business modification data based on the available space size. The index update module 105 is used to update the data space index according to the target data index to obtain the target data space index.
[0063] In one embodiment, the data space index construction module 101, when constructing a data space index between each business data in the data namespace and the data namespace, includes: Perform data lineage analysis on the business data in the data namespace to obtain the data generation source of the business data; Create a data identifier and a namespace identifier for the business data based on the source of the data; Construct a mapping relationship between the data identifier and the namespace identifier; Generate a data space index corresponding to the business data configuration center based on the mapping relationship.
[0064] In one embodiment, when monitoring service update events in the service data configuration center, the service modification data identification module 102 includes: Configure a listening interface in the business data configuration center; Add an event listener to the business data configuration center according to the listening interface; The event listener is used to monitor business update events in the business data configuration center.
[0065] In one embodiment, the service modification data identification module 102 identifies service modification data in the service update event, including: Analyze the business execution logic of the business update event, and identify the business content of the business update event based on the business execution logic; The business data changes of the business update event are determined based on the business content; Identify the modified business data in the business update event based on the changes in the business data.
[0066] In one embodiment, when the available space size calculation module 103 calculates the available space size in the data namespace based on the business modification data, it includes: Construct the target data index corresponding to the business modification data; Calculate the size of the modified data corresponding to the modified business data based on the target data index, and obtain the current available space size of the data namespace; The size of the modified data is compared with the current available space size to obtain the available space size.
[0067] In one embodiment, when the target data index calculation module 104 calculates the target data index corresponding to the service modification data based on the available space size, it includes: The available storage space corresponding to the business modification data is determined based on the available space size. Write the modified business data into the available storage space to obtain the target storage space corresponding to the modified business data; Create a target data index corresponding to the modified business data and the target storage space.
[0068] In one embodiment, when the target index update module 105 updates the data space index according to the target data index to obtain the target data space index, it includes: Identify duplicate and newly added data indexes in the target data index based on the data space index; The duplicate data indexes are removed, and the newly added data indexes are added to the data space index to obtain the target data space index.
[0069] This invention provides a data configuration center index update system. By establishing an index relationship between each business data item and the data namespace within the constructed data namespace, a data space index is obtained. This allows for the determination of the storage space for each business data item, improving the efficiency and accuracy of business data management. Monitoring modified business data in the business data configuration center identifies changes in business data and allows for the calculation of the available space size of the data namespace based on the size of the modified data. This avoids the risk of data namespace overcapacity and improves the rationality and accuracy of business data storage. The system can calculate the target data index corresponding to the modified business data based on the available space size, thereby dynamically expanding or shrinking the data namespace for rational allocation. Updating the data space index based on the target data index yields the target data space index, enabling precise business data retrieval. The system also automatically maintains and expands the data index, improving the flexibility and accuracy of business data retrieval.
[0070] Specific limitations regarding the data configuration center index update system can be found in the limitations of the data configuration center index update method described above, and will not be repeated here. Each module in the aforementioned data configuration center index update system can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in the computer device in hardware form, or stored in the memory of the computer device in software form, so that the processor can call and execute the corresponding operations of each module.
[0071] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 4 As shown, the computer device includes a processor, memory, network interface, and database connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile and / or volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and database. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The network interface is used to communicate with external clients via a network connection. When the computer program is executed by the processor, it implements the functions or steps of a data configuration center index update method on the server side.
[0072] In one embodiment, a computer device is provided, which may be a client, and its internal structure diagram may be as follows: Figure 5As shown, the computer device includes a processor, memory, network interface, display screen, and input system connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface is used to communicate with an external server via a network connection. When executed by the processor, the computer program implements the functions or steps of a data configuration center index update method on the client side. In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to perform the following steps: Obtain the data namespace corresponding to the business data configuration center, and construct a data space index between each business data in the data namespace and the data namespace; Monitor business update events in the business data configuration center and identify the business modification data in the business update events; Calculate the available space size in the data namespace based on the business modification data; Calculate the target data index corresponding to the business modification data based on the available space size; The data space index is updated based on the target data index to obtain the target data space index.
[0073] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor: Obtain the data namespace corresponding to the business data configuration center, and construct a data space index between each business data in the data namespace and the data namespace; Monitor business update events in the business data configuration center and identify the business modification data in the business update events; Calculate the available space size in the data namespace based on the business modification data; Calculate the target data index corresponding to the business modification data based on the available space size; The data space index is updated based on the target data index to obtain the target data space index.
[0074] It should be noted that the functions or steps that can be implemented by the computer-readable storage medium or computer device described above can be referred to the relevant descriptions on the server side and client side in the foregoing method embodiments. To avoid repetition, they will not be described one by one here.
[0075] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
[0076] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is used as an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the system can be divided into different functional units or modules to complete all or part of the functions described above.
[0077] Finally, it should be noted that if any software tools or components not belonging to this company appear in the embodiments of the application, they are merely illustrative examples and do not represent actual use. The embodiments described above are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included within the protection scope of the present invention.
Claims
1. A method for updating an index in a data configuration center, characterized in that, include: Obtain the data namespace corresponding to the business data configuration center, and construct a data space index between each business data in the data namespace and the data namespace; Monitor business update events in the business data configuration center and identify the business modification data in the business update events; Calculate the available space size in the data namespace based on the business modification data; Calculate the target data index corresponding to the business modification data based on the available space size; The data space index is updated based on the target data index to obtain the target data space index.
2. The data configuration center index update method as described in claim 1, characterized in that, The construction of the data space index between each business data in the data namespace and the data namespace includes: Perform data lineage analysis on the business data in the data namespace to obtain the data generation source of the business data; Create a data identifier and a namespace identifier for the business data based on the source of the data; Construct a mapping relationship between the data identifier and the namespace identifier; Generate a data space index corresponding to the business data configuration center based on the mapping relationship.
3. The data configuration center index update method as described in claim 1, characterized in that, The monitoring of business update events in the business data configuration center includes: Configure a listening interface in the business data configuration center; Add an event listener to the business data configuration center according to the listening interface; The event listener is used to monitor business update events in the business data configuration center.
4. The data configuration center index update method as described in claim 1, characterized in that, The identification of business modification data in the business update event includes: Analyze the business execution logic of the business update event, and identify the business content of the business update event based on the business execution logic; The business data changes of the business update event are determined based on the business content; Identify the modified business data in the business update event based on the changes in the business data.
5. The data configuration center index update method as described in claim 1, characterized in that, The step of calculating the available space size in the data namespace based on the business modification data includes: Construct the target data index corresponding to the business modification data; Calculate the size of the modified data corresponding to the modified business data based on the target data index, and obtain the current available space size of the data namespace; The size of the modified data is compared with the current available space size to obtain the available space size.
6. The data configuration center index update method as described in claim 1, characterized in that, The step of calculating the target data index corresponding to the business modification data based on the available space size includes: The available storage space corresponding to the business modification data is determined based on the available space size. Write the modified business data into the available storage space to obtain the target storage space corresponding to the modified business data; Create a target data index corresponding to the modified business data and the target storage space.
7. The data configuration center index update method as described in claim 1, characterized in that, The step of updating the data space index according to the target data index to obtain the target data space index includes: Identify duplicate and newly added data indexes in the target data index based on the data space index; The duplicate data indexes are removed, and the newly added data indexes are added to the data space index to obtain the target data space index.
8. A data configuration center index update system, characterized in that, include: The data space index building module is used to obtain the data namespace corresponding to the business data configuration center and build a data space index between each business data in the data namespace and the data namespace. The business modification data identification module is used to monitor business update events in the business data configuration center and identify business modification data in the business update events. The available space calculation module is used to calculate the available space size in the data namespace based on the business modification data. The target data index calculation module is used to calculate the target data index corresponding to the business modification data based on the available space size. The index update module is used to update the data space index according to the target data index to obtain the target data space index.
9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the data configuration center index update method as described in any one of claims 1 to 7.
10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the data configuration center index update method as described in any one of claims 1 to 7.