A data management method and device, electronic equipment and storage medium

Abstract

The application discloses a data management method and device, electronic equipment and storage medium, and comprises the following steps: a first server sends source code of application construction to a second server, so that the second server creates a first target application, and the first target application is used for providing access service to a user; the first server acquires a first request sent by the user through a second target application; the first server detects a headquarter database to obtain a detection result, and the detection result is used for representing data processing performance of the headquarter side; in the case that the detection result represents that the data processing performance of the headquarter side does not meet data processing requirements, the first server feeds back a reselection instruction to the second target application, and the reselection instruction is used for prompting the user to select to access the first target application, so that the user calls first target data in a branch database through the first target application. The application can improve the data management effect under different business requirements.

Description

Technical Field

[0001] This invention relates to the field of communication network technology, and in particular to a data management method, apparatus, electronic device, and storage medium. Background Technology

[0002] Nowadays, with the completion of distributed construction projects and the rapid development of Internet businesses, enterprise business systems have basically formed an architecture pattern of "logical unity and physical dispersion".

[0003] In existing technologies, relevant enterprises typically set up independent data centers in their branches during the distributed construction of storage systems, and decentralize the acquisition units or acquisition modules to the branches to reduce the data acquisition pressure on the central database at headquarters. Finally, through real-time synchronization, the central database and the branch databases are associated. When users need to access data, they need to obtain the first target data containing data from each branch through the central database.

[0004] It is evident that existing technologies are ineffective in managing data under different business needs. Summary of the Invention

[0005] This invention provides a data management method, apparatus, electronic device, and storage medium to address the problem of poor data management performance under different business requirements in the prior art.

[0006] In a first aspect, embodiments of the present invention provide a data management method, including:

[0007] The first server sends the application's source code to the second server so that the second server can create the first target application. The first target application is used to provide access services to users. The first server is a server on the headquarters side of the business system, and the second server is a server on the branch side of the business system.

[0008] The first server receives a first request from a user through a second target application. The first request is used to request access to first target data. The second target application is located on the first server. The first target data is data synchronized from a branch database to a headquarters database. The branch database is a database on the branch side of the business system, and the headquarters database is a database on the headquarters side of the business system.

[0009] The first server performs a test on the first server side to obtain a test result, which is used to represent the data processing performance on the headquarters side;

[0010] If the test results indicate that the data processing performance on the headquarters side does not meet the data processing requirements, the first server sends a reselection instruction to the second target application. The reselection instruction is used to prompt the user to select the first target application so that the user can call the first target data in the branch database through the first target application.

[0011] Optionally, the first server is configured to send the application's source code to the second server, including:

[0012] The first server is configured with a remote deployment repository, which stores the source code used to build the first target application;

[0013] The first server uses the remote publishing repository to send the source code for building the first target application to the second server, so that the second server can create the first target application.

[0014] Optionally, the first server performs detection on its own side to obtain detection results, including:

[0015] The first server obtains the load index or network status index corresponding to the first server side;

[0016] If at least one of the load index or the network status index is outside a preset range, the first server generates a first detection result, which indicates that the data processing performance on the first server side does not meet the data processing requirements.

[0017] Optionally, after the first server performs detection on its side to obtain a detection result, the method further includes:

[0018] When the load index or the network status index is within the preset range, the first server generates a second detection result, which indicates that the data processing performance of the first server meets the data processing requirements.

[0019] The first server sends a withdrawal instruction to the second server based on the first detection result. The withdrawal instruction is used to withdraw the first target application so that the computing power on the first server side can be recovered.

[0020] Optionally, after the first server sends a reselection instruction to the second target application, the method further includes:

[0021] The first server obtains the number of network elements or alarm collections corresponding to the second server;

[0022] If the number of network elements or the number of alarms collected exceeds a preset number, the first server sends a first instruction to the second server. The first instruction indicates that the second server is instructed to collect and manage the second target data, which is the data input into the business system.

[0023] The first server uses the headquarters database to receive the second target data sent by the branch database in the second server, so as to update the headquarters database.

[0024] Optionally, in the first server

[0025] After sending the reselection instruction to the second target application, the method further includes:

[0026] The first server obtains the load index or network status index corresponding to the first server side;

[0027] If at least one of the load index or the network status index is outside a preset range, the first server sends a device call request to the second server, the device call request indicating a call to a target device on the branch side;

[0028] The first server obtains a registration request generated by the second server based on the device call request. The registration request is used to register the device on the branch side to the first server corresponding to the headquarters side.

[0029] The first server completes access to the target device based on the registration request.

[0030] Optionally, after the first server sends a reselection instruction to the second target application, the method further includes:

[0031] The first server synchronizes the incremental synchronization information or cache synchronization information in the headquarters database to the branch database to ensure data consistency when users access the first target application.

[0032] The incremental synchronization information includes at least one of the following: remote signaling performance data and telemetry performance data; the cache synchronization information includes at least one of the following: collector cache, site cache, collection task cache, collection cycle cache, device cache, semaphore cache, system dictionary table cache, operator interface information configuration cache, and alarm dispatch rule cache.

[0033] Secondly, embodiments of the present invention provide a data management device, comprising:

[0034] The first sending module is used to send the source code of the application construction to the second server so that the second server can create the first target application. The first target application is used to provide access services to users. The second server is a server on the business system branch side.

[0035] The first acquisition module is used to acquire a first request sent by a user through a second target application. The first request is used to request the access of first target data. The second target application is located in the data management device. The first target data is data synchronized from a branch database to a headquarters database. The branch database is a database on the branch side of the business system, and the headquarters database is a database on the headquarters side of the business system.

[0036] The detection module is used to detect the first server side to obtain detection results, which are used to represent the data processing performance of the headquarters side.

[0037] The feedback module is used to send a reselection instruction to the second target application when the detection result indicates that the data processing performance on the headquarters side does not meet the data processing requirements. The reselection instruction is used to prompt the user to select to access the first target application so that the user can call the first target data in the branch database through the first target application.

[0038] Optionally, the first sending module includes:

[0039] A configuration unit is used to configure a remote publishing repository, which stores the source code used to build the first target application;

[0040] The sending unit is used to send the source code for building the first target application to the second server using the remote publishing repository, so that the second server can create the first target application.

[0041] Optionally, the detection module includes:

[0042] The acquisition unit is used to acquire the load index or network status index corresponding to the first server side;

[0043] The generation unit is configured to generate a first detection result when at least one of the load index or the network status index is outside a preset range value. The first detection result indicates that the data processing performance of the first server side does not meet the data processing requirements.

[0044] Optionally, the data management device further includes:

[0045] The generation module is used to generate a second detection result when the load index or the network status index is within the preset range. The second detection result indicates that the data processing performance of the first server side meets the data processing requirements.

[0046] The withdrawal module is used to send a withdrawal instruction to the second server based on the first detection result. The withdrawal instruction is used to withdraw the first target application so that the computing power on the first server side can be recovered.

[0047] Optionally, the data management device further includes:

[0048] The second acquisition module is used to acquire the number of network elements or alarm collections corresponding to the second server.

[0049] The second sending module is used to send a first instruction to the second server when the number of network elements or the number of alarms collected exceeds a preset number. The first instruction indicates that the second server is instructed to collect and manage the second target data, which is the data input into the business system.

[0050] The receiving module is used to receive the second target data sent by the branch database in the second server using the headquarters database, so as to update the headquarters database.

[0051] Optionally, the data management device further includes:

[0052] The third acquisition module is used to acquire the load index or network status index corresponding to the first server side;

[0053] The third sending module is used to send a device call request to the second server when at least one of the load index or the network status index is outside a preset range value. The device call request indicates a call to a target device on the branch side.

[0054] The fourth acquisition module is used to acquire the registration request generated by the second server based on the device call request. The registration request is used to register the device on the branch side to the data management device corresponding to the headquarters side.

[0055] The access module is used to complete the access to the target device based on the registration request.

[0056] Optionally, the data management device further includes:

[0057] The synchronization module is used to synchronize incremental synchronization information or cached synchronization information in the headquarters database to the branch database to ensure data consistency when users access the first target application.

[0058] The incremental synchronization information includes at least one of the following: remote signaling performance data and telemetry performance data; the cache synchronization information includes at least one of the following: collector cache, site cache, collection task cache, collection cycle cache, device cache, semaphore cache, system dictionary table cache, operator interface information configuration cache, and alarm dispatch rule cache.

[0059] Thirdly, embodiments of the present invention provide an electronic device, including:

[0060] At least one processor; and

[0061] A memory communicatively connected to the at least one processor; wherein,

[0062] The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the data management method described in the first aspect.

[0063] Fourthly, embodiments of the present invention provide a non-transitory computer-readable storage medium storing computer instructions, comprising:

[0064] The computer instructions are used to cause the computer to execute the data management method according to the first aspect.

[0065] In this embodiment of the invention, the first server first sends source code to the second server. Based on this source code, a first target application can be created. The first target application can provide access services to users. Then, the first server receives a first request sent by the user through the second target application. The first server checks the headquarters database according to the first request to determine whether the data processing performance on the headquarters side can meet the data processing requirements. If the data processing performance on the headquarters side does not meet the data processing requirements, the first server sends a reselection instruction to the user, prompting the user to select the first target application to call the first target data in the branch database. Through this method, the data processing performance on the headquarters side can be flexibly adjusted, thereby optimizing the service capabilities of resource combination, ensuring the stability and high availability of the business system, and improving the effectiveness of data management.

[0066] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0067] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0068] Figure 1 This is a flowchart illustrating a data management method provided in an embodiment of the present invention;

[0069] Figure 2 This is a schematic diagram of the distributed storage architecture in related technologies;

[0070] Figure 3 This is a schematic diagram of a distributed storage architecture provided in an embodiment of the present invention;

[0071] Figure 4 This is a schematic diagram of the technical architecture corresponding to a data management method provided in an embodiment of the present invention;

[0072] Figure 5 This is a functional architecture diagram corresponding to a data management method provided in an embodiment of the present invention;

[0073] Figure 6 This is a schematic diagram of the business architecture of a data management method provided in an embodiment of the present invention;

[0074] Figure 7 This is a schematic diagram of the structure of a data management device provided in an embodiment of the present invention;

[0075] Figure 8 This is a block diagram of an electronic device used to implement the data management method of the embodiments of the present invention. Detailed Implementation

[0076] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0077] In the embodiments of this invention, the terms "first," "second," etc., are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or devices.

[0078] Please see Figure 1 , Figure 1 This is a flowchart illustrating a data management method provided in an embodiment of the present invention, as shown below. Figure 1 As shown, it includes the following steps:

[0079] Step 101: The first server sends the source code for application construction to the second server so that the second server can create the first target application. The first target application is used to provide access services to users. The first server is a server on the headquarters side of the business system, and the second server is a server on the branch side of the business system.

[0080] Step 102: The first server obtains a first request sent by the user through the second target application. The first request is used to request the access of the first target data. The second target application is located on the first server. The first target data is data synchronized from the branch database to the headquarters database. The branch database is the database on the branch side of the business system, and the headquarters database is the database on the headquarters side of the business system.

[0081] Step 103: The first server performs a test on the first server side to obtain a test result, which is used to represent the data processing performance on the headquarters side;

[0082] Step 104: If the detection result indicates that the data processing performance on the headquarters side does not meet the data processing requirements, the first server sends a reselection instruction to the second target application. The reselection instruction is used to prompt the user to select to access the first target application, so that the user can call the first target data in the branch database through the first target application.

[0083] In this embodiment of the invention, steps 101, 102, 103 and 104 of the above data management method can be executed by a computer or a virtual machine, and the present invention does not limit the execution of these steps.

[0084] It should be noted that the embodiments of the present invention can be based on a distributed storage architecture; please refer to [link / reference]. Figure 2 , Figure 2This is a schematic diagram of the distributed storage architecture in related technologies, such as... Figure 2 As shown, under the distributed construction of the storage system, a data center is built independently in the lower-level province, that is, a data center is built on the branch side, and the collector (collection unit) is distributed to the lower-level province, thereby reducing the pressure on the central database, that is, reducing the database pressure on the headquarters side.

[0085] In addition, real-time synchronization can link the central database (headquarters database) with the provincial databases (branch databases) and maintain logical consistency. The distributed storage architecture supports parallel computing, thereby effectively improving the overall computing power.

[0086] Please continue reading Figure 2 The group collector (the collector on the headquarters side) can be flexibly deployed based on the number of network elements and alarm collections in each province (the branch side). Each provincial node (branch node) can achieve self-maintenance management, and the online and offline registration of network elements in each province can be synchronized from the deployed provincial database (branch database) to the central database (headquarters database) on a regular basis, thereby reducing the pressure on the central database.

[0087] In step 101, the first server can be understood as a server on the headquarters side of the distributed storage architecture. Similarly, the second server can be understood as a server on the branch side of the distributed storage architecture. It should be understood that the distributed storage architecture may include multiple branches, and the second server can be understood as one of the multiple branch servers.

[0088] In addition, the first target application can be created on the second server based on the source code sent by the first server. The first target application helps users access the second server. The source code used to build the first target application can be stored in a database on the headquarters side, or a remote release repository can be created on the headquarters side to store the source code used to build the first target application.

[0089] It should be noted that the first target application mentioned above can be a web application, that is, an application that users can access through the web, thereby reducing the difficulty of access for users, who only need to use a browser to complete the access.

[0090] In step 102, the first server may be the server that receives the first request sent by the user through the second target application. The second target application is the application of the business system on the headquarters side. In the architecture of the business system, when the user needs to call or query relevant data, he or she needs to complete the corresponding operation by accessing the second target application or the first target application.

[0091] It should be noted that the second target application mentioned above can be a web application, that is, an application that users can access through the web, thereby reducing the difficulty of access for users, who only need to use a browser to complete the access.

[0092] The aforementioned first target data can be understood as data synchronized from the branch database to the headquarters database. Therefore, users can access the aforementioned second target application on the headquarters side to call the aforementioned first target data, or they can access the aforementioned first target application on the branch side to call the aforementioned first target data.

[0093] In step 103, the first server can judge the data processing performance of the headquarters side based on the above detection results. It can detect elements such as network status or server load on the headquarters side to obtain the above detection results. The object detected by the first server can be a server, the headquarters database, or the overall environment corresponding to the first server.

[0094] In some optional implementations, the user can set a preset range for each detection element in the first server. If the value corresponding to the detection element is within the preset range after passing the detection, it indicates that the data processing performance of the headquarters side corresponding to the detection result is normal. Similarly, if the value corresponding to the detection element is not within the preset range after passing the detection, it indicates that the data processing performance of the headquarters side corresponding to the detection result is poor.

[0095] In addition to the relevant elements of the headquarters database, the detection elements mentioned above can also be the network status, server load, and other elements corresponding to the first server. This embodiment of the invention does not limit the scope of these elements.

[0096] In step 104, if the above detection results indicate that the data processing performance on the headquarters side does not meet the data processing requirements, the first server may send the above feedback reselection instruction to the second target application. Based on the above reselection instruction, the user can reselect the application, that is, the user selects the first target application to access the second server, thereby achieving the purpose of calling the first target data.

[0097] It should be noted that the data processing performance on the headquarters side can also be understood as the busy status of the business system on the headquarters side. Users can set the headquarters side to a busy state, thereby prompting users to directly access the pre-created first target application mentioned above, without having to access the second target application mentioned above first.

[0098] In this implementation scheme, the first server first sends source code to the second server. Based on this source code, a first target application can be created, which can provide access services to users. Then, the first server receives a first request sent by the user through the second target application. The first server checks the headquarters database based on the first request to determine whether the data processing performance on the headquarters side can meet the data processing requirements. If the data processing performance on the headquarters side does not meet the data processing requirements, the first server sends a reselection instruction to the user, prompting the user to select the first target application to call the first target data in the branch database. Through this method, the data processing performance on the headquarters side can be flexibly adjusted, thereby optimizing the service capabilities of resource combination, ensuring the stability and high availability of the business system, and improving the effectiveness of data management.

[0099] It should be understood that in this embodiment of the invention, the application corresponding to the user can be located in multiple network areas. That is, the user can choose to access the first target application or the second target application, thereby improving the reliability of the business system.

[0100] It should be noted that the first server can both distribute and reclaim computing power. For example, the first server can send an instruction to the second server to cancel the first target application, thereby causing the second server to cancel the first target application and thus reclaim the computing power, thereby avoiding local waste of computing resources.

[0101] Please see Figure 3 , Figure 3 This is a schematic diagram of a distributed storage architecture provided in an embodiment of the present invention, such as... Figure 3 As shown, a data center is built independently in the lower-level province, that is, a data center is built on the branch side, and the data collectors (data collection units) are distributed to the lower-level province, thereby reducing the pressure on the central database, that is, reducing the database pressure on the headquarters side.

[0102] In addition, real-time synchronization can link the central database (headquarters database) with the provincial databases (branch databases) and maintain logical consistency. The distributed storage architecture supports parallel computing, thereby effectively improving the overall computing power.

[0103] Please continue reading Figure 3 The group collector (the collector on the headquarters side) can be flexibly deployed based on the number of network elements and alarm collections in each province (the branch side). Each provincial node (branch node) can achieve self-maintenance management, and the online and offline registration of network elements in each province can be synchronized from the deployed provincial database (branch database) to the central database (headquarters database) on a regular basis, thereby reducing the pressure on the central database.

[0104] In addition, when a user accesses the group's web application, which can be understood as the second target application, and the data processing performance on the group side (headquarters side) does not meet the current user's needs, the user can directly access the edge web application on the edge side (branch side), which can be understood as the first target application, thereby completing the call to the first target data.

[0105] The creation of the edge web application (the first target application) can be understood as a front-end migration based on the configuration from the source code on the group side (headquarters side). The edge web application (the first target application) and the sinking provincial database (branch database) can achieve complete migration.

[0106] It should also be noted that the aforementioned first server can be divided into drift servers and application servers according to their functions. Among them, the computing power drift server mainly includes testing services, source code services, application services, big data services, middleware services, management and monitoring services, computing services, storage services, network services, and database services. These services can be deployed individually or in groups and merged depending on the resource situation. The application server mainly includes data collection area services, front-end presentation services, relational database services, etc.

[0107] Please see Figure 4 , Figure 4 This is a schematic diagram of the technical architecture corresponding to a data management method provided in an embodiment of the present invention, such as... Figure 4 As shown in the diagram, the technical architecture includes message middleware, distributed caching, cloud database, Docker containers, and a service framework. This architecture also supports Layer 4 and Layer 7 load balancing, providing load balancing capabilities for both containerized and non-containerized applications. The message middleware is a distributed message middleware, providing high-performance, real-time, and scalable distributed message middleware capabilities, featuring ordered, non-duplicate, and non-loss messages, and high latency with low overhead. The distributed cache provides a high-performance, highly reliable, and scalable NoSQL in-memory database compatible with the Redis protocol. The cloud database provides a high-performance, highly reliable distributed relational database compatible with MySQL protocol syntax and capable of automatic horizontal partitioning. Docker containers provide one-stop image and container services, and full lifecycle container application management capabilities. The service framework can be a distributed service framework, providing application developers with common pattern tools for quickly building distributed systems, such as service discovery, service routing, and configuration management, supporting rapid service and application development.

[0108] Please see Figure 5 , Figure 5 This is a functional architecture diagram corresponding to a data management method provided in an embodiment of the present invention, such as... Figure 5As shown in the diagram, the functional architecture includes an application layer, a control platform layer, and an infrastructure layer. The application layer primarily handles application deployment, computing power migration, and other functions, all managed and scheduled uniformly through the platform interface, providing visibility, controllability, and manageability. Based on a built-in on-demand switching strategy, migration can be performed automatically or manually according to factors such as current network conditions and load. The control platform layer provides a range of basic services, including containerization, configuration management, remote deployment, on-demand switching, real-time monitoring, and user management. The infrastructure layer provides underlying data storage and network transmission services, ensuring the effective operation of all upper-layer applications. While the branch offices (provinces) and headquarters (group) are physically dispersed, under the control of the elastic control platform, physical resources can still be integrated and treated as a unified whole.

[0109] Optionally, the first server is configured to send the application's source code to the second server, including:

[0110] The first server is configured with a remote deployment repository, which stores the source code used to build the first target application;

[0111] The first server uses the remote publishing repository to send the source code for building the first target application to the second server, so that the second server can create the first target application.

[0112] In this implementation scheme, the first server is configured with the remote release repository, which may store the source code for configuring the first target application. The first server may periodically send the source code to the second server, and the second server creates the first target application after receiving the source code. Through this method, the purpose of elastically distributing computing power can be achieved.

[0113] Please see Figure 6 , Figure 6 This is a business architecture diagram of a data management method provided in an embodiment of the present invention, such as... Figure 6 As shown, the group control platform (headquarters side) and the provincial control platform (branch side) transmit information through a transmission link, and the group control platform (headquarters side) can send the source code of the first target application to the provincial control platform (branch side) to achieve application drift.

[0114] In addition to creating the aforementioned first target application, the created first target application can also be revoked, thereby realizing elastic distribution and recovery of computing power. By configuring scaling strategies, the headquarters can automatically adjust its management services for elastic computing resources to optimize resource combination. Computing power is increased when business volume rises and decreased when business volume falls, thus ensuring the stability and high availability of the business system while saving computing resource costs.

[0115] Optionally, the first server performs detection on its own side to obtain detection results, including:

[0116] The first server obtains the load index or network status index corresponding to the first server side;

[0117] If at least one of the load index or the network status index is outside a preset range, the first server generates a first detection result, which indicates that the data processing performance on the first server side does not meet the data processing requirements.

[0118] In this implementation scheme, the first server may first obtain elements such as load index or network status index of the corresponding headquarters side. If the load index or the network status index is outside the preset range, the first server generates the first detection result indicating that the data processing performance of the headquarters database does not meet the data processing requirements. Through this method, computing power can be allocated in real time according to the data processing capability of the business system, and computing power can be increased when the business volume increases, so as to ensure the stability and high availability of the business system.

[0119] In addition, users can also set a warning value. When the above load index or the above network status index exceeds the warning value, the above first detection result can also be generated. As for the specific values ​​of the above preset range value and the above warning value, users can set them according to the actual situation of the business system. This embodiment of the invention does not limit this.

[0120] It should be noted that, in addition to obtaining the aforementioned load index or network status index, the amount of business data on the headquarters side can also be obtained. When the amount of business data exceeds a certain quantity, the aforementioned first detection result can also be generated to distribute computing power and maintain the stability of the business system and the efficiency of data processing.

[0121] Optionally, after the first server performs detection on its side to obtain a detection result, the method further includes:

[0122] When the load index or the network status index is within the preset range, the first server generates a second detection result, which indicates that the data processing performance of the first server meets the data processing requirements.

[0123] The first server sends a withdrawal instruction to the second server based on the first detection result. The withdrawal instruction is used to withdraw the first target application so that the computing power on the first server side can be recovered.

[0124] In this implementation scheme, after the first server obtains elements such as the load index or network status index of the corresponding headquarters side, if the load index is outside the preset range or the network status index is within the preset range, the first server generates the second detection result indicating that the data processing performance of the headquarters database meets the data processing requirements. Based on the second detection result, the first server can send a withdrawal instruction to the second server to withdraw the first target application. Through this method, computing power can be recovered in real time according to the data processing capability of the business system, and computing power can be increased when the business volume increases, thereby ensuring the stability and high availability of the business system.

[0125] In addition, users can also set a warning value. When the above load index or the above network status index does not exceed the warning value, the above second detection result can also be generated. As for the specific values ​​of the above preset range value and the above warning value, users can set them according to the actual situation of the business system. This embodiment of the invention does not limit this.

[0126] It should be noted that, in addition to obtaining the aforementioned load index or network status index, the amount of business data on the headquarters side can also be obtained. When the amount of business data does not exceed the set quantity, the aforementioned second detection result can also be generated to recover computing power and maintain the stability of the business system and the efficiency of data processing.

[0127] Optionally, after the first server sends a reselection instruction to the second target application, the method further includes:

[0128] The first server obtains the number of network elements or alarm collections corresponding to the second server;

[0129] If the number of network elements or the number of alarms collected exceeds a preset number, the first server sends a first instruction to the second server. The first instruction indicates that the second server is instructed to collect and manage the second target data, which is the data input into the business system.

[0130] The first server uses the headquarters database to receive the second target data sent by the branch database in the second server, so as to update the headquarters database.

[0131] In this implementation scheme, the data collectors on the headquarters side can be flexibly deployed to different branches based on the number of network elements and alarm collections in each branch, thereby achieving self-maintenance management at each branch node. Furthermore, in this implementation scheme, the online and offline registration of network elements in each branch no longer needs to be recorded in real time to the headquarters database on the headquarters side. Instead, they only need to be synchronized from the branch database to the headquarters database periodically, thereby reducing the pressure on the headquarters database. Through this method, the data synchronization performance requirements between each branch and the headquarters quality inspection are reduced, which in turn reduces the pressure on the headquarters database and improves the data processing performance and data management effectiveness of the business system.

[0132] Optionally, after the first server sends a reselection instruction to the second target application, the method further includes:

[0133] The first server obtains the load index or network status index corresponding to the first server side;

[0134] If at least one of the load index or the network status index is outside a preset range, the first server sends a device call request to the second server, the device call request indicating a call to a target device on the branch side;

[0135] The first server obtains a registration request generated by the second server based on the device call request. The registration request is used to register the device on the branch side to the first server corresponding to the headquarters side.

[0136] The first server completes access to the target device based on the registration request.

[0137] In this implementation scheme, the first server can again obtain the load index or network status index of the headquarters database. If at least one of the load index or network status index is outside the preset range, the first server can request device access from the second server, i.e., send the device access request. After the target device completes registration on the first server, the first server completes access to the target device. This method can not only significantly reduce the pressure on the headquarters database, but also reduce costs by reusing server resources. Furthermore, through unified allocation, the headquarters side and the branch side can still maintain overall consistency at the business logic level.

[0138] Optionally, devices on the branch side can register with the server room or server on the next higher branch side according to business needs, or they can register directly with the server room or server on the headquarters side. The number of the aforementioned target devices can be set by the user according to the actual situation of business processing, so as to meet the needs of data processing and data management. This embodiment of the invention does not limit this.

[0139] Optionally, after the first server sends a reselection instruction to the second target application, the method further includes:

[0140] The first server synchronizes the incremental synchronization information or cache synchronization information in the headquarters database to the branch database to ensure data consistency when users access the first target application.

[0141] The incremental synchronization information includes at least one of the following: remote signaling performance data and telemetry performance data; the cache synchronization information includes at least one of the following: collector cache, site cache, collection task cache, collection cycle cache, device cache, semaphore cache, system dictionary table cache, operator interface information configuration cache, and alarm dispatch rule cache.

[0142] This implementation plan can ensure data consistency during on-demand switching of computing power. It achieves data consistency between the headquarters and branch offices by implementing incremental synchronization mechanisms for remote signaling and telemetry performance data of database big data services, as well as caching synchronization mechanisms for collector cache, site cache, collection task cache, collection cycle cache, device cache, semaphore cache, system dictionary table cache, operator interface information configuration cache, and alarm dispatch rule cache.

[0143] Please see Figure 7 , Figure 7 This is a schematic diagram of the structure of a data management device provided in an embodiment of the present invention, as shown below. Figure 7 As shown, the data management device 700 includes:

[0144] The first sending module 701 is used to send the source code of the application construction to the second server so that the second server can create the first target application. The first target application is used to provide access services to users. The second server is a server on the business system branch side.

[0145] The first acquisition module 702 is used to acquire a first request sent by a user through a second target application. The first request is used to request the access of first target data. The second target application is located in the data management device. The first target data is data synchronized from a branch database to a headquarters database. The branch database is a database on the branch side of the business system, and the headquarters database is a database on the headquarters side of the business system.

[0146] The detection module 703 is used to detect the first server side to obtain the detection result, which is used to represent the data processing performance of the headquarters side.

[0147] The feedback module 704 is used to send a reselection instruction to the second target application when the detection result indicates that the data processing performance on the headquarters side does not meet the data processing requirements. The reselection instruction is used to prompt the user to select to access the first target application so that the user can call the first target data in the branch database through the first target application.

[0148] Optionally, the first transmitting module 701 includes:

[0149] A configuration unit is used to configure a remote publishing repository, which stores the source code used to build the first target application;

[0150] The sending unit is used to send the source code for building the first target application to the second server using the remote publishing repository, so that the second server can create the first target application.

[0151] Optionally, the detection module includes:

[0152] The acquisition unit is used to acquire the load index or network status index corresponding to the first server side;

[0153] The generation unit is configured to generate a first detection result when at least one of the load index or the network status index is outside a preset range value. The first detection result indicates that the data processing performance of the first server side does not meet the data processing requirements.

[0154] Optionally, the data management device 700 also includes:

[0155] The generation module is used to generate a second detection result when the load index or the network status index is within the preset range. The second detection result indicates that the data processing performance of the first server side meets the data processing requirements.

[0156] The withdrawal module is used to send a withdrawal instruction to the second server based on the first detection result. The withdrawal instruction is used to withdraw the first target application so that the computing power on the first server side can be recovered.

[0157] Optionally, the data management device 700 also includes:

[0158] The second acquisition module is used to acquire the number of network elements or alarm collections corresponding to the second server.

[0159] The second sending module is used to send a first instruction to the second server when the number of network elements or the number of alarms collected exceeds a preset number. The first instruction indicates that the second server is instructed to collect and manage the second target data, which is the data input into the business system.

[0160] The receiving module is used to receive the second target data sent by the branch database in the second server using the headquarters database, so as to update the headquarters database.

[0161] Optionally, the data management device 700 also includes:

[0162] The third acquisition module is used to acquire the load index or network status index corresponding to the first server side;

[0163] The third sending module is used to send a device call request to the second server when at least one of the load index or the network status index is outside a preset range value. The device call request indicates a call to a target device on the branch side.

[0164] The fourth acquisition module is used to acquire the registration request generated by the second server based on the device call request. The registration request is used to register the device on the branch side to the data management device corresponding to the headquarters side.

[0165] The access module is used to complete the access to the target device based on the registration request.

[0166] Optionally, the data management device 700 also includes:

[0167] The synchronization module is used to synchronize incremental synchronization information or cached synchronization information in the headquarters database to the branch database to ensure data consistency when users access the first target application.

[0168] The incremental synchronization information includes at least one of the following: remote signaling performance data and telemetry performance data; the cache synchronization information includes at least one of the following: collector cache, site cache, collection task cache, collection cycle cache, device cache, semaphore cache, system dictionary table cache, operator interface information configuration cache, and alarm dispatch rule cache.

[0169] According to embodiments of the present invention, the present invention also provides an electronic device and a readable storage medium.

[0170] Figure 8A schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0171] like Figure 8 As shown, device 800 includes a computing unit 801, which can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) 802 or a computer program loaded from storage unit 808 into random access memory (RAM) 803. RAM 803 may also store various programs and data required for the operation of device 800. The computing unit 801, ROM 802, and RAM 803 are interconnected via bus 804. Input / output (I / O) interface 805 is also connected to bus 804.

[0172] Multiple components in device 800 are connected to I / O interface 805, including: input unit 806, such as keyboard, mouse, etc.; output unit 807, such as various types of monitors, speakers, etc.; storage unit 808, such as disk, optical disk, etc.; and communication unit 809, such as network card, modem, wireless transceiver, etc. Communication unit 809 allows device 800 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0173] The computing unit 801 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as data management methods.

[0174] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0175] The program code used to implement the methods of the present invention can be written in any combination of one or more programming languages. This program code can be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing device, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code can be executed entirely on the machine, partially on the machine, as a standalone software package partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0176] In the context of this invention, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media can include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0177] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including voice input, speech input, or tactile input).

[0178] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0179] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0180] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0181] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A data management method characterized by, The method comprises the following steps: The first server sends source code of application construction to a second server, so that the second server creates a first target application, and the first target application is used to provide access service for a user, wherein the first server is a server on a headquarters side of a business system, and the second server is a server on a branch side of the business system; The first server acquires a first request sent by a user through a second target application, the first request is used to request to call first target data, the second target application is located on the first server, the first target data is data synchronized from a branch database to a headquarters database, the branch database is a database on the branch side of the business system, and the headquarters database is a database on the headquarters side of the business system; The first server detects the first server side to obtain a detection result, and the detection result is used to represent data processing performance on the headquarters side; In a case where the detection result represents that the data processing performance on the headquarters side does not meet data processing requirements, the first server feeds back a reselection instruction to the second target application, and the reselection instruction is used to prompt the user to select to access the first target application, so that the user calls the first target data in the branch database through the first target application.

2. The data management method according to claim 1, characterized by, The first server sends source code of application construction to a second server, comprising: The first server configures a remote release warehouse, and the remote release warehouse stores source code used to construct the first target application; The first server sends the source code used to construct the first target application to the second server by using the remote release warehouse, so that the second server creates the first target application.

3. The data management method according to claim 2, characterized by, The first server detects the first server side to obtain a detection result, comprising: The first server acquires a load index or a network state index corresponding to the first server side; In a case where at least one of the load index or the network state index is out of a preset range value, the first server generates a first detection result, and the first detection result represents that data processing performance corresponding to the first server side does not meet data processing requirements.

4. The data management method according to claim 3, characterized by, After the first server detects the first server side to obtain a detection result, the method further comprises: In a case where the load index or the network state index is within the preset range, the first server generates a second detection result, and the second detection result represents that data processing performance corresponding to the first server side meets data processing requirements; The first server sends a withdrawal instruction to the second server according to the first detection result, and the withdrawal instruction is used to perform withdrawal processing on the first target application, so that computing power on the first server side is recycled.

5. The data management method according to claim 4, characterized by, After the first server feeds back the reselection instruction to the second target application, the method further comprises: The first server acquires a number of network elements or a number of alarm collections corresponding to the second server; In a case where the number of network elements or the number of alarm collections exceeds a preset number, the first server sends a first instruction to the second server, the first instruction indicating a command for the second server to collect and manage second target data, the second target data being data input into the service system; The first server receives the second target data sent by the branch database in the second server by using the headquarters database, to update the headquarters database.

6. The data management method of claim 1, wherein, After the first server The method further comprises: The first server acquires a load index or a network state index corresponding to the first server side; In a case where at least one of the load index or the network state index is out of a preset range, the first server sends a device call request to the second server, the device call request indicating a call to a target device on the branch side; The first server acquires a registration request generated by the second server according to the device call request, the registration request being used to register the device on the branch side to the first server on the headquarters side; The first server completes access to the target device according to the registration request.

7. The data management method of claim 1, wherein, After the first server feeds back the reselection instruction to the second target application, the method further comprises: The first server synchronizes incremental synchronization information or cache synchronization information in the headquarters database to the branch database, to ensure data consistency when a user accesses the first target application; The incremental synchronization information includes at least one of remote signaling performance data and remote measurement performance data, and the cache synchronization information includes at least one of collector cache, station address cache, collection task cache, collection period cache, device cache, signal quantity cache, system dictionary table cache, operator interface information configuration cache, and alarm dispatching rule cache.

8. A data management apparatus characterized by comprising: The method further comprises: The sending module is configured to send source code of application construction to the second server, to enable the second server to create the first target application, the first target application being configured to provide access services for users, wherein the second server is a server on the branch side of the service system; The acquiring module is configured to acquire a first request sent by a user through a second target application, the first request being configured to request a call to first target data, the second target application being located in the data management device, the first target data being data synchronized from a branch database to a headquarters database, the branch database being a database on the branch side of the service system, and the headquarters database being a database on the headquarters side of the service system; The detecting module is configured to detect the first server side to obtain a detection result, the detection result being configured to indicate a data processing performance on the headquarters side. The feedback module is configured to feed back a reselection instruction to the second target application, in a case where the detection result indicates that the data processing performance of the headquarters side does not meet the data processing requirement, the reselection instruction being configured to prompt a user to select to access the first target application, so that the user invokes the first target data in the branch database through the first target application.

9. An electronic device, comprising: Comprise: at least one processor; and a memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the data management method of any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium having stored thereon computer instructions, wherein, The computer instructions are configured to enable the computer to perform the data management method of any one of claims 1 to 7.

Images