Data fast change method, system and related device

Abstract

The present disclosure provides a data quick change method, system and related equipment, relating to the field of communication technology, and the method comprises the following steps: obtaining original library data by analyzing original full-amount network data; synchronizing the original library data to business library data; comparing each batch of collected full-amount data as temporary data with the original library data; performing corresponding change operations on the original library data according to the comparison result; forming a log record of all change operations of the original library data; and performing change operations on the business library data according to the log record. The method of the present disclosure reduces the data volume processed by the business library, improves the update efficiency of massive data, and improves the data quality. Further, by using the incremental data update method, the period of full-amount file synchronization between the original library and the business library is greatly reduced, and the load and pressure of the business database are reduced.

Description

Technical Field

[0001] This disclosure relates to the field of communication technology, and in particular to a method, system, computer-readable storage medium, and electronic device for rapid data modification. Background Technology

[0002] In the construction of a digital platform for transmission networks, the reproduction of physical network data within the digital platform has two main characteristics. First, there is the massive volume of data. Taking ports as an example, based on the modeling of transmission network data, logical ports under physical ports in the optical transmission network serve as connection endpoints, reflecting the potential service capabilities of the physical ports. A single SDH physical port can contain over 3,000 logical ports. For ultra-large-scale network digital platform construction, the number of physical ports reaches tens of millions, and the number of managed device logical ports is enormous, reaching billions. Second, there is a requirement for data accuracy and real-time performance. Logical ports are indispensable model objects in the digital operation of the transmission network. They embody the connection and termination relationships of different levels of paths in the SNC layered model and represent the specific connection points for important operational data such as alarms and performance. It is necessary to accurately and in real-time reproduce changes to logical ports in the physical network into the digital platform.

[0003] Full data comparison and updating is a crucial method for data restoration. It involves comparing all data collected from the physical network with data from the digital platform and updating the database based on the comparison results. Full data comparison involves a large data range and is time-consuming; therefore, how to rapidly update massive amounts of data is a problem that needs to be solved. Simultaneously, full data updates consume significant database resources, potentially impacting production operations. Minimizing the impact of full data comparison on the business database is another issue that needs to be addressed.

[0004] Therefore, it is necessary to design a method and system for rapid data changes to solve the above-mentioned problems in the transmission of massive amounts of data.

[0005] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0006] The purpose of this disclosure is to provide a method, system, computer-readable storage medium, and electronic device for rapid data modification, so as to at least solve the technical problems in the related art, such as the large data range involved in full data comparison, the long time consumption, and the large resource consumption of the database and the significant impact on the business database caused by the operation of full data modification.

[0007] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0008] The technical solution disclosed herein is as follows:

[0009] According to one aspect of this disclosure, a method for rapid data modification is provided, the method comprising: parsing raw full-volume network data to obtain raw database data; synchronizing the raw database data to business database data; comparing each batch of collected full-volume data as temporary data with the raw database data; performing corresponding modification operations on the raw database data based on the comparison results; forming a log record of all modification operations on the raw database data; and performing modification operations on the business database data based on the log record.

[0010] In some embodiments of this disclosure, the steps of parsing the original full network data to obtain the original database data include: obtaining the identification information of the network element of the original full network data source; determining the number of storage partitions based on the identification information; mapping the unique identifier of the network element to a hash value using the algorithm; and storing the original database data in a fixed partition based on the hash value mapped to the network element to which the original full network data belongs.

[0011] In some embodiments of this disclosure, the step of comparing each batch of full data collected as temporary data with the original database data includes: comparing each batch of full data collected as temporary data with the original database data by partition.

[0012] In some embodiments of this disclosure, the steps of performing change operations on business database data based on log records include: sending log records to a message middleware; subscribing to change message topics on the message middleware, receiving data change messages, and performing change operations on the business database data one by one according to the messages.

[0013] In some embodiments of this disclosure, the step of synchronizing the original database data to the business database data includes: periodically exporting the full amount of network data from the original database; parsing the full amount of network data and saving it to the business database.

[0014] According to another aspect of this disclosure, a rapid data modification system is provided. This system includes: a data acquisition layer service module, a business database module, a raw database module, and a business layer service module. The data acquisition layer service module is used to parse the raw full-volume network data to obtain raw database data. The raw database module is used to store the raw database data. The business database module is used to synchronize the raw database data to the business database data. The data acquisition layer service module is also used to compare each batch of acquired full-volume data as temporary data with the raw database data; and to perform corresponding modification operations on the raw database data based on the comparison results. The raw database module is also used to log all modification operations on the raw database data. Finally, the business layer service module is used to perform modification operations on the business database data based on the log records.

[0015] In some embodiments of this disclosure, the system further includes a change sending service module, which is used to send log records to the message middleware module; the business layer service module subscribes to the change message topic on the message middleware module, receives data change messages, and performs change operations on the business database data one by one according to the messages.

[0016] In some embodiments of this disclosure, the business library module further includes a full file export module and a full file parsing module, wherein the full file export module is used to periodically export the full network data of the original library; and the full file parsing module is used to parse the full network data and save it to the business library.

[0017] According to another aspect of this disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the above-described rapid data modification method by executing the executable instructions.

[0018] According to another aspect of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the above-described method for rapid data modification.

[0019] The method of this disclosure divides the database for transmitting full network data into two levels: an original database and a business database. When performing full comparison and input of network data into the database, a full comparison is performed in the original database and most of the unchanged configuration data is filtered out. Only message notifications of changed data are sent, so that the business database only needs to process the changed data, reducing the amount of changed data, thereby improving the update efficiency of massive data and improving data quality.

[0020] Furthermore, by using incremental data updates, the cycle of full file synchronization between the original database and the business database is greatly reduced, thus reducing the load and pressure on the business database.

[0021] Furthermore, the method disclosed herein enables the construction of a digital twin of an ultra-large-scale optical transmission network, achieves real-time and efficient data processing of massive logical ports, and forms a unified digital operation foundation for the optical transmission network.

[0022] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0023] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0024] Figure 1 The diagram shows a flowchart of a method for rapid data modification according to an embodiment of this disclosure.

[0025] Figure 2 This illustration shows a flowchart of a method for parsing raw full network data to obtain raw library data in a data rapid modification method according to an embodiment of this disclosure.

[0026] Figure 3 The diagram illustrates a method for comparing the collected full batch of data as temporary data with the original database data in a rapid data modification method according to an embodiment of this disclosure.

[0027] Figure 4 A schematic diagram of the structure of a data rapid change system according to an embodiment of this disclosure is shown.

[0028] Figure 5 This illustration shows a flowchart of yet another data rapid change system according to an embodiment of the present disclosure.

[0029] Figure 6 A schematic block diagram of an electronic device illustrating a rapid data change method according to an embodiment of this disclosure is shown. Detailed Implementation

[0030] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that this disclosure will be more comprehensive and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0031] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0032] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this disclosure, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0033] In view of the technical problems existing in the above-mentioned related technologies, the present disclosure provides a method for detecting human falls, so as to solve at least one or all of the above-mentioned technical problems.

[0034] It should be noted that the nouns or terms used in the embodiments of this application can be referenced from each other and will not be repeated here.

[0035] The following will describe in more detail the steps of a rapid data change method in this exemplary embodiment, with reference to the accompanying drawings and embodiments.

[0036] Figure 1 This diagram illustrates a flowchart of a rapid data modification method according to an embodiment of this disclosure. Figure 1 As shown, method 100 may include the following steps:

[0037] In step S110, the original full network data is parsed to obtain the original library data.

[0038] In this embodiment, the original database is used to store all network data, and the data in the original database can be stored in the form of tables. The original database completely preserves the collected original network data, which facilitates the backtracking of problems and the tracing of original information.

[0039] In step S120, the original database data is synchronized to the business database data.

[0040] In this embodiment, the business database is the main database used to enable rapid changes. The business database obtains the original full network data by synchronizing with the original database, thereby ensuring data consistency between the business database and the original database.

[0041] In step S130, the collected full data of each batch is used as temporary data and compared with the original database data.

[0042] The comparison process includes a full comparison of the original network data in the original database and filtering out most of the unchanged configuration data.

[0043] In step S140, the original database data is modified accordingly based on the comparison results.

[0044] The change operations can include adding, updating, and deleting data in the original database.

[0045] In step S150, all changes to the original database data are logged.

[0046] In step S160, a change operation is performed on the business database data based on the log records.

[0047] The method of this disclosure divides the database for transmitting full network data into two levels: an original database and a business database. When performing full comparison and input of network data into the database, a full comparison is performed in the original database and most of the unchanged configuration data is filtered out. Only message notifications of changed data are sent, so that the business database only needs to process the changed data, reducing the amount of changed data, thereby improving the update efficiency of massive data and improving data quality.

[0048] Furthermore, by using incremental data updates, the cycle of full file synchronization between the original database and the business database is greatly reduced, thus reducing the load and pressure on the business database.

[0049] Furthermore, the method disclosed herein enables the construction of a digital twin of an ultra-large-scale optical transmission network, achieves real-time and efficient data processing of massive logical ports, and forms a unified digital operation foundation for the optical transmission network.

[0050] In some embodiments of this disclosure, step S110 may also, for example... Figure 2 The method 200 shown may include the following steps:

[0051] In step S210, the identification information of the original full network data source network element is obtained.

[0052] The original full network data source network element includes one or more network elements.

[0053] Each network element includes an identification information, which represents the unique identity of the network element.

[0054] In some embodiments of this disclosure, the identification information may be the VENDOR_OBJ_NAME field of the network element.

[0055] In step S220, the number of storage partitions is determined based on the identification information.

[0056] Specifically, the number of network elements and the type of each network element can be obtained from the identification information. Based on the number and type of network elements, the total number of network element ports is estimated. Then, based on the optimal value of the amount of data processed per batch in the data storage used, the required number of storage partitions is calculated.

[0057] In step S230, the unique identifier of the network element is mapped to a hash value using the algorithm.

[0058] Specifically, the unique identifier of a network element is mapped to a hash value using a hash algorithm. This hash algorithm must satisfy the following conditions: the hash value of a mapped network element is greater than zero and less than or equal to a fixed value of the number of partitions; different network elements may be mapped to the same hash value; and the hash distribution of all mapped network elements is relatively uniform.

[0059] In step S240, the original database data is obtained by storing the hash value mapped to the network element to which the original full network data belongs into a fixed partition.

[0060] The method of this disclosure uses a hash algorithm to calculate the mapping partitions based on network elements to store table data, thereby enabling rapid updates and comparisons of massive amounts of data.

[0061] In some embodiments of this disclosure, step S120 may further include: periodically exporting the full network data of the original library; parsing the full network data and saving it to the service library.

[0062] The method in this embodiment synchronizes data between the business master database and the original database, saves all data, and makes the data model closer to the business application, providing it for the business application to use.

[0063] By using the original database change message update method in this embodiment, the cycle of full synchronization of the original database by the business database can be set to 4 times or even longer than the original database data acquisition and parsing cycle, thereby reducing the impact on the performance of the database itself and the resource consumption.

[0064] In some embodiments of this disclosure, step S130 may also be as follows: Figure 3 As shown, when making changes to the full network data comparison in the original database, each batch of full data collected is used as temporary data. The temporary data can be saved in the form of a table, and the temporary data and the original database data are compared by partition.

[0065] In some embodiments of this disclosure, step S160 may further include: sending log records to a message middleware; subscribing to change message topics on the message middleware, receiving data change messages, and performing change operations on the business database data one by one according to the messages.

[0066] Subscription / push can solve the problem of data synchronization that cannot achieve smaller time granularity in related technologies, thus enabling real-time and accurate restoration of data changes to the business database.

[0067] Figure 4 This illustration shows a rapid data change system according to an embodiment of the present disclosure. For example... Figure 4 As shown, the system includes: a data acquisition layer service module 410, a business database module 440, a raw data database module 420, and a business layer service module 430, wherein...

[0068] The data acquisition layer service module 410 is used to parse the original full network data to obtain the original database data; the original database module 420 is used to store the original database data; the business database module 440 is used to synchronize the original database data to the business database data; the data acquisition layer service module 410 is also used to compare each batch of collected full data as temporary data with the original database data; and to perform corresponding change operations on the original database data according to the comparison results; the original database module 420 is also used to log all change operations on the original database data; and the business layer service module 430 is used to perform change operations on the business database data according to the log records.

[0069] In some embodiments of this disclosure, the data rapid change system 400 further includes a change sending service module, wherein the change sending service module is used to send log records to the message middleware module; the business layer service module subscribes to the change message topic on the message middleware module, receives data change messages, and performs change operations on the business database data one by one according to the messages.

[0070] In some embodiments of this disclosure, the business library module further includes a full file export module and a full file parsing module, wherein the full file export module is used to periodically export the full network data of the original library; and the full file parsing module is used to parse the full network data and save it to the business library.

[0071] Through the data rapid change system of this disclosure embodiment, the cycle of full synchronization of the original database by the above two modules in the business database can be set to 4 times or even longer than the data acquisition and parsing cycle of the original database, thereby reducing the impact on the performance of the business database itself and the resource consumption.

[0072] Figure 5 This illustrates yet another data rapid change system, 500. For example... Figure 5As shown, system 500 may include the following modules: acquisition layer service module 510, raw data library module 520, change sending service module 530, message middleware module 540, business layer service module 550, and business library module 560. The rapid data change process is as follows:

[0073] 1. The data acquisition layer service module 510 calls the EMS network management interface to collect all network data;

[0074] 2. The EMS network administrator uploads the original full network data to the FTP server;

[0075] 3. The data acquisition layer service module 510 reads the raw full network data from the FTP server, parses and compares the raw full network data, and stores it in the raw database module 520.

[0076] 3.1 Select the VENDOR_OBJ_NAME field of the network element as the identifier for hash mapping calculation; this identifier ensures that the network element is globally unique in the database;

[0077] Specifically, the VENDOR_OBJ_NAME field is as follows, with EMS serving as a globally unique identifier:

[0078]

[0079] 3.2. Use a hash algorithm to take the modulo of the number of partitions identified by EMS in the VENDOR_OBJ_NAME field, PARTITIONS_COUNT.

[0080] 3.3. Network data collected from different ports will be stored in designated partitions according to the NE_HASH_CODE of their respective network elements; a certain transmission network element is calculated into 8 partitions, and the port storage distribution is shown in Table (1) below:

[0081] Table (1)

[0082]

[0083] 4. The original library module generates a change log from the changes, and the change log table is shown in Table (2):

[0084] Table (2):

[0085]

[0086] 5. The change sending service module 530 scans the change log of the original library module 520 and sends the changes sequentially to the message middleware module 540 in message format; the change message may be in the following format:

[0087] {

[0088] "MSG_DATA": {

[0089] "VENDOR_EXTENSIONS": {}, / / Additional attributes

[0090] "SOURCE_ID": "otms-rpc", / / Message generation system

[0091] "SOURCE_TYPE": 1, / / Message generation system category

[0092] "EVENT_TYPE": 0, / / Message indicating object creation

[0093] "OBJECT_NAME": "01229A509F991DF866FEF6ED426B76F1", / / Change object identifier

[0094] "OS_TIME": "2022-09-21 09:49:21", / / Change system time

[0095] "ATTRIBUTE_LIST": { / / Specific values ​​of the changed record fields

[0096] "OBJ_TYPE": "41",

[0097] "INSERT_TIME": "2022-09-21 09:47:44",

[0098] "DATA_DOMAIN": "1000",

[0099] "DATA_SOURCE": "5",

[0100] "CARRIER_OBJ_ID": "703A46D1AA0AB8C55ADAB769ABA1A2CB",

[0101] "RECEIVE_TIME": "2022-09-21 09:47:44",

[0102] "UPDATE_TIME": "2022-09-21 09:47:44",

[0103] "IS_ACTIVE": "1",

[0104] "OBJ_ID": "CA3354797E48265EE5F36F70377AC7A2",

[0105] "CARRIER_OBJ_TYPE": "19",

[0106] "OBJ_DATA_DOMAIN_ID": "1000",

[0107] "CARRIER_DATA_DOMAIN_ID": "1000",

[0108] "CARRIER_ID": "01229A509F991DF866FEF6ED426B76F1"

[0109] "SOURCE_TIME": "2022-09-21 09:47:44", / / Changed time

[0110] "OBJECT_TYPE": "CARRIER" / / Modified data table

[0111] },

[0112] "MSG_HEAD": { / / Notification header information

[0113] "MSG_ID": "7bd3b7add5d54d439713fb655e4e233a",

[0114] "MSG_TYPE": 4,

[0115] "NOTIFICATION_ID": 23655997,

[0116] "TASK_ID": "E926F2ACC640556EE0531F3C820A9DFC"

[0117] }

[0118] }

[0119] 6. The business layer service module 550 subscribes to data change messages, processes and parses the data, and imports it into the business database module. Specifically, the business service layer module 550 performs corresponding data change operations based on the event type of the reported message. These data change operations can include the following event types (EVENT_...).

[0120] TYPE), as shown in Table (3):

[0121]

[0122] Compared with the prior art, the main advantages and effects of the system of this disclosure are:

[0123] 1) The method and system proposed in this patent can reduce the impact on the business database while realizing the rapid entry of massive data into the database, extend the cycle of full data comparison in the business database, reduce the impact on the resource consumption of the business database, and improve the performance of the business database.

[0124] 2) Based on the method and system proposed in this patent, the construction of a digital twin of an ultra-large-scale optical transmission network is realized, real-time and efficient data processing of massive logical ports is achieved, and a unified digital operation foundation for the optical transmission network is formed.

[0125] Regarding the data rapid change systems 400 and 500 in the above embodiments, the specific methods by which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated here.

[0126] Those skilled in the art will understand that various aspects of this disclosure can be implemented as a system, method, or program product. Therefore, various aspects of this disclosure can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software aspects, collectively referred to herein as a "circuit," "module," or "system."

[0127] The following reference Figure 6 To describe an electronic device 600 according to such an embodiment of the present disclosure. Figure 6 The electronic device 600 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0128] like Figure 6 As shown, the electronic device 600 is manifested in the form of a general-purpose computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, and a bus 630 connecting different system components (including storage unit 620 and processing unit 610).

[0129] The storage unit stores program code that can be executed by the processing unit 610, causing the processing unit 610 to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure. For example, the processing unit 610 can perform actions such as... Figure 1The steps shown are as follows: S110, obtaining raw database data by parsing the original full network data; S120, synchronizing the raw database data to the business database data; S130, comparing the collected batches of full data as temporary data with the raw database data; S140, performing corresponding modification operations on the raw database data according to the comparison results; S150, forming a log record of all modification operations on the raw database data; and S160, performing modification operations on the business database data according to the log record.

[0130] Storage unit 620 may include readable media in the form of volatile storage units, such as random access memory (RAM) 6201 and / or cache memory 6202, and may further include read-only memory (ROM) 6203.

[0131] Storage unit 620 may also include a program / utility 624 having a set (at least one) program module 6205, such program module 6205 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0132] Bus 630 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0133] Electronic device 600 can also communicate with one or more external devices (e.g., keyboard, pointing device, Bluetooth device, etc.), one or more devices that enable a user to interact with electronic device 600, and / or any device that enables electronic device 600 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 650. Furthermore, electronic device 600 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 660. As shown, network adapter 660 communicates with other modules of electronic device 600 via bus 630. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0134] In exemplary embodiments of this disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the methods described above is stored. In some possible implementations, various aspects of this disclosure may also be implemented as a program product including program code that, when the program product is run on a terminal device, causes the terminal device to perform the steps of the various exemplary embodiments of this disclosure described in the "Exemplary Methods" section above.

[0135] The program product for implementing the above-described method according to embodiments of the present disclosure may employ a portable compact disc read-only memory (CD-ROM) and include program code, and may run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, the readable storage medium may be any tangible medium containing or storing a program that may be used or used in conjunction with an instruction execution system, server, terminal, or device.

[0136] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, server, terminal, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0137] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting programs for use by or in conjunction with an instruction execution system, server, terminal, or device.

[0138] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0139] Program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0140] According to one aspect of this disclosure, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional implementations of the above embodiments.

[0141] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0142] Furthermore, although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or a step may be broken down into multiple steps.

[0143] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, mobile terminal, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0144] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

Claims

1. A data quick change method, characterized by, The method comprises: parsing the original full network data to obtain original library data, the original library being used to store the collected original full network data; synchronizing the original library data to business library data, the data model of the business library being used to provide for use by a business application; comparing each batch of collected full data as temporary data with the original library data; performing corresponding change operations on the original library data according to the comparison result; forming a log record of all change operations of the original library data; and performing change operations on the business library data according to the log record; wherein the step of parsing the original full network data to obtain original library data comprises: obtaining a network element unique identifier of a network element to which the original full network data belongs; determining the number of storage partitions according to the network element unique identifier; mapping the network element unique identifier to a hash value through an algorithm; and storing the original full network data to a fixed partition according to the hash value mapped by the network element unique identifier of the network element to which the original full network data belongs to obtain the original library data; the step of performing change operations on the business library data according to the log record comprises: sending the log record to a message middleware; subscribing to a change message topic on the message middleware, receiving data change messages, and performing change operations on the business library data according to the data change messages one by one.

2. The data quick change method of claim 1, wherein, The step of comparing each batch of collected full data as temporary data with the original library data comprises: performing data comparison on each batch of collected full data as temporary data and the original library data on a partition-by-partition basis.

3. The data quick change method of claim 1, wherein, Further comprising: periodically exporting full network data of the original library; parsing the full network data and saving to the business library.

4. A data quick change system, characterized by, The system comprises: a collection layer service module, a business library module, an original library module, and a business layer service module, wherein, the collection layer service module is used to parse original full network data to obtain original library data, the original library being used to store the collected original full network data; wherein parsing the original full network data to obtain the original library data comprises: obtaining a network element unique identifier of a network element to which the original full network data belongs; determining the number of storage partitions according to the network element unique identifier; mapping the network element unique identifier to a hash value through an algorithm; and storing the original full network data to a fixed partition according to the hash value mapped by the network element unique identifier of the network element to which the original full network data belongs to obtain the original library data; the original library module is used to store the original library data; the business library module is used to synchronize the original library data to business library data, the data model of the business library being used to provide for use by a business application; the collection layer service module is further used to compare each batch of collected full data as temporary data with the original library data; and perform corresponding change operations on the original library data according to the comparison result; the original library module is further used to form a log record of all change operations of the original library data; and the business layer service module is used to perform change operations on the business library data according to the log record. The system also includes a change sending service module, wherein The change sending service module is used to send the log records to the message middleware module; The business layer service module subscribes to the change message topic on the message middleware module, receives data change messages, and performs change operations on the business database data one by one according to the data change messages.

5. The data quick change system of claim 4, wherein, The business library module also includes: a full file export module and a full file parsing module, wherein... The full file export module is used to periodically export the full network data of the original library; The full file parsing module is used to parse the full network data and save it to the business database.

6. An electronic device, comprising: include: processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the data fast modification method according to any one of claims 1 to 3 by executing the executable instructions.

7. A computer readable storage medium having stored thereon a computer program, characterized in that When the computer program is executed by the processor, it implements the data rapid modification method according to any one of claims 1 to 3.

Images