Method, device and server for processing operation and maintenance data
By building an operation and maintenance simulation model through dynamic operation and maintenance maps and knowledge graph technology, and combining it with a cache mechanism to optimize operation and maintenance data queries, the problem of low processing efficiency in the operation and maintenance management of large-scale network systems is solved, and fast and accurate query result feedback is achieved.
Patent Information
- Application Number
- CN202410837421.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-26
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2044-06-26
AI Technical Summary
In the operation and maintenance management of large-scale network systems in financial business scenarios, existing methods rely on manual verification, resulting in low processing efficiency, long processing time and prone to errors.
A dynamic operation and maintenance map is combined with digital twin and knowledge graph technology to build an operation and maintenance simulation model. The cache mechanism and routing rules are used to optimize query request processing, reduce on-site calls of simulation operations, and quickly feedback query results through the cache module.
It achieves efficient and accurate operation and maintenance data query, reduces user waiting time, and improves the processing efficiency and accuracy of operation and maintenance management.
Smart Images

Figure CN118690026B_ABST
Abstract
Description
Technical Field
[0001] This specification belongs to the field of artificial intelligence technology, and in particular relates to methods, devices, and servers for processing operation and maintenance data. Background Art
[0002] In financial business scenarios, large-scale network systems such as bank transaction service platforms are often complex and changeable in structure, and involve a large number of managed devices. Accordingly, the operation and maintenance management of the above-mentioned network systems usually involves a relatively large amount of data processing. Based on existing methods, when operation and maintenance personnel perform operation and maintenance management of the above-mentioned network systems (for example, querying and locating faulty equipment in the network system, etc.), they mostly need to rely on operation and maintenance personnel to manually perform a large amount of verification and testing, which has the problems of low processing efficiency, long processing time, and easy error.
[0003] To address the above issues, no effective solutions have been proposed so far. Summary of the Invention
[0004] This specification provides a method, device, and server for processing operation and maintenance data, which can more efficiently and accurately determine and feedback target operation and maintenance query results corresponding to target operation and maintenance data query requests, effectively reducing user waiting time.
[0005] This manual provides a method for processing operation and maintenance data, which is applied to servers and includes:
[0006] Receive a target operation and maintenance data query request initiated by an operation and maintenance terminal based on a dynamic operation and maintenance map; wherein the dynamic operation and maintenance map is an operation and maintenance knowledge graph tool for the target network system; the dynamic operation and maintenance map includes at least a data acquisition layer and a data modeling layer; the data acquisition layer is used to collect device parameters of managed devices in the connected target network system; the data modeling layer is used to use the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on digital twins and knowledge graphs;
[0007] According to the preset instantiation processing rules, by processing the target operation and maintenance data query request, a target operation and maintenance query question that meets the requirements is extracted;
[0008] Detecting whether the target operation and maintenance query problem exists in the cache hot problem list of the current time period; wherein the cache hot problem list of the current time period includes the hot operation and maintenance query problems of the current time period; the cache hot problem list of the current time period is associated with a cache module; the cache module is responsible for storing the operation and maintenance query results corresponding to the hot operation and maintenance query problems of the current time period; the operation and maintenance query results are obtained by calling and running the target operation and maintenance simulation model based on the hot operation and maintenance query problems of the current time period during the idle time period of the server;
[0009] If it is determined that the target operation and maintenance query problem exists in the cache hot problem list of the current time period, the target operation and maintenance data query request carrying the target operation and maintenance query problem is routed to the cache module for data query according to the preset routing rules;
[0010] Obtain the target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module; and send the target operation and maintenance query result to the operation and maintenance terminal; wherein the operation and maintenance terminal is the initiator terminal of the target operation and maintenance data query request.
[0011] In one embodiment, the dynamic operation and maintenance map further includes: a business function layer; wherein the business function layer is connected to the operation and maintenance terminal; the business function layer supports users to initiate operation and maintenance data query requests of various business types through the operation and maintenance terminal;
[0012] The operation and maintenance data query requests of the multiple business types include: a faulty equipment location query request, a connection path navigation query request, and a connection path road condition query request.
[0013] In one embodiment, the dynamic operation and maintenance map also includes: a maintenance management layer; wherein, the maintenance management layer is used to monitor the health status of the target network system based on the simulation calculation results output by the data modeling layer; when an abnormality is detected in the health status of the target network system, an operation and maintenance strategy for the target network system is generated based on the simulation calculation results.
[0014] In one embodiment, according to a preset instantiation processing rule, by processing the target operation and maintenance data query request, a target operation and maintenance query question that meets the requirements is extracted, including:
[0015] According to the preset instantiation processing rules, the initial question is extracted from the target operation and maintenance data query request;
[0016] Match questions based on the preset reference question list and initial questions to obtain corresponding matching results;
[0017] According to the matching results, if it is determined that the matching fails, semantic recognition is performed on the initial question to obtain the corresponding semantic recognition result;
[0018] Performing word segmentation processing on the semantic recognition result; and extracting question keywords based on the semantic recognition result after word segmentation processing;
[0019] Based on the question keywords, multiple pending questions are obtained by querying the knowledge graph associated with the target network system;
[0020] From the multiple pending questions, select target operation and maintenance query questions that meet the requirements.
[0021] In one embodiment, after matching questions based on the preset reference question list and the initial question to obtain corresponding matching results, the method further includes:
[0022] According to the matching result, when it is determined that the matching is successful, a reference question that matches the initial question is determined from a preset reference question list as the target operation and maintenance query question.
[0023] In one embodiment, after detecting whether the target operation and maintenance query problem exists in the cache hot problem list in the current time period, the method further includes:
[0024] If it is determined that the target operation and maintenance query question does not exist in the cache hot problem list of the current time period, the target operation and maintenance data query request carrying the target operation and maintenance query question is routed to the data modeling layer according to the preset routing rules, so as to call the target operation and maintenance simulation model to perform simulation calculation based on the target operation and maintenance query question;
[0025] Obtain the target simulation operation result output by the data modeling layer; and send the target simulation operation result to the operation and maintenance terminal.
[0026] In one embodiment, calling the target operation and maintenance simulation model to perform simulation calculations based on the target operation and maintenance query problem includes:
[0027] According to the target operation and maintenance query question, the starting device, the ending device, and the associated devices are determined by querying the knowledge graph associated with the target network system; wherein the associated devices include directly associated devices and / or indirectly associated devices;
[0028] Obtain and use the link address of the starting device, the link address of the ending device, and the link address of the associated device to construct a target link address matrix;
[0029] Splitting the target link address matrix into a plurality of sub-link address matrices according to the attribute information of the device area;
[0030] Calling the target operation and maintenance simulation model to perform parallel simulation operations according to multiple sub-link address matrices to obtain multiple sub-simulation operation results;
[0031] According to the attribute information of the device area, multiple sub-simulation operation results are combined to obtain the target simulation operation result.
[0032] In one embodiment, after extracting a target operation and maintenance query question that meets the requirements by processing the target operation and maintenance data query request according to a preset instantiation processing rule, the method further includes:
[0033] The target operation and maintenance query question and the query time corresponding to the target operation and maintenance query question are recorded in the query log.
[0034] In one embodiment, the method further comprises:
[0035] At preset time intervals, obtain operation and maintenance query problem records for the current time period based on the query log;
[0036] Based on the operation and maintenance query problem records, the query popularity value of the operation and maintenance query problems in the current time period is obtained;
[0037] Filter out hot O&M issues in the current time period based on the query popularity of the O&M issues in the current time period;
[0038] According to the hot operation and maintenance issues in the current time period, the cache hot issue list of the previous time period is updated to obtain the cache hot issue list of the current time period.
[0039] In one embodiment, the method further comprises:
[0040] Check whether the current idle time period meets the preset trigger conditions;
[0041] When it is determined that the current idle time period meets the preset trigger conditions, the target operation and maintenance simulation model is called through the data modeling layer to process the unmarked hot issues in the cache hot issue list of the current time period;
[0042] Obtain the simulation results for the hot issue output by the data modeling layer; and mark the hot issue accordingly in the cached hot issue list of the current time period;
[0043] The simulation results of the hot issue are sent to the cache module for caching.
[0044] In one embodiment, the cache module is connected to a SQL database and a graph database;
[0045] Correspondingly, after receiving the simulation operation result, the cache module determines the data format type of the simulation operation result; and stores the simulation operation result in a matching database according to the data format type of the simulation operation result.
[0046] In one embodiment, after obtaining the target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module, the method further includes:
[0047] According to the target operation and maintenance query results, query the knowledge graph associated with the target network system to obtain target related data related to the target operation and maintenance query results;
[0048] Generate visual display data based on target operation and maintenance query results and target-related data;
[0049] The visual result display data is sent to the operation and maintenance terminal.
[0050] This specification also provides a device for processing operation and maintenance data, including:
[0051] A receiving module is configured to receive a target operation and maintenance data query request initiated by an operation and maintenance terminal based on a dynamic operation and maintenance map; wherein the dynamic operation and maintenance map is an operation and maintenance knowledge graph tool for the target network system; the dynamic operation and maintenance map comprises at least a data acquisition layer and a data modeling layer; the data acquisition layer is configured to acquire device parameters of managed devices in the connected target network system; the data modeling layer is configured to utilize the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on the digital twin and the knowledge graph;
[0052] An extraction module is used to extract target operation and maintenance query questions that meet the requirements by processing the target operation and maintenance data query request according to preset instantiation processing rules;
[0053] A detection module is configured to detect whether the target operation and maintenance query problem exists in a cache hot problem list of the current time period; wherein the cache hot problem list of the current time period includes the hot operation and maintenance query problems of the current time period; the cache hot problem list of the current time period is associated with a cache module; the cache module is responsible for storing operation and maintenance query results corresponding to the hot operation and maintenance query problems of the current time period; the operation and maintenance query results are obtained by calling and running a target operation and maintenance simulation model based on the hot operation and maintenance query problems of the current time period during an idle time period by the server;
[0054] The routing module is used to route the target operation and maintenance data query request carrying the target operation and maintenance query question to the cache module for data query according to the preset routing rules when it is determined that the target operation and maintenance query question exists in the cache hot problem list of the current time period;
[0055] The feedback module is used to obtain the target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module; and send the target operation and maintenance query result to the operation and maintenance terminal; wherein, the operation and maintenance terminal is the initiator terminal of the target operation and maintenance data query request.
[0056] This specification also provides a server, including a processor and a memory for storing processor-executable instructions, and the processor implements relevant steps of the operation and maintenance data processing method when executing the instructions.
[0057] This specification also provides a computer-readable storage medium having computer instructions stored thereon, which implement the relevant steps of the method for processing operation and maintenance data when executed by a processor.
[0058] Based on the operation and maintenance data processing method, device and server provided in this specification, before specific implementation, the digital twin technology and knowledge graph can be comprehensively utilized to construct a dynamic operation and maintenance map for the target network system; wherein, the dynamic operation and maintenance map at least includes a data modeling layer and a data acquisition layer; the data acquisition layer is used to collect the equipment parameters of the managed devices in the target network system to be connected; the data modeling layer is used to use the equipment parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on the digital twin technology and knowledge graph; wherein, the target operation and maintenance simulation model is associated with the knowledge graph of the target network system. Furthermore, the server will also regularly update the hot operation and maintenance query issues in the cached hot issue list of the current time period; and in the idle time period, without affecting the normal business data processing, the target operation and maintenance simulation model is called through the data modeling layer to perform simulation calculations in advance according to the hot operation and maintenance query issues of the current time period to obtain the corresponding simulation calculation results as the corresponding operation and maintenance query results; then a cache mechanism is introduced to send the above operation and maintenance query results to the cache module for caching for subsequent retrieval and use. In specific implementation, after receiving a target operation and maintenance data query request initiated by the operation and maintenance terminal based on the dynamic operation and maintenance map, the server can first extract the target operation and maintenance query questions that meet the requirements according to the preset instantiation processing rules; then check whether the target operation and maintenance query question exists in the cache hot question list of the current time period; if so, according to the preset routing rules, the target operation and maintenance data query request carrying the target operation and maintenance query question is preferentially routed to the cache module for data query, avoiding the on-site call of the target operation and maintenance simulation model for online simulation calculation, and quickly find the corresponding target operation and maintenance query results from the cache database and feedback them to the operation and maintenance terminal. This can effectively determine and feedback the corresponding target operation and maintenance query results more efficiently and accurately, effectively reducing the user's waiting time. BRIEF DESCRIPTION OF THE DRAWINGS
[0059] In order to more clearly illustrate the embodiments of this specification, the following is a brief introduction to the drawings required for use in the embodiments. The drawings described below are only some of the embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0060] Figure 1 This is a flowchart of a method for processing operation and maintenance data provided by an embodiment of this specification;
[0061] Figure 2This is a schematic diagram of an embodiment of a method for processing operation and maintenance data provided by an embodiment of this specification, in a scenario example;
[0062] Figure 3 This is a schematic diagram of an embodiment of a method for processing operation and maintenance data provided by an embodiment of this specification, in a scenario example;
[0063] Figure 4 This is a schematic diagram of an embodiment of a method for processing operation and maintenance data provided by an embodiment of this specification, in a scenario example;
[0064] Figure 5 This is a schematic diagram of an embodiment of a method for processing operation and maintenance data provided by an embodiment of this specification, in a scenario example;
[0065] Figure 6 This is a schematic diagram of an embodiment of a method for processing operation and maintenance data provided by an embodiment of this specification, in a scenario example;
[0066] Figure 7 This is a schematic diagram of an embodiment of a method for processing operation and maintenance data provided by an embodiment of this specification, in a scenario example;
[0067] Figure 8 This is a schematic diagram of the structure of a server provided by an embodiment of this specification;
[0068] Figure 9 This is a schematic diagram of the structure of an operation and maintenance data processing device provided by an embodiment of this specification;
[0069] Figure 10 This is a schematic diagram of an embodiment of a method for processing operation and maintenance data provided by an embodiment of this specification, in a scenario example. DETAILED DESCRIPTION
[0070] To help those skilled in the art better understand the technical solutions in this specification, the following will provide a clear and complete description of the technical solutions in the embodiments of this specification, in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of this specification, not all of them. All other embodiments derived by those skilled in the art based on the embodiments in this specification without creative effort shall fall within the scope of protection of this specification.
[0071] See Figure 1 As shown, the embodiment of this specification provides a method for processing operation and maintenance data. Among them, the method is specifically applied to the server side. When implemented specifically, the method may include the following contents:
[0072] S101: Receive a target operation and maintenance data query request initiated by an operation and maintenance terminal based on a dynamic operation and maintenance map; wherein the dynamic operation and maintenance map is an operation and maintenance knowledge graph tool for the target network system; the dynamic operation and maintenance map includes at least a data acquisition layer and a data modeling layer; the data acquisition layer is used to collect device parameters of managed devices in the connected target network system; the data modeling layer is used to use the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on digital twins and knowledge graphs;
[0073] S102: extracting target operation and maintenance query questions that meet the requirements by processing the target operation and maintenance data query request according to preset instantiation processing rules;
[0074] S103: Detecting whether the target operation and maintenance query problem exists in the cache hot problem list of the current time period; wherein the cache hot problem list of the current time period includes the hot operation and maintenance query problem of the current time period; the cache hot problem list of the current time period is associated with a cache module; the cache module is responsible for storing the operation and maintenance query results corresponding to the hot operation and maintenance query problem of the current time period; the operation and maintenance query results are obtained by calling and running the target operation and maintenance simulation model based on the hot operation and maintenance query problem of the current time period during the idle time period of the server;
[0075] S104: When it is determined that the target operation and maintenance query question exists in the cache hot question list of the current time period, the target operation and maintenance data query request carrying the target operation and maintenance query question is routed to the cache module for data query according to a preset routing rule;
[0076] S105: Obtain a target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module; and send the target operation and maintenance query result to the operation and maintenance terminal; wherein the operation and maintenance terminal is the initiator of the target operation and maintenance data query request.
[0077] Based on the above embodiment, on the one hand, digital twin technology and knowledge graph technology are introduced and utilized to construct a dynamic operation and maintenance map for the target network system; wherein, the dynamic operation and maintenance map includes at least a data modeling layer and a data acquisition layer; the data acquisition layer is used to automatically acquire and update the device parameters of the managed devices in the corresponding target network system; the data modeling layer is used to use the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system; at the same time, the target operation and maintenance simulation model is also associated with the knowledge graph of the target network system. Based on the above dynamic operation and maintenance map, the server can use the target operation and maintenance simulation model in combination with the knowledge graph to accurately obtain the corresponding operation and maintenance query results through simulation calculations, thereby meeting the user's diverse operation and maintenance query needs. On the other hand, a caching mechanism is also introduced. The server regularly updates the hot operation and maintenance query questions in the cached hot question list of the current time period; and in the idle time period, without affecting the normal business data processing, by calling the target operation and maintenance simulation model to pre-simulate the hot operation and maintenance query questions of the current time period, obtain the corresponding operation and maintenance query results; and then send the above operation and maintenance query results to the cache module for caching for subsequent use. Based on the above-mentioned caching mechanism, after receiving the target operation and maintenance data query request and extracting the corresponding target operation and maintenance query question, the server can first search whether the question exists in the cache hot question list of the current time period; if it does, there is no need to call the target operation and maintenance simulation model on site to perform simulation calculations with a large amount of data. Instead, it can be directly routed to the cache module according to the preset routing rules, quickly query and obtain the corresponding target operation and maintenance query results, and promptly feedback to the operation and maintenance terminal, thereby effectively reducing the user's waiting time and improving overall processing efficiency.
[0078] In some embodiments, the above-mentioned operation and maintenance data processing method can be applied to a server, which can be an operation and maintenance server of a transaction service platform.
[0079] Specifically, the server may include a background server capable of performing functions such as data transmission and data processing. Specifically, the server may be, for example, an electronic device with data computing, storage, and network interaction capabilities. Alternatively, the server may be a software program running on the electronic device that provides support for data processing, storage, and network interaction. In this embodiment, the number of servers is not specifically limited. The server may be a single server, several servers, or a server cluster formed by several servers.
[0080] The target network system may specifically be the backend data processing system of a transaction service platform. Specifically, the target network system may be connected to multiple managed devices, such as ATMs, servers, teller machines, surveillance cameras, computers, routers, switches, and the like. Furthermore, the managed devices included in the target network system may be divided into multiple business function areas based on device area attribute information (e.g., business function attributes), such as a database area, a security area, a settlement area, and the like.
[0081] The above-mentioned dynamic operation and maintenance map can be specifically understood as an operation and maintenance knowledge graph tool constructed for the target network system by pre-utilizing digital twin technology and knowledge graph technology.
[0082] Among them, the above-mentioned digital twin technology can specifically refer to a simulation technology that fully utilizes physical models, monitoring data updates, operation history and other data, integrates multi-disciplinary, multi-physical quantity, multi-scale, and multi-probability simulation technology. Based on the above-mentioned digital twin technology, it can complete the mapping of the target network system in the virtual space, and then accurately and finely reflect the full life cycle operation process of each managed device corresponding to the target network system.
[0083] The above-mentioned knowledge graph can specifically refer to a structured semantic knowledge base, which is used to describe concepts and their relationships in the physical world in symbolic form. Its basic component unit is the "entity-relationship-entity" triple, as well as the entity and its related attribute-value pairs. Entities are connected to each other through relationships to form a network knowledge structure.
[0084] The above-mentioned operation and maintenance knowledge graph tool can be specifically understood as a tool software suitable for operation and maintenance scenarios, configured with a knowledge graph corresponding to the target network system, and can realize operation and maintenance data query and operation and maintenance status management of the target network system based on the knowledge graph and combined with digital twin technology.
[0085] The target network system's knowledge graph may at least include attribute information for each managed device in the target network system, as well as the connection relationships between different managed devices. Specifically, each node in the target network system's knowledge graph corresponds to a managed device, and the edges between different nodes correspond to the connection relationships between different managed devices. Furthermore, the nodes in the knowledge graph may be annotated with the device identifiers and attribute information of the corresponding managed devices, and the edges may be annotated with the attribute information of the corresponding connection relationships.
[0086] For details, see Figure 2 As shown, the above-mentioned dynamic operation and maintenance map includes at least a data collection layer and a data modeling layer.
[0087] The data collection layer can be connected to each managed device in the target network system via a wired or wireless connection. Furthermore, the data collection layer can deploy monitoring threads on each connected managed device.
[0088] Accordingly, the data collection layer can collect configuration parameters of managed devices through data connections with them, such as their device ID, physical address, CPU model, routing table entries, ARP table entries, and MAC table entries. Furthermore, the data collection layer can also collect operational parameters of managed devices in real time or at scheduled intervals through monitoring threads, such as their CPU utilization, network communication speed, and response time. The data collection layer can then combine these basic information and operational parameters to obtain the device parameters.
[0089] The data modeling layer can be specifically connected to the data acquisition layer. The data modeling layer can utilize the device parameters of the target network system's managed devices collected by the data acquisition layer, based on digital twin technology and combined with the target network system's knowledge graph, to construct a target operation and maintenance simulation model specific to the target network system and associated with the target network system's knowledge graph.
[0090] Among them, the above-mentioned target operation and maintenance simulation model can utilize the device parameters of the managed devices in the target network system, simulate the real network between the managed devices in the target network system, and related network behaviors to perform simulation operations to accurately determine the current operation status of the target network system, or predict the future operation status of the target network system.
[0091] Furthermore, the data modeling layer may also support calling the target operation and maintenance simulation model to simulate part of or all of the structures in the target network system based on the device parameters of the relevant managed devices.
[0092] In some embodiments, see Figure 2 As shown, the above-mentioned dynamic operation and maintenance map may further include a business function layer (or core capability layer); wherein the business function layer may specifically be connected to the operation and maintenance terminal; the business function layer supports users to initiate operation and maintenance data query requests of various business types through the operation and maintenance terminal;
[0093] The operation and maintenance data query requests of the multiple business types may specifically include: a faulty equipment location query request, a connection path navigation query request, a connection path road condition query request, and the like.
[0094] Specifically, the path navigation can be understood as navigation of the data interaction connection path between the specified managed devices of interest to the user. The connection path status can specifically include the operating status of the connection path itself (for example, whether the connection path is currently congested) and the operating status of other managed devices involved in the connection path (for example, the operating status of the server passed through by the connection path).
[0095] Of course, it should be noted that the operation and maintenance data query request listed above is only an illustrative example. In specific implementation, the above operation and maintenance data query request may also include other types of operation and maintenance data query requests based on specific business scenarios and processing requirements. This specification does not limit this.
[0096] Based on the above embodiment, users can connect to the business function layer through the operation and maintenance terminal, use the corresponding business functions in the business function layer, and perform diversified operation and maintenance data queries to meet the user's diverse operation and maintenance query needs.
[0097] Specifically, the business function layer is also connected to the knowledge graph of the target network system. The business function layer can be connected to the data modeling layer.
[0098] In specific implementation, a client app for the dynamic operation and maintenance map can be installed on the operation and maintenance terminal to establish a data interface connected to the business function layer. Accordingly, users can access the business function layer through this data interface and initiate operation and maintenance data query requests to the server for the operation and maintenance data of interest. Furthermore, the business function layer can also visualize the retrieved operation and maintenance data using the knowledge graph, generating data similar to an electronic map, which can then be displayed to users through the operation and maintenance terminal. This provides a superior user interaction experience.
[0099] The aforementioned operation and maintenance terminal may specifically include a front-end that is applied to the user (e.g., the operator of the target network system) and is capable of performing functions such as data collection and data transmission. Specifically, the operation and maintenance terminal may be, for example, an electronic device such as a desktop computer, tablet computer, laptop computer, or smartphone. Alternatively, the operation and maintenance terminal may be a software application that can be run on the aforementioned electronic devices.
[0100] In some embodiments, see Figure 2 As shown, the dynamic operation and maintenance map may also include: a maintenance management layer (or upper application layer); wherein, the maintenance management layer can be specifically used to monitor the health status of the target network system according to the simulation calculation results output by the data modeling layer; when an abnormality is detected in the health status of the target network system, an operation and maintenance strategy for the target network system is generated according to the simulation calculation results.
[0101] Based on the above embodiments, the maintenance management layer can be used to automatically monitor the health status of the target network system in real time or at regular intervals. When it is determined that there is an abnormality in the health status of the target network system, a corresponding operation and maintenance strategy can be automatically generated so that the abnormality can be eliminated in a timely manner based on the operation and maintenance strategy, thereby improving the stability and health of the target network system.
[0102] The maintenance management layer is specifically configured with at least a preset anomaly detection model and may also be configured with a preset policy set.
[0103] The aforementioned preset anomaly detection model can be specifically understood as a neural network model pre-trained using artificial intelligence technology, utilizing the target network system's historical maintenance records and a target operation and maintenance simulation model. This model can analyze and determine whether the network system is abnormal, as well as the specific type of anomaly, based on the input network system operation and maintenance simulation results. The aforementioned preset policy set can specifically include multiple preset template operation and maintenance policies; each preset template operation and maintenance policy corresponds to a specific anomaly type.
[0104] During specific implementation, the maintenance management layer can periodically call a preset anomaly detection model to process the system simulation results output by the data modeling layer for the entire target network system. The preset anomaly detection model can then be used to process the system simulation results to obtain the corresponding anomaly detection results. Based on the anomaly detection results, the system health status of the target network system is judged to be abnormal. If an abnormality is determined to be present, the anomaly type is further determined based on the anomaly detection results. The preset policy set is then retrieved to determine a preset template operation and maintenance policy that matches the anomaly type as the operation and maintenance policy for the target network system. This operation and maintenance policy can then be displayed to the user or executed within certain permissions to eliminate anomalies in the target network system. This effectively and automatically maintains the target network system for continued normal operation.
[0105] Before specific implementation, the historical operation and maintenance records of the target network system can be obtained, and the device parameters and sample device parameters of the relevant managed devices in the relevant target network system can be extracted from the historical operation and maintenance records; the target operation and maintenance simulation model is then used to process the sample device parameters to obtain the corresponding sample operation simulation results as sample data; according to the abnormal record information in the historical operation and maintenance records corresponding to the sample data, the sample data is labeled (including abnormality labeling and abnormality type labeling) to obtain labeled sample data; the labeled sample data is then used to train the initial classification model to obtain a preset anomaly detection model that meets the requirements.
[0106] Before specific implementation, the historical operation and maintenance records of the target network system can be obtained, and the historical operation and maintenance records with abnormalities in the abnormal record information can be filtered out from the historical operation and maintenance records to obtain abnormal historical operation and maintenance records, and the abnormal type of the abnormal historical operation and maintenance records can be determined based on the abnormal record information. Operation and maintenance operation records are extracted from the abnormal historical operation and maintenance records; and the operation and maintenance operation records are spliced with the abnormal type to obtain a sample abnormal operation record. In addition, considering that the proportion of real abnormal historical operation and maintenance records in the historical operation and maintenance records is relatively small, the remaining normal historical operation and maintenance records in the historical operation and maintenance records can be further modified and adjusted to obtain modified historical operation and maintenance records; then, the target operation and maintenance simulation model and the preset abnormality detection model are used to sequentially process the above-mentioned modified historical operation and maintenance records to filter out the historical operation and maintenance records with abnormalities as expanded abnormal operation and maintenance records, as well as the abnormal type of the expanded abnormal operation and maintenance records; then, based on the expanded abnormal operation and maintenance records and the corresponding abnormal type, expert experience is used to generate operation and maintenance operation records for the expanded abnormal operation and maintenance records; and the operation and maintenance operation records are spliced with the abnormal type to obtain the expanded abnormal operation record. The expanded abnormal operation records and the sample abnormal operation records are then mixed, and the mixed abnormal operation records are clustered to obtain a combination of multiple groups of abnormal operation steps corresponding to multiple different abnormal types, as corresponding multiple preset template operation and maintenance strategies; and then a preset strategy set is established.
[0107] In some embodiments, see Figure 3 As shown, the above-mentioned target operation and maintenance query questions that meet the requirements are extracted by processing the target operation and maintenance data query request according to the preset instantiation processing rules. When specifically implemented, the following contents may be included:
[0108] S1: Extract the initial question from the target operation and maintenance data query request according to the preset instantiation processing rules;
[0109] S2: Match the questions according to the preset reference question list and the initial question to obtain the corresponding matching results;
[0110] S3: Based on the matching results, if it is determined that the matching fails, semantic recognition is performed on the initial question to obtain a corresponding semantic recognition result;
[0111] S4: performing word segmentation processing on the semantic recognition result; and extracting question keywords based on the semantic recognition result after word segmentation processing;
[0112] S5: Based on the question keywords, multiple pending questions are obtained by querying the knowledge graph associated with the target network system;
[0113] S6: Filter out target operation and maintenance query questions that meet the requirements from the multiple pending questions.
[0114] Based on the above embodiment, the server can automatically and accurately extract from the target operation and maintenance data query request questions that the server can identify and can represent the user's operation and maintenance query demands in a standardized form as target operation and maintenance query questions that meet the requirements, so as to facilitate subsequent specific use and further data processing.
[0115] During specific implementation, the server may locate a specified question field in the target operation and maintenance data query request according to the format template of the query request, and then extract the initial question based on the question field.
[0116] Then, the initial question can be used to perform feature vector matching in a preset reference question list to obtain a corresponding matching result. The preset reference question list can specifically include multiple common reference questions that meet standard requirements.
[0117] According to the results, when it is determined that the match is successful, the reference question in the preset reference question list that matches the initial question is determined as the target operation and maintenance query question. On the contrary, when it is determined that the match fails, the initial question can be semantically recognized to obtain the corresponding semantic recognition result; through word segmentation processing, based on the semantic recognition result after word segmentation processing, combined with specific grammatical rules and keyword library, the required question keywords are extracted. Furthermore, based on the question keywords, combined with the preset reference question list, multiple pending questions can be obtained by querying the knowledge graph of the target network system. The feature distance between each pending question and the initial question is then calculated separately, and the pending question with the smallest feature distance is screened out as the target operation and maintenance query question that meets the requirements.
[0118] In some embodiments, after matching questions based on a preset reference question list and the initial question to obtain corresponding matching results, the method may further include the following when implemented:
[0119] According to the matching result, when it is determined that the matching is successful, a reference question that matches the initial question is determined from a preset reference question list as the target operation and maintenance query question.
[0120] Based on the above embodiment, a preset reference question list can be used to quickly determine target operation and maintenance query questions that meet the requirements through question matching.
[0121] In some embodiments, when it is determined that the target operation and maintenance query problem exists in the cache hot problem list of the current time period, the server can add the target operation and maintenance query problem to the target operation and maintenance data query request according to the preset routing rules; and then route the target operation and maintenance data query request carrying the target operation and maintenance query problem to the cache module. The cache module receives and responds to the target operation and maintenance data query request, retrieves the connected cache database according to the target operation and maintenance query problem carried, and finds the target operation and maintenance query result corresponding to the target operation and maintenance query problem in combination with the correspondence between the problems stored in the cache database and the simulation operation results, and returns the target operation and maintenance query result to the server. The server can then feed back the above-mentioned target operation and maintenance query result to the operation and maintenance terminal. Among them, the cache database can specifically include: an SQL database and a graph database. The above-mentioned SQL database is used to cache simulation operation results of structured format type, and the above-mentioned graph database is used to cache simulation operation results of unstructured format type.
[0122] In some embodiments, after detecting whether the target operation and maintenance query problem exists in the cache hot problem list of the current time period, the method may further include the following steps during implementation:
[0123] S1: When it is determined that the target operation and maintenance query question does not exist in the cache hot problem list of the current time period, the target operation and maintenance data query request carrying the target operation and maintenance query question is routed to the data modeling layer according to the preset routing rules, so as to call the target operation and maintenance simulation model to perform simulation calculation based on the target operation and maintenance query question;
[0124] S2: Obtain the target simulation calculation result output by the data modeling layer; and send the target simulation calculation result to the operation and maintenance terminal.
[0125] Based on the above embodiment, when it is determined that the target operation and maintenance query problem does not exist in the cache hot problem list of the current time period, it can be judged that the cache module has not previously cached the corresponding target simulation operation result; accordingly, the server can route the target operation and maintenance data query request carrying the target operation and maintenance query problem to the data modeling layer according to the preset routing rules, so as to call the target operation and maintenance simulation model online according to the target operation and maintenance query problem through the data modeling layer to perform relevant simulation operations, so as to obtain the target simulation operation result as the corresponding target operation and maintenance query result, and feed it back to the operation and maintenance terminal.
[0126] In some embodiments, see Figure 4 As shown, the above-mentioned calling target operation and maintenance simulation model performs simulation calculation based on the target operation and maintenance query problem. The specific implementation may include the following contents:
[0127] S1: According to the target operation and maintenance query question, determine the starting device, the ending device, and the associated devices by querying the knowledge graph associated with the target network system; wherein the associated devices include directly associated devices and / or indirectly associated devices;
[0128] S2: Obtain and use the link address of the starting device, the link address of the ending device, and the link address of the associated device to construct a target link address matrix;
[0129] S3: splitting the target link address matrix into multiple sub-link address matrices according to the attribute information of the device area;
[0130] S4: calling the target operation and maintenance simulation model to perform parallel simulation operations according to multiple sub-link address matrices to obtain multiple sub-simulation operation results;
[0131] S5: According to the attribute information of the device area, multiple sub-simulation operation results are combined to obtain the target simulation operation result.
[0132] Based on the above embodiment, the server can call the target operation and maintenance simulation model through the data modeling layer to perform online simulation calculations based on the target operation and maintenance query problem to obtain more accurate target simulation calculation results.
[0133] The link address may specifically be an IP address. Furthermore, when the target link address matrix is split into multiple sub-link address matrices, it may be possible to detect whether the amount of data contained in the sub-link address matrices is greater than the maximum tolerable amount of data during the current single run of the target operation and maintenance simulation model. If it is determined that the amount of data contained in the sub-link address matrix is greater than the maximum tolerable amount of data, the sub-link address matrix may be further split until the amount of data contained in the resulting sub-link address matrix is less than the maximum tolerable amount of data.
[0134] In specific implementation, the data modeling layer receives and responds to the target operation and maintenance query request, and determines the starting device and ending device associated with the problem based on the target operation and maintenance query question; further, the knowledge graph of the target network system can be queried to retrieve the nodes directly or indirectly connected to the node corresponding to the starting device and the node corresponding to the ending device through the connection edge, so as to determine the associated devices. Then, by querying the attribute information marked on the node in the knowledge graph, the link address of the starting device, the link address of the ending device, and the link address of the associated device can be quickly obtained; and based on the link address of the starting device, the link address of the ending device, the link address of the associated device, and the edge relationship between the devices, the corresponding target link address matrix is constructed; then, based on the attribute information of the device area, the target link address matrix is split into multiple sub-link address matrices; wherein, each sub-link address matrix corresponds to a device area; then, multiple threads can be started at the same time, and the target operation and maintenance simulation model can be called to synchronously perform parallel simulation operations based on multiple sub-link address matrices to quickly obtain multiple corresponding sub-simulation operation results; then, based on the attribute information of the device area, multiple sub-simulation operation results are combined to obtain a complete target simulation operation result. Therefore, the required target simulation results can be obtained more efficiently through computational simulation in a shorter time.
[0135] In some embodiments, after extracting a target operation and maintenance query question that meets the requirements by processing the target operation and maintenance data query request according to a preset instantiation processing rule, the method may further include the following when implemented:
[0136] The target operation and maintenance query question and the query time corresponding to the target operation and maintenance query question are recorded in the query log.
[0137] Based on the above embodiment, the subsequent server can accurately update the hot operation and maintenance issues according to the historical operation and maintenance query issues recorded in the query log.
[0138] In some embodiments, see Figure 5 As shown, when the method is implemented, it may also include the following contents:
[0139] S1: At preset time intervals, obtain the operation and maintenance query problem records of the current time period based on the query log;
[0140] S2: Based on the operation and maintenance query problem records, the query popularity value of the operation and maintenance query problems in the current time period is obtained;
[0141] S3: Filter out hot O&M issues in the current time period based on the query popularity of the O&M issues in the current time period;
[0142] S4: Based on the hot operation and maintenance issues in the current time period, the cache hot issue list of the previous time period is updated to obtain the cache hot issue list of the current time period.
[0143] Based on the above embodiment, the server can accurately determine the hot operation and maintenance issues in the current time period by counting and calculating the query heat values of the operation and maintenance query issues at preset time intervals, so as to update the cache hot issue list of the current time period with relatively good results and high reference value.
[0144] During specific implementation, the server can count the query frequency of operation and maintenance query problems in the current time period based on the operation and maintenance query problem records, and determine the problem type of the operation and maintenance query problem, as well as the equipment area involved; at the same time, the server will also collect error feedback in the current time period, and determine the weight parameters for different problem types and different equipment areas for the current time period based on the error feedback; and then perform weighted operations based on the query frequency of operation and maintenance query problems in the current time period, as well as the weight parameters of the problem type of the operation and maintenance query problem and the weight parameters of the equipment area involved, to obtain the corresponding weighted operation result as the query heat value of the operation and maintenance query problem.
[0145] During specific implementation, the server can query your bureau to arrange the operation and maintenance query issues in the current time period in descending order of popularity value, and filter out a preset number of operation and maintenance query issues with the highest ranking as the hot operation and maintenance issues in the current time period.
[0146] In some embodiments, see Figure 6 As shown, when the method is implemented, it may also include the following contents:
[0147] S1: Check whether the current idle time period meets the preset trigger conditions;
[0148] S2: When it is determined that the current idle time period meets the preset triggering conditions, the target operation and maintenance simulation model is called through the data modeling layer to process the unmarked hot issues in the cache hot issue list of the current time period;
[0149] S3: Obtain the simulation results for the hot issue output by the data modeling layer; and mark the hot issue accordingly in the cached hot issue list of the current time period;
[0150] S4: Send the simulation result of the hot issue to the cache module for caching.
[0151] Based on the above embodiment, the server can utilize the data processing resources in the idle time period through the introduced cache mechanism, and without affecting the normal business data processing of the target network system, call the target operation and maintenance simulation model through the data modeling layer to obtain in advance through simulation calculations the operation and maintenance query results corresponding to the hot operation and maintenance query issues in the current time period that subsequent users are likely to query, and cache them through the cache module, so that when the user queries related issues later, the corresponding operation and maintenance query results can be directly fed back to the user through the cache module.
[0152] The idle time period may be a non-working time period, for example, 11:00 pm to 2:00 am, etc. The unmarked hot issues may be understood as hot query issues for which the cache module has not cached the corresponding simulation results.
[0153] In specific implementation, the server can detect whether there is a business with a critical business tag in the target network system at the current time point in the idle time period in the execution state; when it is determined that the above business is not in the execution state, it is determined that the preset trigger condition is met.
[0154] In some embodiments, the cache module can be specifically connected to an SQL database and a graph database; wherein the SQL database is used to cache simulation operation results of structured data format type; and the graph database is used to cache simulation operation results of unstructured data format type.
[0155] Correspondingly, after receiving the simulation operation result, the cache module determines the data format type of the simulation operation result; and stores the simulation operation result in a matching database according to the data format type of the simulation operation result.
[0156] Based on the above embodiment, by introducing and utilizing two different cache databases to cache simulation operation results of different data format types respectively, the reading and writing efficiency of the simulation operation results in the cache database can be effectively improved, and the processing efficiency of subsequent queries to obtain corresponding simulation operation results can be further improved, further shortening the user's waiting time.
[0157] In some embodiments, after obtaining the target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module, refer to Figure 7 As shown, when the method is implemented, it may also include the following contents:
[0158] S1: Based on the target operation and maintenance query results, query the knowledge graph associated with the target network system to obtain target associated data related to the target operation and maintenance query results;
[0159] S2: Generate visual display data based on the target operation and maintenance query results and target related data;
[0160] S3: Send the visualized result display data to the operation and maintenance terminal.
[0161] Based on the above embodiment, the server can combine the knowledge graph of the target network system to convert the target operation and maintenance query results into corresponding visual result display data and feed it back to the operation and maintenance terminal, so that users can conveniently and intuitively understand the specific content involved in the target operation and maintenance query results, thereby improving the user's interactive experience.
[0162] During specific implementation, the server can use the knowledge graph of the target network system to obtain image data such as nodes, connection edges, etc. related to the target operation and maintenance query results as target related data; then, based on the target operation and maintenance query results and target related data, imitate the electronic map to construct corresponding visualization result display data.
[0163] Specifically, for example, for a query request for locating a faulty device, the generated visualization result display data may specifically include a knowledge graph of the local network system containing the faulty device; the faulty device and the cause of the fault are marked in the knowledge graph; further, the associated devices associated with the faulty device, as well as the connection edges involved in the faulty device and the associated devices, are marked in the knowledge graph, so that the user can accurately and efficiently determine the faulty device and the cause of the fault based on the above knowledge graph, and can also conveniently and meticulously sort out the affected device area range and the impact method caused by the faulty device based on the above faulty device; thus, the above faulty device and other devices within the affected device area can be better targeted for operation and maintenance repair to eliminate the fault.
[0164] As can be seen from the above, based on the method for processing operation and maintenance data provided in the embodiment of this specification, before specific implementation, the digital twin technology and knowledge graph technology can be comprehensively utilized to construct a dynamic operation and maintenance map for the target network system; wherein, the dynamic operation and maintenance map at least includes a data modeling layer and a data acquisition layer; the data acquisition layer is used to collect the device parameters of the managed devices in the target network system to be connected; the data modeling layer is used to use the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on the digital twin and the knowledge graph; wherein, the target operation and maintenance simulation model is associated with the knowledge graph of the target network system. Furthermore, the server will also regularly update the hot operation and maintenance query issues in the cached hot issue list of the current time period; and in the idle time period, without affecting the normal business data processing, the target operation and maintenance simulation model is called through the data modeling layer to perform simulation calculations in advance according to the hot operation and maintenance query issues of the current time period to obtain the corresponding operation and maintenance query results; then a cache mechanism is introduced to send the above operation and maintenance query results to the cache module for caching for subsequent use. In specific implementation, after receiving a target operation and maintenance data query request initiated by the operation and maintenance terminal based on the dynamic operation and maintenance map, the server can first extract the target operation and maintenance query question that meets the requirements according to the preset instantiation processing rules; then check whether the target operation and maintenance query question exists in the cache hot question list of the current time period; if so, according to the preset routing rules, the target operation and maintenance data query request carrying the target operation and maintenance query question is routed to the cache module for data query, so as to quickly find the corresponding target operation and maintenance query result from the cache database and feedback it to the operation and maintenance terminal. This can effectively determine and feedback the corresponding target operation and maintenance query result more efficiently and accurately, effectively reducing the user's waiting time.
[0165] This specification also provides a server, see Figure 8 The server includes a network communication port 801, a processor 802, and a memory 803, and the above structures are connected through internal cables so that each structure can perform specific data interaction.
[0166] The network communication port 801 can be specifically used to receive a target operation and maintenance data query request initiated by the operation and maintenance terminal based on a dynamic operation and maintenance map; wherein the dynamic operation and maintenance map is an operation and maintenance knowledge graph tool for the target network system; the dynamic operation and maintenance map includes at least a data acquisition layer and a data modeling layer; the data acquisition layer is used to collect device parameters of managed devices in the connected target network system; the data modeling layer is used to use the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on digital twins and knowledge graphs;
[0167] The processor 802 can be specifically used to extract the target operation and maintenance query problem that meets the requirements by processing the target operation and maintenance data query request according to the preset instantiation processing rules; detect whether the target operation and maintenance query problem exists in the cache hot problem list of the current time period; wherein the cache hot problem list of the current time period contains the hot operation and maintenance query problem of the current time period; the cache hot problem list of the current time period is associated with the cache module; the cache module is responsible for storing the operation and maintenance query results corresponding to the hot operation and maintenance query problem of the current time period; the operation and maintenance query result is obtained by calling and running the target operation and maintenance simulation model based on the hot operation and maintenance query problem of the current time period in the idle time period; when it is determined that the target operation and maintenance query problem exists in the cache hot problem list of the current time period, according to the preset routing rules, the target operation and maintenance data query request carrying the target operation and maintenance query problem is routed to the cache module for data query; obtain the target operation and maintenance query result corresponding to the target operation and maintenance query problem fed back by the cache module; and send the target operation and maintenance query result to the operation and maintenance terminal; wherein, the operation and maintenance terminal is the initiating terminal of the target operation and maintenance data query request;
[0168] The memory 803 may be specifically used to store corresponding instruction programs.
[0169] In this embodiment, the network communication port 801 can be a virtual port that is bound to different communication protocols, thereby being capable of sending or receiving different data. For example, the network communication port can be a port responsible for web data communication, a port responsible for FTP data communication, or a port responsible for email data communication. Furthermore, the network communication port can also be a physical communication interface or communication chip. For example, it can be a wireless mobile network communication chip, such as GSM or CDMA; it can also be a Wi-Fi chip; or it can be a Bluetooth chip.
[0170] In this embodiment, the processor 802 may be implemented in any suitable manner. For example, the processor may take the form of a microprocessor or a processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, an embedded microcontroller, etc. This specification is not intended to limit this.
[0171] In this embodiment, the memory 803 may include multiple levels. In a digital system, anything that can store binary data can be a memory. In an integrated circuit, a circuit with a storage function that has no physical form is also called a memory, such as RAM, FIFO, etc. In a system, a storage device with a physical form is also called a memory, such as a memory stick, TF card, etc.
[0172] The embodiment of this specification also provides a computer-readable storage medium based on the above-mentioned operation and maintenance data processing method, and the computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed, the following steps are implemented: receiving a target operation and maintenance data query request initiated by the operation and maintenance terminal based on a dynamic operation and maintenance map; wherein, the dynamic operation and maintenance map is an operation and maintenance knowledge graph tool for the target network system; the dynamic operation and maintenance map includes at least a data acquisition layer and a data modeling layer; the data acquisition layer is used to collect device parameters of the managed devices in the docked target network system; the data modeling layer is used to use the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on digital twins and knowledge graphs; according to preset instantiation processing rules, by processing the target operation and maintenance data query request, the target operation and maintenance query questions that meet the requirements are extracted; and the cache hot problem list for the current time period is detected. whether the target operation and maintenance query problem exists in the cache hot problem list of the current time period; wherein, the cache hot problem list of the current time period includes the hot operation and maintenance query problem of the current time period; the cache hot problem list of the current time period is associated with the cache module; the cache module is responsible for storing the operation and maintenance query results corresponding to the hot operation and maintenance query problem of the current time period; the operation and maintenance query results are obtained by calling and running the target operation and maintenance simulation model based on the hot operation and maintenance query problem of the current time period in the idle time period; when it is determined that the target operation and maintenance query problem exists in the cache hot problem list of the current time period, according to the preset routing rules, the target operation and maintenance data query request carrying the target operation and maintenance query problem is routed to the cache module for data query; the target operation and maintenance query result corresponding to the target operation and maintenance query problem fed back by the cache module is obtained; and the target operation and maintenance query result is sent to the operation and maintenance terminal; wherein, the operation and maintenance terminal is the initiating terminal of the target operation and maintenance data query request.
[0173] In this embodiment, the storage medium includes, but is not limited to, random access memory (RAM), read-only memory (ROM), cache, hard disk drive (HDD), or memory card. The memory can be used to store computer program instructions. The network communication unit can be an interface configured in accordance with the standards specified by the communication protocol for network connection communication.
[0174] In this embodiment, the functions and effects specifically implemented by the program instructions stored in the computer-readable storage medium can be explained in comparison with other implementations and will not be repeated here.
[0175] See Figure 9 As shown, at the software level, the embodiments of this specification further provide a device for processing operation and maintenance data, which may specifically include the following structural modules:
[0176] Receiving module 901 may be specifically configured to receive a target operation and maintenance data query request initiated by an operation and maintenance terminal based on a dynamic operation and maintenance map; wherein the dynamic operation and maintenance map is an operation and maintenance knowledge graph tool for a target network system; the dynamic operation and maintenance map comprises at least a data acquisition layer and a data modeling layer; the data acquisition layer is configured to acquire device parameters of managed devices in the connected target network system; the data modeling layer is configured to utilize the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on a digital twin and a knowledge graph;
[0177] The extraction module 902 may be specifically configured to process the target operation and maintenance data query request according to a preset instantiation processing rule to extract a target operation and maintenance query question that meets the requirements;
[0178] Detection module 903 may be specifically configured to detect whether the target operation and maintenance query problem exists in the cache hot problem list of the current time period; wherein the cache hot problem list of the current time period includes the hot operation and maintenance query problems of the current time period; the cache hot problem list of the current time period is associated with a cache module; the cache module is responsible for storing operation and maintenance query results corresponding to the hot operation and maintenance query problems of the current time period; the operation and maintenance query results are obtained by calling and running the target operation and maintenance simulation model based on the hot operation and maintenance query problems of the current time period during the idle time period of the server;
[0179] The routing module 904 may be specifically configured to, upon determining that the target operation and maintenance query question exists in the cache hotspot question list for the current time period, route the target operation and maintenance data query request carrying the target operation and maintenance query question to the cache module for data query according to a preset routing rule;
[0180] The feedback module 905 can be specifically used to obtain the target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module; and send the target operation and maintenance query result to the operation and maintenance terminal; wherein, the operation and maintenance terminal is the initiating terminal of the target operation and maintenance data query request.
[0181] In some embodiments, the dynamic operation and maintenance map may further include: a business function layer; wherein the business function layer is connected to the operation and maintenance terminal; the business function layer supports users to initiate operation and maintenance data query requests of various business types through the operation and maintenance terminal;
[0182] The operation and maintenance data query requests of the multiple business types include: a faulty equipment location query request, a connection path navigation query request, and a connection path road condition query request.
[0183] In some embodiments, the dynamic operation and maintenance map may further include: a maintenance management layer; wherein, the maintenance management layer is used to monitor the health status of the target network system based on the simulation calculation results output by the data modeling layer; when an abnormality is detected in the health status of the target network system, an operation and maintenance strategy for the target network system is generated based on the simulation calculation results.
[0184] In some embodiments, when the above-mentioned extraction module 902 is implemented, it can be implemented in the following manner according to preset instantiation processing rules, by processing the target operation and maintenance data query request, to extract the target operation and maintenance query question that meets the requirements: according to the preset instantiation processing rules, extract the initial question from the target operation and maintenance data query request; according to the preset reference question list and the initial question, perform question matching to obtain the corresponding matching result; according to the matching result, when it is determined that the match fails, perform semantic recognition on the initial question to obtain the corresponding semantic recognition result; perform word segmentation processing on the semantic recognition result; and based on the semantic recognition result after word segmentation processing, extract question keywords; according to the question keywords, obtain multiple pending questions by querying the knowledge graph associated with the target network system; and screen out the target operation and maintenance query question that meets the requirements from the multiple pending questions.
[0185] In some embodiments, after matching questions based on a preset reference question list and the initial question to obtain corresponding matching results, the device, when implemented, can also be used to: based on the matching results, when it is determined that the match is successful, determine a reference question that matches the initial question from the preset reference question list as the target operation and maintenance query question.
[0186] In some embodiments, after detecting whether the target operation and maintenance query problem exists in the cache hot spot problem list of the current time period, the device can also be used, when implemented specifically, to: when it is determined that the target operation and maintenance query problem does not exist in the cache hot spot problem list of the current time period, according to preset routing rules, route the target operation and maintenance data query request carrying the target operation and maintenance query problem to the data modeling layer to call the target operation and maintenance simulation model to perform simulation operations based on the target operation and maintenance query problem; obtain the target simulation operation results output by the data modeling layer; and send the target simulation operation results to the operation and maintenance terminal.
[0187] In some embodiments, when the device is implemented, the target operation and maintenance simulation model can be called to perform simulation operations based on the target operation and maintenance query problem in the following manner: according to the target operation and maintenance query problem, the starting device, the ending device, and the associated devices are determined by querying the knowledge graph associated with the target network system; wherein the associated devices include directly associated devices and / or indirectly associated devices; the link address of the starting device, the link address of the ending device, and the link address of the associated device are obtained and utilized to construct a target link address matrix; according to the attribute information of the device area, the target link address matrix is split into multiple sub-link address matrices; the target operation and maintenance simulation model is called to perform parallel simulation operations based on the multiple sub-link address matrices to obtain multiple sub-simulation operation results; according to the attribute information of the device area, the multiple sub-simulation operation results are combined to obtain the target simulation operation result.
[0188] In some embodiments, after extracting a target operation and maintenance query question that meets the requirements by processing the target operation and maintenance data query request according to a preset instantiation processing rule, the device can also be used to: record the target operation and maintenance query question and the query time corresponding to the target operation and maintenance query question into the query log when it is implemented.
[0189] In some embodiments, when the device is implemented, it can also be used to: obtain the operation and maintenance query problem records of the current time period based on the query log at every preset time interval; obtain the query heat value of the operation and maintenance query problem of the current time period based on the operation and maintenance query problem records; filter out the hot operation and maintenance problems of the current time period based on the query heat value of the operation and maintenance query problem of the current time period; update the cached hot problem list of the previous time period based on the hot operation and maintenance problems of the current time period, and obtain the cached hot problem list of the current time period.
[0190] In some embodiments, when the device is implemented, it can also be used to: detect whether the current idle time period meets the preset trigger conditions; when it is determined that the current idle time period meets the preset trigger conditions, call the target operation and maintenance simulation model through the data modeling layer to process the unmarked hot issues in the cache hot issue list of the current time period; obtain the simulation operation results for the hot issue output by the data modeling layer; and mark the hot issue accordingly in the cache hot issue list of the current time period; and send the simulation operation results of the hot issue to the cache module for caching.
[0191] In some embodiments, the cache module may be specifically connected to a SQL database and a graph database;
[0192] Accordingly, after receiving the simulation operation result, the cache module can determine the data format type of the simulation operation result; and store the simulation operation result in a matching database according to the data format type of the simulation operation result.
[0193] In some embodiments, after obtaining the target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module, the device can also be used, when implemented, to: query the knowledge graph associated with the target network system based on the target operation and maintenance query result, and obtain target association data related to the target operation and maintenance query result; generate visual result display data based on the target operation and maintenance query result and the target association data; and send the visual result display data to the operation and maintenance terminal.
[0194] It should be noted that the units, devices or modules described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. For the convenience of description, the above devices are described in terms of functions and are divided into various modules and described separately. Of course, when implementing this specification, the functions of each module can be implemented in the same or multiple software and / or hardware, or the module that implements the same function can be implemented by a combination of multiple sub-modules or sub-units. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0195] As can be seen from the above, the operation and maintenance data processing device provided in the embodiments of this specification can more efficiently and accurately determine and feedback the corresponding target operation and maintenance query results, effectively reducing the user's waiting time.
[0196] In a specific scenario example, the operation and maintenance data processing method provided in this specification can be applied to optimize and improve network simulation forwarding path query in system operation and maintenance scenarios. The specific implementation includes the following contents.
[0197] S1: Combine digital twin technology and dynamic operation and maintenance maps to build a simulation model (e.g., target operation and maintenance simulation model);
[0198] S2: Build a cache mechanism;
[0199] S3: Optimizes and improves the efficiency of simulated forwarding path queries based on the cache mechanism of S2.
[0200] For S1, refer to Figure 10 As shown, a dynamic operation and maintenance map can be an application tool based on the operation and maintenance knowledge graph. From an architectural perspective, it can be divided into a data collection layer (marked as 1), a data modeling layer (marked as 2), a core capability layer (e.g., a business function layer, marked as 3), and an upper application layer (e.g., a maintenance management layer, marked as 4). The data collection layer is responsible for accessing source data. To build a complete map for the IT infrastructure environment, it is necessary to collect data from different dimensions such as devices, networks, systems, cloud platforms, and applications (e.g., device parameters); the data modeling layer is responsible for integrating and pulling together the data into an operation and maintenance graph (e.g., a knowledge graph of the target network system); and further constructing a simulation model (e.g., a target operation and maintenance simulation model); the core capability layer refers to the digital map in life and builds capabilities such as "search and positioning", "route navigation", and "road condition display" on the operation and maintenance graph; the application layer serves specific business scenarios based on core capabilities.
[0201] Furthermore, the simulation model has been partially optimized. This model is based on network device configuration information, routing table entries, ARP entries, and MAC entries provided by the data collection layer. It is built using digital twin technology and uses mathematical methods to simulate real-world networks and network behavior. The optimization aims to improve the efficiency and coverage of the simulation model's output.
[0202] For S2, a cache mechanism is introduced, drawing on the idea of "trading space for time" to query hot issues (for example, hot query issues in the current time period) in full when the system is idle at night (for example, during the idle time period) for efficient use the next day. First, a problem identification module needs to be built. This module first implements hot issue statistics and second, routes queries. If the query matches a hot issue, it is routed to the cache library (for example, the cache module) to obtain the result; otherwise, it is routed to the simulation system for calculation. Secondly, a problem instantiation module needs to be built. This module implements the enumeration of all instances of hot issues based on the full data of the operation and maintenance map. For example, if the network forwarding path is a hot issue (the input of the issue is the IP addresses of two servers, and the output is the links of each network device through which the two servers communicate), the IP matrix should be enumerated and constructed in this module to cover all source and destination combinations, and the full IP address is obtained from the operation and maintenance map. Finally, the scheduled query module is triggered at night based on the enumeration of all instances, and queries the entire simulation model. Based on the data format of the query results, different results are saved in different databases. If the result is structured data, it is stored in a SQL database. If the result is unstructured data, it is stored in a graph database.
[0203] For S3, the efficiency of forwarding path queries is optimized. First, based on the server access information in the operation and maintenance map, the IP matrix constructed in S2 is simplified into a matrix from switch i to switch j. Second, based on the network area information in the operation and maintenance map, the matrix from switch i to switch j is split, and a sub-matrix (for example, a sub-link address matrix) is constructed for every n switches in each area, where n is limited by the number of devices that the simulation model can manage at one time. Finally, for areas with multiple sub-matrices, the simulation model is pulled up batch by batch to calculate the path from switch i to switch j. The results of S2 are stored in the design library and the results are saved and updated on a daily basis.
[0204] Furthermore, when providing external path query services, the saved results are combined with server access information to provide the service. This allows for fast, highly concurrent forwarding paths to be provided to upper-layer applications. For example, in fault location scenarios, paths between multiple pairs of server IP addresses can be retrieved simultaneously, eliminating the need for serial queries that can affect location efficiency or the problem of limited visibility when analyzing a single path. Furthermore, this overcomes the issue of a limited number of managed devices in the simulation model, enabling block-by-block (several areas at once) network queries to ensure that each query is within that block.
[0205] Based on the above scenario examples, the O&M data processing method presented in this manual has been verified. By combining dynamic maps with digital twin technology to simulate and model the network, accurate queries based on simulation calculations are achieved. The efficiency of simulation result queries is improved by introducing and building a caching mechanism. Furthermore, by employing relevant routing rules, network forwarding path query efficiency is optimized. This improves the query efficiency and device coverage of the simulation model when providing external services, thereby enhancing O&M efficiency and accuracy, and effectively predicting abnormal conditions such as failures.
[0206] Although this specification provides the method operation steps as described in the embodiments or flow charts, more or fewer operation steps may be included based on conventional or non-creative means. The order of steps listed in the embodiments is only one way of executing the order of many steps and does not represent the only execution order. When the device or client product in practice is executed, it can be executed in sequence or in parallel according to the method shown in the embodiments or the drawings (for example, a parallel processor or a multi-threaded processing environment, or even a distributed data processing environment). The term "comprise", "include" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, product or device including a series of elements includes not only those elements, but also includes other elements that are not explicitly listed, or also includes elements inherent to such process, method, product or device. In the absence of more restrictions, it is not excluded that there are other identical or equivalent elements in the process, method, product or device including the elements. Words such as first and second are used to represent names and do not represent any particular order.
[0207] Those skilled in the art will also appreciate that, in addition to implementing the controller in pure computer-readable program code, it is entirely possible to implement the same functionality by logically programming the method steps in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, embedded microcontrollers, and the like. Therefore, such a controller can be considered a hardware component, and the devices included therein for implementing various functions can also be considered structures within the hardware component. Alternatively, the devices for implementing various functions can be considered both software modules implementing the method and structures within the hardware component.
[0208] This specification may be described in the general context of computer-executable instructions, such as program modules, executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, classes, and the like that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communications network. In a distributed computing environment, program modules may be located in local and remote computer-readable storage media, including storage devices.
[0209] Although the present specification has been described through embodiments, those skilled in the art will appreciate that there are many modifications and variations to the present specification without departing from the spirit of the present specification. It is intended that the appended claims include these modifications and variations without departing from the spirit of the present specification.
Claims
1. A method for processing operation and maintenance data, characterized in that: Applicable to servers, including: Receive a target operation and maintenance data query request initiated by an operation and maintenance terminal based on a dynamic operation and maintenance map; wherein the dynamic operation and maintenance map is an operation and maintenance knowledge graph tool for the target network system; the dynamic operation and maintenance map includes at least a data acquisition layer and a data modeling layer; the data acquisition layer is used to collect device parameters of managed devices in the connected target network system; the data modeling layer is used to use the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on digital twins and knowledge graphs; According to the preset instantiation processing rules, by processing the target operation and maintenance data query request, a target operation and maintenance query question that meets the requirements is extracted; Detecting whether the target operation and maintenance query problem exists in the cache hot problem list of the current time period; wherein the cache hot problem list of the current time period includes the hot operation and maintenance query problems of the current time period; the cache hot problem list of the current time period is associated with a cache module; the cache module is responsible for storing the operation and maintenance query results corresponding to the hot operation and maintenance query problems of the current time period; the operation and maintenance query results are obtained by calling and running the target operation and maintenance simulation model based on the hot operation and maintenance query problems of the current time period during the idle time period of the server; If it is determined that the target operation and maintenance query problem exists in the cache hot problem list of the current time period, the target operation and maintenance data query request carrying the target operation and maintenance query problem is routed to the cache module for data query according to the preset routing rules; Obtain a target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module; and send the target operation and maintenance query result to the operation and maintenance terminal.
2. The method according to claim 1, characterized in that The dynamic operation and maintenance map further includes: a business function layer; wherein the business function layer is connected to the operation and maintenance terminal; the business function layer supports users to initiate operation and maintenance data query requests of various business types through the operation and maintenance terminal; The operation and maintenance data query requests of the multiple business types include: a faulty equipment location query request, a connection path navigation query request, and a connection path road condition query request.
3. The method according to claim 1, characterized in that The dynamic operation and maintenance map also includes: a maintenance management layer; wherein, the maintenance management layer is used to monitor the health status of the target network system based on the simulation calculation results output by the data modeling layer; when an abnormality is detected in the health status of the target network system, an operation and maintenance strategy for the target network system is generated based on the simulation calculation results.
4. The method according to claim 1, wherein According to the preset instantiation processing rules, by processing the target operation and maintenance data query request, the target operation and maintenance query question that meets the requirements is extracted, including: According to the preset instantiation processing rules, the initial question is extracted from the target operation and maintenance data query request; Match questions based on the preset reference question list and initial questions to obtain corresponding matching results; According to the matching results, if it is determined that the matching fails, semantic recognition is performed on the initial question to obtain the corresponding semantic recognition result; Performing word segmentation processing on the semantic recognition result; and extracting question keywords based on the semantic recognition result after word segmentation processing; Based on the question keywords, multiple pending questions are obtained by querying the knowledge graph associated with the target network system; From the multiple pending questions, select target operation and maintenance query questions that meet the requirements.
5. The method according to claim 4, characterized in that After matching questions based on the preset reference question list and the initial question to obtain corresponding matching results, the method further includes: According to the matching result, when it is determined that the matching is successful, a reference question that matches the initial question is determined from a preset reference question list as the target operation and maintenance query question.
6. The method according to claim 4, characterized in that After detecting whether the target operation and maintenance query problem exists in the cache hot problem list of the current time period, the method further includes: If it is determined that the target operation and maintenance query question does not exist in the cache hot problem list of the current time period, the target operation and maintenance data query request carrying the target operation and maintenance query question is routed to the data modeling layer according to the preset routing rules, so as to call the target operation and maintenance simulation model to perform simulation calculation based on the target operation and maintenance query question; Obtain the target simulation operation result output by the data modeling layer; and send the target simulation operation result to the operation and maintenance terminal.
7. The method according to claim 6, characterized in that Call the target operation and maintenance simulation model to perform simulation operations based on the target operation and maintenance query problem, including: According to the target operation and maintenance query question, the starting device, the ending device, and the associated devices are determined by querying the knowledge graph associated with the target network system; wherein the associated devices include directly associated devices and / or indirectly associated devices; Obtain and use the link address of the starting device, the link address of the ending device, and the link address of the associated device to construct a target link address matrix; Splitting the target link address matrix into a plurality of sub-link address matrices according to the attribute information of the device area; Calling the target operation and maintenance simulation model to perform parallel simulation operations according to multiple sub-link address matrices to obtain multiple sub-simulation operation results; According to the attribute information of the device area, multiple sub-simulation operation results are combined to obtain the target simulation operation result.
8. The method according to claim 1, characterized in that After extracting a target operation and maintenance query question that meets the requirements by processing the target operation and maintenance data query request according to a preset instantiation processing rule, the method further includes: The target operation and maintenance query question and the query time corresponding to the target operation and maintenance query question are recorded in the query log.
9. The method according to claim 8, characterized in that The method further comprises: At preset time intervals, obtain operation and maintenance query problem records for the current time period based on the query log; Based on the operation and maintenance query problem records, the query popularity value of the operation and maintenance query problems in the current time period is obtained; Filter out hot O&M issues in the current time period based on the query popularity of the O&M issues in the current time period; According to the hot operation and maintenance issues in the current time period, the cache hot issue list of the previous time period is updated to obtain the cache hot issue list of the current time period.
10. The method according to claim 9, characterized in that The method further comprises: Check whether the current idle time period meets the preset trigger conditions; When it is determined that the current idle time period meets the preset trigger conditions, the target operation and maintenance simulation model is called through the data modeling layer to process the unmarked hot issues in the cache hot issue list of the current time period; Obtain the simulation results for the hot issue output by the data modeling layer; and mark the hot issue accordingly in the cached hot issue list of the current time period; The simulation results of the hot issue are sent to the cache module for caching.
11. The method according to claim 10, characterized in that The cache module is connected to the SQL database and the graph database; Correspondingly, after receiving the simulation operation result, the cache module determines the data format type of the simulation operation result; and stores the simulation operation result in a matching database according to the data format type of the simulation operation result.
12. The method according to claim 1, characterized in that After obtaining the target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module, the method further includes: According to the target operation and maintenance query results, query the knowledge graph associated with the target network system to obtain target related data related to the target operation and maintenance query results; Generate visual display data based on target operation and maintenance query results and target-related data; The visual result display data is sent to the operation and maintenance terminal.
13. A device for processing operation and maintenance data, characterized in that: include: A receiving module is configured to receive a target operation and maintenance data query request initiated by an operation and maintenance terminal based on a dynamic operation and maintenance map; wherein the dynamic operation and maintenance map is an operation and maintenance knowledge graph tool for the target network system; the dynamic operation and maintenance map comprises at least a data acquisition layer and a data modeling layer; the data acquisition layer is configured to acquire device parameters of managed devices in the connected target network system; the data modeling layer is configured to utilize the device parameters of the managed devices to construct a target operation and maintenance simulation model for the target network system based on the digital twin and the knowledge graph; An extraction module is used to extract target operation and maintenance query questions that meet the requirements by processing the target operation and maintenance data query request according to preset instantiation processing rules; A detection module is configured to detect whether the target operation and maintenance query problem exists in a cache hot problem list of the current time period; wherein the cache hot problem list of the current time period includes the hot operation and maintenance query problems of the current time period; the cache hot problem list of the current time period is associated with a cache module; the cache module is responsible for storing operation and maintenance query results corresponding to the hot operation and maintenance query problems of the current time period; the operation and maintenance query results are obtained by calling and running a target operation and maintenance simulation model based on the hot operation and maintenance query problems of the current time period during an idle time period by the server; The routing module is used to route the target operation and maintenance data query request carrying the target operation and maintenance query question to the cache module for data query according to the preset routing rules when it is determined that the target operation and maintenance query question exists in the cache hot problem list of the current time period; The feedback module is used to obtain the target operation and maintenance query result corresponding to the target operation and maintenance query question fed back by the cache module; and send the target operation and maintenance query result to the operation and maintenance terminal.
14. A server, characterized in that: The method comprises a processor and a memory for storing processor-executable instructions, wherein the processor implements the steps of the method according to any one of claims 1 to 12 when executing the instructions.
15. A computer-readable storage medium, characterized in that Computer instructions are stored thereon, and when the instructions are executed by a processor, the steps of the method according to any one of claims 1 to 12 are implemented.
Citation Information
Patent Citations
ICT system fault analysis and auxiliary research and judgment test case automatic generation method and device
CN112131096A
System maintenance method and device and server
CN114924936A