Knowledge graph construction method for log data

A technology of knowledge graph and construction method, applied in relational database, database model, visual data mining, etc., can solve the problems of not being able to automatically view, unable to view operation and maintenance data, etc.

Active Publication Date: 2021-03-30
XIAN UNIV OF POSTS & TELECOMM +1
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the prior art, for abnormal operation and maintenance data, the intelligence cannot be automatically checked through manual inspection, and at the same time, it is impossible to view the associated operation and maintenance data that may have abnormalities. Therefore, how to establish a knowledge map to realize the representation The entity of operation and maintenance data and the relationship between operation and maintenance data have become technical problems that need to be solved at present

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Knowledge graph construction method for log data
  • Knowledge graph construction method for log data
  • Knowledge graph construction method for log data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0085] Such as Figure 1A as shown, Figure 1A It shows a schematic flowchart of a method for constructing a knowledge map of log data provided by an embodiment of the present invention. The execution subject of the method of this embodiment can be any electronic device or computer. The method of this embodiment may include:

[0086] S1. Obtain log data within a specified time window;

[0087] S2. Preprocessing the log data, and building a template tree according to a template tree building strategy.

[0088] For example, this step may include the following sub-steps:

[0089] S2-1. For each piece of log data, the unstructured data corresponding to the text content in the log data can be converted into structured text data;

[0090] S2-2. For all structured text data, use delimiters to perform word segmentation;

[0091] S2-3. For the text data processed by word segmentation, adopt a template tree establishment strategy to establish a template tree;

[0092] Among them, the...

Embodiment 2

[0107] to combine Figure 1A to Figure 6The content shown is a detailed description of the construction process of the above knowledge map. In this embodiment, the executor can be any electronic device, and the electronic device can obtain the log data within a specified time window through the data interface to obtain the internal data platform of the business, clean the text content in the log data, and remove stop words , to obtain structured text data / text log data, and establish a template tree for extracting log templates, and then obtain log templates, extract entity and relationship information based on log templates, and obtain triplet data for hybrid storage With time series data, the final knowledge map is obtained. That is, use the graph database and step-by-step database to realize the mixed storage mode of triple data and time series data, and the intermediate results are stored in the relational database.

[0108] In particular, the acquired log data includes ...

Embodiment 3

[0196] Figure 6 It is the flow chart of building the operation and maintenance log data knowledge map provided by the embodiment of the present invention, such as Figure 6 As shown, it includes a data preprocessing analysis module (ie, pre-analysis), an ontology building module (ie, a pattern layer module), an entity extraction module, and a relationship extraction module (ie, a knowledge extraction module). The embodiment of the present invention can be divided into two parts, the first part is the construction of the knowledge graph of the log data, and the second part is the visualization application of the knowledge graph, and the two parts will be described below.

[0197] 1) Knowledge map construction of log data

[0198] Data preprocessing analysis module: According to the position, the information of the log content column is obtained, and all the log templates are extracted after word segmentation and data cleaning, and the concepts and relationships in the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a knowledge graph construction method for log data. The knowledge graph construction method comprises the following steps: S1, acquiring log data in a specified time window; S2, preprocessing the log data, and converting the log data into structured log data; establishing a template tree according to the template tree establishment strategy; S3, acquiring a log template based on the established template tree; S4, based on the structured log data and the log template, carrying out entity and relationship extraction, acquiring multiple pieces of triple data used for output, wherein the triple data is data in the form of 'entity-relationship-entity '; and S5, fusing the plurality of triple data according to a time sequence to obtain a knowledge graph of the log data. The unstructured text data can be converted into the structured data, the operation and maintenance log knowledge graph is constructed, and visual services with different functions are provided for theentity information of the business from different latitudes around the entity information in the knowledge graph.

Description

technical field [0001] The invention relates to the technical field of information processing, in particular to a method for constructing a log data knowledge map. Background technique [0002] With the popularization of the Internet and the rapid growth of data volume, there is more and more information, and people have higher and higher requirements for the quality and accuracy of information query. The log system is a very important part of the operation and maintenance work. It records all the behaviors of the system and the operator, and at the same time records its operations according to a certain specification of the developer. [0003] However, in the prior art, for abnormal operation and maintenance data, the intelligence cannot be automatically checked through manual inspection, and at the same time, it is impossible to view the associated operation and maintenance data that may have abnormalities. Therefore, how to establish a knowledge graph to realize the repre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/28G06F16/26G06F16/215G06F40/186G06N20/00
CPCG06F16/288G06F16/26G06F16/215G06F40/186G06N20/00Y02D10/00
Inventor 李晓戈邱连涛胡飞雄胡立坤于智洋张东
Owner XIAN UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap