Potential hot content identification method based on mainstream value vertical domain knowledge base

Abstract

The present invention relates to the field of deep learning technology, and discloses a method for identifying potential hot content based on a mainstream value vertical category domain knowledge base, including: constructing a mainstream value vertical category domain knowledge base, performing topic modeling and extracting potential subject words through an implicit Dirichlet distribution model, and extracting event triples through a RoBERTa‑CRF model and constructing an event graph; retrieving nodes related to hot spots from the event graph through a graph retrieval engine, and converting the subgraph composed of related nodes into a vector representation through a graph embedding technology to form a hot spot pattern; by calculating the Jaccard similarity, matching content features similar to the hot spot pattern in a fusion graph representation network to identify potential hot content. The present invention can enhance the real-time monitoring and prediction capabilities of social hot trends by accurately identifying and screening positively reinforced information content through technologies such as topic modeling, event extraction, graph retrieval, and similarity calculation.

Description

Technical Field

[0001] The present invention relates to the field of deep learning technology, and in particular to a method for identifying potential hot content based on a mainstream value vertical field knowledge base. Background Art

[0002] The hot information contained in the knowledge base of mainstream value vertical categories is of great value for understanding the focus of public attention, guiding public opinion, and formulating relevant policies. However, faced with massive amounts of data and information, how to effectively mine content with potential hot value from these data has become a huge challenge. The rise of social media and the popularization of the Internet have made information dissemination faster, but it has also brought about the problem of information overload, making it difficult to quickly identify truly important hot spots from a large amount of information. In addition, with the increasing complexity and diversity of social events, traditional information processing methods have been unable to meet the needs of modern society for information screening and prediction. Therefore, developing a method that can accurately discover potential hot content from the knowledge base of mainstream value vertical categories is of great significance for improving information processing efficiency, optimizing decision support systems, strengthening public safety, and enhancing social governance capabilities.

[0003] Traditional methods for discovering potential hot content mainly rely on techniques such as keyword matching and frequency statistics, which are effective in dealing with simple and intuitive hot content discovery tasks. However, in the face of complex text data and deep semantic information, these traditional methods are powerless. They often cannot effectively handle the long-tail effect in the text, that is, information that appears less frequently but has important value. In addition, traditional methods also lack sufficient flexibility and adaptability when dealing with emerging topics and rapidly changing hot topics. These methods are usually unable to deeply understand the context and topic structure of the text, resulting in large errors in the prediction and discovery of hot content. At the same time, they also have difficulty dealing with the multimodal characteristics of information, such as text, images, and videos, which limits their application capabilities in an all-media environment. Therefore, there is an urgent need for a new method that can overcome these shortcomings and achieve accurate discovery and prediction of potential hot content. Summary of the invention

[0004] In order to solve the above problems, the present invention proposes a method for identifying potential hot content based on the mainstream value vertical field knowledge base. The mainstream value vertical field knowledge base is used to perform topic modeling through LDA to extract keyword, and the RoBERTa-CRF model is used to extract event triplets to construct an event graph. Combined with graph embedding technology and Jaccard similarity calculation, it can accurately identify and screen positively reinforced information content, effectively improving the real-time monitoring and prediction capabilities of social hot trends.

[0005] The technical solution adopted by the present invention is as follows:

[0006] The potential hot content identification method based on the knowledge base of mainstream value vertical categories includes:

[0007] Build a knowledge base in the mainstream vertical domain, perform topic modeling and extract potential keywords through the latent Dirichlet distribution model, and extract event triplets and build an event graph through the RoBERTa-CRF model;

[0008] Retrieve nodes related to hot spots from the event graph through the graph retrieval engine, and convert the subgraph composed of related nodes into vector representation through graph embedding technology to form a hot spot model;

[0009] By calculating the Jaccard similarity, content features similar to the hotspot pattern are matched in the fusion graph representation network to identify potential hotspot content.

[0010] Furthermore, the topic modeling is performed through the latent Dirichlet distribution model to extract potential topic words, and the event triples are extracted through the RoBERTa-CRF model to construct an event graph, including:

[0011] Preprocess the text data in the mainstream value vertical domain knowledge base, input the preprocessed text data into the latent Dirichlet distribution model, train to obtain the topic distribution and topic word set, and thus extract potential topic words;

[0012] Based on the RoBERTa-CRF model, the deep semantic information in the text and the complex relationship between entities are captured through the pre-trained language representation capability of the RoBERTa layer, and the relationship between entities is predicted through the CRF layer to generate event triples, wherein the event triples include subject, predicate and object;

[0013] The event triples are mapped into a graph structure, with the subject and object in the event triples as nodes in the graph and the predicate as the edge connecting the nodes; the relationship between multiple event triples is explicitly represented in the graph to form an overall network structure.

[0014] Furthermore, the graph retrieval engine retrieves nodes related to hot spots from the event graph, and converts the subgraph composed of related nodes into a vector representation through graph embedding technology to form a hot spot model, including:

[0015] Input keywords related to hot topics through the graph search engine to locate nodes in the event graph that match the hot topic words; the retrieved nodes include the main nodes of the hot events and their associated context information;

[0016] The hotspot-related subgraphs are converted into vector representations through graph embedding technology. The graph embedding technology maps the nodes and edges in the event graph into a high-dimensional vector space by learning the neighborhood relationships and graph topology features of the nodes in the graph structure.

[0017] Furthermore, the topic modeling and extraction of potential topic words by using the implicit Dirichlet distribution model include:

[0018] For each document Select a topic distribution , for each word in the document , first select a topic from the topic distribution of the document , and then select words from the word distribution corresponding to the topic ;in, Is the theme The word distribution of is a dimensional vector, is the number of topics; is a dimensional vector, is the size of the vocabulary;

[0019] In mathematical expression, given Topics and documents ,document The generation probability of the word for:

[0020]

[0021] in, Indicated in the topic Next word The probability of Representation Document Medium Theme The probability of is a topic-word distribution, is a document-topic distribution, Representation Document The number of words in .

[0022] Furthermore, the extracting of event triples by the RoBERTa-CRF model includes:

[0023] Through the RoBERTa layer to input text Encode and get the vector representation of each word ;

[0024] Learning the sequence probability of word labels based on vector representation through CRF layer ,in is a label sequence, and the CRF layer maximizes the conditional probability To predict the optimal label sequence for each word:

[0025]

[0026] in, is the normalization factor, is the weight of the transferred feature, is the label of the i−1th word, is the label of the i-th word, Indicates the index of the tag; is an exponential function, is the length of the word sequence, is the number of label types;

[0027] Event triples are constructed based on the output label sequence, thereby accurately extracting event information from the text.

[0028] Furthermore, the constructing of the event graph includes:

[0029] The event triples are converted into event graphs, and the association relationship of events is represented by a graph structure; the subject and object in the event triples are used as nodes in the graph, and the predicate is used as the edge connecting the nodes:

[0030]

[0031] in, Represents the event graph, is a collection of nodes, is the edge set;

[0032] Each entity pair in the event triple By predicate Connected, expressions include:

[0033]

[0034] Where R is the set of all possible predicate relations.

[0035] Furthermore, the subgraph composed of related nodes is converted into a vector representation by using a graph embedding technology to form a hotspot pattern, including:

[0036] For each node , generate a fixed-length node sequence through a random walk method , as the contextual relationship of the event graph, where is the walk length;

[0037] The node sequence is analyzed by Skip-Gram model Perform embedding learning to maximize the co-occurrence probability between a node and its context:

[0038]

[0039] in, Is a node The context node set of Is a node Generate context node probability.

[0040] Furthermore, the transition probability of the random walk method is:

[0041]

[0042] in, Is a node arrive The transfer weight, is a normalization constant; the Node2Vec model introduces two hyperparameters and Control the depth-first and breadth-first tendencies of the walk so that the transfer weight Defined as:

[0043]

[0044] in, Representation Node and Shortest path distance in a graph; hyperparameters Control the probability of returning a node, a hyperparameter Control the probability of exploring new nodes to achieve a balanced modeling of the local and global structures of the graph.

[0045] Furthermore, the node Generate context node Probability , expressed using the Softmax function:

[0046]

[0047] in, Representation Node and The dot product of the embedding vector is used to measure the similarity; if negative sampling is used for optimization, the objective function is approximated as:

[0048]

[0049] in, is a Sigmoid function, and ; is the negative sampling distribution, is the number of negative samples; represents the mathematical expectation operation, is a negative sampling distribution The elements sampled from ;

[0050] After training, each node The embedding vector That is its representation in d-dimensional vector space; for the entire subgraph , can generate the overall vector representation of the subgraph by aggregating the embedding vectors of all its nodes, and the aggregation methods include averaging, weighted summation and graph pooling-based methods; finally, the subgraph vector It is expressed as:

[0051]

[0052] in, Is an aggregate function.

[0053] Furthermore, the Jaccard similarity is calculated to match content features similar to the hotspot pattern in the fusion graph representation network to identify potential hotspot content, including:

[0054] The Jaccard similarity is used to calculate the similarity between the subgraph vector and the fusion graph to represent other content features in the network. This is achieved by comparing the ratio of the intersection and union of the two sets. The calculation formula of the Jaccard similarity is:

[0055]

[0056] in, and Represents two sets, Is a collection and The number of elements in the intersection, and Is a collection and The number of elements in the union; the value range of Jaccard similarity is between 0 and 1, and the larger the value, the higher the similarity between the two sets;

[0057] Based on the event graph, each subgraph is represented as a feature set, which contains the attributes of the nodes, the types of the edges, and the related graph information. The similarity between the subgraphs is quantified by calculating the Jaccard similarity of these feature sets.

[0058] The beneficial effects of the present invention are:

[0059] 1. This invention proposes a method to effectively improve the accuracy and professionalism of potential hot content discovery by combining the LDA topic model and the domain knowledge base. This method can deeply explore the deep topics in a specific field, use the professional knowledge and terminology in the domain knowledge base, and provide the model with rich contextual information, so that it can be more professional when processing texts in a specific field, especially in application scenarios that require in-depth professional knowledge. This improvement in professionalism is crucial for the accurate identification of information.

[0060] 2. The present invention introduces novel considerations for real-time monitoring and prediction of social hot spot trends, directly addressing the dynamic and complex issues of information dissemination. By constructing an event graph and using a graph retrieval engine, the present invention can capture the relationship and dynamic changes between events in real time, quickly retrieve nodes related to hot spots, and thus achieve real-time monitoring and prediction of social hot spot trends, greatly improving the response speed to social changes and trends.

[0061] 3. The present invention is of great significance for the optimization of information content screening and positive reinforcement. By using the RoBERTa-CRF model to extract event triplets, construct an event graph, and use graph embedding technology and Jaccard similarity calculation, the present invention can accurately identify and screen positively reinforced information content. This screening mechanism helps to filter out irrelevant or negative information, ensure the quality and value of information content, and at the same time improve the model's ability to identify positive information content. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 This is a flow chart of a method for identifying potential hot content based on a mainstream value vertical field knowledge base in Example 1 of the present invention.

[0063] Figure 2 It is an architecture diagram of a series of technologies for identifying abnormal and hot content features in Example 2 of the present invention. DETAILED DESCRIPTION

[0064] In order to have a clearer understanding of the technical features, purposes and effects of the present invention, the specific implementation methods of the present invention are now described. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention, that is, the embodiments described are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present invention.

[0065] The relevant terms involved in the present invention are explained as follows:

[0066] LDA model (Latent Dirichlet Allocation Model): It is an unsupervised topic modeling method that can represent large-scale text data as a probability distribution of multiple topics. It identifies implicit topics in the text through topic decomposition and extracts keywords for each topic. Its theoretical basis can be found in the literature [Blei, DM, Ng, AY,&Jordan, MI (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993-1022.].

[0067] Graph Embedding: It is a method of mapping graph data into low-dimensional vectors, which can capture the topological structure of the graph and the relationship between nodes. Specifically, the core idea of ​​graph embedding technology is to convert the graph structure into a representation in the vector space, with the goal of retaining the information of the nodes and edges of the original graph as much as possible in the low-dimensional space, so as to facilitate subsequent tasks such as node classification, link prediction, and clustering. Its theoretical basis can be found in the literature [Grover, A., & Leskovec, J. (2016). node2vec: Scalable Feature Learning for Networks. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and DataMining.].

[0068] Event Knowledge Graph: A graph structure built based on event triples, where nodes represent event entities and edges represent relationships between entities. Its theoretical basis can be found in the literature [Paulheim, H. (2017). Knowledge Graph Refinement: A Survey of Approaches and Evaluation Methods. Semantic Web, 8(3), 489-508.].

[0069] Fusion Graph Representation Network: A graph neural network technology that fuses features of multiple graph structures to extract global and local representations of content. Its theoretical basis can be found in the literature [Grover, A., & Leskovec, J. (2016). node2vec: Scalable Feature Learning for Networks. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.].

[0070] Example 1

[0071] At present, the potential hot content discovery aims to predict and discover information that may arouse widespread public attention or discussion from a large amount of information, so as to respond to social hot spots in a timely manner, optimize content recommendations, or conduct effective information monitoring and management. The difficulty lies in accurately extracting features from massive and complex data, effectively clustering, and updating hot information in real time. It is also necessary to consider the authenticity verification of information and the polarization of public opinion.

[0072] This embodiment provides a method for identifying potential hot content based on a mainstream value vertical field knowledge base. It comprehensively utilizes technologies such as topic modeling, event extraction, graph retrieval and similarity calculation to discover potential hot content in the vertical field knowledge base, and can achieve real-time monitoring of social hot trends and improve the ability to predict them.

[0073] like Figure 1 As shown, the potential hot content identification method based on the mainstream value vertical category knowledge base in this embodiment includes:

[0074] Build a knowledge base in the mainstream vertical domain, perform topic modeling and extract potential keywords through the latent Dirichlet distribution model, and extract event triplets and build an event graph through the RoBERTa-CRF model;

[0075] Retrieve nodes related to hot spots from the event graph through the graph retrieval engine, and convert the subgraph composed of related nodes into vector representation through graph embedding technology to form a hot spot model;

[0076] By calculating the Jaccard similarity, content features similar to the hotspot pattern are matched in the fusion graph representation network to identify potential hotspot content.

[0077] Preferably, topic modeling is performed through a latent Dirichlet distribution model to extract potential topic words, and event triplets are extracted through a RoBERTa-CRF model to construct an event graph, including:

[0078] Preprocess the text data in the mainstream value vertical domain knowledge base, input the preprocessed text data into the latent Dirichlet distribution model, train to obtain the topic distribution and topic word set, and thus extract potential topic words;

[0079] Based on the RoBERTa-CRF model, the pre-trained language representation capability of the RoBERTa layer is used to capture the deep semantic information in the text and the complex relationship between entities. The CRF layer is used to predict the relationship between entities and generate event triples. The event triples include subject, predicate and object.

[0080] The event triples are mapped into a graph structure, with the subject and object in the event triples as nodes in the graph and the predicate as the edge connecting the nodes; the relationship between multiple event triples is explicitly represented in the graph to form an overall network structure.

[0081] Preferably, nodes related to hot spots are retrieved from the event graph by a graph retrieval engine, and the subgraph composed of related nodes is converted into a vector representation by a graph embedding technology to form a hot spot model, including:

[0082] Input keywords related to hot topics through the graph search engine to locate nodes in the event graph that match the hot topic words; the retrieved nodes include the main nodes of the hot events and their associated context information;

[0083] The hotspot-related subgraphs are converted into vector representations through graph embedding technology. Graph embedding technology maps the nodes and edges in the event graph into a high-dimensional vector space by learning the neighborhood relationships and graph topology features of the nodes in the graph structure.

[0084] Specifically, the potential hot content identification method based on the mainstream value vertical category knowledge base in this embodiment can be implemented by the following steps:

[0085] S1, Construction of mainstream value vertical knowledge base: In order to prevent the risks of generative AI in ideological security and political security, mainstream value corpus support is needed. The knowledge base is divided into basic corpus and question-and-answer corpus. The basic corpus includes authoritative data sets such as hundreds of millions of speech and comment data, national laws and regulations data, national public opinion data, and media cases; the question-and-answer corpus includes 120,000 pairs of major sensitive issues and hot issues that netizens are concerned about. Through the combination of man and machine, a variety of question-and-answer data is formed to meet the corpus requirements of generative AI in pre-training, fine-tuning, reinforcement learning and other tasks.

[0086] S2, Topic Modeling: Use the LDA model to perform topic modeling on the text in the knowledge base. First, preprocess the text data, including removing stop words, word segmentation, and word frequency statistics. Then input the preprocessed text into the LDA model and train it to obtain the topic distribution and topic word set. Each topic is represented by a set of high-frequency words, which are potential topic words.

[0087] S3, event triple extraction: Based on the extracted keywords, the RoBERTa-CRF model is used to extract event triples from the text. The model captures the deep semantic information in the text and the complex relationship between entities through the pre-trained language representation capability of RoBERTa. The CRF layer predicts the relationship between entities (such as subject, predicate, and object related to keywords) and generates event triples (subject, predicate, object). Based on sequence labeling, the CRF layer further optimizes the order of entity and relationship labels to ensure the grammatical and semantic consistency of the extracted event triples.

[0088] S4, Event Graph Construction: The event graph is constructed by mapping event triples into a graph structure, with the "subject" and "object" in the triples as nodes in the graph and the "predicate" as the edge connecting these nodes. In this way, the relationship between multiple triples is explicitly represented in the graph, forming an overall network structure.

[0089] S5, hotspot related node retrieval: through the graph retrieval engine (such as the Neo4j engine based on the Cypher query language), enter the keywords related to the hotspot and locate the nodes in the event graph that match the hotspot keywords. The retrieved nodes include the main node of the hotspot event and its associated contextual information (such as other related events, relationships or child nodes).

[0090] S6, subgraph vectorization: Use graph embedding technology (such as Node2Vec or GraphSAGE) to convert the hotspot related subgraph into a vector representation. Graph embedding technology maps the nodes and edges in the graph into a high-dimensional vector space by learning the neighborhood relationship and graph topology features of the nodes in the graph structure. After subgraph vectorization, each hotspot subgraph can be represented by a specific vector.

[0091] S7, potential hot content matching: match the subgraph vector with the content features of the fusion graph representation network, and measure the similarity between the two by calculating the Jaccard similarity. Jaccard similarity is a metric for measuring the similarity of a set, which is suitable for comparing subgraph features. Through similarity calculation, potential hot content similar to the current hot pattern is identified.

[0092] Among them, the purpose of step S1 is to prevent the risks of generative AI in ideological security and political security, and at the same time provide mainstream value corpus support for generative AI to meet its corpus needs in pre-training, fine-tuning, reinforcement learning and other tasks. Specific practices include collecting and integrating basic corpora from authoritative sources, such as People's Daily, speech and commentary, laws and regulations, public opinion data and media cases, etc., to form a large-scale corpus. In addition, through the combination of man and machine, major sensitive issues and hot issues of concern to netizens are covered to form a diverse question and answer corpus. The collection and processing of these corpora help generative AI to follow the mainstream value orientation when processing texts, ensure the comprehensiveness, accuracy and correctness of the content, so as to achieve the safety, standardization and sustainable development of generative AI under the framework of full network mobilization, scientific professionalism and man-machine integration.

[0093] The purpose of step S2 is to structure the text content in the knowledge base, identify the implicit topics in the text through topic decomposition, and extract the keywords of each topic. These keywords will provide semantic guidance for the subsequent event triple extraction, ensuring that the model focuses on content related to hot spots. First, for each document Select a topic distribution , then for each word in the document , first select a topic from the topic distribution of the document , and then select words from the word distribution corresponding to the topic ,in Is the theme The word distribution of . is a dimensional vector( is the number of topics), the value of each dimension determines the prior probability of the corresponding topic appearing in the document. If an element of is larger, then the prior probability of the topic corresponding to the element appearing in the document is relatively high. is a dimensional vector( is the size of the vocabulary), controls the distribution of words under each topic, and similarly, if If an element of is larger, then the prior probability of the word corresponding to the element appearing in the topic is relatively high.

[0094] In mathematical expression, given Topics and documents ,document The generation probability of the word in is:

[0095]

[0096] in, Indicated in the topic Next word The probability of Representation Document Medium Theme The probability of is a topic-word distribution, is a document-topic distribution, Representation Document The number of words in .

[0097] The purpose of step S3 is to extract the "subject-predicate-object" triples of events from the text based on the keywords, forming a structured event description and providing a data basis for event graph construction. Specifically, the model uses RoBERTa to extract the event triples from the text. Encode and get the vector representation of each word The CRF layer then learns the sequence probabilities of word labels based on these vector representations. ,in is a label sequence. The CRF model maximizes the conditional probability To predict the optimal label sequence for each word, this can be achieved by the following formula:

[0098]

[0099] in, is the normalization factor, is the weight of the transferred feature, and are the labels of the i−1th and ith words respectively; is an exponential function, is the length of the word sequence, in the conditional probability In the calculation of , it is necessary to consider the information of each position in the sequence, from arrive Perform summation; is the number of label types for each position The word, its label Can be taken different values, among which Indicates the index of a tag.

[0100] Finally, the label sequence output by the model is used to construct event triples in the form of (entity 1, relation, entity 2), thereby accurately extracting event information from the text.

[0101] The purpose of step S4 is to convert the event triples into an event graph, using a graph structure to represent the association of events, and to provide intuitive graph data support for the retrieval and analysis of hot information. The "subject" and "object" in the triples are used as nodes in the graph, and the "predicate" is used as the edge connecting these nodes. The construction of the graph can be represented by the following formula to represent the connection relationship between nodes and edges: ,in Representative graph, is a collection of nodes, is a set of edges. For each entity pair in the event triple , which are expressed by the predicate connected, can be expressed as:

[0102]

[0103] Among them, R is the set of all possible predicate relations. In actual operation, graph databases such as Neo4j can be used to store and query these structured data. Such databases provide efficient data retrieval performance, making the query and analysis of event graphs faster and more convenient.

[0104] The purpose of step S5 is to find nodes related to hot topics and their associated subgraphs through a graph retrieval engine to provide target data for the construction of hot spot patterns. The process of retrieving nodes related to hot spots from an event graph through a graph retrieval engine involves using a graph database query language, such as Cypher, to perform efficient graph queries. The specific approach is to define queries to match nodes and relationships related to hot spots. For example, if a hot spot is related to a specific event type, the query may look for nodes with specific labels or nodes with specific attribute values. In a graph database, such as Neo4j, this query can quickly find relevant nodes in the graph structure and retrieve other nodes and relationships connected to these nodes, thereby constructing an event graph related to the hot spot. This method can not only identify the direct participants in hot events, but also reveal the complex relationship network behind the event, providing support for further analysis and decision-making.

[0105] The purpose of step S6 is to map the structure, node features and edge relationships of the hotspot-related subgraphs into a high-dimensional vector space. Through embedding, the complex relationships of the subgraphs can be compressed into a vector representation of fixed dimensions, which is convenient for similarity calculation with other content. Represented as a low-dimensional vector, where is a collection of nodes, is a set of edges. Given a subgraph , we hope to embed the function The node Mapping to d-dimensional vector space , while retaining the structural characteristics and semantic information of the graph. To achieve this goal, it is necessary to define the neighborhood relationship of the nodes, generate the context of the nodes through random walks, and then embed these contexts for learning.

[0106] In the Node2Vec model, the first step of the embedding process is to generate a neighborhood sequence of nodes through random walks. , generating a fixed-length node sequence through random walks ,in is the walk length. The transition probability of a random walk is defined as:

[0107]

[0108] in, Is a node arrive The transfer weight, is a normalization constant. Node2Vec introduces two hyperparameters and Control the depth-first and breadth-first tendencies of the walk so that the transfer weight Defined as:

[0109]

[0110] in, Representation Node and The shortest path distance in the graph. Parameters Control the probability of returning a node, Control the probability of exploring new nodes to achieve a balanced modeling of the local and global structures of the graph.

[0111] Node sequence generated by random walk is regarded as the contextual relationship of the graph. Next, these sequences are embedded and learned through the Skip-Gram model. The goal of Skip-Gram is to maximize the co-occurrence probability between a node and its context, which is defined as:

[0112]

[0113] in, Is a node The context node set of Is a node Generate context node The probability of , using the Softmax function is expressed as:

[0114]

[0115] in, Representation Node and The dot product of the embedded vectors is used to measure their similarity. Since the cost of calculating the Softmax denominator is high, negative sampling is usually used for optimization, and the objective function is approximated as:

[0116]

[0117] in, is a Sigmoid function, and ; is the negative sampling distribution, is the number of negative samples, represents the mathematical expectation operation, is a negative sampling distribution After training, each node The embedding vector That is its representation in d-dimensional vector space. For the entire subgraph , the overall vector representation of the subgraph can be generated by aggregating the embedding vectors of all its nodes. Common aggregation methods include averaging, weighted summation, or graph pooling-based methods. Finally, the subgraph vector representation is:

[0118]

[0119] in, is an aggregation function, such as mean or maximum pooling. Through the above process, the hotspot related subgraphs are converted into high-dimensional vector representations, which not only retain the structural information of the graph, but also capture the semantic relationship between nodes, which is convenient for subsequent similarity calculation and hotspot pattern matching.

[0120] The purpose of step S7 is to identify potential hot content similar to the current hot pattern by calculating the similarity between the hot pattern and other content features. The process of using Jaccard similarity to calculate the similarity between the subgraph vector and other content features in the fusion graph representation network is achieved by comparing the ratio of the intersection and union of the two sets. The calculation formula of Jaccard similarity is:

[0121]

[0122] in, and Represents two sets, Is a collection and The number of elements in the intersection, and Is a collection and The number of elements in the union. The value range of Jaccard similarity is between 0 and 1. The larger the value, the higher the similarity between the two sets.

[0123] In the context of graphs, each subgraph can be represented as a feature set that contains node attributes, edge types, and other relevant graph information. By calculating the Jaccard similarity of these feature sets, the similarity between subgraphs can be quantified. Specifically, for the feature sets of two subgraphs, first determine their common features (intersection), then determine the sum of all their unique features (union), and finally apply the above formula to calculate the similarity.

[0124] It can be seen that the method of this embodiment can improve the efficiency and accuracy of identifying potential hot content from the mainstream value vertical field knowledge base by accurately identifying and screening positively reinforced information content through technologies such as topic modeling, event extraction, graph retrieval and similarity calculation, and enhance the real-time monitoring and prediction capabilities of social hot trends, thereby providing timely and valuable information support for decision makers. In addition, the method of this embodiment can also break through the limitations of existing technologies in the discovery of potential hot content based on field knowledge bases, and achieve accurate perception of potential hot spots and abnormal content by building a large-scale mainstream value vertical field knowledge base, which is of great significance for quickly responding to social changes, guiding public opinion and optimizing information processing processes.

[0125] To sum up, the method in this embodiment builds a knowledge base of mainstream value vertical fields, comprehensively utilizes topic modeling, event extraction, graph retrieval and similarity calculation, accurately perceives potential hotspots and abnormal content, enhances the application of generative AI in ideology and political security, realizes the identification and screening of positive information content, significantly improves the positive screening ability of information content, and enhances the real-time monitoring and prediction of social hot trends.

[0126] Example 2

[0127] This embodiment is based on embodiment 1:

[0128] This embodiment provides a method for identifying potential hot content based on a mainstream value vertical domain knowledge base, including the following steps:

[0129] Build a mainstream value vertical knowledge base, including basic corpus and question-and-answer corpus. The basic corpus includes authoritative data sets such as People's Daily, and the question-and-answer corpus covers major sensitive issues and hot issues that netizens are concerned about;

[0130] The LDA model is used to perform topic modeling on the text in the knowledge base. The text data is preprocessed and input into the model to train the topic distribution and topic word set.

[0131] Based on the extracted keywords, the RoBERTa-CRF model is used to extract event triplets from the text to capture the deep semantic information in the text and the complex relationships between entities.

[0132] Construct an event graph, map event triplets into a graph structure, and form an overall network structure;

[0133] Retrieve nodes related to hot spots through the graph search engine and locate nodes in the event graph that match hot topic terms;

[0134] Graph embedding technology is used to convert hotspot related subgraphs into vector representations, and the neighborhood relationships and graph topology features of nodes in the graph structure are learned;

[0135] The subgraph vector is matched with the content features of the fusion graph representation network, and the potential hot content similar to the current hot pattern is identified by calculating the Jaccard similarity.

[0136] Specifically, the method of this embodiment was used to conduct experiments on two real data sets (a People's Daily corpus data set and a social media public opinion data set), respectively verifying the method's ability to discover potential hot content in different domain knowledge base environments.

[0137] Experimental data sets: 1. People's Daily corpus data set: mainly involving mainstream values, policy interpretations and hot comments. 2. Social media public opinion data set: public opinion data crawled from Sina website, and marked as rumors, and quality management. For the protection of privacy, this data set has been anonymized.

[0138] Baseline model: The comparison baseline methods include keyword frequency statistics (TF-IDF), traditional topic modeling (LDA), and deep learning event extraction model (BERT+CRF).

[0139] Evaluation indicators: Hotspot detection accuracy (Precision), recall rate (Recall) and F1 score are used as the main evaluation criteria.

[0140] Experimental scenario: For hot events in different data sets, compare the potential hotspot discovery performance of the method in this embodiment with that of the baseline model.

[0141] Table 1 - Experimental results of different methods on two datasets

[0142]

[0143] As shown in Table 1, in the People's Daily corpus data set, the method of this embodiment accurately discovered hot policy interpretations and public opinion focuses by constructing event graphs and using graph embedding technology, with an F1 score of 0.88, which is 10% higher than the F1 score of the baseline model BERT+CRF. In the social media public opinion data set, the method of this embodiment significantly improved the monitoring ability of hot spot propagation paths and topic aggregation, and the accuracy of hot spot discovery reached 0.85, which is 11.8% higher than the BERT+CRF baseline model.

[0144] like Figure 2 As shown in the figure, the recognition mode and series of technologies of abnormal and hot content features are demonstrated. The left part describes how to perform feature matching through the representation of the fusion graph of all-media content to identify abnormal and hot content; when the match is successful, the system can find the abnormality or hot spot. The right part introduces the series of technologies for identifying abnormal and hot content features that support this process, including the use of mainstream value vertical knowledge bases and event context knowledge graphs to identify the publishing subject, and the use of content precision understanding technology to process hot content, such as false information, sensitive images, and dense videos, so as to achieve comprehensive identification and management of abnormal and hot content.

[0145] It can be seen that the method of this embodiment significantly improves the accuracy and real-time performance of potential hot content discovery. The method has strong generalization ability and can be applied to hot content discovery tasks in different fields. Through the above experiments and analysis, the method of this embodiment proves its superiority in potential hot content discovery and provides an important reference for hot spot monitoring and prediction in related fields.

[0146] Example 3

[0147] This embodiment is based on embodiment 1:

[0148] This embodiment provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the potential hot content identification method based on the mainstream value vertical category knowledge base of embodiment 1 is implemented. The computer program may be in source code form, object code form, executable file, or some intermediate form.

[0149] Example 4

[0150] This embodiment is based on embodiment 1:

[0151] This embodiment provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the potential hot content identification method based on the mainstream value vertical category knowledge base of embodiment 1. Among them, the computer program can be in source code form, object code form, executable file or some intermediate form, etc. The storage medium includes: any entity or device capable of carrying computer program code, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the storage medium does not include electric carrier signals and telecommunication signals.

[0152] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity of description, they are expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

Claims

1. A method for identifying potential hot content based on a knowledge base of mainstream value vertical categories, characterized by: include: Build a knowledge base in the mainstream vertical domain, perform topic modeling and extract potential keywords through the latent Dirichlet distribution model, and extract event triplets and build an event graph through the RoBERTa-CRF model; Retrieve nodes related to hot spots from the event graph through the graph retrieval engine, and convert the subgraph composed of related nodes into vector representation through graph embedding technology to form a hot spot model; By calculating the Jaccard similarity, we match content features similar to the hotspot pattern in the fusion graph representation network and identify potential hotspot content; The topic modeling is performed by using a latent Dirichlet distribution model to extract potential topic words, and the event triples are extracted by using a RoBERTa-CRF model to construct an event graph, including: Preprocess the text data in the mainstream value vertical domain knowledge base, input the preprocessed text data into the latent Dirichlet distribution model, train to obtain the topic distribution and topic word set, and thus extract potential topic words; Based on the RoBERTa-CRF model, the deep semantic information in the text and the complex relationship between entities are captured through the pre-trained language representation capability of the RoBERTa layer, and the relationship between entities is predicted through the CRF layer to generate event triples, wherein the event triples include subject, predicate and object; The event triples are mapped into a graph structure, with the subject and object in the event triples as nodes in the graph, and the predicate as the edge connecting the nodes; the relationship between multiple event triples is explicitly represented in the graph to form an overall network structure; The method of retrieving nodes related to hot spots from the event graph through the graph retrieval engine and converting the subgraph composed of related nodes into a vector representation through the graph embedding technology to form a hot spot model includes: Input keywords related to hot topics through the graph search engine to locate nodes in the event graph that match the hot topic words; the retrieved nodes include the main nodes of the hot events and their associated context information; The hotspot-related subgraphs are converted into vector representations through graph embedding technology. The graph embedding technology maps the nodes and edges in the event graph into a high-dimensional vector space by learning the neighborhood relationship and graph topology features of the nodes in the graph structure. By calculating the Jaccard similarity, content features similar to the hotspot pattern are matched in the fusion graph representation network to identify potential hotspot content, including: The Jaccard similarity is used to calculate the similarity between the subgraph vector and the fusion graph to represent other content features in the network. This is achieved by comparing the ratio of the intersection and union of the two sets. The calculation formula of the Jaccard similarity is: in, and Represents two sets, Is a collection and The number of elements in the intersection, and Is a collection and The number of elements in the union; the value range of Jaccard similarity is between 0 and 1, and the larger the value, the higher the similarity between the two sets; Based on the event graph, each subgraph is represented as a feature set, which contains the attributes of the nodes, the types of the edges, and the related graph information. The similarity between the subgraphs is quantified by calculating the Jaccard similarity of these feature sets.

2. The potential hot content identification method based on the mainstream value vertical category knowledge base according to claim 1 is characterized in that: The topic modeling is performed through the latent Dirichlet distribution model and potential topic words are extracted, including: For each document Select a topic distribution , for each word in the document , first select a topic from the topic distribution of the document , and then select words from the word distribution corresponding to the topic ;in, Is the theme The word distribution of is a dimensional vector, is the number of topics; is a dimensional vector, is the size of the vocabulary; In mathematical expression, given Topics and documents ,document The generation probability of the word for: in, Indicated in the topic Next word The probability of Representation Document Medium Theme The probability of is a topic-word distribution, is a document-topic distribution, Representation Document The number of words in .

3. The potential hot content identification method based on the mainstream value vertical domain knowledge base according to claim 1 is characterized in that: The event triples extracted by the RoBERTa-CRF model include: Through the RoBERTa layer to the input text Encode and get the vector representation of each word ; Learning the sequence probability of word labels based on vector representation through CRF layer ,in is a label sequence, and the CRF layer maximizes the conditional probability To predict the optimal label sequence for each word: in, is the normalization factor, is the weight of the transferred feature, is the label of the i−1th word, is the label of the i-th word, Indicates the index of the tag; is an exponential function, is the length of the word sequence, is the number of label types; Event triples are constructed based on the output label sequence, thereby accurately extracting event information from the text.

4. The potential hot content identification method based on the mainstream value vertical category knowledge base according to claim 1 is characterized in that: The constructing of the event graph includes: The event triples are converted into event graphs, and the association relationship of events is represented by a graph structure; the subject and object in the event triples are used as nodes in the graph, and the predicate is used as the edge connecting the nodes: in, Represents the event graph, is a collection of nodes, is the edge set; Each entity pair in the event triple By predicate Connected, expressions include: Where R is the set of all possible predicate relations.

5. The method for identifying potential hot content based on a mainstream value vertical domain knowledge base according to claim 4 is characterized in that: The subgraph consisting of related nodes is converted into a vector representation by using a graph embedding technology to form a hotspot pattern, including: For each node , generate a fixed-length node sequence through a random walk method , as the contextual relationship of the event graph, where is the walk length; The node sequence is analyzed by Skip-Gram model Perform embedding learning to maximize the co-occurrence probability between a node and its context: in, Is a node The context node set of Is a node Generate context node probability.

6. The potential hot content identification method based on the mainstream value vertical category knowledge base according to claim 5 is characterized in that: The transition probability of the random walk method is: in, Is a node arrive The transfer weight, is a normalization constant; the Node2Vec model introduces two hyperparameters and Control the depth-first and breadth-first tendencies of the walk so that the transfer weight Defined as: in, Representation Node and Shortest path distance in a graph; hyperparameters Control the probability of returning a node, a hyperparameter Control the probability of exploring new nodes to achieve a balanced modeling of the local and global structures of the graph.

7. The method for identifying potential hot content based on a mainstream value vertical domain knowledge base according to claim 6 is characterized in that: The node Generate context node Probability , expressed using the Softmax function: in, Representation Node and The dot product of the embedding vector is used to measure the similarity; if negative sampling is used for optimization, the objective function is approximated as: in, is a Sigmoid function, and ; is the negative sampling distribution, is the number of negative samples; represents the mathematical expectation operation, is a negative sampling distribution The elements sampled from ; After training, each node The embedding vector That is its representation in d-dimensional vector space; for the entire subgraph , can generate the overall vector representation of the subgraph by aggregating the embedding vectors of all its nodes, and the aggregation methods include averaging, weighted summation and graph pooling-based methods; finally, the subgraph vector It is expressed as: in, Is an aggregate function.

Images