Method, computing device and medium for enterprise risk assessment based on news text

Abstract

The present disclosure provides a method, computing device and computer-readable storage medium for enterprise risk assessment based on news text. The method includes: constructing a public opinion entity for the news text, the attributes of the public opinion entity including the subject category and sentiment polarity of the news text; determining the direct relationship risk value and associated risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise; determining the indirect relationship risk value of the news text to the enterprise based on the enterprise knowledge graph and a collection of historical news texts; and determining the risk value of the news text to the enterprise based on the direct relationship risk value, the indirect relationship risk value and the associated risk value.

Description

Technical Field

[0001] The present disclosure generally relates to the field of machine learning, and more specifically, to a method, a computing device, and a computer-readable storage medium for performing enterprise risk assessment based on news text. Background Art

[0002] For many companies, especially those directly related to people's livelihood, public opinion has a huge impact on their reputation, especially negative public opinion. If it is not dealt with in time, it is likely to cause serious or even devastating losses to the company. At present, in the information age, with the development of Internet technology, more and more news information can appear on the Internet at the first time. With the prosperity of various online media, especially self-media, there are more sources of public opinion and it spreads faster. Therefore, relying solely on manual reading by the marketing department or public relations department of the company is no longer able to fully understand the public opinion situation, especially it is impossible to understand these negative public opinions in time before they are widely spread.

[0003] Therefore, there is a need to automatically collect various public opinion messages through computer systems and analyze them in a timely manner to assess corporate risks and issue early warnings. Summary of the invention

[0004] In response to at least one of the above problems, the present disclosure provides a solution for evaluating the risk impact of collected news texts (also referred to as public opinion in this article) on an enterprise by analyzing multiple dimensions including sentiment, theme, entity, relationship, event, etc.

[0005] According to one aspect of the present disclosure, a method for enterprise risk assessment based on news text is provided. The method includes: constructing a public opinion entity for the news text, the attributes of the public opinion entity including the subject category and sentiment polarity of the news text; determining the direct relationship risk value and associated risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise; determining the indirect relationship risk value of the news text to the enterprise based on the enterprise knowledge graph and a collection of historical news texts; and determining the risk value of the news text to the enterprise based on the direct relationship risk value, the indirect relationship risk value and the associated risk value.

[0006] In some embodiments, determining the direct relationship risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise includes: using an entity model to identify a mentioned entity in the news text; determining a hit entity of the mentioned entity in the enterprise knowledge graph of the enterprise; and determining the direct relationship risk value between the public opinion entity and the hit entity based on the enterprise knowledge graph.

[0007] In some embodiments, determining the direct relationship risk value includes: determining the direct relationship risk value based on the total number of paths between the public opinion entity and the hit entity.

[0008] In some embodiments, determining the direct relationship risk value includes: determining the direct relationship risk value based on the total number of paths within a predetermined distance between the public opinion entity and the hit entity.

[0009] In some embodiments, determining the associated risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise includes: determining the attention entities associated with the public opinion entity from the enterprise knowledge graph based on a label propagation algorithm, and marking a risk value for each attention entity; and determining the associated risk value of the public opinion entity based on the risk value of the attention entity.

[0010] In some embodiments, determining the indirect relationship risk value of the news text to the enterprise based on the enterprise knowledge graph and the historical news text set includes: determining a plurality of historical public opinion entities similar to the public opinion entity of the news text from the historical news text set; and determining the indirect relationship risk values ​​between the plurality of historical public opinion entities and the hit entities of the news text in the enterprise knowledge graph based on the enterprise knowledge graph.

[0011] In some embodiments, determining the indirect relationship risk value includes: determining the indirect relationship risk value based on a similarity between the public opinion entity and the hit entity.

[0012] In some embodiments, the method further includes: using an entity model to identify entities in the news text and determining a hit entity of the identified entity in the enterprise knowledge graph of the enterprise; and determining a direct relationship risk value between the public opinion entity and the hit entity based on the enterprise knowledge graph.

[0013] In some embodiments, constructing a public opinion entity for the news text includes: using a sentiment classification model to determine the sentiment polarity of the news text, the sentiment polarity indicating whether the sentiment training text has positive sentiment, negative sentiment, or neutral sentiment.

[0014] In some embodiments, the method also includes: constructing a sentiment training text set associated with the enterprise, the sentiment training text set containing multiple sentiment training texts, each sentiment training text including a news text associated with the enterprise; labeling sentiment polarity for each sentiment training text in the sentiment training text set; training the sentiment classification model using the sentiment training text and the labeled sentiment polarity to generate a trained sentiment classification model; and inputting the news text into the trained sentiment classification model to determine the sentiment polarity of the news text.

[0015] In some embodiments, inputting the news text into a trained sentiment classification model to determine the sentiment polarity of the news text includes: filtering the text data contained in the news text; segmenting the filtered text data, and mapping the segmented text data into a text identifier sequence, wherein each text identifier sequence includes one or more discrete encoding vectors; inputting the generated text identifier sequence into an embedding layer of the sentiment classification model to convert the text identifier sequence into a continuous embedding vector; encoding the embedding vector output by the embedding layer in the encoding layer of the sentiment classification model to generate a contextual representation of the embedding vector; generating a sentence-level feature vector of the embedding vector using an attention function in the pooling layer of the sentiment classification model; generating a quality probability distribution of the sentence-level feature vector, the quality probability distribution indicating the probability of the news text being at different sentiment polarities; and selecting the sentiment polarity with the highest probability in the quality probability distribution as the sentiment polarity of the news text.

[0016] In some embodiments, labeling the sentiment polarity of each sentiment training text in the sentiment training text set includes: searching for a risk word in a risk word dictionary in the sentiment training text; if a risk word is found in the sentiment training text, determining the semantics associated with the risk word based on dependency syntactic rules; and labeling the sentiment training text based on the semantics associated with the risk word.

[0017] In some embodiments, constructing a public opinion entity for the news text includes: determining a topic category of the news text using a topic classification model.

[0018] In some embodiments, the topic classification model includes a topic extraction layer, a topic clustering layer and a topic description layer, and wherein constructing a public opinion entity for the news text includes: in the topic extraction layer, using a two-word topic model to determine the probability distribution of the title of the news text in a predetermined topic set and the probability distribution of each word in the title in each topic in the predetermined topic set; in the topic clustering layer, based on the probability distribution of the title of the news text in the predetermined topic set, using a clustering algorithm to determine the topic category of the news text; and in the topic description layer, selecting central keywords from the news text to form a topic description of the news text.

[0019] In some embodiments, at the topic extraction layer, a two-word topic model is used to determine the probability distribution of the title of the news text in a predetermined topic set and the probability distribution of each word in the title in each topic in the predetermined topic set, including: segmenting the title of the news text to obtain multiple words of the title; organizing two words of the multiple words into a two-word pair and assigning a topic in the predetermined topic set to the two-word pair; determining the probability distribution of the topics of all two-word pairs composed of the multiple words; and determining the probability distribution of each word in the two-word pair based on the probability distribution of the topic of each two-word pair.

[0020] In some embodiments, at the topic clustering layer, based on the probability distribution of the title of the news text in a predetermined topic set, determining the topic category of the news text using a clustering algorithm includes: clustering the news titles into multiple clusters; identifying mentioned entities in the news text using an entity model; and merging the multiple clusters by similarity clustering based on the mentioned entities in the news text to determine the topic category of the news text.

[0021] In some embodiments, at the topic description layer, selecting central keywords from the news text to form a topic description of the news text includes: extracting a summary of the news text; and selecting central keywords from the summary as a description of the topic based on entities in the news text and the number of words in the news text.

[0022] In some embodiments, the method also includes: obtaining multiple historical topic descriptions in the predetermined topic set; performing text similarity calculations on the multiple historical topic descriptions to determine the text similarities between the multiple historical topic descriptions; and based on the text similarities between the multiple historical topic descriptions, merging the topics in the predetermined topic set to update the predetermined topic set.

[0023] According to another aspect of the present disclosure, a computing device is provided. The computing device includes: at least one processor; and at least one memory, the at least one memory is coupled to the at least one processor and stores instructions for execution by the at least one processor, and when the instructions are executed by the at least one processor, the computing device executes the steps according to the above method.

[0024] According to yet another aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program code is stored. When the computer program code is executed, the method described above is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The present disclosure will be better understood and other objects, details, features and advantages of the present disclosure will become more apparent through the description of specific embodiments of the present disclosure given with reference to the following drawings.

[0026] Figure 1 A schematic diagram of a system for implementing a method for performing enterprise risk assessment based on news text according to an embodiment of the present disclosure is shown.

[0027] Figure 2 A flowchart of a method for performing enterprise risk assessment based on news text according to some embodiments of the present disclosure is shown.

[0028] Figure 3 A flowchart of a method for performing enterprise risk assessment based on news text according to other embodiments of the present disclosure is shown.

[0029] Figure 4A A flowchart of a method for determining an event risk value of a public opinion event according to some embodiments of the present disclosure is shown.

[0030] Figure 4B A more detailed flow chart of a block for identifying public opinion events according to some embodiments of the present disclosure is shown.

[0031] Figure 4C A more detailed flowchart of a block for determining an event risk value of a public opinion event using an event risk model according to some embodiments of the present disclosure is shown.

[0032] Figure 5A A flowchart of a method for determining the sentiment polarity of a news text according to an embodiment of the present disclosure is shown.

[0033] Figure 5B A structural schematic diagram of a sentiment classification model according to an embodiment of the present disclosure is shown.

[0034] Fig. 6A A flowchart of a method for determining a topic category of a news text according to an embodiment of the present disclosure is shown.

[0035] Figure 6B A structural diagram of a topic classification model according to an embodiment of the present disclosure is shown.

[0036] Figure 6C A more detailed flow chart of a block for determining a probability distribution of each word in a title according to some embodiments of the present disclosure is shown.

[0037] Fig.6D A more detailed flow chart of a block for determining topic categories of news text using a clustering algorithm according to some embodiments of the present disclosure is shown.

[0038] Fig. 6EA more detailed flow chart of a block for determining a topic expression of a news text according to some embodiments of the present disclosure is shown.

[0039] Fig. 7A A flowchart of a method for identifying mentioned entities in news text using an entity model according to an embodiment of the present disclosure is shown.

[0040] Figure 7B A further detailed flowchart of a block for identifying mentioned entities and entity relationships from news text using an entity model according to some embodiments of the present disclosure is shown.

[0041] Figure 7C A further detailed flowchart of a block for identifying mentioned entities and entity relationships from news text using an entity model according to some other embodiments of the present disclosure is shown.

[0042] Fig.7D A structural diagram of an entity and relationship joint recognition model based on parameter sharing according to an embodiment of the present disclosure is shown.

[0043] Fig. 7E A detailed flowchart of a block for training the joint recognition model using annotated training text according to some embodiments of the present disclosure is shown.

[0044] Figure 7F A more detailed flow chart of a block for determining entity distance according to an embodiment of the present disclosure is shown.

[0045] Fig. 8A A schematic diagram of an enterprise knowledge graph according to an embodiment of the present disclosure is shown.

[0046] Figure 8B A schematic diagram of an industry knowledge graph according to an embodiment of the present disclosure is shown.

[0047] Fig. 9 A block diagram of a computing device suitable for implementing an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0048] The preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the preferred embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0049] In the following description, certain specific details are set forth for the purpose of illustrating various embodiments of the invention to provide a thorough understanding of the various embodiments of the invention. However, those skilled in the relevant art will recognize that the embodiments may be practiced without one or more of these specific details. In other cases, well-known devices, structures, and techniques associated with the present application may not be shown or described in detail to avoid unnecessarily obscuring the description of the embodiments.

[0050] Unless the context requires otherwise, throughout the specification and claims, the word "comprise" and variations such as "include" and "have" should be construed in an open, inclusive sense, ie, should be interpreted as "including, but not limited to."

[0051] References throughout the specification to "one embodiment" or "some embodiments" indicate that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, the appearance of "in one embodiment" or "some embodiments" in various places throughout the specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any manner in one or more embodiments.

[0052] In addition, the terms "first", "second", "third", "fourth" etc. used in the specification and claims are only used to distinguish objects for the sake of clarity of description, and do not limit the size or other order of the objects described.

[0053] Figure 1 FIG. 1 is a schematic diagram of a system 1 for implementing a method for performing enterprise risk assessment based on news text according to an embodiment of the present disclosure. Figure 1 As shown in , the system 1 includes one or more data sources 10, a computing device 20 and a network 30. The data source 10 and the computing device 20 can exchange data through the network 30. Here, the data source 10 can be, for example, a device for providing various (screened) news texts (also referred to as public opinion in this article), such as a third-party data source that pushes various news texts (for example, various news, media articles, government notices, etc.) to the computing device 20, or it can be an original data source that is actively crawled by the computing device 20 through crawlers and other technologies. The computing device 20 can obtain these news texts in real time and process these news texts to assess corporate risks. The computing device 20 may include at least one processor 22 and at least one memory 24 coupled to the at least one processor 22, the memory 24 storing instructions 26 executable by the at least one processor 22, and the instructions 26 execute at least a part of the method described below when executed by the at least one processor 22. The specific structure of the computing device 20 can be, for example, combined as follows Fig. 9 described.

[0054] In the scheme disclosed in the present invention, the internal and external knowledge of the enterprise is first sorted out and integrated to construct an enterprise knowledge graph for the enterprise. Then, multiple deep learning models are used to analyze at least two of the sentiment, theme, entity, relationship, and event in multiple dimensions for the news texts that are constantly emerging on the Internet to obtain the risks related to the enterprise contained in the news texts. The enterprise knowledge graph is retrieved and inferred to assess whether the news text has risks and / or risk levels for the enterprise. Finally, the system can make early warning decisions based on the risk information and impact information.

[0055] Risk assessment of enterprises based on news texts can include two levels: one is to assess whether the news poses a public opinion risk to the enterprise, and the other is to assess the degree of public opinion risk (i.e., risk value) caused by the news to the enterprise. These two aspects can be performed separately or in combination, that is, first assess whether the news poses a public opinion risk to the enterprise, and then further assess the degree of risk caused by the news to the enterprise if it is determined that the news poses a public opinion risk to the enterprise. Figure 2 and Figure 3 The specific solutions for these two aspects are described respectively.

[0056] Figure 2 FIG. 2 is a flowchart of a method 200 for performing enterprise risk assessment based on news text according to some embodiments of the present disclosure. The method 200 may be performed by, for example Figure 1 The following takes the execution in the computing device 20 as an example, combined with Figures 1 to 9 The method 200 is described.

[0057] like Figure 2 As shown in , method 200 includes box 210, where computing device 20 can determine whether the acquired news text meets a predetermined condition, and in box 220, when it is determined that the news text meets the predetermined condition (i.e., when the judgment in box 210 is "yes"), computing device 20 can determine that the enterprise has a public opinion risk. Here, the predetermined condition can be two or more of event risk value, sentiment polarity, topic category, and enterprise knowledge graph hit situation. Specifically, as Figure 2 As shown in , determining that the news text satisfies the predetermined condition may include at least two of blocks 212 , 214 , 216 , and 218 .

[0058] In box 212, the computing device 20 may determine that the event risk value of the public opinion event corresponding to the acquired news text is greater than a risk threshold.

[0059] Here, as mentioned above, the news text can be obtained by the computing device 20 from various data sources 10 in real time. The public opinion event refers to the event representation identified from the news text. The public opinion event can be linked to the historical public opinion events to determine the event risk value of the public opinion event based on the event risk model. The method for determining the event risk value of the public opinion event is, for example, combined with the following Figures 4A to 4C The method 400 is described in detail. Those skilled in the art will appreciate that the present disclosure is not limited to Figures 4A to 4C The implementation details of method 400 are not disclosed. Instead, other models may be used in combination with historical public opinion events with known risks to determine the event risk value of the public opinion event.

[0060] In box 214, the computing device 20 may determine that the sentiment polarity of the news text is lower than the sentiment threshold. In this article, the news text as a whole may have its sentiment polarity. For example, in the case of three categories, the sentiment polarity of the news text may include positive, neutral and negative. In the case of five categories, the sentiment polarity of the news text may include positive, positive, neutral, negative and negative. Alternatively, in some other embodiments, the sentiment polarity may be represented as a sentiment value within a continuous sentiment range, such as a value between [0,1]. The sentiment polarity of the news text may be determined using a regression model, a classification model, etc., and a classification model is used in this article. Depending on the sentiment classification model used and the training sample, different sentiment polarity classification methods may be implemented. The method of determining the sentiment polarity of the news text using a sentiment classification model is, for example, combined with the following: Figures 5A to 5B Those skilled in the art will appreciate that the present disclosure is not limited to Figures 5A to 5B The implementation details of method 500 are not disclosed, but other sentiment classification models may be used to determine the sentiment polarity of the news text.

[0061] Here, the sentiment threshold may be, for example, a specific sentiment polarity or a specific sentiment value. For example, in the case of using a three-category or five-category sentiment polarity, the sentiment threshold may be "neutral". In the case of using a continuous sentiment range (e.g., [0, 1]), the sentiment threshold may be 0.5. In these cases, a sentiment polarity below the sentiment threshold may indicate that the sentiment polarity of the news text is biased toward the negative.

[0062] At block 216 , computing device 20 may determine a topic category for the news text and determine that the determined topic category belongs to a specific risk topic set.

[0063] Here, the topic category refers to the different topics presented in the news text. Determining the topic category helps to quickly screen out the current news text from the massive news text to see whether it is the type of news text that the enterprise is interested in (for example, food safety). The topic classification model can be used to determine the topic category of the news text, for example, combining the following Figures 6A to 6E The method 600 is described in detail. Those skilled in the art will appreciate that the present disclosure is not limited to Figures 6A to 6E The implementation details of method 600 are not disclosed, but other topic classification models may be used to determine the topic type of the news text.

[0064] The specific risk topic set refers to a set of topic types that the enterprise is interested in. For example, for a food enterprise, the topic types that it is interested in may include food safety, food quality, food carcinogenicity risk, and other topic types that may cause public opinion risks to the enterprise. In this case, the enterprise can set the topic types that it is interested in to the specific risk topic set. In box 216, after determining the topic category of the news text, it can be determined whether the topic category belongs to the specific risk topic set. If it is determined that the news text belongs to the specific risk topic set, then the news text is more likely to cause public opinion risks to the enterprise.

[0065] In block 218 , the computing device 20 may identify entity mentions in the news text and determine whether the entity mentions hit the enterprise knowledge graph of the enterprise.

[0066] Generally, an entity refers to a person's name, place name, organization name, etc. that appears in a news text. Furthermore, an entity may also include any other subject of interest, such as a product name, material name, brand name, etc. Each entity may include one or more entity attributes. In addition, various entity relationships may exist between entities. In this article, an entity model may be used to at least identify entities in the news text, the attributes of the entity, and the entity relationships between entities. In order to distinguish the entities identified from the news text from the entities displayed in the enterprise knowledge graph, the former are also referred to as "mention entities" in this article.

[0067] The method of using entity model to identify entities in news text is, for example, combined with the following Figures 7A to 7F The method 700 is described in detail. Those skilled in the art will appreciate that the present disclosure is not limited to Figures 7A to 7F The implementation details of the method 700 are not described, but other entity models can be used to identify entities in the news text.

[0068] If at least two of blocks 212, 214, 216, and 218 are satisfied, the computing device 20 may determine in block 220 that the news text will generate public opinion risk for the enterprise. Otherwise, in block 230, it may be determined that the news text will not generate public opinion risk for the enterprise.

[0069] Figure 3 FIG. 3 is a flowchart of a method 300 for performing enterprise risk assessment based on news text according to another embodiment of the present disclosure. The method 300 may be, for example, Figure 1 The following takes the execution in the computing device 20 as an example, combined with Figures 1 to 9 The method 300 is described.

[0070] In block 310, the computing device 20 may construct a public opinion entity for the news text. The attributes of the public opinion entity include the topic category and sentiment polarity of the news text. Here, the method for determining the topic category of the news text may be, for example, combining Figures 6A to 6E The method 600 described above, the method for determining the sentiment polarity of a news text may be, for example, the method 500 described in conjunction with FIG. 5 . Those skilled in the art will appreciate that the present disclosure is not limited to Figures 5A to 5B Method 500 and Figures 6A to 6E The implementation details of method 600 are not disclosed, but other sentiment classification models may be used to determine the sentiment polarity of the news text and / or other topic classification models may be used to determine the topic type of the news text.

[0071] In box 320, the computing device 20 can determine the direct relationship risk value and the associated risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise.

[0072] In some embodiments, determining the direct relationship risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise may include: using an entity model to identify a mentioned entity in the news text; determining a hit entity of the mentioned entity in the enterprise knowledge graph of the enterprise; and determining the direct relationship risk value between the public opinion entity and the hit entity based on the enterprise knowledge graph.

[0073] Here, the method of using entity model to identify entities in news text is combined as follows Figures 7A to 7F The method 700 is described in detail. Those skilled in the art will appreciate that the present disclosure is not limited to Figures 7A to 7F The implementation details of the method 700 are not described, but other entity models can be used to identify entities (also referred to as mention entities in this article) in the news text.

[0074] There may be a corresponding relationship between the entities identified from the news text and the entities in the enterprise knowledge graph. The entities identified from the news text may be subsidiaries, abbreviations, aliases, etc. of a certain enterprise, while the entities in the enterprise knowledge graph may be standard names set for the enterprise. In this case, it can be determined whether the entity identified from the news text hits the entity in the enterprise knowledge graph based on the entity attributes. For example, suppose that the entity "KFC" representing the enterprise name is extracted from a news text, and there is an entity "KFC" representing the enterprise name in the enterprise knowledge graph, and its entity attributes include the alias "KFC", then it can be determined that the entity "KFC" identified from the news text hits the entity "KFC" in the enterprise knowledge graph.

[0075] In some embodiments, the direct relationship risk value R path It can be determined by determining the total number of paths between the public opinion entity and the hit entity.

[0076] R path =∑Q(A,E i )

[0077] Among them, A is the public opinion entity, Ei is the hit entity, and Q(A,Ei) represents the number of paths from the public opinion entity A to the hit entity Ei.

[0078] In some embodiments, the direct relationship risk value R can be determined based only on the total number of paths within a predetermined distance (e.g., 2 or 3) between the public opinion entity and the hit entity. path .

[0079] For example, suppose the enterprise knowledge graph of the enterprise is as follows Fig. 8A As shown, further, the construction of the enterprise knowledge graph 810 can be as follows Fig. 7A As described in block 710 of Fig. 8AAs shown in , it is assumed that the enterprise knowledge graph 810 includes entities E1-E9, the public opinion entity is A, and the entities identified from the news text (i.e., mentioned entities) include entities A1, A2, and A3. The mentioned entities A1, A2, and A3 hit entities E2, E7, and E9 in the enterprise knowledge graph, respectively, and only the case where the distance between the public opinion entity and the hit entity is less than the predetermined distance 3 is calculated. Then, the number of paths between public opinion entity A and hit entity E2 can be expressed as Q(A,E2)=1 (i.e., there is only one path A—>A2—>E2 from public opinion entity A to hit entity E2), the number of paths between public opinion entity A and hit entity E7 can be expressed as Q(A,E7)=1 (i.e., there is only one path A—>A1—>E7 from public opinion entity A to hit entity E7), and the number of paths between public opinion entity A and hit entity E9 can be expressed as Q(A,E9)=2 (i.e., there are two paths A—>A2—>E2—>E9 and A—>A3—>E9 from public opinion entity A to hit entity E9). Therefore, the direct relationship risk value R path =1+1+2=4.

[0080] In addition, in some embodiments, the direct relationship risk value R path The calculation of may also consider the directionality of the paths between entities in the enterprise knowledge graph 810. For example, some paths in entities E1-E9 are unidirectional, and other paths are bidirectional.

[0081] In some embodiments, determining the associated risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph 810 of the enterprise may include: based on a label propagation algorithm, determining the focus entities associated with the public opinion entity from the enterprise knowledge graph 810, and marking a risk value for each focus entity; and determining the associated risk value of the public opinion entity based on the risk values ​​of these focus entities.

[0082] Throughout the risk assessment process, the enterprise knowledge graph will be continuously updated to add newly discovered risk factors. In some cases, although the text directly identified from the news text may not directly hit the entity in the enterprise knowledge graph, there may be entities in the enterprise knowledge graph that are related to the news text and have potential risks and need special attention. In this case, the label propagation algorithm can be used to mine entities that may be associated with public opinion entity A from the enterprise knowledge graph (also referred to as attention entities here), and label each attention entity with a risk value. For example, a risky attention entity is labeled with a risk value of 1, and a risky attention entity that does not have a risk is labeled with a risk value of 0.

[0083] In this way, the associated risk value R of the public opinion entity A can be determined based on the risk values ​​of these concerned entities. tag .

[0084] R tag =∑T(E i )

[0085] Wherein, Ei is an entity of interest, and T(Ei) represents the risk value of the entity of interest (for example, 0 or 1).

[0086] In block 330 , the computing device 20 may determine an indirect relationship risk value of the news text to the enterprise based on the enterprise knowledge graph and the historical news text collection.

[0087] In some embodiments, the computing device 20 may determine from the historical news text set a plurality of historical public opinion entities similar to the public opinion entity of the news text, and determine the indirect relationship risk value between these historical public opinion entities and the hit entity in the enterprise knowledge graph based on the enterprise knowledge graph. For example, the indirect relationship risk value R sim It can be determined by the similarity between the public opinion entity and the hit entity.

[0088] R sim =∑S(A,E i )

[0089] Among them, A is the public opinion entity, Ei is the hit entity, and S(A,Ei) represents the similarity between the public opinion entity A and the hit entity Ei. Here, the similarity can be represented by the vector distance between the embedding vectors of the public opinion entity and the hit entity.

[0090] In some embodiments, for example, a graph embedding method (GEM), also known as network representation learning (NRL), can be used to express each entity in the enterprise knowledge graph using a low-dimensional, dense, real-valued embedding vector to obtain an embedding matrix of the entire enterprise knowledge graph. According to the embedding matrix, the vector expression of each input entity can be found, and then similarity metrics such as cosine similarity, Pearson correlation coefficient, KL divergence, and Jaccard similarity coefficient can be used to obtain the similarity between the input entities.

[0091] In block 340 , the computing device 20 may determine a risk value of the news text to the enterprise based on the direct relationship risk value and the associated risk value determined in block 320 and the indirect relationship risk value determined in block 330 .

[0092] In some embodiments, without considering the different impacts of the direct relationship risk value, indirect relationship risk value and associated risk value on the public opinion risk of the enterprise, the direct relationship risk value, indirect relationship risk value and associated risk value can be directly added to obtain the risk value of the news text to the enterprise.

[0093] In other embodiments, considering the different impacts of the direct risk value, the indirect risk value and the associated risk value on the public opinion risk of the enterprise, different weight values ​​are set for the direct risk value, the indirect risk value and the associated risk value, and the risk value of the news text to the enterprise is obtained by weighted summing them. For example, the risk value of the enterprise can be expressed as:

[0094] R=λ path *R path +λ sim *R sim +λ tag *R tag

[0095] Among them, λ path , sim and λ tag They are the weight values ​​of direct relationship risk value, indirect relationship risk value and associated risk value, which can be set based on experience or determined through experiments.

[0096] Figure 4A A flowchart of a method 400 for determining an event risk value of a public opinion event according to some embodiments of the present disclosure is shown.

[0097] like Figure 4A As shown in , in box 410, the computing device 20 can establish a public opinion event model. The public opinion event model can be used at least to identify event types, event trigger words corresponding to each event type, and event elements. Here, the public opinion event model can be established for the enterprise or any enterprise of interest. A public opinion event refers to an event representation of a news text (or public opinion). A public opinion event includes at least a trigger word and an event element. Among them, the trigger word is a word used to trigger the public opinion event, which can clearly express the occurrence of the event, usually a noun or a verb, and the event element is the information involved in the event, which is related to the event representation method.

[0098] In addition, in some embodiments, in addition to trigger words and event elements, the public opinion event may also include at least one of an event type, an event element role, and an event description sentence. The event type is used to indicate the type of the public opinion event, the event element role may indicate the role played by each event element in the public opinion event, and the event description sentence is a sentence used to describe the public opinion event, which usually includes trigger words and event elements.

[0099] Here, the public opinion event model is established for the enterprise, and the public opinion events and the event types, trigger words, event elements, event element roles, event description sentences, etc. contained in the public opinion events have values ​​related to the enterprise. For example, the following Table 1 lists the types of public opinion events that food companies are concerned about and the corresponding trigger words (list).

[0100] Table 1

[0101]

[0102] In box 420, the computing device 20 can use the public opinion event model to identify public opinion events from the news text.

[0103] Figure 4B A more detailed flow chart of block 420 for identifying public sentiment events according to some embodiments of the present disclosure is shown.

[0104] like Figure 4B As shown, block 420 may further include block 422, where computing device 20 may determine an event representation of the news text. The event representation may include any one of a headline event representation, a central event representation, an event extraction representation, and an event semantic representation.

[0105] In box 424, the computing device 20 can identify the public opinion event from the news text based on the event representation mode using the public opinion event model established for the enterprise. Here, identifying the public opinion event from the news text using the public opinion event model can be identified from the news text through the trigger words and event elements of the public opinion event. It can be understood by those skilled in the art that the present invention is not limited to this, and the public opinion event model can also be constructed based on artificial intelligence algorithms or machine learning algorithms to identify public opinion events. In addition, for the title event representation, the public opinion event can be identified from the title of the news text, for the central event representation, the core words can be extracted from the title and text of the news text, and the public opinion event can be summarized from these core words. For the event extraction representation, the trigger words can be extracted from the news text, the corresponding arguments can be found based on the trigger words, and the public opinion event can be summarized. For the event semantic representation, the event can be transformed into a vector representation after the event is summarized by the event extraction representation, and the event fusion can be performed to obtain the public opinion event.

[0106] In block 426, the computing device 20 may generate a short text public opinion event representation for the public opinion event identified in block 424. Here, the short text public opinion event representation refers to representing the identified public opinion event in the form of short text. Those skilled in the art will appreciate that the short text here is relative to the long text, and may vary depending on the application scenario, for example, it may be in the range of dozens to hundreds of characters.

[0107] For example, for the title-style event representation, some text preprocessing can be performed on the news text, such as traditional-simplified conversion, word segmentation, and removal of stop words, to generate a short text representation of the public opinion event. For the central event representation, the news text can be processed using methods such as Figure 6BThe topic classification model 650 is shown to obtain a short text representation of the public opinion event.

[0108] continue Figure 4A In block 430 , the computing device 20 may determine the event risk value of the public opinion event using the event risk model.

[0109] Figure 4C A more detailed flow chart of block 430 for determining an event risk value of a public opinion event using an event risk model according to some embodiments of the present disclosure is shown.

[0110] like Figure 4C As shown, block 430 may further include block 432, where the computing device 20 may construct a historical event library associated with the enterprise. The historical event library may contain multiple historical events of the risk type of interest, each of which is constructed based on the public opinion event model.

[0111] In block 434 , the computing device 20 may annotate each historical event in the historical event library with a risk value, where the risk value indicates the risk level of the historical event.

[0112] At block 436 , the computing device 20 may train the event risk model using historical events with risk values ​​to generate a trained event risk model.

[0113] In block 438 , the computing device 20 may input the public opinion event identified in block 420 into a trained event risk model to determine an event risk value for the public opinion event.

[0114] In some embodiments, the event risk model can be constructed based on the KNN (K-Nearest Neighbor) model. The KNN model is a traditional model whose classification principle is to classify any new sample into the category with the most categories among the K samples closest to the sample. Here, the event risk is marked as different levels of classes by using the frequency of occurrence of feature word events in the historical event library, and the corresponding event risk value is determined by determining which category the public opinion event corresponding to the news text belongs to. Of course, those skilled in the art will understand that the event risk model in the present invention can also be constructed based on other appropriate machine learning models.

[0115] Specifically, training the event risk model in box 436 may include: constructing a feature word set of the historical event based on the event type, event trigger word and event element of each historical event; determining the occurrence frequency of multiple feature word sets constructed for multiple historical events in the historical event library; selecting several feature word sets with the highest occurrence frequency from the multiple feature word sets, and determining the average word vector of each selected feature word set; finally, determining the parameters of the event risk model based on the average word vector to obtain the trained event risk model.

[0116] In this case, determining the event risk value of the identified public opinion event in box 438 may include: constructing a feature word set of the public opinion event based on the event type, event trigger words and event elements of the public opinion event; determining the average word vector of the feature word set; comparing the average word vector with multiple average word vectors in the parameters of the event risk model to determine the closest average word vector; and determining the event risk value of the public opinion event based on the closest average word vector. In other words, the risk value of the historical event corresponding to the feature word set corresponding to the closest average word vector can be considered as the risk value of the public opinion event.

[0117] use Figures 4A to 4C The method for determining the event risk value of a public opinion event shown can construct the acquired news text into an overall public opinion event, and the event risk model determines the correlation between the current news text and the historical public opinion events, thereby determining the overall event risk value accordingly.

[0118] Figure 5A A flowchart of a method 500 for determining the sentiment polarity of a news text using a sentiment classification model according to an embodiment of the present disclosure is shown.

[0119] like Figure 5A As shown in , method 500 may include block 510, where computing device 20 may construct a set of emotion training texts associated with the enterprise. The emotion training text set includes multiple emotion training texts, each of which includes a news text associated with the enterprise.

[0120] In block 520, the computing device 20 may annotate the sentiment polarity of each sentiment training text in the sentiment training text set. Here, taking the three-category sentiment polarity as an example, the annotated sentiment polarity may indicate that the corresponding sentiment training text has positive sentiment, negative sentiment, or neutral sentiment.

[0121] In block 530 , the computing device 20 may train the sentiment classification model using the sentiment training text and the annotated sentiment polarity to generate a trained sentiment classification model.

[0122] In block 540 , the computing device 20 may input the current news text into a trained sentiment classification model to determine the sentiment polarity of the news text.

[0123] In some embodiments, the sentiment classification model can be built based on a BERT (Bidirectional Encoder Representation from Transformers) model. Figure 5B FIG. 5 shows a schematic diagram of the structure of a sentiment classification model 550 according to an embodiment of the present disclosure. Figure 5B As shown, the sentiment classification model 550 may include an embedding layer 551, an encoding layer 552, a pooling layer 553, and an output layer 554. In addition, a data preprocessing process may be included before the embedding layer 551 to generate a text identifier sequence input to the embedding layer, as described below. Of course, those skilled in the art will appreciate that the sentiment classification model in the present invention may also be constructed based on other appropriate machine learning models.

[0124] More specifically, training the sentiment classification model 550 in box 530 may further include: filtering the text data contained in the sentiment training text, such as performing traditional and simplified Chinese conversion, special word processing and / or filtering of predetermined tag formats within the station, etc. Then, the filtered text data is segmented, and the segmented text data is mapped into a text identification sequence, wherein each text identification sequence includes one or more discrete coding vectors. Here, the text identification sequence can be generated, for example, using a dedicated tokenizer (tokenizer) of the BERT model, which is not repeated here. The text identification sequence may include a tag encoding, a position encoding, a sentence position encoding, and an attention mask. The tag encoding is used to indicate the encoding vector of each tag conversion in the text identification sequence, the position encoding indicates the position of each tag, and the sentence position encoding indicates which sentence each tag belongs to (for example, "0" indicates that the current tag belongs to the first sentence, "1" indicates that the current identification belongs to the second sentence, etc.). The attention mask indicates whether the current tag is filled (for example, "1" indicates that the current tag is non-filled, and "0" indicates that the current tag is filled). By converting the sentiment training text into a text label sequence, the data preprocessing process before training is realized.

[0125] The generated text identifier sequence is input to the embedding layer 551 of the sentiment classification model 550 to convert the text identifier sequence into a continuous embedding vector. Then, in the encoding layer 552 of the sentiment classification model 550, the embedding vector output by the embedding layer is encoded to generate a contextual representation of the embedding vector. The encoding layer 552 can extract the output features of the embedding vector output by the embedding layer 551, and can be composed of a plurality of hidden layers with the same structure but different parameters connected in series. Each hidden layer includes, for example, a linear transformation, an activation function, multi-head self-attention, and a skip connection.

[0126] Then, in the pooling layer 553 of the sentiment classification model 550, the attention function can be used to generate a sentence-level feature vector of the embedding vector; and the quality probability distribution of the sentence-level feature vector is generated in the output layer 554 as the output vector of the sentiment training text. For example, the Softmax model can be used to obtain the quality probability distribution. The model convergence parameters of the sentiment classification model can be determined based on the output vector of the sentiment training text, the marked sentiment polarity and the loss function. For example, the forward propagation algorithm or the back propagation algorithm can be used to update the weight functions of each layer of the sentiment classification model to obtain stable model parameters.

[0127] In some embodiments, in box 520, the sentiment training text can be annotated based on the risk word dictionary. Specifically, the risk words in the risk word dictionary can be searched in the sentiment training text. Here, the risk word dictionary can be a pre-set collection of words (i.e., risk words) that represent the existence of risks or negative impacts in the industry. If a risk word is found in the sentiment training text, the semantics associated with the risk word can be determined based on the dependency syntactic rules. Dependency syntactic rules refer to the dependency relationship between words. For example, if one word modifies another word, the modifier is considered to be a subordinate word, and the modified word is called a dominant word. The relationship between the two is called a dependency relationship. Usually, the modified word is combined with the modifier to truly determine the true semantics of the modified word in the article. Then, the sentiment training text can be annotated based on the determined semantics associated with the risk word. For example, it is annotated as positive emotion, neutral emotion, or negative emotion.

[0128] In the case of using the BERT model to construct the sentiment classification model 550, determining the sentiment polarity of the news text in block 540 may include: filtering the text data contained in the news text, such as performing traditional and simplified Chinese conversion, special word processing, and / or filtering of a predetermined tag format within the site, etc. Then, segmenting the filtered text data, and mapping the segmented text data into a text identifier sequence, wherein each text identifier sequence includes one or more discrete encoding vectors.

[0129] The generated text identifier sequence is input into the embedding layer 551 of the sentiment classification model 550 to convert the text identifier sequence into a continuous embedding vector. Then, the embedding vector output by the embedding layer 551 is encoded in the encoding layer 552 of the sentiment classification model 550 to generate a contextual representation of the embedding vector.

[0130] Then, in the pooling layer 553 of the sentiment classification model 550, the sentence-level feature vector of the embedding vector can be generated using the attention function, and the quality probability distribution of the sentence-level feature vector can be generated using the Softmax model in the output layer 554. Here, the obtained quality probability distribution indicates the probability of the news text being in different sentiment polarities. Therefore, the sentiment polarity with the highest probability in the quality probability distribution can be selected as the sentiment polarity of the news text.

[0131] use Figure 5A The method of determining the sentiment polarity of a news text using the sentiment classification model 550 shown can analyze the sentiment of the news text as a whole, and thus can evaluate the risk situation of the public opinion represented by the news text to the enterprise based on the overall sentiment of the news text.

[0132] Although the above combined Figure 5A The sentiment classification model according to the present disclosure is described using the BERT model as an example. However, those skilled in the art will appreciate that the present disclosure is not limited thereto, and deep learning models such as TextCNN and Attention-BILSTM may also be used to construct a sentiment classification model that implements full-text level sentiment classification.

[0133] In addition, in some embodiments, it is also possible to construct an entity-level sentiment classification (for example, in combination with Figures 6A to 6E After the entity recognition described in method 600), the entity-level sentiment classification model is combined with Figure 5B The full-text level sentiment classification model 550 may adopt the same model structure but use different training samples.

[0134] Fig. 6A A flowchart of a method 600 for determining a topic category of a news text according to an embodiment of the present disclosure is shown. Figure 6B FIG. 6 shows a schematic diagram of the structure of a topic classification model 650 according to an embodiment of the present disclosure. Figure 6B As shown, the topic classification model 650 may include a topic extraction layer 651 and a topic clustering layer 652. In some embodiments, the topic classification model 650 may also include a topic description layer 653.

[0135] like Fig. 6AAs shown in, in box 610, in the topic extraction layer 651, the computing device 20 can use a biterm topic model (BTM) to determine the probability distribution of the title of the news text in a predetermined topic set and the probability distribution of each word in the title in each topic in the predetermined topic set.

[0136] The BTM model can learn topics by modeling the generation of bigrams in a document collection. Here, bigrams refer to word pairs that co-occur in the same context. The more times two words co-occur, the more semantically related they are, and the more likely they are to belong to the same topic. Based on this understanding, it is assumed that each bigram is generated by the same topic, and topics are generated from a mixed distribution of topics defined on the entire corpus. During the extraction process, low-frequency words, stop words, etc. can be removed. In addition, the distance between two words can also be limited. For example, for short texts, the distance between two words can be arbitrary, and for long texts, the distance between two words is usually selected between 30-60.

[0137] Figure 6C A more detailed flow chart of block 610 for determining the probability distribution of each word in a title is shown according to some embodiments of the present disclosure.

[0138] like Figure 6C As shown, block 610 may further include block 612, where the computing device 20 may segment the title of the news text to obtain a plurality of words of the title.

[0139] At block 614, computing device 20 may organize two words of the plurality of words into a two-word pair and assign a theme from a predetermined theme set to the two-word pair. Here, the predetermined theme set may include, for example, a plurality of theme categories determined based on historical news texts.

[0140] At block 616 , computing device 20 may determine a probability distribution of topics for all two-word pairs formed by the plurality of words.

[0141] At block 618 , computing device 20 may determine a probability distribution for each word in each big-word pair based on the probability distribution for the subject of the big-word pair.

[0142] continue Fig. 6A In block 620, at the topic clustering layer 652, the computing device 20 may determine the topic category of the news text using a clustering algorithm based on the probability distribution of the title of the news text in a predetermined topic set. In some embodiments, the clustering algorithm used may be an Xmeans algorithm, which does not require the number of clusters to be specified, but iteratively selects the optimal number of clusters based on the quality index of the clusters.

[0143] Fig.6DA more detailed flow chart of block 620 for determining topic categories of news text using a clustering algorithm according to some embodiments of the present disclosure is shown.

[0144] like Fig.6D As shown, block 620 may further include block 622, where computing device 20 may cluster the news titles into a plurality of clusters. For example, the news titles may be clustered using an Xmeans algorithm.

[0145] In block 624, the computing device 20 may use the entity model to identify the mentioned entity in the news text. Here, the method of using the entity model to identify the mentioned entity in the news text may be, for example, as follows: Figures 7A to 7F Method 700 is shown, but the present disclosure is not limited in this regard.

[0146] Then, in box 626, the computing device 20 can perform similar clustering merging on multiple clusters based on the mentioned entities in the news text to determine the subject category of the news text. Here, similar cluster merging refers to merging clusters with a large number of mentioned entity distributions into one cluster. In some implementations, the number of mentioned entities in each cluster can be counted, the core entities in each cluster (e.g., the number of mentioned entities greater than a certain number threshold) can be determined, and clusters with overlaps higher than a certain threshold can be merged into one cluster as the result of similar clustering merging of the mentioned entities in the news text.

[0147] continue Fig. 6A In block 630, in the topic description layer 653, the computing device 20 may select a central keyword from the news text to form a topic description of the news text. In this way, the obtained topic description can not only actually reflect the topic of the news text, but also has a good text display form, which is easy to read and improves the user experience.

[0148] Fig. 6E A more detailed flow chart of block 630 for determining a topic expression of a news text according to some embodiments of the present disclosure is shown.

[0149] like Fig. 6E As shown, block 630 may further include block 632, in which the computing device 20 may perform summary extraction on the news text. For example, in some embodiments, the computing device 20 may perform summary extraction using the TextRank algorithm.

[0150] In block 634 , the computing device 20 may select a central keyword from the summary as a description of the topic based on the mentioned entities in the news text and the number of words in the news text.

[0151] also, Figures 6A to 6EThe method 600 shown may also include a historical topic merging process, which is used to merge historical topics based on similarity to prevent the above-mentioned predetermined topic set from being too large or scattered.

[0152] More specifically, the historical topic merging process may include obtaining multiple historical topic descriptions in the predetermined topic set, that is, topic descriptions of multiple topics in the predetermined topic set. Then, a text similarity calculation may be performed on the obtained multiple historical topic descriptions to determine the text similarity between these historical topic descriptions. For example, TF-IDF (term frequency–inverse document frequency) may be used to calculate the cosine similarity between two historical topic descriptions as the text similarity. After determining the text similarity between these historical topic descriptions, the topics in the predetermined topic set may be merged based on these text similarities to update the predetermined topic set. For example, the text similarity may be compared with a predetermined similarity threshold, and two historical topics whose text similarity is less than the similarity threshold may be merged into one topic.

[0153] use Figures 6A to 6E The method of determining the topic category of a news text using a topic classification model can evaluate the risk of the news text to the enterprise based on whether the topic category of the news text belongs to a specific risk topic set. In addition, the topic category of the news text can be used as one of the attributes of the public opinion entity represented by the news text, thereby facilitating further association between the public opinion entity and the entity in the enterprise knowledge graph.

[0154] Fig. 7A A flowchart of a method 700 for identifying entity mentions in news text using an entity model according to an embodiment of the present disclosure is shown.

[0155] like Fig. 7A As shown in , method 700 may include block 710, where computing device 20 may construct an enterprise knowledge graph for the enterprise. The enterprise knowledge graph is, for example, Fig. 8A As shown, as mentioned above, the enterprise knowledge graph 810 may include multiple entities E1-E9 indicating the business elements of the enterprise, entity attributes of each entity, and entity relationships between the entities (in Fig. 8A even represented by lines between entities).

[0156] Here, the enterprise knowledge graph can be constructed based on the industry knowledge graph of the industry to which the enterprise belongs. Figure 8B A schematic diagram of an industry knowledge graph 820 according to an embodiment of the present disclosure is shown.

[0157] In this case, block 710 may further include: constructing an industry knowledge graph 820 based on the industry characteristics of the industry to which the enterprise belongs. The industry knowledge graph includes an entity set {E1}-{E9} indicating each business element of the industry, an entity attribute set of each entity, and an entity relationship set between each entity.

[0158] For example, for the food industry, it focuses on business elements such as food categories, products, food materials, ingredients, enterprises, medicines, subordinate units, brands, nutrients, etc., so it can build business elements such as Figure 8B The industry knowledge graph 820 shown, for example, wherein {E1} is an entity set representing brands, {E2} is an entity set representing products, {E3} is an entity set representing food categories, {E4} is an entity set representing ingredients, {E5} is an entity set representing nutrients, {E7} is an entity set representing enterprises, {E6} is an entity set representing subordinate units of enterprises, {E8} is an entity set representing medicines, and {E9} is an entity set representing food materials. Various entities and their corresponding attribute sets are shown in Table 2 below.

[0159] Table 2

[0160]

[0161] The relationship between entities is shown in Table 3 below.

[0162] Table 3

[0163]

[0164]

[0165] After the industry knowledge graph 820 is constructed, the enterprise knowledge graph 810 of the target enterprise can be constructed based on the business data of the target enterprise and the industry knowledge graph 820. For example, a specific name in the entity set {E7} in the industry knowledge graph 820 can be selected as the entity E7 in the enterprise knowledge graph 810, and the relationship between entity E7 and entity E8 is established as "the enterprise supplies medicines", and the relationship between entity E7 and entity E9 is established as "the enterprise supplies food materials".

[0166] In addition, as mentioned above, the enterprise knowledge graph 810 may also include the public opinion entity corresponding to the news text and the mentioned entity identified from the news text. Specifically, a public opinion entity may be constructed for the news text, the attributes of which include the topic category and sentiment polarity of the news text, and the public opinion entity and the mentioned entity identified from the news text are added to the enterprise knowledge graph 810, such as Fig. 8AThe public opinion entity is shown in Table 4 below, for example, where the attributes of the public opinion entity may include the topic category and sentiment polarity of the news text.

[0167] Table 4

[0168]

[0169] In addition, when there are multiple news texts, the similarity relationship between the public opinion entities corresponding to each news text can also be constructed. For example, the vector distance between the public opinion entity and the existing public opinion entity can be determined, and when the vector distance is lower than a certain threshold, the two public opinion entities are considered to be similar, thereby constructing the relationship between the two public opinion entities as similar. For example, Table 5 shows two public opinion entities with a similar relationship.

[0170] Table 5

[0171] relation entity resemblance Public opinion entity 1, public opinion entity 2

[0172] Here, as mentioned above, the method for determining the subject category of the news text may be, for example, combining Figures 6A to 6E The method 600 described above, the method for determining the sentiment polarity of the news text may be, for example, the method 500 described in conjunction with FIG. 5 . In addition, the method for identifying the mentioned entity from the news text may be, for example, the following method combined with Figures 7B to 7E and as described in detail in block 720.

[0173] In box 720, the computing device 20 can use the entity model to identify one or more mentioned entities, the attributes of each mentioned entity, and the entity relationships between the mentioned entities from the news text. Here, the description and attributes of the mentioned entities are shown in Table 2 above, and the entity relationships between the mentioned entities are shown in Table 3 above. The identification of entities and entity relationships may include a serial method or a joint identification method. For the former, the entity model may include two serial models, namely an entity recognition model and an entity relationship model, which can first identify entities from the text and then identify entity relationships between entity pairs. The method of identifying entities and entity relationships in a serial manner is, for example, combined with the following Figure 7B As shown in detail. For the latter, entities and relationships between entities can be jointly extracted. For the joint extraction method, it can further include joint extraction based on parameter sharing and joint extraction of entity relationships based on joint decoding. The joint extraction method based on parameter sharing is for example combined with the following Figure 7C As shown in detail.

[0174] At block 730, the computing device 20 may determine an entity distance between the mentioned entity identified at block 720 and multiple entities in the enterprise knowledge graph (e.g., entities E1-E9 in the enterprise knowledge graph 810). The process of determining the entity distance may be, for example, as follows: Figure 7F Described in detail.

[0175] In block 740, the computing device 20 may determine, based on the entity distance, that the mentioned entity hits the enterprise knowledge graph 810. Specifically, the computing device 20 may determine whether the entity distance calculated in block 730 is less than a predetermined distance threshold, and when the entity distance is less than the predetermined distance threshold, determine that the mentioned entity hits an entity in the enterprise knowledge graph 810. In this case, the entity hit in the enterprise knowledge graph 810 is also referred to as a hit entity.

[0176] Figure 7B FIG. 7 is a further detailed flowchart of block 720 for identifying entity mentions and entity relationships from news text using an entity model according to some embodiments of the present disclosure. Figure 7B In the illustrated embodiment, the entity model includes a serial entity recognition model and an entity relationship model, which work in a pipeline manner. The entity recognition model is first used to identify mentioned entities from news text, and then the entity relationship model is used to determine the entity relationship between the identified mentioned entities.

[0177] like Figure 7B As shown, box 720 may include box 721, in which the computing device 20 can annotate entities in the training text and entity relationships between entities. Here, the training text may be a historical news text in a historical news text library. Among them, entities that need attention, such as entities related to risk warnings for food safety, can be annotated, and the entity relationships between these entities that need attention can be annotated, for example, based on at least a part of the entity relationships shown in Table 3, the entity relationships in the training text are annotated. That is, both entity labels and entity relationship labels can be set in the training text. In addition, entity attributes can also be selected according to the focus, for example, the attributes of concern are selected from the entity attributes shown in Table 2, and the attributes of the entity are annotated. Further, in some embodiments, the sentiment polarity at the entity level can also be annotated.

[0178] In block 722 , the computing device 20 may train the entity recognition model using the annotated training text to generate a trained entity recognition model.

[0179] In block 723, the computing device 20 may train the entity relationship model using the annotated training text to generate a trained entity relationship model. Thus, by annotating the entities and entity relationships in the training text, the trained entity recognition model and entity relationship model are obtained using the training text.

[0180] In block 724 , the computing device 20 may use the trained entity recognition model to identify one or more mentioned entities and attributes of each mentioned entity from the news text to be recognized.

[0181] Depending on the different entity labels, the entity content that can be recognized by the trained entity recognition model is also different. For example, the content of the entity annotation usually includes the location and type, so the content of the entity mentioned by the trained entity recognition model usually also includes the location and type of the entity mentioned.

[0182] In box 725, the computing device 20 can use the trained entity relationship model and one or more mentioned entities identified from the news text in box 724 to determine the entity relationship between each mentioned entity. Here, depending on the different entity relationship labels marked, the entity relationship that can be identified by the trained entity relationship model is also different. For example, if only the entity relationship between the enterprise and its subordinate units shown in Table 3 is marked, the trained entity relationship model can only identify the relationship between the two when the mentioned entity is an enterprise and its subordinate units.

[0183] In addition, in some embodiments, for example, during a cold start, a keyword dictionary may be directly used to identify mentioned entities in the news text. For example, a string matching method may be used to directly search for keywords preset by the enterprise from the news text.

[0184] Figure 7C FIG. 7 is a further detailed flowchart of block 720 for identifying mentioned entities and entity relationships from news text using an entity model according to some other embodiments of the present disclosure. Figure 7C In the illustrated embodiment, the entity model includes a joint recognition model of entities and entity relationships. From the perspective of task completion, the joint recognition model still has to complete two tasks, entity recognition and entity relationship recognition, that is, it involves two sub-models. The difference is that in the joint recognition model, at least a part of the two sub-models can be shared. For example, it can be entity relationship extraction based on parameter sharing or entity relationship extraction based on joint decoding.

[0185] like Figure 7C As shown in , box 720 may include box 721 ′, in which the computing device 20 may annotate entities in the training text and entity relationships between entities.

[0186] Similarly, the training text may be a historical news text in a historical news text library. Among them, entities that need attention, such as entities related to risk warnings for food safety, may be annotated. In addition, entity attributes may be selected based on the focus, such as selecting the attributes of interest from the entity attributes shown in Table 2, and annotating the attributes of the entity, and the entity relationships in the training text may be annotated based on at least a portion of the entity relationships shown in Table 3. Furthermore, in some embodiments, the sentiment polarity at the entity level may also be annotated.

[0187] In block 722 ′, the computing device 20 may train the joint recognition model using the annotated training text to generate a trained joint recognition model.

[0188] In block 723 ′, the computing device 20 may use the trained joint recognition model to identify one or more mentioned entities and attributes of each mentioned entity and entity relationships between the mentioned entities from the news text.

[0189] In some embodiments, the joint recognition model is an entity and relationship joint recognition model based on parameter sharing. Fig.7D A structural diagram of an entity and relationship joint recognition model 750 based on parameter sharing according to an embodiment of the present disclosure is shown. Fig. 7E FIG. 7 shows a detailed flow chart of block 722′ for training the joint recognition model 750 using annotated training text according to some embodiments of the present disclosure. Fig.7D As shown, the entity and relationship joint recognition model 750 based on parameter sharing may include an embedding layer 751, a shared encoding layer 752, an entity decoding layer 753, a relationship decoding layer 754 and a loss function layer 755.

[0190] like Fig. 7E As shown in , box 722' also includes box 7221', where the computing device 20 can input the annotated training text into the embedding layer 751 to convert it into an embedding vector.

[0191] In block 7222', the computing device 20 may extract the semantic encoding of the training text from the embedding vector obtained in block 7221' using the context model in the shared encoding layer 752. Here, the semantic encoding may include the grammatical and syntactic features of the training text.

[0192] In box 7223', the computing device 20 may calculate the score distribution of the entity tag category of the training text according to the semantic encoding obtained in box 7222' at the entity decoding layer 753.

[0193] In block 7224', the computing device 20 may calculate the score distribution of the relationship tag categories of the training text according to the semantic encoding obtained in block 7222' at the relationship decoding layer 754.

[0194] In box 7225', the computing device 20 can use the cross entropy function in the loss function layer 755 to determine the loss value based on the score distribution of the entity label category, the score distribution of the relationship label category and the true distribution of the training text.

[0195] In block 7226', the computing device 20 may iteratively optimize the joint recognition model 750 based on the loss value determined in block 7225' to obtain a trained joint recognition model. Here, a back propagation algorithm may be used to update the model parameters of the joint recognition model 750 to achieve the dependency between the entity decoding layer 753 and the relationship decoding layer 754.

[0196] In some embodiments, the shared encoding layer 752 may include a bidirectional LSTM model, the entity decoding layer 753 may include an LSTM model, and the relationship decoding layer 754 may include a CNN model. In other words, the joint recognition model 750 is a joint recognition model based on LSTM and CNN.

[0197] Utilizing the joint recognition model 750, the label dependency problem in entity recognition is solved by encoding the input text through a shared encoding layer and then using an LSTM model and a CNN model for entity recognition and entity relationship classification respectively. In addition, a backpropagation algorithm is used to update shared parameters during iterative optimization of the model to realize the dependency between the two subtasks.

[0198] Figure 7F A more detailed flow chart of block 730 for determining entity distance is shown in accordance with an embodiment of the present disclosure.

[0199] like Figure 7F As shown, block 730 may include block 732, where the computing device 20 may determine a word vector as an entity name distance based on the entity name of the mentioned entity determined in block 720 and the entity name of an entity in the enterprise knowledge graph. Fig. 8A As shown in , the mentioned entity A1 and the entity E2 in the enterprise knowledge graph 810 can be represented as word vectors V A1 and V E2 (The word vector can be the word vector after removing non-keyword characters.) Then, the entity name distance between the two entities can be expressed as D1 = || V A1 -V E2 ||.

[0200] In block 734, the computing device 20 may determine multiple word vectors as entity attribute distances based on each attribute of the mentioned entity and multiple attributes of an entity in the enterprise knowledge graph. Fig. 8A As shown in , the attributes of the mentioned entity A1 and the attributes of the entity E2 in the enterprise knowledge graph 810 can be represented as multiple word vectors V A1_i and V E2_i Then, the entity attribute distance between these two entities can be expressed as

[0201]

[0202] In block 736, the computing device 20 may determine the entity distance between the mentioned entity A1 and the entity E2 in the enterprise knowledge graph 810 based on the entity name distance D1 and the entity attribute distance D2. In some embodiments, the entity distance D = D1 + D2.

[0203] In some other embodiments, the entity distance D=α1*D1+α2*D2, wherein α1 and α2 are empirical weight values.

[0204] Use Figures 7A to 7F The method 700 shown, by using an entity model to identify entities in news texts and determining that the identified entities hit entities in the enterprise knowledge graph, can determine from the entity level whether the news text poses a public opinion risk to the enterprise.

[0205] Fig. 9 FIG. 9 is a block diagram of a computing device 900 suitable for implementing an embodiment of the present disclosure. The computing device 900 may be, for example, the computing device 20 described above.

[0206] like Fig. 9 As shown in the figure, the computing device 900 may include one or more central processing units (CPU) 910 (only one is schematically shown in the figure), which can perform various appropriate actions and processes according to computer program instructions stored in a read-only memory (ROM) 920 or computer program instructions loaded from a storage unit 980 to a random access memory (RAM) 930. In the RAM 930, various programs and data required for the operation of the computing device 900 can also be stored. The CPU 910, the ROM 920, and the RAM 930 are connected to each other via a bus 940. An input / output (I / O) interface 950 is also connected to the bus 940.

[0207] A number of components in the computing device 900 are connected to the I / O interface 950, including: an input unit 960, such as a keyboard, a mouse, etc.; an output unit 970, such as various types of displays, speakers, etc.; a storage unit 980, such as a disk, an optical disk, etc.; and a communication unit 990, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 990 allows the computing device 900 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0208] The methods 200 to 700 described above may be performed, for example, by the CPU 910 of the computing device 900. For example, in some embodiments, the methods 200 to 700 may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 980. In some embodiments, part or all of the computer program may be loaded and / or installed on the computing device 900 via the ROM 920 and / or the communication unit 990. When the computer program is loaded into the RAM 930 and executed by the CPU 910, one or more operations of the methods 200 to 700 described above may be performed. In addition, the communication unit 990 may support wired or wireless communication functions.

[0209] Those skilled in the art will understand that Fig. 9 The computing device 900 shown is exemplary only. In some embodiments, the computing device 20 may include more or fewer components than the computing device 900.

[0210] The above describes the methods 200 and 300 for enterprise risk assessment based on news text according to the present disclosure, as well as specific implementation methods 400 to 700 of some of these methods, and a computing device 900 that can be used as the computing device 20 in conjunction with the accompanying drawings. However, those skilled in the art will appreciate that the execution of the steps and sub-steps of the methods 200 to 700 is not limited to the order shown in the figures and described above, but can be executed in any other reasonable order. In addition, the computing device 900 does not necessarily include Fig. 9 All components shown in the figure may include only some of the components necessary to perform the functions described in the present disclosure, and the connection method of these components is not limited to the form shown in the figure.

[0211] The present disclosure may be a method, an apparatus, a system and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for executing various aspects of the present disclosure.

[0212] In one or more exemplary designs, the functions described in the present disclosure may be implemented using hardware, software, firmware, or any combination thereof. For example, if implemented using software, the functions may be stored as one or more instructions or codes on a computer-readable medium, or transmitted as one or more instructions or codes on a computer-readable medium.

[0213] The various units of the apparatus disclosed herein may be implemented using discrete hardware components or may be integrated on a hardware component, such as a processor. For example, the various exemplary logic blocks, modules, and circuits described in conjunction with the present disclosure may be implemented or executed using a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof for performing the functions described herein.

[0214] Those skilled in the art should also understand that the various illustrative logical blocks, modules, circuits, and algorithm steps described in conjunction with the embodiments of the present disclosure may be implemented as electronic hardware, computer software, or a combination of the two.

[0215] The above description of the present disclosure is intended to enable any person of ordinary skill in the art to implement or use the present disclosure. Various modifications of the present disclosure are obvious to those of ordinary skill in the art, and the general principles defined herein may also be applied to other variations without departing from the spirit and scope of the present disclosure. Therefore, the present disclosure is not limited to the examples and designs described herein, but is consistent with the broadest scope of the principles and novel features disclosed herein.

Claims

1. A method for enterprise risk assessment based on news text, comprising: Constructing a public opinion entity for the news text, wherein the attributes of the public opinion entity include the subject category and sentiment polarity of the news text; Determine the direct relationship risk value and the associated risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise; Determine the indirect relationship risk value of the news text to the enterprise based on the enterprise knowledge graph and the historical news text collection; as well as Determine the risk value of the news text to the enterprise based on the direct relationship risk value, the indirect relationship risk value and the associated risk value, Wherein determining the direct relationship risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise comprises: identifying mentioned entities in the news text using an entity model; Determining a hit entity of the mentioned entity in the enterprise knowledge graph of the enterprise; and Determine the direct relationship risk value between the public opinion entity and the hit entity based on the enterprise knowledge graph, Wherein determining the indirect relationship risk value of the news text to the enterprise based on the enterprise knowledge graph and the historical news text set includes: Determining, from a historical news text collection, a plurality of historical public opinion entities similar to the public opinion entity of the news text; and Based on the enterprise knowledge graph, indirect relationship risk values ​​between the multiple historical public opinion entities and the hit entities of the news text in the enterprise knowledge graph are determined.

2. The method of claim 1, wherein determining the direct relationship risk value comprises: The direct relationship risk value is determined based on the total number of paths between the public opinion entity and the hit entity.

3. The method of claim 1, wherein determining the direct relationship risk value comprises: The direct relationship risk value is determined based on the total number of paths within a predetermined distance between the public opinion entity and the hit entity.

4. The method according to claim 1, wherein determining the associated risk value of the news text to the enterprise based on the public opinion entity and the enterprise knowledge graph of the enterprise comprises: Based on the label propagation algorithm, determine the concerned entities associated with the public opinion entity from the enterprise knowledge graph, and mark the risk value for each concerned entity; as well as An associated risk value of the public opinion entity is determined based on the risk value of the concerned entity.

5. The method of claim 1, wherein determining the indirect relationship risk value comprises: The indirect relationship risk value is determined based on the similarity between the public opinion entity and the hit entity.

6. The method of claim 1, further comprising: Using an entity model to identify entities in the news text and determine hit entities of the identified entities in the enterprise knowledge graph of the enterprise; The direct relationship risk value between the public opinion entity and the hit entity is determined based on the enterprise knowledge graph.

7. The method according to claim 1, wherein constructing a public opinion entity for the news text comprises: The sentiment polarity of the news text is determined using a sentiment classification model, where the sentiment polarity indicates positive sentiment, negative sentiment, or neutral sentiment.

8. The method of claim 7, further comprising: Constructing a set of emotion training texts associated with the enterprise, wherein the set of emotion training texts includes a plurality of emotion training texts, and each emotion training text includes a news text associated with the enterprise; Labeling the sentiment polarity of each sentiment training text in the sentiment training text set; Training the sentiment classification model using the sentiment training text and the marked sentiment polarity to generate a trained sentiment classification model; as well as The news text is input into a trained sentiment classification model to determine the sentiment polarity of the news text.

9. The method of claim 8, wherein inputting the news text into a trained sentiment classification model to determine the sentiment polarity of the news text comprises: Filtering text data contained in the news text; Segmenting the filtered text data, and mapping the segmented text data into text identifier sequences, wherein each text identifier sequence includes one or more discrete encoding vectors; Inputting the generated text identifier sequence into an embedding layer of the sentiment classification model to convert the text identifier sequence into a continuous embedding vector; Encoding the embedding vector output by the embedding layer at the encoding layer of the sentiment classification model to generate a contextual representation of the embedding vector; Generating a sentence-level feature vector of the embedding vector using an attention function at a pooling layer of the sentiment classification model; generating a quality probability distribution of the sentence-level feature vector, wherein the quality probability distribution indicates the probability of the news text being at different sentiment polarities; and The sentiment polarity with the highest probability in the quality probability distribution is selected as the sentiment polarity of the news text.

10. The method according to claim 8, wherein labeling the sentiment polarity of each sentiment training text in the sentiment training text set comprises: searching the risk words in the risk word dictionary in the sentiment training text; If a risk word is found in the sentiment training text, determining the semantics associated with the risk word based on dependency syntactic rules; as well as The sentiment training text is annotated based on the semantics associated with the risk words.

11. The method according to claim 1, wherein constructing a public opinion entity for the news text comprises: The topic category of the news text is determined using a topic classification model.

12. The method of claim 11, wherein the topic classification model comprises a topic extraction layer, a topic clustering layer and a topic description layer, and wherein constructing a public opinion entity for the news text comprises: At the topic extraction layer, using a two-word topic model, the probability distribution of the title of the news text in a predetermined topic set and the probability distribution of each word in the title in each topic in the predetermined topic set are determined; At the topic clustering layer, based on the probability distribution of the title of the news text in a predetermined topic set, a clustering algorithm is used to determine the topic category of the news text; and At the topic description layer, central keywords are selected from the news text to form a topic description of the news text.

13. The method of claim 12, wherein at the topic extraction layer, using a two-word topic model, determining the probability distribution of the title of the news text in a predetermined topic set and the probability distribution of each word in the title in each topic in the predetermined topic set comprises: Segmenting the title of the news text to obtain a plurality of words of the title; Organizing two words from the plurality of words into a bigram pair and assigning a topic from the predetermined topic set to the bigram pair; Determine the probability distribution of topics of all two-word pairs formed by the plurality of words; A probability distribution for each word in each big-word pair is determined based on the probability distribution for the subject of the big-word pair.

14. The method of claim 12, wherein at the topic clustering layer, based on the probability distribution of the title of the news text in a predetermined topic set, determining the topic category of the news text using a clustering algorithm comprises: Cluster news headlines into multiple clusters; identifying mentioned entities in the news text using an entity model; as well as The plurality of clusters are similarly clustered and merged based on the mentioned entities in the news text to determine a topic category of the news text.

15. The method according to claim 12, wherein at the topic description layer, selecting central keywords from the news text to form the topic description of the news text comprises: Extracting a summary of the news text; as well as Based on entities in the news text and the number of words in the news text, central keywords are selected from the summary as a description of the topic.

16. The method of claim 12, further comprising: Obtaining a plurality of historical topic descriptions in the predetermined topic set; Performing text similarity calculation on the plurality of historical topic descriptions to determine text similarities between the plurality of historical topic descriptions; and Based on the text similarities between the multiple historical topic descriptions, topics in the predetermined topic set are merged to update the predetermined topic set.

17. A computing device comprising: at least one processor; as well as At least one memory, the at least one memory being coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the computing device to perform the steps of the method according to any one of claims 1 to 16.

18. A computer-readable storage medium having a computer program code stored thereon, wherein the computer program code executes the method according to any one of claims 1 to 16 when executed.

Images