Information analysis device and information analysis method
The information analysis device addresses user comprehension and scalability issues by linking natural language to analysis results and using a key-value database, ensuring efficient and flexible cybersecurity information analysis.
Patent Information
- Application Number
- JP2020172800
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-10-13
- Publication Date
- 2024-12-09
- Estimated Expiration
- 2040-10-13
AI Technical Summary
Conventional cybersecurity information analysis methods face challenges in linking natural language to analysis results, leading to user comprehension difficulties, slow search speeds due to large data volumes, and high costs associated with scalability and flexibility issues in monolithic designs.
An information analysis device that analyzes security-related information, generates linked index information, and uses a key-value database for efficient storage and retrieval, ensuring user-friendly results and maintaining scalability and flexibility through a publisher-subscriber model.
The device provides understandable analysis results with maintained search speed and ensures scalability and flexibility, allowing for easy expansion of functionality and efficient information retrieval.
Smart Images

Figure 0007595915000001 
Figure 0007595915000002 
Figure 0007595915000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information analysis device and an information analysis method. [Background technology]
[0002] for example Non-patent literature 1 describes a monolithically designed technology that consistently performs a series of processes, such as collecting cybersecurity-related information from information sources, storing the collected information in a database, and analyzing the stored information. Analysis refers to, for example, finding meaning from connections between IoCs (Indicators of Compromise) or clusters consisting of multiple IoCs, and modeling the associations between IoCs from cybersecurity-related articles written in natural language. [Prior art documents] [Non-patent literature]
[0003] [Non-Patent Document 1] Onuki Ito, Tatsuya Nagai, Kenta Nomura, Hidenori Kondo, Masaki Kamizono, Yoshiaki Shiraishi, Keisuke Furumoto, Maki Takita, Kumi Mori, Tadashi Takano, Masakatsu Morii. Diamond Model-Based Threat Analysis System for Threat Intelligence. Transactions of the Institute of Electronics, Information and Communication Engineers, Vol. J101-D, No. 10, pp. 1427-1437, 2018. Summary of the Invention [Problem to be solved by the invention]
[0004] however Non-patent literature 1 Conventional methods such as those described in the article have the problem that the analysis results are not linked to natural language, making them difficult for users to understand. Non-patent literature 1 However, the conventional method described in does not take into consideration the search speed of a database that stores cybersecurity-related information, and there is a problem that the search speed may decrease when the amount of information stored in the database increases. Non-patent literature 1 Conventional techniques such as those described in the above have a problem in that, since they use a monolithic design, it is difficult to ensure scalability and flexibility, and the cost tends to increase when improving the processing.
[0005] An object of one aspect of an embodiment of the present invention is to provide an information analysis device that makes analysis results easy for a user to understand, is less likely to reduce search speed, and ensures expandability and flexibility. [Means for solving the problem]
[0006] Provided is an information analysis device that analyzes security-related information, which is information related to security, including threat information, which is information obtained by observing security threats, and usage example information, which is information on usage examples of security threats, transmitted from a threat observation device, and generates analysis result information, which is information resulting from the analysis.The information analysis device includes a publisher message receiving unit that receives the security-related information, a pre-processing unit that generates multiple types of index information for searching for security-related information from the threat information, and performs pre-processing to input entity information, which is the threat information linked to the index information, into a database storage unit that stores a key-value database, a cross-sectional analysis unit that extracts associations between multiple types of index information by searching for other index information that is not linked to the entity information using the index information as an exact match search key, searches for the usage example information using the index information as an exact match search key, and generates analysis result information in which phrase information, which is a phrase in natural language stored in the index information as part of the usage example information, is linked to the index information, and a subscriber transceiver unit that transmits the analysis result information to a user terminal used by a user who analyzes the security-related information.
[0007] Provided is an information analysis method executed by an information analysis device that analyzes security-related information, which is information related to security, including threat information, which is information on observed security threats transmitted from a threat observation device, and usage example information, which is information on usage examples of security threats, and generates analysis result information, which is information resulting from the analysis, the information analysis method comprising: a first step of receiving the security-related information; a second step of performing preprocessing of generating multiple types of index information for searching the security-related information from the threat information and inputting entity information, which is the threat information linked to the index information, into a database storage unit that stores a key-value database; a third step of searching for other index information that is not linked to the entity information using the index information as an exact match search key to extract associations between the multiple types of index information, and searching the usage example information using the index information as an exact match search key, to generate analysis result information in which phrase information, which is a phrase in natural language stored in the index information as part of the usage example information, is linked to the index information; and a fourth step of transmitting the analysis result information to a user terminal used by a user who analyzes the security-related information. Effect of the Invention
[0008] According to one aspect of the embodiment of the present invention, it is possible to realize an information analysis device that allows a user to easily understand the analysis results, is less likely to experience a decrease in search speed, and ensures expandability and flexibility. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram showing a configuration of an information analysis system including an information analysis device according to this embodiment. [Diagram 2] FIG. 2 is a diagram showing an overview of a key-value database stored in the information analysis device according to this embodiment. [Diagram 3] FIG. 3 is a diagram showing the concept of the data structure of the key-value database stored in the information analysis device according to this embodiment. [Figure 4]FIG. 4 shows a screen displayed on a user terminal by the information analysis device according to this embodiment. [Diagram 5] FIG. 5 is a flowchart showing the procedure of the information analysis process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] An embodiment of the present invention will be described in detail below with reference to the drawings.
[0011] 1 is a block diagram showing a configuration of an information analysis system including an information analysis device 1 according to this embodiment. The information analysis system includes the information analysis device 1, a threat observation device 2, a use example listing device 3, and a user terminal 4.
[0012] In the information analysis system shown in Figure 1, an information analysis device 1 receives threat information (hereinafter, this may be referred to as IoC), which is information on observed security threats, transmitted from a threat observation device 2, and usage example information, which is information on usage examples of security threats, transmitted from a usage example enumeration device 3.
[0013] The information related to security, including the threat information and the usage example information, may be called security-related information. When the information analysis device 1 receives the security-related information, it analyzes the security-related information, generates analysis result information which is information on the result of the analysis, and transmits the analysis result information to the user terminal 4.
[0014] The threat observation device 2 may be one or more, and may be, for example, a honeypot device that is a device that receives unauthorized access without conducting regular communication, or a darknet observation device that observes unused IP addresses called a darknet.
[0015] For example, a honeypot device transmits threat information including an IP address or a hash value of a file to the information analysis device 1. Also, for example, a darknet monitoring device transmits threat information including an IP address or a domain name to the information analysis device 1.
[0016] The use case enumeration device 3 may be one or more, and may be, for example, an ATT&CK providing device that provides ATT&CK (Adversarial Tactics, Techniques, and Common Knowledge), which is a structured list of known attacker behaviors summarized by MITRE into tactics and techniques and expressed not only in a small number of matrices but also in STIX (Structured Threat Information eXpression) / TAXII (Trusted Automated eXchange of Indicator Information).
[0017] Furthermore, the use example enumeration device 3 may be an article extracted phrase providing device that obtains the contents of articles from an RSS feed, extracts phrases written in natural language from the obtained article contents, and provides the extracted phrases.
[0018] The usage example information includes threat information, and for example, the usage example information sent to the information analysis device 1 by the ATT&CK providing device or the article extracted phrase providing device includes IP addresses, domain names, and file hash values.
[0019] The user terminal 4 is one or more terminals used by a user who analyzes security-related information using the information analysis device 1, and may be a personal computer, a tablet terminal, a smartphone, or the like. The user terminal 4 may be a threat information platform providing device that is a device that aggregates and accumulates threat information, or a Security Information and Event Management (SIEM) device that provides security-related information and manages events that are actions or occurrences that occur within a program.
[0020] The information analysis device 1 includes a publisher message receiving unit 5, a preprocessing unit 6, a cross-sectional analysis unit 7, a database storage unit 8, and a subscriber transmitting / receiving unit 9. The publisher message receiving unit 5 receives security-related information from threat observation devices 2 and use case enumeration devices 3, which are publishers to the information analysis device 1. The publisher message receiving unit 5 receives the security-related information every time the security-related information is issued.
[0021] The pre-processing unit 6 includes an index information generation unit 10 that generates multiple types of index information for searching for security-related information from threat information, and an entity information input unit 11 that inputs entity information, which is threat information linked to the index information, into the database memory unit 8.
[0022] The cross-sectional analysis unit 7 includes an association extraction unit 12 and a semantic assignment unit 13. The association extraction unit 12 extracts associations between multiple types of index information by searching for other index information that is not linked to the entity information as a search key for an exact match. The semantic assignment unit 13 searches for the use example information as a search key for an exact match, and generates analysis result information in which phrase information, which is a phrase in natural language stored in the index information as a part of the use example information, is linked to the index information.
[0023] The database storage unit 8 stores a key-value database DB1, which is a key-value database in which a value is associated with a search key. In the key-value database DB1, a value is searched for by the search key.
[0024] The subscriber transceiver unit 9 transmits the analysis result information to the subscriber user terminal 4. The subscriber transceiver unit 9 may transmit information related to the requested index information included in the analysis result acquisition request from the user terminal 4 in the requested order. For example, the publisher message receiver 5, the preprocessing unit 6, the cross-sectional analysis unit 7, the database storage unit 8 and the subscriber transceiver unit 9 are integrated circuits.
[0025] Next, an overview of the key-value database DB1 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an overview of the key-value database DB1 stored in the information analysis device 1 according to this embodiment. The key-value database DB1 includes key-value databases DB11 to DB18.
[0026] As shown in Figure 2, a search key is composed of at least one of one or more index information and phrase information, and is processed in order. Also, as shown in Figure 2, a search key can have a specific value and a generic value, and when the search key is a specific value, it links multiple types of index information and phrase information. When the search key is composed only of a generic value, the search key serves as a table of contents.
[0027] For example, in the key-value database DB11, when the search key is "cure:pub:ip-index", the search key consists only of generic values such as "cure", "pub", and "ip-index". The value associated with the search key consisting only of generic values serves as a table of contents. When the search key is "cure:pub:ip-index", the value will be an IP address such as "203.0.113.1".
[0028] For example, in the key-value database DB12, when the search key is "cure:pub:ip:203.0.113.1", the search key consists of generic values such as "cure", "pub", and "ip" indicating an IP address, and a specific value such as "203.0.113.1".
[0029] If the search key is "cure:pub:ip:203.0.113.1", the value will be entity information such as "timestamp:159356923,publisher_id:300,dst_ip:"203.0.113.1",dst_port:443,...,content:"SuspiciousFileDownload". The specific value of the IP address, "203.0.113.1", becomes index information linked to the entity information.
[0030] For example, in the key-value database DB13, when the search key is "cure:pub:ip:203.0.113.1:domain", the search key consists of generic values such as "cure", "pub", "ip" indicating an IP address, and "domain" indicating a domain name, as well as the specific value of the IP address, "203.0.113.1". Therefore, the specific value of the IP address, "203.0.113.1", links the IP address, which is index information, with the domain name, which is index information.
[0031] If the search key is "cure:pub:ip:203.0.113.1:domain", the value will be a specific domain name such as "www.example.net". The specific IP address "203.0.113.1" becomes the index information associated with the specific domain name.
[0032] For example, in the key-value database DB14, when the search key is "cure:pub:ip:203.0.113.1:file", the search key is composed of generic values such as "cure", "pub", "ip" indicating an IP address, and "file" indicating a hash value of a file, as well as the specific value of the IP address, "203.0.113.1". Therefore, the specific value of the IP address, "203.0.113.1", links the IP address, which is index information, with the hash value of the file, which is index information.
[0033] If the search key is "cure:pub:ip:203.0.113.1:file", the value will be the specific value of the file's hash value, such as "73336a8e9ea4345084c903336be41264". The specific IP address "203.0.113.1" becomes the index information associated with the specific value of the file's hash value.
[0034] For example, in the key-value database DB15, when the search key is "cure:pub:ip:203.0.113.1:tag", the search key is composed of generic values such as "cure", "pub", "ip" indicating an IP address, and "tag" indicating phrase information, as well as the specific value of the IP address, "203.0.113.1". Therefore, the IP address "203.0.113.1" links the IP address, which is index information, with the phrase information.
[0035] If the search key is "cure:pub:ip:203.0.113.1:tag", the value will be a specific value of the phrase information, such as "Group123". The specific value of the IP address, "203.0.113.1", becomes index information linked to the specific value of the phrase information. As an easier-to-understand example, specific values of phrase information include "WannaCry" and "Ransomeware".
[0036] For example, in the key-value database DB16, when the search key is "cure:pub:tag:Group123:ip", the search key is made up of generic values such as "cure", "pub", "tag" indicating phrase information, and "ip" indicating an IP address, as well as "Group123", which is a specific value of phrase information. Therefore, "Group123", which is phrase information, links between the phrase information and the IP address, which is index information.
[0037] If the search key is "cure:pub:tag:Group123:ip," the value will be a specific IP address, such as "203.0.113.1." The specific value of the phrase information, "Group123," becomes index information linked to the specific value of the IP address.
[0038] For example, in the key-value database DB17, when the search key is "cure:pub:tag:Group123:domain", the search key is made up of generic values such as "cure", "pub", "tag" indicating phrase information, and "domain" indicating a domain name, as well as "Group123" which is a specific value of phrase information. Therefore, "Group123", which is phrase information, links between the phrase information and the domain name which is index information.
[0039] When the search key is "cure:pub:tag:Group123:domain", the value is a specific domain name such as "www.example.org". The specific value of the phrase information, "Group123", becomes index information linked to the specific value of the domain name.
[0040] For example, in the key-value database DB18, when the search key is "cure:pub:tag:Group123:file", the search key is made up of generic values such as "cure", "pub", "tag" indicating phrase information, and "file" indicating the hash value of the file, as well as "Group123" which is a specific value of the phrase information. Therefore, "Group123", which is the phrase information, links the phrase information with the hash value of the file which is index information.
[0041] If the search key is "cure:pub:tag:Group123:file", the value will be a specific value of the file's hash value, such as "73336a8e9ea4345084c903336be41264". The specific value of the phrase information, "Group123", becomes index information linked to the specific value of the file's hash value.
[0042] Next, the data structure of the key-value database DB1 will be described with reference to Fig. 3. Fig. 3 is a diagram showing the concept of the data structure of the key-value database DB1 stored in the information analysis device 1 according to this embodiment. As shown in Fig. 3, the key-value database DB1 has a hierarchical structure, and for example, the top layer is linked by index information, and the bottom layer is linked by word / phrase information.
[0043] Specifically, the first hierarchical level, which is the highest hierarchical level, is key-value database DB11, the second hierarchical level, which is key-value databases DB12, DB13, and DB15, and the third hierarchical level, which is the lowest hierarchical level, is key-value databases DB16, DB17, and DB18.
[0044] The first and second hierarchical layers are linked by "203.0.113.1", which is a specific value of an IP address, and the second and third hierarchical layers are linked by "Group123", which is a specific value of word information.
[0045] Next, the screen 20 displayed on the user terminal 4 will be described with reference to Fig. 4. Fig. 4 shows the screen 20 displayed on the user terminal 4 by the information analysis device 1 according to this embodiment. As shown in Fig. 4, the screen 20 includes, for example, an API (Application Programming Interface) in JSON (JavaScript Object Notation) format and a web user interface.
[0046] Appropriate information is displayed on screen 20 according to the user's use case. An IP address and phrase information are displayed on screen 20. Since information for displaying phrases in natural language is transmitted to user terminal 4, the phrase information is displayed on screen 20.
[0047] The screen 20 will be described in detail. The screen 20 includes areas 21 to 30. The area 21 displays the IP address that is the subject of analysis. The area 22 displays options for selecting the type of the analysis subject. The area 23 displays which region the analysis subject is from.
[0048] The word information is displayed in the area 24. The year, month, day, hour, minute, and second when the index information or word information was last published by the publisher are displayed in the area 25. The link information to information sources other than the information analysis device 1 is displayed in the area 26.
[0049] Area 27 displays information about which publisher information was received from and when it was received by the information analysis device 1. Area 28 displays information about the ratio of each publisher to all publishers that are the issuers of information received by the information analysis device 1 within a specified period. Area 29 displays details of the information received by the information analysis device 1 within a specified period. Area 30 displays all index information and phrase information handled by the information analysis device 1.
[0050] Next, the information analysis process performed by the information analysis device 1 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the procedure of congestion control processing. When a publisher issues security-related information, the publisher message receiving unit 5 receives the security-related information (S1).
[0051] Next, the index information generating unit 10 generates index information such as a key-value database DB11 (S2). Next, the entity information input unit 11 inputs entity information such as a key-value database DB12 into the database storage unit 8 (S3).
[0052] Next, the relation extraction unit 12 extracts relations between multiple types of index information by searching for other index information that is not linked to the entity information, for example, in the key-value database DB13, using the index information as a search key that matches exactly (S4). Next, the meaning assignment unit 13 assigns meaning, for example, in the key-value databases DB15-18 (S5). Next, the subscriber transmitting / receiving unit transmits the analysis result information to the subscriber in response to the analysis result acquisition request received from the subscriber (S6).
[0053] As described above, the information analysis device 1 according to this embodiment makes it easy for the user to understand the results of the analysis by the information analysis device 1 because, for example, word information is displayed on the screen 20. Also, the information analysis device 1 according to this embodiment uses a publisher-subscriber model in which security-related information is issued by a publisher and the results of the analysis are received by a subscriber (hereinafter, this may be referred to as subscribing).
[0054] In this embodiment, the information analysis device 1 uses a publisher-subscriber model, so that functions can be easily expanded, such as by adding new use cases by adding publishers such as a threat observation device 2 and a use case enumeration device 3.
[0055] For example, the SIEM device or threat information platform providing device serving as the user terminal 4 can also transmit security-related information based on the received analysis result information to the information analysis device serving as the threat observation device 2 or the use case enumeration device 3. In this way, the information analysis device 1 can easily expand its functions.
[0056] Furthermore, in this embodiment, the information analysis device 1 uses a key-value database, so the search performance in the case of an exact match is O(1) in terms of the amount of calculation, and the search performance in the case of a partial match is O(N) in terms of the amount of calculation, so the search speed is unlikely to decrease.
[0057] N is the total number of pieces of search information plus the number of pieces of phrase information, and in this embodiment, since the search information consists of three pieces of information: an IP address, a domain name, and a file hash value, it is set to 4. The meaning can also be expanded.
[0058] In the above embodiment, the search information is described as consisting of three items: an IP address, a domain name, and a file hash value, but the present invention is not limited to these. For example, an email address may be added to the search information.
[0059] As described above, one aspect of an embodiment of the present invention makes it possible to provide an information analysis device that makes analysis results easy for a user to understand, is less likely to reduce search speed, and ensures scalability and flexibility.
[0060] In the above embodiment, the publisher message receiving unit 5, preprocessing unit 6, crossing analysis unit 7, database storage unit 8, and subscriber transmitting / receiving unit 9 are described as integrated circuits, but the present embodiment is not limited to this. The publisher message receiving unit 5, preprocessing unit 6, crossing analysis unit 7, database storage unit 8, and subscriber transmitting / receiving unit 9 may be implemented by a program stored in a server, for example.
[0061] In addition, the publisher message receiving unit 5, pre-processing unit 6, cross-sectional analysis unit 7, database storage unit 8 and subscriber transceiver unit 9 do not have to be implemented in a single device, but may be implemented in a distributed manner across multiple devices connected via a network, for example. [Explanation of symbols]
[0062] 1...information analysis device, 2...threat observation device, 3...usage example enumeration device, 4...user terminal, 5...publisher message receiving unit, 6...preprocessing unit, 7...cross-sectional analysis unit, 8...database storage unit, 9...subscriber transmitting / receiving unit.
Claims
1. An information analysis device that analyzes security-related information, which is information related to security, including threat information, which is information obtained by observing security-related threats transmitted from a threat observation device, and usage example information, which is information about usage examples of the security-related threats, and generates analysis result information, which is information on the results of the analysis, a publisher message receiving unit for receiving the security-related information; a pre-processing unit that performs a pre-processing to generate a plurality of types of index information for searching for the security-related information from the threat information, and to input entity information, which is the threat information linked to the index information, into a database storage unit that stores a key-value database; a cross-sectional analysis unit that extracts associations between a plurality of types of index information by searching for other index information not linked to the entity information using an exact match search key, searches for the index information using the index information as an exact match search key for the usage example information, and generates analysis result information in which phrase information, which is a phrase in natural language stored in the index information as a part of the usage example information, is linked to the index information; a subscriber transceiver unit for transmitting the analysis result information to a user terminal used by a user who analyzes the security-related information; An information analysis device comprising:
2. The search key is composed of at least one of the index information or a plurality of the index information items and the phrase information items and is processed in order, the search key has a specific value and a generic value, and when the search key is a specific value, a link is formed between a plurality of types of the index information items and the phrase information items. The information analysis device according to claim 1 .
3. the analysis result information has a hierarchical structure, the top layer is linked by the index information, and the bottom layer is linked by the word / phrase information; The information analysis device according to claim 1 .
4. The subscriber transceiver unit transmits information related to the requested index information included in the analysis result information acquisition request transmitted from the user terminal in a requested order, and information for displaying the phrase in the natural language is transmitted to the user terminal. The information analysis device according to claim 1 .
5. An information analysis method executed by an information analysis device, which analyzes security-related information, which is information related to security, including threat information, which is information obtained by observing security-related threats transmitted from a threat observation device, and usage example information, which is information on usage examples of the security-related threats, and generates analysis result information, which is information on the results of the analysis, a first step of receiving said security related information; a second step of performing a pre-processing of generating a plurality of types of index information for searching the security-related information from the threat information, and inputting entity information, which is the threat information linked to the index information, into a database storage unit that stores a key-value database; a third step of extracting associations between a plurality of types of index information by searching other index information not linked to the entity information using an exact match search key, searching the index information using the exact match search key for the usage example information, and generating analysis result information in which phrase information, which is a phrase in natural language stored in the index information as a part of the usage example information, is linked to the index information; a fourth step of transmitting the analysis result information to a user terminal used by a user who analyzes the security-related information; The information analysis method includes:
Citation Information
Patent Citations
Vulnerability management system and program
JP2020021309A
Security information analysis device, security information analysis method, security information analysis program, security information evaluation device, security information evaluation method, security information analysis system, and recording medium
WO2018139458A1
Vulnerability information management device, vulnerability information management method, and program
WO2020050355A1
