Information processing system, information processing method, and program

Abstract

We provide an information processing system that can analyze the results of risk investigations. [Solution] According to one aspect of the present invention, there is provided an information processing system comprising at least one processor, the processor being configured to execute each of the following steps by reading a program, wherein in an investigation result acquisition step, results of multiple risk investigations on the person being evaluated are acquired, in an item reception step, input of a first item and a second item for analyzing and displaying the multiple results is received from the evaluation user, and in an analysis information display control step, analysis information is displayed for each of multiple display areas of a coordinate system having the first item as the horizontal axis and the second item as the vertical axis, showing the number of results including the content of the first item and the content of the second item corresponding to the coordinates of the display area, and the display areas are areas obtained by dividing the planar area of ​​the coordinate system along at least one of the horizontal axis and the vertical axis.

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 describes a system audit support system that includes a checklist database that stores checkpoint array information data for identifying each checkpoint when auditing an audit target in a regular order, and also stores evidence array information data for identifying the evidence required to evaluate each checkpoint in correspondence with the checkpoint array information data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2003-44658 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for technology that can analyze the results of risk surveys.

[0005] In view of the above circumstances, the present invention provides an information processing system and the like capable of analyzing the results of risk investigations. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing system comprising at least one processor, the processor being configured to execute each of the following steps by reading a program, wherein in the investigation result acquisition step, results of multiple risk investigations on the person to be evaluated are acquired, in the item reception step, input of a first item and a second item for analyzing and displaying the multiple results is received from the evaluation user, and in the analysis information display control step, analysis information is displayed for each of multiple display areas of a coordinate system having the first item as the horizontal axis and the second item as the vertical axis, indicating the number of results including the content of the first item and the content of the second item corresponding to the coordinates of the display area, and the display areas are areas obtained by dividing the planar area of ​​the coordinate system along at least one of the horizontal axis and the vertical axis.

[0007] According to this embodiment, the evaluation user can analyze the results of the risk investigation on the person to be evaluated along any item. [Brief description of the drawings]

[0008] [Figure 1] 1 is a configuration diagram illustrating an information processing system 1. [Diagram 2] 2 is a block diagram showing the hardware configuration of the server device 10 and the target person terminal 20.

[0023] FIG. [Diagram 3] FIG. 2 is a block diagram showing the hardware configuration of an evaluator terminal 30 and a user terminal 40. [Figure 4] FIG. 2 is a block diagram showing functions realized by a server device 10 (control unit 11), a subject terminal 20 (control unit 21), an evaluator terminal 30 (control unit 31), and a user terminal 40 (control unit 41). [Diagram 5] 13 is a diagram showing an example of an analysis information display screen AD displayed on a user terminal 40. FIG. [Figure 6] 13 is a diagram showing an example of an analysis information display screen AD displayed on a user terminal 40. FIG. [Figure 7] FIG. 6 is a diagram showing a continuation of the analysis information display screen AD of FIG. 5. [Figure 8]FIG. 7 is a diagram showing a state in which one display area of ​​analytical information AI is selected on the analytical information display screen AD of FIG. 5. [Figure 9] 13 is a diagram showing an example of a result information display screen RD displayed on a user terminal 40. FIG. [Figure 10] 1 is an activity diagram showing an example of the flow of information processing (analysis information display processing) executed by the information processing system 1. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings. Various characteristic features shown in the following embodiments can be combined with each other.

[0010] Incidentally, a program for realizing the software appearing in one embodiment may be provided as a non-transitory computer-readable recording medium, or may be provided so as to be downloadable from an external server, or may be provided so that the program is launched on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] In addition, in various information processing according to an embodiment, an input and an output according to the input can be realized. Here, as long as an output is obtained as a result of the input, the form of information referenced in such information processing (hereinafter referred to as reference information) is not limited. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a judgment formula such as a regression formula constructed by a statistical method), or may be a trained model that has previously trained the correlation between the input and the output, or may be a large-scale language model that can output a desired result by inputting a prompt.

[0012] In one embodiment, the term "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In one embodiment, various information is handled, and this information is represented by, for example, physical values ​​of signal values ​​representing voltage and current, high and low signal values ​​as a binary bit collection consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculation can be performed on the circuit in the broad sense.

[0013] Furthermore, a circuit in the broad sense is a circuit realized by at least appropriately combining a circuit, circuitry, a processor, and a memory. The processor may be a general-purpose processor or a dedicated circuit. In other words, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0014] 1. Hardware Configuration This section describes the hardware configuration.

[0015] <Information Processing System 1> 1 is a configuration diagram showing an information processing system 1. The information processing system 1 includes a communication line 2, a server device 10, a plurality of subject terminals 20, at least one evaluator terminal 30, and a plurality of user terminals 40. The server device 10, the subject terminal 20, the evaluator terminal 30, and the user terminal 40 are configured to be able to communicate with each other through the communication line 2. The server device 10, the subject terminal 20, the evaluator terminal 30, and the user terminal 40 may be connected by wire or wirelessly.

[0016] The information processing system 1 constitutes at least a part of a security evaluation system used by, for example, multiple evaluation subjects (a first evaluation subject U1 and a second evaluation subject U2), at least one evaluator U3, and multiple evaluation users (a first evaluation user U4 and a second evaluation user U5). The information processing system 1 mainly performs security evaluation of commercial materials and the like provided by the evaluation subjects, and provides security evaluations. For example, the information processing system 1 mainly provides a security evaluation service by the evaluators. In one embodiment, the information processing system 1 is composed of one or more devices or components. These components will be described below.

[0017] <Server device 10> Fig. 2 is a block diagram showing the hardware configuration of server device 10 and subject terminal 20. As shown in Fig. 2A, server device 10 includes a control unit 11, a storage unit 12, a communication unit 13, and a communication bus 14. Control unit 11, storage unit 12, and communication unit 13 are electrically connected inside server device 10 via communication bus 14.

[0018] <Control unit 11> The control unit 11 performs processing and control of the overall operation related to the server device 10. The control unit 11 is, for example, a central processing unit (CPU). The control unit 11 realizes various functions related to the server device 10 by reading out a predetermined program stored in the storage unit 12. That is, information processing by software stored in the storage unit 12 can be specifically realized by the control unit 11, which is an example of hardware, and executed as each functional unit included in the control unit 11. These will be described in more detail in the next section. Note that the control unit 11 is not limited to being a single unit, and the server device 10 may have multiple control units 11 for each function. Also, the server device 10 may be configured with a combination of these.

[0019] <Storage section 12> The storage unit 12 stores various information defined by the above description. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs and the like related to the server device 10 executed by the control unit 11, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to the program calculations. The storage unit 12 stores various programs, variables, etc. related to the server device 10 executed by the control unit 11.

[0020] <Communications Division 13> The communication unit 13 is preferably a wired communication means such as USB, IEEE1394, Thunderbolt (registered trademark), wired LAN network communication, etc., but may also include wireless LAN network communication, mobile communication such as LTE / 5G, BLUETOOTH (registered trademark) communication, etc. as necessary. In other words, it is more preferable to implement it as a collection of multiple communication means. In other words, the server device 10 may communicate various information from the outside via the communication unit 13 and the network.

[0021] The server device 10 may be in an on-premise form or in a cloud form. The server device 10 in a cloud form may provide the above-mentioned functions and processes in the form of, for example, SaaS (Software as a Service) or cloud computing.

[0022] <Target user terminal 20> The subject terminal 20 is an information processing terminal used by a person who is to be evaluated for security. The "subject to evaluation" includes a business partner organization or its personnel that has any type of business relationship with the evaluation user (especially the person requesting evaluation), such as the provision of commercial materials (goods or services) (e.g., provision of cloud services) or the outsourcing of business. The subject to evaluation is, for example, a business operator such as a service provider, supplier, or outsourcing organization for the evaluation user (person requesting evaluation).

[0023] Here, a "business partner organization" includes a first-tier business partner organization that directly receives business from the evaluation user (evaluation requester), a second-tier business partner organization that receives second-tier business from the first-tier business partner organization, etc. In other words, a business partner organization means a first-tier business partner organization or an N-tier business partner organization (N>1) from the perspective of the source organization (evaluation user), and the first-tier business partner organization and the N-tier business partner organization for one trading object constitute a supply chain for that trading object. The trading object includes the commercial materials and outsourced work to be traded. A business partner organization may also include an individual business owner that receives a transaction.

[0024] A trading organization is an organization that is downstream of a trading organization (evaluation user) in a supply chain. From the perspective of a trading organization, a trading organization may be a trading partner, a contractor (including a subcontractor, a sub-subcontractor, etc.), a vendor, a supplier, a seller, a subsidiary, etc. A trading organization may include a contractor other than an end user in a supply chain.

[0025] Additionally, "organization" includes profit-making corporations (such as companies), non-profit corporations (such as cooperatives and foundations), and public corporations (such as local governments).

[0026] 2B, subject terminal 20 includes control unit 21, storage unit 22, communication unit 23, input unit 24, output unit 25, and communication bus 26. Control unit 21, storage unit 22, communication unit 23, input unit 24, and output unit 25 are electrically connected via communication bus 26 inside subject terminal 20. Description of control unit 21, storage unit 22, and communication unit 23 will be omitted since they are similar to the descriptions of each unit in server device 10.

[0027] <Input section 24> The input unit 24 accepts an operation input made by a user. The operation input is transferred as a command signal to the control unit 21 via the communication bus 26. The control unit 21 may execute a predetermined control or calculation based on the transferred command signal as necessary. The input unit 24 may be included in the housing of the subject terminal 20, or may be externally attached. For example, the input unit 24 may be implemented as a touch panel integrated with the output unit 25. When the input unit 24 is implemented as a touch panel, the user can input a tap operation, a swipe operation, or the like to the input unit 24. As the input unit 24, a switch button, a mouse, a track pad, a QWERTY keyboard, or the like can be adopted instead of a touch panel.

[0028] <Output section 25> The output unit 25 displays a screen of a graphical user interface (GUI) that can be operated by a user. The output unit 25 may be included in the housing of the subject terminal 20, or may be externally attached. Specifically, the output unit 25 may be implemented as a display device such as a CRT display, a liquid crystal display, an organic EL display, or a plasma display. It is preferable that these display devices are implemented by selectively using them according to the type of the subject terminal 20.

[0029] <Evaluator Terminal 30> The evaluator terminal 30 is an information processing terminal used by an evaluator who evaluates the answers of the evaluation target. An "evaluator" is an organization such as a company that evaluates security (for example, a security evaluation company that evaluates the security of services such as cloud services, software, etc.) or a person in charge thereof. The evaluator evaluates the security of the evaluation target from the evaluator terminal 30 via the information processing system 1, for example.

[0030] Fig. 3 is a block diagram showing the hardware configuration of the evaluator terminal 30 and the user terminal 40. As shown in Fig. 3A, the evaluator terminal 30 includes a control unit 31, a storage unit 32, a communication unit 33, an input unit 34, an output unit 35, and a communication bus 36. The control unit 31, the storage unit 32, the communication unit 33, the input unit 34, and the output unit 35 are electrically connected via the communication bus 36 inside the evaluator terminal 30. The explanation of the control unit 31, the storage unit 32, the communication unit 33, the input unit 34, and the output unit 35 will be omitted because they are the same as the explanation of each unit in the subject terminal 20.

[0031] <User terminal 40> The user terminal 40 is an information processing terminal used by an evaluation user who uses a service (e.g., an evaluation service for answer data, a service for providing a security report, etc.) provided by the information processing system 1. The "evaluation user" includes an evaluation requester, a viewer, etc.

[0032] The "evaluation requester" is an evaluation user who requests an evaluation of the security of the evaluation target, and is, for example, an individual or organization having a business relationship with the evaluation target, or a person in charge of the organization. The evaluation requester includes, for example, an evaluation user who is registered with the security evaluation service by evaluators provided by the information processing system 1.

[0033] The evaluation requester includes a source organization, which is an organization or individual that requests a transaction with a trading organization (evaluation target). The source organization receives and uses the merchandise provided by the trading organization. For example, if the merchandise being traded is a good, the evaluation requester (source organization) is the purchaser of the item (finished product or parts) manufactured by the trading organization. Also, for example, if the merchandise being traded is a service, the evaluation requester (source organization) is the user of the service provided by the trading organization (for example, the user of a cloud service provided by a cloud service provider). Furthermore, for example, if the merchandise being traded is a business (task), the evaluation requester (source organization) is the business requester or outsourcer of the business.

[0034] The evaluation requester includes not only an individual or organization that conducts a transaction (use of a service, outsourcing, etc.) with the evaluation target that is the subject of the evaluation, but also an individual or organization that requests an evaluation of a specific service. For example, the evaluation requester may include a company that wants to evaluate the security of a cloud service, etc. that it uses or is considering using, or a company that wants to confirm the evaluation.

[0035] A "viewer" is an individual or organization that uses the results of the security evaluation of the evaluation target, which was conducted at the request of the evaluation requester. A viewer is, for example, a provider of a commodity to be used, a business partner organization with which a transaction is planned, or an individual or organization that requests an evaluation of the evaluation target as a candidate for these. Viewers may include evaluation users who are registered with the security evaluation service by evaluators provided by the information processing system 1, and other evaluation users who are not registered with the evaluation service (for example, evaluation users who are not registered with the evaluation service but have obtained a web page that displays the evaluation provided by the evaluation service and is accessible from outside the evaluation service, a link to a file containing the evaluation, etc.).

[0036] 4B, user terminal 40 includes a control unit 41, a storage unit 42, a communication unit 43, an input unit 44, an output unit 45, and a communication bus 46. Control unit 41, storage unit 42, communication unit 43, input unit 44, and output unit 45 are electrically connected via communication bus 46 inside user terminal 40. Descriptions of control unit 41, storage unit 42, communication unit 43, input unit 44, and output unit 45 will be omitted because they are similar to the descriptions of the respective units in subject terminal 20.

[0037] 2. Functional configuration In this section, the functional configuration of the present embodiment will be described. Information processing by software stored in the storage unit 12 is specifically realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11 (at least one processor included in the information processing system 1).

[0038] FIG. 4 is a block diagram showing functions realized by server device 10 (controller 11), subject terminal 20 (controller 21), evaluator terminal 30 (controller 31), and user terminal 40 (controller 41).

[0039] As shown in Figure 4A, the server device 10 (control unit 11) includes a basic display control unit 111, an answer receiving unit 112, an evaluation receiving unit 113, a survey result acquisition unit 114, an item receiving unit 115, a question receiving unit 116, an analysis information display control unit 117, a report output unit 118, and an artificial intelligence unit 120.

[0040] As shown in Fig. 4B, subject terminal 20 (control unit 21) includes a display unit 211 and an operation acquisition unit 212. As shown in Fig. 4C, evaluator terminal 30 (control unit 31) includes a display unit 311 and an operation acquisition unit 312. As shown in Fig. 4D, user terminal 40 (control unit 41) includes a display unit 411 and an operation acquisition unit 412.

[0041] <Basic display control unit 111> The basic display control unit 111 is configured to display various information on the subject terminal 20, the evaluator terminal 30, and the user terminal 40. For example, the basic display control unit 111 displays an answer input form in which the person to be evaluated inputs their answers, the answers registered by the person to be evaluated, the evaluation results of the answers by the evaluator, etc. on the display unit 211 of the subject terminal 20, the display unit 311 of the evaluator terminal 30, or the display unit 411 of the user terminal 40.

[0042] <Answer Reception Section 112> The answer receiving unit 112 is configured to create or update answer data by receiving answers to questions in a risk investigation from the person to be evaluated. The risk investigation is an investigation regarding the security or secondary transactions of the person to be evaluated.

[0043] In a security survey (security survey), the answer receiving unit 112 displays a predetermined answer input form for receiving answers to questions about security from the evaluation subject on the subject terminal 20, and registers the answers entered in the answer input form as answer data. The security survey may be called a security risk survey.

[0044] The person to be evaluated answers questions in response to a request from an evaluation user with whom the person is conducting a transaction (has concluded a contract regarding the transaction), for example.

[0045] The answer receiving unit 112 may receive answers to questions about security from the subject of evaluation and a category to be assigned to the answer from the subject terminal 20, and add answer data including the answer and the category to the answer database. Note that a category is assigned to the entire answer data including multiple answers.

[0046] In addition, the answer receiving unit 112 does not necessarily have to receive a category designation from the person to be evaluated. For example, the answer receiving unit 112 may present the person to be evaluated with questions (answer input form) with a category designated in advance, and register answer data in which the previously designated category is assigned to the answer entered in the subject terminal 20.

[0047] The answer data may include question data in addition to the answer data and information indicating the category. If answer data has already been registered for the same question and category, the answer receiving unit 112 replaces the answer included in the answer data with the newly entered answer.

[0048] "Category" is information that indicates the preconditions of the person being evaluated when answering the questions (for example, the product that is the subject of the answer, the business that is the subject of the answer, the department that is the subject of the answer, the contract with the trading organization that is the subject of the answer, etc.). In other words, a category is information such as the product, business, department, and contract that are the subject of the answer entered by the person being evaluated. The person being evaluated enters answers to the questions about the product, etc. specified as the category.

[0049] The category may be the type of merchandise handled by the person being evaluated, the provider of the merchandise, the type of plan included in the merchandise, the business providing the merchandise, or a combination of these. The category may also be a contract name that represents a combination of these. This allows different answers to be entered and registered depending on the target, even for the same person being evaluated, as answers to questions may differ depending on the target merchandise, etc.

[0050] The person to be evaluated who provides the service inputs answers according to, for example, the type of the target service (e.g., AI (Artificial Intelligence) service, RPO (Recruitment Process Outsourcing) service, etc.), the destination of the service (e.g., attributes of the person requesting the evaluation, such as the name of the organization requesting the evaluation), the type of plan (option) included in the service, the name of the business providing the service, the name of the department, etc. In other words, the person to be evaluated who provides multiple services or plans may input answers for each of these service attributes or contracts, and the answer receiving unit 112 may register answer data for each service attribute. The input answers are stored as answer data in association with the service attribute (category).

[0051] The "services" provided by the assessee include services provided via the Internet, such as SaaS, IaaS (Infrastructure as a Service), PaaS (Platform as a Service), and cloud services, and in this case, the "assessee" includes cloud service providers, etc. In addition, the "services" provided by the assessee may be services provided to business partners, customers, etc.

[0052] The answer accepting unit 112 may not accept the input (designation) of a category for answer data that does not depend on a category (i.e., is not classified into a specific category and applies to any service, plan, destination, etc.). The answer accepting unit 112 may also accept the designation (input) of an "unclassified category" for answer data that does not depend on a category. For example, the answer accepting unit 112 may accept the designation (input) of the "common" category as the unclassified category.

[0053] The response data includes the responses of the subject to a number of questions regarding the security of the subject. The "questions" are questions to which the subject is required to respond, and may include, for example, questions regarding the security of the subject himself / herself, the security of the products (goods or services) provided by the subject. The "questions" may also include questions regarding the security of other organizations in the supply chain of the subject. The "other organizations" include, for example, business partner organizations of the subject, such as organizations to which the subject outsources his / her business (including contractors, subcontractors, sub-subcontractors, etc.). In other words, the "other organizations" may include questions regarding the security of N-th business partner organizations (N>1) from the perspective of the original business partner organization, such as second-tier business partner organizations that directly receive second-tier transactions from the first-tier business partner organization that receives responses in the second-tier transaction survey described later, as well as third-tier business partner organizations that receive third-tier transactions from the second-tier business partner organization. The questions may also include a so-called security checklist.

[0054] Questions may include, for example, questions confirming (and requesting responses from) the security certification status or evaluation, service level, scope of responsibility, security measures within the evaluation subject, handling of data related to the evaluation requester, handling of data managed by the evaluation subject, and service development, maintenance, or operation policies (e.g., account management).

[0055] The "answer data" is composed of the answers of the person being evaluated to each of a plurality of questions regarding the security of the service, and is information that is the subject of the evaluator's check of the contents and evaluation. The answer data may be evaluated only once or multiple times. In other words, the evaluation of the answer data may include an initial evaluation (so-called review), an interim evaluation, a final evaluation, etc. The initial evaluation and the interim evaluation are evaluations in which a further evaluation is performed after the evaluation. The answer data may be corrected by the person being evaluated based on the initial evaluation or the interim evaluation. The multiple evaluations may be performed by the same evaluator or by different evaluators (so-called reviewers, etc.). In the final evaluation, an evaluation is created that is used in a report or report provided to the evaluation user. In addition, the answer data may be evaluated by the evaluator again when the person being evaluated has made corrections, updates, etc. The evaluation result of the answer data by the evaluator is used as part of the report or report or as reference information.

[0056] The answers to each question included in the answer data are the answers entered by the subject of evaluation into the answer input form for each question presented in the answer input form, and are registered in the answer database. The answers to one question may be hierarchical.

[0057] In addition, the answer receiving unit 112 may receive answer input via an interface other than the answer input form (for example, uploading of a data file containing the answer by the subject of evaluation) and register this answer as answer data in the answer database.

[0058] The risk investigation for which the response receiving unit 112 accepts responses may include an investigation into secondary transactions (secondary transaction investigation). The secondary transaction investigation is an investigation into transactions between a trading partner organization and other organizations that are trading targets. For example, the secondary transaction investigation is an investigation into the presence or absence of Nth-level trading partner organizations (N>1) from the perspective of the trading source organization, such as second-level trading partner organizations that receive second-level transactions directly from the first-level trading partner organization, as well as third-level trading partner organizations that receive third-level transactions from the second-level trading partner organization, and may be interpreted as an "Nth-level transaction investigation." The secondary transaction investigation may also be called a "subcontractor investigation." The secondary transaction investigation may be an investigation into the constituent organizations of a sub-supply chain formed by a trading partner organization with respect to the trading target.

[0059] A second-tier transaction investigation may be one requested by a source organization to a first-tier trading partner organization, or it may be one requested directly by a source organization to a second-tier trading partner organization that the source organization knows. Note that a "second-tier transaction investigation of an Nth-tier trading partner organization" refers to an investigation of a trading partner downstream of an Nth-tier trading partner organization (i.e., an N+1th-tier trading partner organization or later).

[0060] The answer receiving unit 112 displays on the subject terminal 20 a predetermined answer input form that receives answers from the subject to be evaluated to questions regarding the secondary transaction, and registers the answers entered in the answer input form as answer data.

[0061] The answer input form for the secondary transaction survey may be sent to the subject of evaluation at the request of the evaluation user. Also, the answer input form for the security survey may be sent to the subject of evaluation at the request of the evaluation user. Also, these answer input forms may be sent to the secondary business partner organization at the request of the evaluation user. Furthermore, these answer input forms may be created and sent for each transaction target.

[0062] An answer input form corresponding to the type of security investigation selected by the evaluation user may be sent to the evaluation target. For example, an answer input form with a large number of questions (e.g., about 120 items) may be sent to an evaluation target for which "regular investigation" is selected as the type of security investigation, and an answer input form with fewer questions than the "regular investigation" (e.g., about 30 items) may be sent to an evaluation target for which "simple investigation" is selected as the type of security investigation. Note that a security investigation may not be conducted for evaluation targets for which secondary transactions are prohibited.

[0063] <Evaluation Reception Department 113> The evaluation receiving unit 113 is configured to receive, from an evaluator, an evaluation of the answer data registered (created or updated) by the answer receiving unit 112. The evaluation receiving unit 113, for example, registers the evaluated answer data together with the evaluation result in an answer database or the like. The evaluation result includes at least an evaluation value (security score) indicating the level of the security countermeasure (how many or few problems there are in the security countermeasure).

[0064] "Evaluation" refers to the act of checking for deficiencies or inconsistencies in the answers included in the answer data, making comments on the content of the answers, assessing the content of the answers, scoring the answers based on a predetermined standard, etc. As described above, the evaluation may be performed by multiple evaluators, or a first evaluator may request a second evaluator to evaluate the registered answer data. In that case, the evaluation receiving unit 113 may receive an evaluation from the second evaluator after the evaluation by the first evaluator.

[0065] For example, when evaluation is performed in two stages, an initial evaluation (review) involves checking for deficiencies or inconsistencies, making suggestions, etc. Then, the response data after the initial evaluation is subjected to a final evaluation, such as assessment and scoring of the content (response) and making comments on the entire response data based on a predetermined standard, and a report or report (e.g., a security report) including the results is created. The report or report is created by a final evaluator or an evaluation unit included in the control unit 11. The evaluation unit is configured to generate a part or the whole of the report or report based on the input response data. The evaluation result of the response data may be included in the report or report as part of the report or report or as reference information.

[0066] The evaluation receiving unit 113 receives input of characters, sentences, etc. used for evaluation from the evaluator terminal 30. Evaluation is typically performed on answer data in which all questions have been answered. Answer data that has unanswered questions (questions for which answers are not registered) is not subject to evaluation, and evaluations may not be accepted by the evaluation receiving unit 113. Even if answer data includes unanswered questions (questions for which answers are not registered), only the answered questions may be partially subject to evaluation.

[0067] <Survey Results Acquisition Unit 114> The investigation result acquisition unit 114 is configured to acquire the results of multiple risk investigations on the evaluation user. The "results of risk investigations on the evaluation user" include, for example, the results of risk investigations on a trading partner organization (evaluation target) requested by the evaluation user himself to a trading partner organization with which the evaluation user is conducting business as a trading source organization, the results of risk investigations on trading partner organizations (evaluation target) requested by a person other than the evaluation user to a trading partner organization with which the evaluation user is conducting business as a trading source organization, and the results of risk investigations on evaluation targets with whom the evaluation user is not conducting business but for whom the results of the risk investigation are to be analyzed. The investigation result acquisition unit 114 may also acquire the results of risk investigations on multiple evaluation targets.

[0068] The "results of the risk investigation" include, for example, at least one of response data (answers to questions) and the evaluation results of the security investigation (security score). The results of the risk investigation may also be the results of a risk investigation conducted for each contract or transaction between the evaluation user (transaction source organization) and the evaluation target (transaction partner organization). This allows the evaluation user to analyze the results of the risk investigation of the evaluation target on a contract or transaction basis with the transaction partner organization, making it easier to manage security risks on a contract or transaction basis.

[0069] The "contract or transaction" may be made on a supply chain basis. In other words, the "results of a risk investigation carried out for each contract or transaction" may be rephrased as "the results of a risk investigation carried out for each supply chain." By obtaining the results of a risk investigation carried out for each supply chain as the subject of analysis, it becomes easier to manage risks on a supply chain basis, etc.

[0070] The result of the risk investigation may include information on the subject of the risk investigation. The information on the subject of the risk investigation included in the result of the risk investigation may include, for example, the organization name, business name, contract business name, transaction used (service used, commissioned work, etc.), information handled (for example, type of information entrusted to the subject of the risk investigation), importance of the transaction, the status of the subject of the secondary transaction (for example, whether or not secondary transaction is possible, information on secondary transaction partners, whether or not there is a notification obligation when secondary transaction partners are changed, etc.).

[0071] The information of the person to be evaluated may be, for example, information input by the evaluation user (person requesting evaluation) from the user terminal 40, or information input by the person to be evaluated from the target terminal 20 in response to a request from the evaluation user. The information of the person to be evaluated may also be input from a predetermined format (for example, a response format for a secondary transaction survey sent to the person to be evaluated). The information of the person to be evaluated is registered in a response database together with, for example, response data, evaluation results, etc.

[0072] In addition, the information on the person being evaluated may include information recorded in the service ledger managed by the evaluation user (e.g., whether or not the contract is being renewed, the company's unique priority, the department that uses the target service, the number of registered accounts for the target service, etc.).

[0073] <Item Reception Section 115> The item receiving unit 115 is configured to receive, from the evaluation user (user terminal 40), input of a first item and a second item for analyzing and displaying the results of a plurality of risk investigations acquired by the investigation result acquiring unit 114. The first item and the second item are indicators used as the horizontal axis and the vertical axis, respectively, in the analysis information by the analysis information display control unit 117 described later.

[0074] The first and second items are arbitrarily selected from items included in the result of the risk investigation, the contents of which are numerical values ​​or information selected from options prepared in advance. The item receiving unit 115 may, for example, present a plurality of items selectable as the first or second item, and receive an item selected from the user terminal 40 as the first or second item.

[0075] The first item and the second item may be a security score calculated based on the risk survey or an attribute of the person to be assessed, respectively. This makes it possible to analyze the results of the risk survey based on the security score or the attribute of the person to be assessed.

[0076] The attributes of the person to be evaluated may include at least one of the type of information entrusted to the person to be evaluated, the importance of the transaction performed by the person to be evaluated, and the status of the secondary transaction performed by the person to be evaluated. This allows the evaluation user to analyze security risks according to the attributes of the person to be evaluated. Furthermore, the attributes of the person to be evaluated may include the attributes of the person to be evaluated itself, the attributes of the transactions and contracts performed by the person to be evaluated, and the attributes of the information handled by the person to be evaluated (information other than the information entrusted).

[0077] The "type of information entrusted" includes, for example, highly important information such as personal information, confidential information, and information for which use should be limited. In addition, the "secondary transaction" includes, for example, an N-th transaction (N≧2) from the perspective of the source organization, such as a tertiary transaction from a second-tier business partner organization to a third-tier business partner organization.

[0078] One of the first item and the second item may be a security score, and the other may be an attribute of any evaluation subject. This allows for analysis combining the security score and the attribute of the evaluation user. The first item and the second item may be different attributes from each other. This allows for analysis combining different attributes.

[0079] The item receiving unit 115 may further receive an input of a division condition for dividing the coordinate system by the horizontal axis or the vertical axis from the evaluation user (user terminal 40). This allows the evaluation user to create analysis information at a desired granularity, thereby improving the analysis accuracy of the results of the risk investigation.

[0080] If the content of the first or second item is a numerical value, the division condition is an arbitrary numerical value that divides the horizontal or vertical axis. In this case, the vertical or horizontal axis is divided into two regions using the numerical value input as the division condition as a threshold. For example, if a numerical value of "X" is input as the division condition of the first item, the horizontal axis of the division information is divided into a region less than X and a region equal to or greater than X. The item receiving unit 115 may also receive input of multiple numerical values ​​as the division condition. If the number of input numerical values ​​is N, the horizontal or vertical axis is divided into N+1 regions.

[0081] Furthermore, when the content of the first or second item is information selected from options, the division condition is two or more types of arbitrary options that divide the horizontal or vertical axis. In this case, the vertical or horizontal axis is divided into multiple areas that respectively represent the multiple options input as the division condition. For example, when "Option A" and "Option B" are input as the division condition for the second item, the vertical axis of the division information is divided into an area representing "Option A" and an area representing "Option B." Furthermore, the remaining options (e.g., "Option B") may be automatically set depending on the selection of some of the options (e.g., "Option A").

[0082] The item receiving unit 115 may receive only the division condition for the first item (horizontal axis) or may receive only the division condition for the second item (vertical axis). Furthermore, the item receiving unit 115 may receive the division condition only for the item whose content is expressed by a numerical value (e.g., security score, etc.) among the first and second items.

[0083] The item receiving unit 115 may, for example, present input fields or options for the division conditions corresponding to the first and second items on the user terminal 40, and receive input of a numerical value as the division condition, or selection of an option.

[0084] The item receiving unit 115 may set a preset split condition for each of the first and second items for items that do not accept split conditions or for items for which split conditions have not been input. For example, when "type of deposited information of evaluation subject" is selected as the second item, the item receiving unit 115 may automatically set the split conditions to "personal information deposited" and "personal information not deposited." In addition, for items whose contents are information selected from options, the item receiving unit 115 may set all available options as split conditions.

[0085] <Question Reception Section 116> The question receiving unit 116 receives a combination of questions included in a risk investigation and answers to the questions from the evaluation user (user terminal 40) as a narrowing-down condition. This allows risk analysis of the results of a risk investigation in which a specific answer has been given.

[0086] The question receiving unit 116 may, for example, present options for questions included in the risk survey to the user terminal 40 and accept input of questions to be used as narrowing-down conditions. The question receiving unit 116 may also present options for the selected questions (options presented to the evaluation subject in the risk survey) to the user terminal 40 and accept input of answers to be used as narrowing-down conditions. Note that the question receiving unit 116 may present an indicator (answer rank such as O, X, etc.) representing the answer to be described later to the user terminal 40 as an answer to the narrowing-down conditions, rather than the option itself for the question, and accept input of the answer (indicator) to be used as a narrowing-down condition.

[0087] Furthermore, the question receiving unit 116 may receive from the user terminal 40 an input of a combination of a plurality of questions and answers, and a logical relationship (AND condition or OR condition) between these combinations.

[0088] <Analysis information display control unit 117> The analytical information display control unit 117 is configured to display analytical information indicating the number of results acquired by the investigation result acquisition unit 114, including the content of the first item and the content of the second item corresponding to the coordinates of the display area, for each of multiple display areas in a coordinate system with the first item accepted by the item accepting unit 115 as the horizontal axis and the second item accepted by the item accepting unit 115 as the vertical axis.

[0089] This allows the evaluation user to grasp the overall distribution of security risks when the evaluation user has multiple supply chains, business partners, contracts, etc. As a result, the evaluation user can analyze security risks that should be addressed as a priority.

[0090] The analytical information is displayed, for example, as a planar graph. The multiple display areas included in the analytical information are areas obtained by dividing a planar area of ​​a coordinate system constituting the graph along at least one of the horizontal and vertical axes. The planar area may be divided only along the horizontal axis (the display areas may be arranged only along the horizontal axis), or only along the vertical axis (the display areas may be arranged only along the vertical axis), or may be a matrix divided along both the horizontal and vertical axes.

[0091] In other words, the analysis information display control unit 117 may display analysis information indicating the number of risk investigation results including the contents of the first item and the contents of the second item corresponding to the coordinates of a display area for each of a plurality of display areas obtained by dividing the planar area of ​​the coordinate system along both the horizontal and vertical axes. This enables risk analysis of the subject of evaluation by crossing any two items.

[0092] "The contents of the first item (second item) corresponding to the coordinates of the display area" refers to the contents set for each divided area on the horizontal axis (vertical axis), and for example, if the contents of the first item (second item) are numerical, it means the contents (numerical values) of the first item (second item) that satisfy the numerical range set in the divided area (e.g., "70 or more"). Also, for example, if the contents of the first item (second item) are information selected from options, it means the contents of the first item (second item) that match the options set in the divided area (e.g., "Personal information has been deposited").

[0093] Therefore, each display area displays the number of results that include a first item corresponding to the content of the first item set in each display area and a second item corresponding to the content of the second item set in each display area, among the results of multiple risk investigations acquired by the investigation result acquisition unit 114. In other words, the analysis information display control unit 117 classifies the results of multiple risk investigations into display areas in which both the first and second items of these results satisfy the conditions (corresponding to the set contents).

[0094] When the item receiving unit 115 receives an input of a division condition, the analysis information display control unit 117 may display, for each of a plurality of display areas obtained by dividing the horizontal or vertical axis by the division condition, analysis information indicating the number of risk investigation results including the contents of the first and second items corresponding to the coordinates of the display area. In this case, the range or options of the numerical values ​​input as the division condition are respectively assigned to each divided area of ​​the horizontal or vertical axis.

[0095] The analysis information display control unit 117 may change the display form for each display area according to the level of security risk (hereinafter, "risk score") based on the combination of the contents of the first item and the contents of the second item (hereinafter, "combined information"). This allows the evaluation user to easily and visually grasp areas with high security risk.

[0096] The analysis information display control unit 117 calculates a risk score for each display area based on, for example, the combination information of each display area and the reference information. The reference information includes at least a correlation between the combination information and the risk score. The reference information is stored in, for example, the storage unit 12.

[0097] The reference information may include, for example, a table, a function, a simple algorithm, etc., that indicates the correlation between the combination information and the risk score. The correlation included in the reference information may be constructed, for example, by statistically analyzing data that records the combination information and the corresponding risk score.

[0098] The reference information may include a risk score calculation model, which is a learning model or a generation AI that has been trained to be able to input the combination information and output a risk score. In this case, the analysis information display control unit 117 inputs the combination information to the risk score calculation model and causes the risk score calculation model to output a risk score. In the risk score calculation model, parameters calculated, tuned, etc. by learning constitute the correlation of the reference information.

[0099] The risk score calculation model is included in the artificial intelligence unit 120. The risk score calculation model that has been trained to be able to output a risk score is trained using, for example, combination information and data on the corresponding risk scores as training data.

[0100] When the risk score calculation model is a generative AI including a large-scale language model, the analytical information display control unit 117 inputs combination information, inputs a prompt including an instruction to calculate a risk score corresponding to the combination information to the risk score calculation model, and causes the risk score calculation model to output the risk score. The analytical information display control unit 117 may generate a prompt that gives an instruction to calculate a risk score to the risk score calculation model, and inputs the prompt to the risk score calculation model. In addition to the risk score calculation / output instruction and the combination information, the analytical information display control unit 117 may input a prompt into which, for example, one or more samples of combination information and one or more samples of risk scores corresponding thereto are inserted as examples, samples, or teacher data of input and output pairs to the risk score calculation model.

[0101] The analytical information display control unit 117 may calculate a first sub-risk score based on the content of the first item (horizontal axis) and a second sub-risk score based on the content of the second item (vertical axis) based on the reference information. In this case, the analytical information display control unit 117 may calculate a risk score for each display area by the sum or product of the first sub-risk score and the second sub-risk score, or may determine the display form of the display area based on a table that defines a risk score for each combination of the first sub-risk score and the second sub-risk score. When calculating the first sub-risk score and the second sub-risk score, the analytical information display control unit 117, for example, inputs the content of the first item or the content of the second item into a risk score calculation model and causes the risk score calculation model to output the first sub-risk score or the second sub-risk score.

[0102] Furthermore, the analysis information display control unit 117 may determine that a divided area in which both the first sub-risk score and the second sub-risk score exceed their respective thresholds is an area with a high risk score. The threshold is set in advance for each of the first item and the second item. For example, the analysis information display control unit 117 may display in a warning color a divided area in which the first item (horizontal axis) is a content or value with a high security risk (exceeding the threshold) and the second item (vertical axis) is also a content or value with a high security risk. Furthermore, for example, a divided area in which both items are content or values ​​with a high security risk may be displayed in a display form that is distinguishable from a divided area in which only one of the first item (horizontal axis) and the second item (vertical axis) is a content or value with a high security risk.

[0103] The "display form of the display area" includes, for example, the color of the display area, the thickness of the border (frame) of the display area, the decoration of the display area (presence or absence of shading, etc.), the size of the characters indicating the number of results, and the addition of icons (marks, characters, etc.) to the display area. For example, the analysis information display control unit 117 may change the color of the display area so that the higher the risk score, the closer the color becomes to a warning color such as red. Also, for example, the analysis information display control unit 117 may add a mark indicating a warning to a display area in which the risk score exceeds a predetermined threshold.

[0104] When the question receiving unit 116 receives a combination of a question and an answer as a filtering condition, the analytical information display control unit 117 may display, for each of the multiple display areas, analytical information indicating the number of results including the first item content and the second item content corresponding to the coordinates of the display area, among the results of the risk investigation that satisfy the filtering condition. For example, when the filtering condition "Answer to question Q2 is O" is input from the user terminal 40, the question receiving unit 116 extracts the results of the risk investigation in which "Answer to question Q2 is O" is from the results acquired by the investigation result acquisition unit 114, and classifies only the extracted results into each display area of ​​the analytical information.

[0105] The analytical information display control unit 117 may display on the user terminal 40, together with the analytical information, a list of result information indicating the contents of each of the results of the multiple risk investigations that constitute the analytical information. The result information includes at least the contents of the first item and the second item. This allows the evaluation user to instantly confirm the source of the analytical information. In addition, the evaluation user can refer to the details of the results of the risk investigations included in the analytical information.

[0106] The result information is information extracted from information included in the result of the risk investigation acquired by the investigation result acquisition unit 114. The result information may include only the first item and the second item accepted by the item acceptance unit 115 (set by the user), or may include information other than the first item and the second item.

[0107] When the result information includes information other than the first item and the second item, the analysis information display control unit 117 may highlight the first item and the second item included in the result information. "Highlighting the first item and the second item" includes, for example, coloring the first item and the second item, shading the first item and the second item, making the characters representing the contents of the first item and the second item larger, and adding an icon (mark, character, etc.) indicating that it is the first item or the second item.

[0108] The result information may include multiple pieces of answer information indicating the answers to multiple questions included in the risk survey. This allows the evaluation user to refer to the answers of the evaluation target when analyzing the results of the risk survey.

[0109] The answer information may be the actual answer included in the answer data (the answer entered or selected by the evaluation subject). The answer information may also be an index showing the level of security measures in the answers to the questions. In other words, the analysis information display control unit 117 may display answer information in which the actual answer contents are replaced with an index as result information. This allows the evaluation user to get an overview of the elements with high security risks in the results of the risk survey. This makes it easier for the evaluation user to consider measures against security risks.

[0110] An "index indicating the level of security measures" (hereinafter referred to as "answer index") is an answer rank determined according to the level of security measures, and is expressed, for example, by symbols or signs such as "○·×·△" or "A·B·C". The number of answer rank classes is not particularly limited as long as it is two or more. The answer index may also be a numerical value indicating the level of security measures. The answer index is, for example, set in advance for each option in a question. The answer index may be common to all questions (for example, the answer index may be displayed as a two-option "○·×" for the entire result of the risk survey), or may be different for each question.

[0111] Specifically, for example, in a certain question, if option A or option B is selected as the answer, an answer indicator may be set to ◯, and if option C is selected as the answer, an answer indicator may be set to ×. Alternatively, for example, if option A is selected as the answer, an answer indicator may be set to ◯, if option B, option C, or option D is selected as the answer, an answer indicator may be set to △, and if option E is selected as the answer, an answer indicator may be set to ×.

[0112] Typically, the analysis information display control unit 117 may display on the user terminal 40 result information including the risk survey category (e.g., contract name), the name of the person being evaluated who conducted the risk survey, multiple items that can be selected as the first or second item, and response information.

[0113] The analysis information display control unit 117 may display a plurality of pieces of result information in a list on the user terminal 40. For example, when the result of the risk investigation is on a contract basis, the result information for each contract may be displayed in a list on the user terminal 40.

[0114] The analysis information display control unit 117 may receive an input of a selection of a display area in the analysis information from the evaluation user, highlight the selected display area, and display result information narrowed down to the results of the risk investigation belonging to the selected display area. This allows the evaluation user to select a display area that he / she wants to check in detail, and display only the results of the risk investigation included in that display area. Therefore, for example, it is possible to extract contracts included in a display area with a high security risk, and consider measures such as reviewing the contracts.

[0115] The "input of the selection of the display area" is performed, for example, by tapping the display area, clicking with the pointer over the display area, or the like.

[0116] "Highlighting the display area" includes, for example, making the color of the selected display area stand out, thickening the border of the display area, shading the display area, enlarging the characters indicating the number of results, adding an icon (mark, character, etc.) indicating that it is being selected, etc. Furthermore, the analysis information display control unit 117 may highlight the display area when the pointer is placed over the display area, and narrow down the result information when a click is performed thereafter.

[0117] The analysis information display control unit 117 may receive input of narrowing down conditions for the result information from the evaluation user, and display the result information narrowed down to the results of risk investigations that satisfy the narrowing down conditions. This allows the display of only the result information to be narrowed down while maintaining the display of the analysis information (without narrowing down the results of the risk investigations in the analysis information).

[0118] In addition, if a filtering condition for the analysis information (for example, a combination of questions and answers) is set, the result information that is further filtered based on the result of the risk investigation filtered by the filtering condition is displayed.

[0119] The narrowing condition of the result information is any information included in the result information. Therefore, when the result information includes answer information, the analysis information display control unit 117 may accept a combination of a question and an answer as the narrowing condition.

[0120] The analysis information display control unit 117 may display, on the user terminal 40, response information input by the evaluation user, indicating the response status of each security risk as a result of the risk investigation, as part of the result information. The "response information" is, for example, a keyword indicating the degree of acceptance by the evaluation user of the result of the risk investigation, such as "accepted," "response required," or "response completed." The response information may be input by the evaluation user selecting from options prepared in advance, or may be input by the evaluation user as text. The response information may include, in addition to the keyword indicating the degree of acceptance, a memo input by the person being evaluated.

[0121] 5 and 6 are diagrams showing an example of an analysis information display screen AD displayed on the user terminal 40. The analysis information display screen AD includes an analysis information display area AA and a result display area RA.

[0122] In the analysis information display area AA, a first item input field IF1, a condition input field CF, a second item input field IF2, analysis information AI, and a question receiving object QO are displayed.

[0123] The first item input field IF1 accepts input of the first item which is the horizontal axis of the analysis information AI. As shown in FIG. 6, the evaluation user selects the first item from options presented in a pull-down list, for example. The condition input field CF shown in FIG. 5 accepts input of the division condition of the horizontal axis. The evaluation user selects the division condition from options presented in a pull-down list, for example. The second item input field IF2 accepts input of the second item which is the vertical axis of the analysis information AI. The evaluation user selects the second item from options presented in a pull-down list, for example. In the example of FIG. 5, the condition input field CF for the first item is displayed, but the condition input field CF for the second item may be displayed, or the condition input field CF for the first item may not be displayed.

[0124] The analytical information AI is a graph created based on the input contents in the first item input field IF1, the condition input field CF, and the second item input field IF2 (for each of a plurality of display areas in a coordinate system with the first item on the horizontal axis and the second item on the vertical axis, the number of results including the contents of the first item and the contents of the second item corresponding to the coordinates of the display area is shown). When the input contents of any of the first item input field IF1, the condition input field CF, and the second item input field IF2 are changed, the analytical information AI is regenerated and the new analytical information AI is displayed.

[0125] In the example of Fig. 5, the analysis information AI is displayed with four display areas (first display area DA1, second display area DA2, third display area DA3, and fourth display area DA4) with the horizontal and vertical axes each divided into two. In this example, the horizontal axis (first item) is the security score ("Score" in Fig. 5), and the vertical axis (second item) is the status of the secondary transaction ("Deposit information" in Fig. 5).

[0126] The first display area DA1 shows the number of risk investigation results for evaluation subjects who have a security score of 70 points or more and have not entrusted personal information. The second display area DA2 shows the number of risk investigation results for evaluation subjects who have a security score of less than 70 points and have not entrusted personal information. The third display area DA3 shows the number of risk investigation results for evaluation subjects who have a security score of 70 points or more and have entrusted personal information. The fourth display area DA4 shows the number of risk investigation results for evaluation subjects who have a security score of less than 70 points and have entrusted personal information.

[0127] The third display area DA3 is displayed in a display form (e.g., colored yellow) indicating a higher security risk than the first display area DA1 and the second display area DA2. The fourth display area DA4 is displayed in a display form (e.g., colored red) indicating a higher security risk than the third display area DA3, and in a display form different from the first display area DA1 and the second display area DA2 and distinguishable from these areas.

[0128] The question reception object QO accepts input of a combination of questions and their answers as a filtering condition for the analysis information AI. When an input operation is performed on the question reception object QO in FIG. 5, a question input field QF, an answer selection field AF, and a cancellation object CO are displayed as shown in FIG. 6. The question input field QF accepts input of questions, for example, by a pull-down list. The answer selection field AF accepts answers to the questions entered in the question input field QF, for example, by a pull-down list. When an input operation is performed on the cancellation object CO, the question input field QF and the answer selection field AF are deleted (the entered filtering condition is cancelled). Furthermore, when an input operation is performed on the question reception object QO while the question input field QF and the answer selection field AF are displayed, the question input field QF and the answer selection field AF are added.

[0129] 5, the result display area RA is displayed below the analysis information display area AA. In the result display area RA, a refinement condition input field NF and a result information list RL are displayed.

[0130] The narrowing down condition input field NF receives input of narrowing down conditions for the result information to be displayed in the result information list RL.

[0131] The result information list RL includes result information on the results of risk investigations that constitute the analysis information AI (counted in any of the display areas of the analysis information AI). FIG. 7 is a diagram showing a continuation of the analysis information display screen AD of FIG. 5. In the example of FIG. 7, multiple pieces of result information for each contract are displayed side by side in the result information list RL. The result information list RL includes, as result information, first basic information RI1, second basic information RI2, and answer information RI3. Note that the result display area RA displays a portion of the multiple pieces of result information included in the result information list RL, and the result information displayed in the result display area RA can be switched by, for example, scrolling left and right, switching pages, or other operations.

[0132] The first basic information RI1 includes the subject of evaluation ("Subcontractor name" in FIG. 7) and a risk response object RO. The risk response object RO is an object that displays response information and accepts input of response information. When an input operation is performed on the risk response object RO, an input field is displayed for inputting (selecting) response information. The response information entered in the input field is displayed in the risk response object RO.

[0133] The second basic information RI2 displays items that can be selected as the first item or the second item (i.e., items displayed as options in the first item input field IF1 or the second item input field IF2 in the analysis information display area AA in Fig. 5). Furthermore, among the items included in the second basic information RI2, the items selected as the first item or the second item are highlighted (displayed with a shaded area in Fig. 7).

[0134] Some of the items included in the second basic information RI2 are assigned a sort object SO or a refinement object NO. When an input operation is performed on the sort object SO, the left-right arrangement order of the result information for each contract is changed based on the size of the item to which the sort object SO is assigned ("Score" in FIG. 7). When an input operation is performed on the refinement object NO, options for refinement are displayed. When an option is selected by the evaluation user, only result information whose content matches the selected option in the item to which the refinement object NO is assigned ("Deposit Information" or "Business Impact" in FIG. 7) is displayed in the result information list RL.

[0135] The answer information RI3 includes a plurality of questions included in the risk survey and answers to each question. In the example of Fig. 7, the questions are displayed as symbols (codes), and the answers are displayed as indicators (circle or cross). A question display object DO is attached to each question. When the pointer is placed over the question display object DO, the content (text) of the question to which the question display object DO is attached is displayed, for example, as a pop-up.

[0136] Fig. 8 is a diagram showing a state in which one display area of ​​the analytical information AI is selected on the analytical information display screen AD of Fig. 5. In Fig. 8, the fourth display area DA4 is selected and the fourth display area DA4 is highlighted. In addition, the result display area RA displays result information showing the result of the risk investigation included in the fourth display area DA4.

[0137] When an input operation is performed for the result information of any contract in the result information list RL (for example, an input operation for a contract name such as "Contract A"), detailed information on the results of the risk investigation of that contract (information including items not included in the result information list RL) is displayed on the user terminal 40. Fig. 9 is a diagram showing an example of a result information display screen RD displayed on the user terminal 40. On the result information display screen RD, the information displayed can be switched by switching the tab TB.

[0138] <Report Output Section 118> The report output unit 118 is configured to output a report or a report created based on the evaluation received by the evaluation receiving unit 113 to the user terminal 40. The report or report includes at least the whole or part of the answer data entered by the person to be evaluated and the evaluation results by the evaluator (e.g., evaluation value, comments, etc.).

[0139] <Artificial Intelligence Department 120> The artificial intelligence unit 120 is configured to receive input from each functional unit and return the instructed output. The artificial intelligence used by the server device 10 in each functional unit may be a common one, or may be prepared individually for each functional unit.

[0140] The artificial intelligence unit 120 may be an AI (Artificial Intelligence) equipped with a learning model such as a transformer including GPT (Generative Pretrained Transformer, including GPT-1, GPT-2, GPT-3, and GPT-4), BERT (Bidirectional Encoder Representations from Transformers), BART (Bidirectional and Auto-regressive Transformer), or a language model such as a recurrent neural network (RNN), and may include a generative AI including a large-scale language model. The large-scale language model is a type of generative AI and includes models provided by services such as OpenAI's GPT, Google's Gemini, and Microsoft's Azure AI Studio. In addition, the artificial intelligence unit 120 may include any machine learning model, deep learning model, artificial intelligence model, etc.

[0141] The language model is an example of a learning model based on a machine learning algorithm. Specific examples of machine learning algorithms include nearest neighbor methods, naive Bayes methods, decision trees, support vector machines, and deep learning using neural networks. The artificial intelligence unit 120 can apply the above algorithms as appropriate.

[0142] The artificial intelligence unit 120 may have a trained model constructed by a learning method such as supervised learning, unsupervised learning, or self-supervised learning. In supervised learning, machine learning is performed using training data (training data). The training data is composed of a pair of input data for learning and output data (correct answer data). In addition, the language model may not only be one trained for a specific task, but also a general-purpose model that can be used for a wide range of tasks.

[0143] The artificial intelligence unit 120 may be a general-purpose natural language processing learning model such as a large language model (LLM) that has learned a huge amount of data as an artificial intelligence. The LLM is a learning model that has learned a large amount of large data (for example, (i) web content on the Internet, or (ii) data stored in a specified database) composed of text data and the like in advance, and can execute various language processing tasks by giving tasks. According to a given prompt, it can perform a wide range of natural language processing tasks such as grasping sentence patterns and contexts, answering questions, and generating sentences. Such a general-purpose learning model includes a language model that can handle various tasks without fine tuning by One-shot Learning, Few-shot Learning, etc. In addition, the general-purpose learning model may be configured to be able to handle various tasks by Zero-shot Learning as well. The artificial intelligence used in each functional unit of the control unit 11 may be a separate learning model, or a common general-purpose learning model.

[0144] The learning model included in the artificial intelligence unit 120 (the learning model used in each functional unit, such as the risk score calculation model) can perform additional learning as transfer learning or fine tuning. For example, each time new data is registered, the artificial intelligence unit 120 may perform additional learning and fine tuning using the new data as new teacher data. This improves the accuracy of information output from the learning model.

[0145] The learning model included in the artificial intelligence unit 120 may be a learning model (distilled model) obtained by knowledge distillation using an original learning model. In knowledge distillation, a learned model such as a large-scale language model is used as a teacher model, and the parameters of the student model are adjusted so that the output loss (Soft Target Loss) of the student model (distilled model) relative to the output (Soft Target) of the teacher model is reduced, thereby learning the student model, and the student model becomes a distilled model. In addition, the student model may be learned so that the output loss (Hard Target Loss) of the student model relative to the correct label (Hard Target) of the teacher data (combination of input data and output data of the learning model) is reduced. Compared to the original learning model (teacher model), the distilled model has a smaller number of parameters and a smaller processing load while having performance close to that of the learning model. Therefore, by using the distilled model, the cost of the information processing system 1 can be reduced.

[0146] For example, the learning model used in each functional unit may be a distilled model trained using a combination of input data and output data in a large-scale language model as training data. Furthermore, when the information processing system 1 is introduced, a large-scale language model may be used as the learning model used in each functional unit, and when training data from the large-scale language model is accumulated, a distilled model obtained by knowledge distillation using the training data may be used as the learning model used in each functional unit.

[0147] <Display> The display unit 211 of the subject terminal 20, the display unit 311 of the evaluator terminal 30, and the display unit 411 of the user terminal 40 each display a screen indicated by the screen data transmitted from the server device 10.

[0148] <Operation acquisition part> The operation acquisition unit 212 of the subject terminal 20 accepts operations by the subject to be evaluated who uses the subject terminal 20. The operation acquisition unit 312 of the evaluator terminal 30 accepts operations by the evaluator who uses the evaluator terminal 30. The operation acquisition unit 412 of the user terminal 40 accepts operations by the evaluation user who uses the user terminal 40.

[0149] 3. Information processing method This section describes an information processing method of the server device 10. This information processing method is executed by a computer, with each unit of the server device 10 acting as each step.

[0150] This information processing includes an investigation result acquisition step, an item reception step, and an analysis information display control step. In the investigation result acquisition step, the results of multiple risk investigations are acquired. In the item reception step, input of a first item and a second item for analyzing and displaying the multiple results is received from the evaluation user. In the analysis information display control step, analysis information is displayed for each of multiple display areas in a coordinate system with the first item as the horizontal axis and the second item as the vertical axis, showing the number of results including the content of the first item and the content of the second item corresponding to the coordinates of the display area.

[0151] 10 is an activity diagram showing an example of the flow of information processing (analysis information display processing) executed by the information processing system 1. The information processing will be described below along with each activity in this activity diagram.

[0152] The analytical information display process starts with a display request for analytical information from the evaluation user. The evaluation user instructs the user terminal 40 to display the analytical information (activity A101). The server device 10 acquires the results of the risk survey that constitutes the analytical information from the response database (activity A102).

[0153] After the server device 10 acquires the results, the evaluating user inputs the first item and the second item in the user terminal 40 (activity A103). The server device 10 accepts the first item and the second item from the user terminal 40 (activity A104). Next, the server device 10 outputs analysis information using the accepted first item and second item to the user terminal 40 (activity A105). As a result, the analysis information is displayed on the user terminal 40 (activity A106).

[0154] 4. Effect The operation of this embodiment can be summarized as follows: That is, the evaluation user can analyze the results of the risk investigation on the evaluation target along any item.

[0155] Although the embodiment of the present invention has been described above, the present invention is not limited to this, and can be modified as appropriate without departing from the technical concept of the invention.

[0156] 5.Other In the above embodiment, the server device 10 performs various storage and control, but multiple external devices may be used instead of the server device 10. That is, various information and programs may be distributed and stored in multiple external devices using block chain technology or the like. In particular, the artificial intelligence unit 120 may be an external configuration of the server device 10. In that case, the artificial intelligence unit 120, which is an external configuration, is provided by, for example, an artificial intelligence service server, and is configured to receive input from each functional unit of the server device 10, receive a request to execute an artificial intelligence service, and return an instructed output as a processing result to the server device 10. The artificial intelligence service server may be a server that provides a service using a language model as a learning model, or may be a server that executes a language processing task using a language model. The artificial intelligence service server may be constructed by LLM. The artificial intelligence service server receives input of a prompt by text, image, voice, etc., and generates and responds to the prompt.

[0157] The control unit 11 does not necessarily have to include the question receiving unit 116. In other words, the information processing system 1 does not necessarily have to receive a combination of a question and an answer as a condition for narrowing down the analysis information.

[0158] The aspect of the present embodiment is not limited to the information processing system 1, and may be an information processing method or a program. The information processing method includes each step executed by the information processing system 1. The program causes a computer to execute each step of the information processing system 1.

[0159] It may be provided in any of the following ways:

[0160] (1) An information processing system comprising at least one processor, the processor being configured to execute each of the following steps by reading a program: an investigation result acquisition step acquires results of multiple risk investigations on a subject to evaluation; an item receiving step receives input of a first item and a second item for analyzing and displaying the multiple results from an evaluation user; and an analysis information display control step displays, for each of multiple display areas of a coordinate system having the first item as the horizontal axis and the second item as the vertical axis, analysis information indicating the number of results including the content of the first item and the content of the second item corresponding to the coordinates of the display area, wherein the display area is an area obtained by dividing a planar area of ​​the coordinate system along at least one of the horizontal axis and the vertical axis.

[0161] (2) In the information processing system described in (1) above, in the analysis information display control step, the analysis information is displayed for each of a plurality of display areas obtained by dividing the planar area of ​​the coordinate system along both the horizontal and vertical axes, showing the number of results including the contents of the first item and the contents of the second item corresponding to the coordinates of the display area.

[0162] (3) In the information processing system described in (1) or (2) above, the first item and the second item are, respectively, a security score calculated based on the risk survey or an attribute of the person to be evaluated.

[0163] (4) In the information processing system described in (3) above, the attributes include at least one of the type of information entrusted to the person being evaluated, the importance of transactions conducted by the person being evaluated, and the status of secondary transactions of the person being evaluated.

[0164] (5) In the information processing system described in any one of (1) to (4) above, the item receiving step further receives input of a division condition for dividing the coordinate system along a horizontal axis or a vertical axis from the evaluation user, and the analysis information display control step displays, for each of a plurality of display areas divided along the horizontal axis or the vertical axis by the division condition, the analysis information indicating the number of results including the content of the first item and the content of the second item corresponding to the coordinates of the display area.

[0165] (6) An information processing system according to any one of (1) to (5) above, wherein the results are the results of the risk investigation conducted for each contract or transaction between the evaluation user and the person being evaluated.

[0166] (7) In the information processing system described in any one of (1) to (6) above, the processor is configured to further execute the following steps: in the question receiving step, a combination of questions included in the risk survey and answers to the questions is received from the evaluation user as a filtering condition; and in the analysis information display control step, for each of a plurality of the display areas, the analysis information is displayed indicating the number of results that satisfy the filtering condition and include the content of the first item and the content of the second item corresponding to the coordinates of the display area.

[0167] (8) In an information processing system described in any one of (1) to (7) above, in the analysis information display control step, a list of result information indicating the contents of each of the multiple results constituting the analysis information is displayed together with the analysis information, and the result information includes at least the contents of the first item and the contents of the second item.

[0168] (9) In the information processing system described in (8) above, the result information includes a plurality of pieces of answer information representing answers to each of a plurality of questions included in the risk survey.

[0169] (10) In the information processing system described in (9) above, the answer information is an index showing a level of security measures in the answers to the questions.

[0170] (11) In the information processing system described in any one of (8) to (10) above, in the analysis information display control step, an input of a selection of the display area in the analysis information is received from the evaluation user, the selected display area is highlighted, and the result information narrowed down to the results belonging to the selected display area is displayed.

[0171] (12) In the information processing system described in any one of (8) to (11) above, in the analysis information display control step, an input of filtering conditions for the result information is accepted from the evaluation user, and the result information narrowed down to the results that satisfy the filtering conditions is displayed.

[0172] (13) In an information processing system described in any one of (1) to (12) above, in the analysis information display control step, the display format for each display area is changed depending on the level of security risk based on the combination of the content of the first item and the content of the second item.

[0173] (14) An information processing method comprising steps executed by an information processing system according to any one of (1) to (13) above.

[0174] (15) A program for causing a computer to execute each step of the information processing system described in any one of (1) to (13) above. Of course, this is not the case.

[0175] Finally, although various embodiments according to the present disclosure have been described, these are presented as examples and are not intended to limit the scope of the invention. The novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The embodiments and their modifications are included within the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0176] 1: Information processing system 2: Communication lines 10: Server device 11: Control section 12: Storage section 13: Communications Department 14: Communication bus 20: Target device 21: Control section 22: Storage section 23: Communications Department 24: Input section 25: Output section 26: Communication bus 30: Evaluator terminal 31: Control section 32: Storage section 33: Communications Department 34: Input section 35: Output section 36: Communication bus 40: User terminal 41: Control section 42: Storage section 43: Communications Department 44: Input section 45: Output section 46: Communication bus 111: Basic display control unit 112: Answer Reception Department 113: Evaluation Reception Department 114: Survey Results Acquisition Department 115: Item Reception Department 116: Question Reception Department 117: Analysis information display control section 118: Report output section 120: Artificial Intelligence Department 211: Display section 212: Operation acquisition section 311: Display section 312: Operation acquisition section 411: Display section 412: Operation acquisition section AA: Analysis information display area AD:Analysis information display screen AF: Answer selection field AI: Analysis information CF: Condition input field CO : Cancellation object DA1: 1st display area DA2: 2nd display area DA3: 3rd display area DA4: 4th display area DO : Question display object IF1: First item input field IF2: Second item input field NF: Filtering criteria input field NO : Filter object QF: Question input field QO: Question acceptance object RA:Result display area RD: Result information display screen RI1: 1st basic information RI2: 2nd basic information RI3: Answer information RL: Result information list RO : Risk Response Object SO : Sort Object TB : Tab

Claims

1. An information processing system, At least one processor; The processor is configured to execute the following steps by reading the program: In the investigation result acquisition step, the results of multiple risk investigations on the assessment subjects are obtained, In the item receiving step, input of a first item and a second item for analyzing and displaying the plurality of results is received from the evaluation user; In the analytical information display control step, analytical information is displayed in each of a plurality of display areas of a coordinate system having the first item as the horizontal axis and the second item as the vertical axis, showing the number of results including the contents of the first item and the contents of the second item corresponding to the coordinates of the display area, wherein the display areas are areas obtained by dividing a planar area of ​​the coordinate system along at least one of the horizontal axis and the vertical axis, in an information processing system.

2. 2. The information processing system according to claim 1, In the analysis information display control step, the information processing system displays, for each of a plurality of display areas obtained by dividing the planar area of ​​the coordinate system along both the horizontal and vertical axes, the analysis information indicating the number of results including the contents of the first item and the contents of the second item corresponding to the coordinates of the display area.

3. 2. The information processing system according to claim 1, An information processing system, wherein the first item and the second item are, respectively, a security score calculated based on the risk survey or an attribute of the person to be evaluated.

4. 4. The information processing system according to claim 3, An information processing system, wherein the attributes include at least one of the type of information entrusted to the person being evaluated, the importance of transactions conducted by the person being evaluated, and the status of secondary transactions of the person being evaluated.

5. 2. The information processing system according to claim 1, In the item receiving step, an input of a division condition for dividing the coordinate system along a horizontal axis or a vertical axis is further received from the evaluation user; In the analysis information display control step, the information processing system displays the analysis information indicating the number of results including the contents of the first item and the contents of the second item corresponding to the coordinates of the display area for each of the multiple display areas divided on the horizontal or vertical axis according to the division condition.

6. 2. The information processing system according to claim 1, An information processing system, wherein the results are the results of the risk investigation conducted for each contract or transaction between the evaluation user and the evaluation target.

7. 2. The information processing system according to claim 1, The processor is further configured to perform the steps of: In the question receiving step, a combination of questions included in the risk survey and answers to the questions is received from the evaluation user as a narrowing-down condition; In the analysis information display control step, the information processing system displays, for each of the multiple display areas, analysis information indicating the number of results that satisfy the filtering conditions and include the content of the first item and the content of the second item corresponding to the coordinates of the display area.

8. 2. The information processing system according to claim 1, In the analysis information display control step, a list of result information indicating the contents of each of the plurality of results constituting the analysis information is displayed together with the analysis information; An information processing system, wherein the result information includes at least the content of the first item and the content of the second item.

9. 9. The information processing system according to claim 8, An information processing system, wherein the result information includes a plurality of pieces of answer information indicating answers to each of a plurality of questions included in the risk survey.

10. 10. The information processing system according to claim 9, An information processing system, wherein the answer information is an index showing a level of security measures in the answers to the questions.

11. 9. The information processing system according to claim 8, In the analysis information display control step, an information processing system receives input of a selection of the display area in the analysis information from the evaluation user, highlights the selected display area, and displays the result information narrowed down to the results belonging to the selected display area.

12. 9. The information processing system according to claim 8, The analysis information display control step includes receiving an input of a narrowing down condition for the result information from the evaluation user, and displaying the result information narrowed down to the results that satisfy the narrowing down condition.

13. 2. The information processing system according to claim 1, In the analysis information display control step, the display form for each display area is changed according to the level of security risk based on the combination of the content of the first item and the content of the second item.

14. 1. An information processing method, comprising: An information processing method comprising the steps executed by the information processing system according to any one of claims 1 to 13.

15. A program, A program for causing a computer to execute each step of the information processing system according to any one of claims 1 to 13.

Images