Information processing systems, information processing methods, and programs

Abstract

This invention provides an information processing system, information processing method, and program for efficiently performing security assessments. [Solution] The method in the information processing system 1 involves, in the judgment rule registration step, receiving input from the evaluator of multiple judgment rules for answers to questions in a security survey, and a risk message associated with each judgment rule, and registering the judgment rules and the associated risk messages in a database, with the risk message containing a sentence explaining the matter that violates the judgment rule; in the response reception step, receiving input of answers to questions in the survey from the service provider; in the judgment step, determining whether the input answer violates the judgment rule, and if there is a violation, displaying a risk message for that answer; and in the evaluation reception step, receiving evaluations of the service provider's answers in the survey from the evaluator.

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a program.

Background Art

[0002] Patent Document 1 discloses a technique for receiving an input of an answer to a security-related question and performing a security evaluation.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, it is desired to efficiently perform a security evaluation.

[0005] In view of the above circumstances, the present invention aims to provide an information processing system or the like that can efficiently perform a security evaluation.

Means for Solving the Problems

[0006] According to one aspect of the present invention, an information processing system is provided, comprising at least one processor, the processor configured to perform the following steps by reading a program, wherein in the judgment rule registration step, the system receives input from an evaluator of multiple judgment rules for answers to questions in a security survey, and a risk message associated with each judgment rule, and registers the judgment rules and the associated risk messages in a database, the risk message includes a sentence explaining the matter that violates the judgment rule, in the response reception step, the system receives input from a service provider of answers to questions in a survey, in the judgment step, the system determines whether the input answers violate the judgment rules, and if there is a violation, displays a risk message for the answer, and in the evaluation reception step, the system receives an evaluation of the service provider's answers in the survey from an evaluator.

[0007] In this configuration, when entering answers to questions in a security survey, service providers (respondents) can review or correct their answers based on the risk messages displayed for incomplete answers. As a result, security assessments can be conducted efficiently. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram showing the configuration of Information Processing System 1. [Figure 2] Block diagram showing the hardware configuration of the server device 10 and the provider terminal 20. [Figure 3] This block diagram shows the hardware configuration of the evaluator terminal 30 and the user terminal 40. [Figure 4] This is a block diagram showing the functions realized by the server device 10 (control unit 11), provider terminal 20 (control unit 21), evaluator terminal 30 (control unit 31), and user terminal 40 (control unit 41). [Figure 5] This figure shows an example of the judgment rule registration screen RD displayed on the evaluator terminal 30. [Figure 6] This figure shows an example of the judgment rule list screen LD displayed on the evaluator terminal 30. [Figure 7] This figure shows an example of the response input screen AD displayed on the provider terminal 20. [Figure 8] This figure shows another example of the response input screen AD displayed on the provider terminal 20. [Figure 9] This figure shows yet another example of the response input screen AD displayed on the provider terminal 20. [Figure 10] This figure shows an example of the transmission confirmation screen CD displayed on the provider terminal 20. [Figure 11] This figure shows another example of the transmission confirmation screen CD displayed on the provider terminal 20. [Figure 12] This is an activity diagram showing an example of the flow of information processing (security investigation processing) performed by Information Processing System 1. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings. The various features shown in the embodiments below can be combined with each other.

[0010] Incidentally, the program for implementing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or it may be provided as a downloadable medium from an external server, or it may be provided so that the program is launched on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] Furthermore, in various information processing according to one embodiment, an input and an output corresponding to the input can be realized. Here, as long as an output is obtained as a result of the input, the form of the information referenced in such information processing (hereinafter referred to as "reference information") is not limited. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression equation constructed by a statistical method), or a pre-trained model that has learned the correlation between input and output in advance, or a large-scale language model that can output a desired result by inputting a prompt.

[0012] Furthermore, in one embodiment, "part" may include, for example, hardware resources implemented by a circuit in a broad sense, and the information processing of software that can be specifically realized by these hardware resources. Also, in one embodiment, various types of information are handled, and this information can be represented, for example, by the physical values ​​of signal values ​​representing voltage and current, the high or low values ​​of signal values ​​as a set of binary bits composed of 0s or 1s, or by quantum superposition (so-called qubits), and communication and calculations can be performed on a circuit in a broad sense.

[0013] Furthermore, a circuit in a broad sense is a circuit realized by combining at least a suitable combination of circuits, circuits, processors, and memory. The processor may be a general-purpose processor or a dedicated circuit. In other words, it includes application-specific integrated circuits (ASICs), programmable logic devices (for example, simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field programmable gate arrays (FPGAs)), etc.

[0014] 1. Hardware Configuration In this section, the hardware configuration will be described.

[0015] <Information Processing System 1> FIG. 1 is a configuration diagram showing the information processing system 1. The information processing system 1 includes a communication line 2, a server device 10, a plurality of provider terminals 20, at least one evaluator terminal 30, and a plurality of user terminals 40. The server device 10, the provider terminals 20, the evaluator terminal 30, and the user terminals 40 are configured to be able to communicate with each other through the communication line 2. The connections of the server device 10, the provider terminals 20, the evaluator terminal 30, and the user terminals 40 may be wired or wireless.

[0016] The information processing system 1 constitutes at least a part of a security evaluation system for Internet services used by, for example, a plurality of service providers (the first service provider U1 and the second service provider U2), at least one evaluator U3, and a plurality of service users (the first service user U4 and the second service user U5). The information processing system 1 mainly performs evaluations of the security of services provided by service providers, provision of evaluation results of security investigations, etc. For example, the information processing system 1 mainly provides security evaluation services by evaluators. In one embodiment, the information processing system 1 is composed of one or more devices or components. Hereinafter, these components will be described.

[0017] <Server Device 10> FIG. 2 is a block diagram showing the hardware configurations of the server device 10 and the provider terminal 20. As shown in FIG. 2A, the server device 10 includes a control unit 11, a storage unit 12, a communication unit 13, and a communication bus 14. The control unit 11, the storage unit 12, and the communication unit 13 are electrically connected to each other inside the server device 10 via the communication bus 14.

[0018] <Control Unit 11> The control unit 11 performs processing and control of the overall operation related to the server device 10. The control unit 11 is, for example, a Central Processing Unit (CPU). The control unit 11 realizes various functions related to the server device 10 by reading predetermined programs stored in the memory unit 12. That is, information processing by software stored in the memory unit 12 is concretely realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11. These will be described in more detail in the next section. Note that the control unit 11 is not limited to being a single unit, and there may be multiple control units 11 for each function. Furthermore, the control unit 11 may have a configuration that combines these.

[0019] <Storage section 12> The storage unit 12 stores various types of information as defined above. This can be done, for example, as a storage device such as a solid-state drive (SSD) that stores various programs related to the server device 10 executed by the control unit 11, or as memory such as random access memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) related to program calculations. The storage unit 12 stores various programs, variables, etc. related to the server device 10 executed by the control unit 11.

[0020] <Communications Department 13> The communication unit 13 preferably uses wired communication methods such as USB, IEEE1394, Thunderbolt®, and wired LAN network communication, but may also include wireless LAN network communication, mobile communication such as 3G / LTE / 5G, and Bluetooth® communication as needed. In other words, it is more preferable to implement it as a collection of these multiple communication methods. That is, the server device 10 may communicate various information from the outside via the communication unit 13 and the network.

[0021] The server device 10 may be on-premises or in a cloud environment. A cloud-based server device 10 may provide the above-mentioned functions and processing in the form of, for example, SaaS (Software as a Service) or cloud computing.

[0022] <Provider terminal 20> The provider terminal 20 is an information processing terminal used by a service provider that provides IT services. As shown in Figure 2B, the provider terminal 20 comprises a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, an output unit 25, and a communication bus 26. The control unit 21, storage unit 22, communication unit 23, input unit 24, and output unit 25 are electrically connected within the provider terminal 20 via the communication bus 26. The descriptions of the control unit 21, storage unit 22, and communication unit 23 are the same as the descriptions of each part in the server device 10 and are therefore omitted.

[0023] <Input section 24> The input unit 24 receives operation inputs made by the user. The operation inputs are transmitted as command signals to the control unit 21 via the communication bus 26. The control unit 21 can perform predetermined controls or calculations based on the transmitted command signals as needed. The input unit 24 may be included in the casing of the provider terminal 20 or it may be external. For example, the input unit 24 may be implemented as a touch panel integrated with the output unit 25. When the input unit 24 is implemented as a touch panel, the user can input tap operations, swipe operations, etc. to the input unit 24. Instead of a touch panel, the input unit 24 can be a switch button, mouse, trackpad, QWERTY keyboard, etc.

[0024] <Output section 25> The output unit 25 displays a graphical user interface (GUI) screen that can be operated by the user. The output unit 25 may be included in the casing of the provider terminal 20 or it may be an external component. Specifically, the output unit 25 can be implemented as a display device such as a CRT display, liquid crystal display, organic EL display, or plasma display. It is preferable that these display devices be used in accordance with the type of provider terminal 20.

[0025] <Evaluator terminal 30> The evaluator terminal 30 is an information processing terminal used by evaluators to evaluate user responses. The evaluator is an organization such as a company that conducts security evaluations (for example, a security evaluation company that conducts security evaluations of services such as cloud services and software) or a person in charge of such an organization. The evaluator performs the service evaluation from the evaluator terminal 30 via the information processing system 1.

[0026] Figure 3 is a block diagram showing the hardware configuration of the evaluator terminal 30 and the user terminal 40. As shown in Figure 3A, the evaluator terminal 30 comprises a control unit 31, a storage unit 32, a communication unit 33, an input unit 34, an output unit 35, and a communication bus 36. The control unit 31, storage unit 32, communication unit 33, input unit 34, and output unit 35 are electrically connected within the evaluator terminal 30 via the communication bus 36. The descriptions of the control unit 31, storage unit 32, communication unit 33, input unit 34, and output unit 35 of the evaluator terminal 30 are the same as the descriptions of each part in the provider terminal 20 and are therefore omitted.

[0027] <User terminal 40> The user terminal 40 is an information processing terminal used by users of the security evaluation service provided by the server device 10. As shown in Figure 3B, the user terminal 40 comprises a control unit 41, a storage unit 42, a communication unit 43, an input unit 44, an output unit 45, and a communication bus 46. The control unit 41, storage unit 42, communication unit 43, input unit 44, and output unit 45 are electrically connected within the user terminal 40 via the communication bus 46. The descriptions of the control unit 41, storage unit 42, communication unit 43, input unit 44, and output unit 45 of the user terminal 40 are the same as the descriptions of each part in the provider terminal 20 and are therefore omitted.

[0028] 2. Functional Configuration This section describes the functional configuration of this embodiment. Information processing by software stored in the memory unit 12 is specifically realized by the control unit 11, which is an example of hardware, and can be executed as each functional unit included in the control unit 11 (at least one processor provided by the information processing system 1).

[0029] Figure 4 is a block diagram showing the functions realized by the server device 10 (control unit 11), provider terminal 20 (control unit 21), evaluator terminal 30 (control unit 31), and user terminal 40 (control unit 41).

[0030] As shown in Figure 4A, the server device 10 (control unit 11) comprises a basic display control unit 111, a judgment rule registration unit 112, a response reception unit 113, a judgment unit 114, a response transmission unit 115, an evaluation reception unit 116, and a report output unit 117. As shown in Figure 4B, the provider terminal 20 (control unit 21) comprises a display unit 211 and an operation acquisition unit 212. As shown in Figure 4C, the evaluator terminal 30 (control unit 31) comprises a display unit 311 and an operation acquisition unit 312. As shown in Figure 4D, the user terminal 40 (control unit 41) comprises a display unit 411 and an operation acquisition unit 412.

[0031] <Basic display control unit 111> The basic display control unit 111 is configured to display various information on the provider terminal 20, the evaluator terminal 30, and the user terminal 40. For example, the basic display control unit 111 displays the input form in which the service provider enters their answers, the answers entered by the service provider, and the evaluation results by the evaluator on the display unit 211 of the provider terminal 20, the display unit 311 of the evaluator terminal 30, or the display unit 411 of the user terminal 40.

[0032] <Judgment Rule Registration Section 112> The judgment rule registration unit 112 is configured to register judgment rules for responses to questions in a security survey of service providers.

[0033] The "services" provided by a service provider include services delivered via the internet, such as SaaS, IaaS (Infrastructure as a Service), PaaS (Platform as a Service), and cloud services. The term "service provider" includes cloud service providers, etc. Furthermore, the "services" provided by a service provider may also be services provided to trading partners, customers, etc.

[0034] The "questions" are items that the service provider is required to answer, and may include, for example, items concerning the service provider's own security, the security of the services provided by the service provider, etc. The questions may also include items concerning the security of other organizations included in the service provider's supply chain. "Other organizations" include, for example, organizations to which the service provider outsources its operations (including contractors, subcontractors, sub-subcontractors, etc.), and other organizations that the service provider deals with.

[0035] A single question may contain multiple answer elements (answer fields). Furthermore, the questions may include a so-called security checklist.

[0036] The evaluation rules are used to determine whether there are any deficiencies, errors, inconsistencies, etc., in the answers to the questions. Deficiencies in answers include, for example, answers that make it impossible to evaluate security, reduce the accuracy of the security evaluation, or significantly lower the security evaluation, and which require the evaluator to request the service provider to review or re-enter the answers.

[0037] The judgment rules should include at least one of the following: a first inconsistency condition defining inconsistencies with other answers, a second inconsistency condition defining inconsistencies regarding dates, and a non-disclosure condition regarding the non-disclosure of answers. This allows for highly accurate determination of inconsistencies with relatively simple condition settings, thereby improving the quality of answers provided by service providers. As a result, the number of answers returned for review by evaluators is reduced, and the time required for evaluation by evaluators can be shortened.

[0038] The first inconsistency condition stipulates that a conflict occurs when there is a contradiction among the specified multiple answers (multiple answers satisfy the definition of contradiction). The other answers in the first inconsistency condition may include answers from other question items and answers within the same question item. This allows for the determination of contradictions between answers from independent question items and contradictions between multiple answer elements within a single question item, thereby promoting the reduction of the need for evaluators to resubmit answers.

[0039] The second inconsistency condition stipulates, for example, that a conflict occurs when the current date and the date the answer was entered, or the date it was entered as an answer, satisfy a predetermined relationship. This allows, for example, a risk message to be displayed in a question item concerning matters with expiration dates, such as authentication, if it is determined that the expiration date has passed.

[0040] The confidentiality condition stipulates, for example, that a violation occurs when "Confidential" is entered (selected) as the answer. This allows a risk message to be displayed for inputs that make the answer confidential.

[0041] The judgment rules may include multiple conflict conditions. Each conflict condition is defined as a single response that constitutes a condition for fulfilling a conflict in a single question item. This allows evaluators to set judgment rules on a question item basis or on a response basis, thus enabling the efficient construction of a network of judgment rules in security investigations.

[0042] Multiple conflict conditions may include those that define the content of each of the multiple answers in a single question item where multiple answers are possible or required. For example, a single judgment rule may include two conflict conditions: "Option A is included in the answer to the Nth question item" and "Option B is not included in the answer to the Nth question item." Furthermore, a judgment rule may include combinations of multiple question items that may result in contradictions, and conflict conditions for each of the multiple question items included in that combination.

[0043] A risk message is a notification indicating that there is a response that violates the judgment rules. The risk message includes text explaining the matter that violates the judgment rules. The "matter that violates" may include, for example, the reason for the violation, the basis for the judgment of violation (date, etc.), the relevant question items and corresponding entered answers, etc. The risk message may also include suggestions on how to revise the response.

[0044] "Related question items" are question items in which a contradictory relationship is defined in the judgment rules; in other words, they are question items that are included in a "combination of multiple question items that may result in a contradiction" in the conflicting judgment rules.

[0045] Risk messages may include links to other related questions. This allows service providers to quickly review related questions and revise their answers, enabling them to efficiently correct responses.

[0046] Links to other questions may be attached to keywords (e.g., question numbers) that indicate the questions within the text of the risk message, or they may be included in the risk message independently of the text as objects such as buttons. When an input operation is performed on the provider terminal 20 for a link, the answer input screen (answer input field) for the linked question is displayed on the provider terminal 20.

[0047] The judgment rule registration unit 112 receives input from the evaluator, including multiple judgment rules and risk messages associated with each judgment rule, and registers the judgment rules and the associated risk messages in the rule database.

[0048] The judgment rule registration unit 112 displays a judgment rule registration screen on the evaluator terminal 30, which includes, for example, a judgment rule input field for receiving judgment rules and a risk message input field for receiving risk messages to be associated with the judgment rules. The judgment rule registration unit 112 associates the judgment rules entered in the judgment rule input field with the risk messages entered in the risk message input field and registers them in the rule database. As a result, when the judgment unit 114, described later, determines that an answer violates one judgment rule, one risk message registered in association with that judgment rule is displayed on the provider terminal 20. In other words, there is a one-to-one correspondence between judgment rules and risk messages. To put it another way, each risk message is registered in the rule database linked to a judgment rule that includes the question item to which the risk message is to be displayed as a condition.

[0049] The judgment rule registration unit 112 may accept attribute settings for each judgment rule from the evaluator and register the judgment rules and attributes in the rule database in association with each other. Attributes of a judgment rule may include, for example, the warning level and warning timing of the judgment rule. The risk message of a judgment rule may be displayed in a form that corresponds to the attributes (for example, the higher the warning level, the more emphasized it is). The risk message of a judgment rule may also be displayed at a timing that corresponds to the attributes (for example, immediately after answer input, after answer submission, etc.).

[0050] In particular, the judgment rule registration unit 112 may accept from the evaluator the setting of a mandatory correction attribute for each judgment rule, indicating that correction of answers that violate the judgment rule is mandatory, and may register the judgment rule and the mandatory correction attribute in association with each other in the rule database. This allows the service provider to be prompted to correct answers containing content that the evaluator cannot evaluate before such answers are submitted to the evaluator. As a result, security evaluations can be performed efficiently.

[0051] The judgment rule registration unit 112, for example, when receiving judgment rules and risk messages from the evaluator terminal 30, also accepts input on whether or not an attribute is a mandatory modification attribute. Input of a mandatory modification attribute may be done by selecting an option that indicates it is a mandatory modification attribute. The judgment rule registration unit 112 registers the mandatory modification attribute in the rule database along with the judgment rule and risk message that were entered in association with it. Therefore, the mandatory modification attribute is also associated with the risk message.

[0052] The judgment rules registered in the rule database are applied to all service providers in common. The judgment rule registration unit 112 may display a list of registered judgment rules on the evaluator terminal 30. The judgment rule registration unit 112 may also accept editing (modification, deletion, etc.) of registered judgment rules from the evaluator terminal 30.

[0053] Furthermore, neither the service provider nor the user can register judgment rules and risk messages. In other words, the judgment rule registration unit 112 only accepts registration of judgment rules and risk messages from the evaluator terminal 30.

[0054] Figure 5 shows an example of the judgment rule registration screen RD displayed on the evaluator terminal 30. The judgment rule registration screen RD includes an ID input field IF, a rule name input field NF, a risk message input field MF, an attribute input field AF, a judgment rule input field RF, and a registration button B11.

[0055] The ID input field IF accepts the input of an ID to be assigned to each individual judgment rule. Each judgment rule and risk message is identified and managed by this ID. The rule name input field NF accepts the input of the name of the judgment rule. The risk message input field MF accepts the input of a risk message. The risk message entered in the risk message input field MF is linked to the ID entered in the ID input field IF.

[0056] The attribute input field AF accepts input for the attributes of the judgment rule. In the example in Figure 5, the attribute input field AF displays options (checkboxes) for attributes that must be modified ("Required Modification"). Attributes entered (selected) in the attribute input field AF are linked to the IDs entered in the ID input field IF.

[0057] The Judgment Rule Input Field RF accepts input of specific conditions for the judgment rule. The conditions of the judgment rule entered (selected) in the Judgment Rule Input Field RF are linked to the ID entered in the ID Input Field IF. The Judgment Rule Input Field RF includes the Overall Condition Input Field ACF, at least one Item Condition Input Field ICF, and the Condition Group Add Button B12.

[0058] The item condition input field ICF accepts input of a conflict condition for one question item. A condition group is formed by the conflict conditions entered in at least one item condition input field ICF. Each item condition input field ICF includes a question item input field IF1, an answer choice input field IF2, a supplementary condition input field IF3, a delete button B13, and an input field add button B14.

[0059] The Question Item Input Field IF1 accepts input of the question item (question) that is subject to the infringement condition. In the example in Figure 5, the Question Item Input Field IF1 displays multiple question items included in the security survey (an input form in which the service provider enters answers) in a dropdown format and accepts the selection of a question item. The Answer Choice Input Field IF2 accepts input of answers (choices) to the question item entered in the Question Item Input Field IF1. In the example in Figure 5, the Answer Choice Input Field IF2 displays multiple choices set as answers to the question item entered in the Question Item Input Field IF1 in a dropdown format and accepts the selection of an answer (choice).

[0060] The auxiliary condition input field IF3 accepts input for a judgment condition of "whether or not the answer entered in the answer choice input field IF2 is included." In the example in Figure 5, the auxiliary condition input field IF3 displays multiple judgment conditions in a dropdown menu and accepts selection of a judgment condition ("includes answer" or "does not include answer"). The delete button B13 accepts input for the operation to delete the item condition input field ICF. The input field add button B14 accepts input for the operation to add a new item condition input field ICF to the same condition group.

[0061] The overall condition input field ACF accepts input of theoretical conditions (AND conditions or OR conditions) for conflicting conditions (conditions entered in the item condition input field ICF) in multiple question items included in a single condition group. In the example in Figure 5, the overall condition input field ACF displays multiple theoretical conditions in a pull-down format and accepts selection of theoretical conditions ("and" or "or").

[0062] The Add Condition Group button B12 accepts input for adding a new condition group (a set of one overall condition input field ACF and at least one item condition input field ICF).

[0063] The registration button B11 accepts input for registering the items entered in the ID input field IF, rule name input field NF, risk message input field MF, attribute input field AF, and judgment rule input field RF into the rule database. This operation associates the judgment rule, risk message, and attributes with the ID of a single judgment rule and registers them accordingly.

[0064] Figure 6 shows an example of the judgment rule list screen LD displayed on the evaluator terminal 30. The judgment rule list screen LD includes a query input field QF, a search execution button B21, and a list display field LF.

[0065] The list display field LF shows a list of registered judgment rules. The query input field QF accepts input for the search query for judgment rules (the filtering conditions for the judgment rules displayed in the list display field LF). The search execution button B21 accepts input for the operation to perform a search (filtering) of judgment rules based on the search query entered in the query input field QF.

[0066] <Response Reception Department 113> The response receiving unit 113 is configured to receive input from service providers regarding their answers to the survey questions.

[0067] The response receiving unit 113 displays a predetermined input form on the provider terminal 20 for receiving answers to security-related questions, for example. The questions include, for example, those that confirm security certification or evaluation, service levels, scope of responsibility, security measures within the service provider, handling of data created by service users, and service development, maintenance, or operation policies (such as account management) (questions that require answers from the service provider).

[0068] After the service provider has finished entering their responses, the response reception unit 113 receives instructions from the service provider to submit the responses entered for the survey questions. Specifically, the response reception unit 113 receives instructions from the provider terminal 20 to submit the responses entered in the input form (instructions to submit to the evaluators).

[0069] <Determination unit 114> The determination unit 114 is configured to determine whether the input response violates any registered determination rules, and if a violation occurs, to display a registered risk message for that response on the provider terminal 20.

[0070] The determination unit 114 may determine that there is a violation of the determination rule if all of the multiple violation conditions included in the determination rule are met, or if any of the multiple violation conditions included in the determination rule are met. For example, if the theoretical condition (theoretical condition in the condition group) for the multiple violation conditions included in the determination rule is an AND condition, then the condition for determining a violation is that all of the answers mentioned in each violation condition among the input answers match all of the answer contents specified for each violation condition. Also, for example, if the theoretical condition for the multiple violation conditions included in the determination rule is an OR condition, then the condition for determining a violation is that at least one of the answers mentioned in each violation condition among the input answers matches the answer contents specified for each violation condition.

[0071] The timing of the infringement determination by the determination unit 114 and the timing of the display of the risk message can be arbitrarily set by the evaluator as attributes of the determination rule. Furthermore, the risk message does not necessarily have to be displayed immediately after the infringement is determined by the determination unit 114.

[0072] The determination unit 114 may display a risk message on the provider terminal 20 when an answer is entered for a question item in the survey, depending on the determination result of whether the answer violates the determination rules. This increases the efficiency of answer input, as the service provider can make corrections immediately without having to switch question items.

[0073] When a risk message is to be displayed when an answer is entered, the determination unit 114 performs a violation determination, for example, when at least one answer to a question item is entered, or when the input of an answer to a question item is confirmed (for example, when the answer to a question item is saved), and after the violation determination, displays the risk message in association with the question item. "Display associated with the question item" includes displaying it in the area assigned to the question item in the input form (for example, the answer input field), displaying it alongside the question item, and displaying it as a pop-up when the question item is displayed.

[0074] Figure 7 shows an example of an answer input screen AD displayed on the provider terminal 20. The answer input screen AD includes a question number QN, a question content QC, an answer input field AIF, a save answer button B41, and a proceed button B42. In Figure 7, only one question item is displayed on the answer input screen AD, but multiple question items may be displayed on the answer input screen AD, and the displayed question items may be switched by operations such as scrolling.

[0075] In the example in Figure 7, the question content QC and the answer input field AIF for the question item with question number QN "AA-1" are displayed. Multiple answer choices AC and auxiliary answer choices SC are displayed in the answer input field AIF. Each answer choice AC is accompanied by an input receiving object that allows multiple selections, such as checkboxes. Auxiliary answer choices SC are accompanied by an input receiving object that allows exclusive selection, such as radio buttons. Auxiliary answer choices SC may be accompanied by a different input receiving object from the answer choice AC so that they can be visually distinguished from the answer choice AC.

[0076] Auxiliary options SC include, for example, options indicating that there are no appropriate (matching) answers among the presented answer options AC, and options indicating that the service provider will not disclose (not answer) the answers to the questions. Furthermore, auxiliary options SC and answer options AC are mutually exclusive. That is, if you select any of the auxiliary options SC, you cannot simultaneously select any of the answer options AC. For example, if you select an arbitrary authentication name and then select an auxiliary option SC, the selection of answer options AC will be deselected.

[0077] In the example in Figure 7, the question content QC is displayed as "Question about the data center region or area," and the answer options AC are displayed as a list of options representing the region or area, with "Japan" selected as the answer. In addition, in the example in Figure 7, a risk message RM explaining that the answer "Japan" violates the judgment rule is displayed at the bottom of the answer input field AIF. Specifically, the risk message RM contains sentences that suggest the answer "Japan" contradicts the answer to another question item ("DD-1"). Furthermore, the keyword ("DD-1") that indicates the other question item in the risk message RM is linked to that question item. When an input operation is performed on the provider terminal 20 for the "DD-1" link, the question number QN, question content QC, and answer input field AIF for the "DD-1" question item are displayed on the provider terminal 20.

[0078] If the service provider corrects the answer to a question item where the risk message RM is displayed (for example, correcting the answer to question item "AA-1" or question item "DD-1" in the example in Figure 7), and the violation of the judgment rule is resolved, the display of the risk message RM will be removed.

[0079] The answer save button B41 accepts input for saving the answer entered in the answer input field AIF. The entered answer is stored, for example, in the answer database of the storage unit 12. At this time, if the risk message RM is displayed, the unresolved information indicating that the risk message is displayed, that is, that the violation of the judgment rule has not been resolved, is linked to the answer and stored in the answer database.

[0080] The progress button B42 accepts input for switching the question items displayed on the answer input screen AD.

[0081] Figure 8 shows another example of the answer input screen AD displayed on the provider terminal 20. In the example in Figure 8, the question content QC and answer input field AIF for the question item with question number QN "CC-1" are displayed. Specifically, the question content QC is "Question about the existence of security certification or evaluation," and the answer options AC are a list of options representing information (certification name) that indicates security certification, with the option "ISO / IEC ○○○" selected as the answer.

[0082] Furthermore, in the example in Figure 8, a risk message RM explaining that the answer "We have obtained ISO / IEC ○○○" violates the judgment rule is displayed directly below the corresponding answer (the selected option). Note that the risk message RM may also be displayed below all options. Specifically, in the example in Figure 8, the risk message RM displayed contains a sentence suggesting that the answer "We have obtained ISO / IEC ○○○" contradicts another answer in the same question item ("We do not have obtained ISO / IEC ×××"). In the example in Figure 8, the risk message RM is removed when the violation of the judgment rule is resolved by deselecting "ISO / IEC ○○○" or selecting "ISO / IEC ×××".

[0083] The judgment unit 114 may display a list of the question items and answers that have been targeted for display of a risk message, along with the risk message, on the provider terminal 20. This allows the service provider to get an overview of the question items and answers that have been targeted for display of a risk message (the answers that violate the judgment rules and the corresponding question items) and correct their answers as needed. As a result, the efficiency of correcting answers by the service provider increases.

[0084] The determination unit 114 displays, for example, the question items, answers, and risk messages that are subject to list display on the provider terminal 20, concatenating them vertically. Alternatively, the determination unit 114 may display a list of information (such as question numbers) indicating the question items subject to list display on the provider terminal 20.

[0085] The determination unit 114 may, for example, display a notification, menu item, etc., on the provider terminal 20 to indicate that there are answers that violate the determination rules or that there are question items that require confirmation, and may accept a command from the provider terminal 20 to display a list. For example, if there are no answers that violate the determination rules, the determination unit 114 may deactivate or hide the menu item that accepts a command to display a list of answers that violate the determination rules and their question items, and activate or make visible the menu item if there are answers that violate the determination rules.

[0086] When displaying a list of questions and answers along with risk messages, the determination unit 114 may, for example, perform a conflict determination when an answer is entered for each question and store the results. When it receives a list display instruction from the provider terminal 20, it may display the questions, answers, and risk messages on the provider terminal 20 based on the stored determination results. Alternatively, after receiving a list display instruction from the provider terminal 20, the determination unit 114 may perform a conflict determination on the answers to the questions for which answers have been entered among the multiple questions included in the survey, and after the conflict determination, display the questions, answers, and risk messages determined to be conflicts on the provider terminal 20.

[0087] The determination unit 114 may display the question item and answer that were the target of the risk message display, along with related question information including other question items and answers related to the risk message, on the same screen on the provider terminal 20. This allows the service provider to confirm the reason for the violation of the determination rule from the answers to the other question items. In addition, the provider terminal 20 can modify the answers to the other question items without having to display the other question items again.

[0088] The judgment unit 114 may display related question information along with a risk message on the provider terminal 20 when an answer that violates the judgment rules is entered. In addition, the judgment unit 114 may also display the corresponding related question information for each question item in the list display of multiple question items, answers, and risk messages that violate the judgment rules.

[0089] Figure 9 shows yet another example of the response input screen AD displayed on the provider terminal 20. In the response input screen AD of Figure 9, information on related questions is displayed in the related questions display field CAF, along with the input form for the question item on which the risk message RM is displayed. In the example of Figure 9, the related questions display field CAF is displayed to the right of the display field for the question item on which the risk message RM is displayed ("AA-1"). The related questions display field CAF displays the question number, question content, and entered answer of the question item ("DD-1") included in the risk message RM (for example, the question item on which an answer that contradicts the answer to "AA-1" has been entered). Note that the related questions display field CAF may also accept corrections to the answer.

[0090] The judgment unit 114 may display an alert on the provider terminal 20 indicating that there is an answer that violates the judgment rules when it receives a transmission instruction for an answer to a question item from the answer reception unit 113. This gives the service provider an opportunity to review or revise their answer before it is submitted to the evaluator. As a result, the occurrence of answers being returned for revision is suppressed.

[0091] The alert may include conflicting question information (e.g., question number) indicating the answer or question item that violates the judgment rule. If there are multiple conflicting answers, the alert may include information on multiple conflicting questions. Furthermore, the alert may include a risk message corresponding to the conflicting judgment rule.

[0092] The alert may include a link to the question item corresponding to the answer that violates the judgment rule, or an input form for the question item corresponding to the answer in question where the answer that violates the judgment rule is displayed. This allows the service provider to quickly access the question item to review or correct the answer, thus reducing the time required for the service provider to submit the answer.

[0093] Links to questions in an alert may be attached to the conflicting question information (e.g., question number), or they may be included in the alert independently of the conflicting question information and risk message, for example, as an object such as a button. When an input operation is performed on the provider terminal 20 for the link, the answer input screen (answer input field) for the linked question is displayed on the provider terminal 20.

[0094] Figure 10 shows an example of a transmission confirmation screen CD displayed on the provider terminal 20. The transmission confirmation screen CD is displayed, for example, when the service provider enters an instruction to send a response to the evaluator (evaluation request instruction). The transmission confirmation screen CD includes an alert message AM, a comment input field CIF, a cancel button B51, and a send button B52.

[0095] The alert message AM includes text indicating that the response contains a violation of the judgment rule (a risk message is displayed, and the violation has not been resolved), keywords (question numbers) indicating the question item corresponding to the violation, and so on. The keywords indicating the question item also have links to that question item. For example, if an input operation is performed on the provider terminal 20 by clicking on the "PU-1" link in the alert message AM, the question item and answer (input form) for "PU-1" will be displayed on the provider terminal 20. Note that if the response to be submitted does not contain a response that violates the judgment rule, the alert message AM will not be displayed.

[0096] The comment input field CIF accepts comments (handover information) from the service provider to the evaluator. Examples of comments include the reason for the response that triggered the alert message AM.

[0097] The Cancel button B51 accepts input for canceling the submission of an answer. Input to the Cancel button B51 may also cause a list of answers and their corresponding questions that violate the judgment rules to be displayed on the provider terminal 20. The Send button B52 accepts input for submitting an answer. Input to the Send button B52 registers the answer entered by the service provider in the answer database and sends it to the evaluator.

[0098] Figure 11 shows another example of the transmission confirmation screen CD displayed on the provider terminal 20. In the transmission confirmation screen CD of Figure 10, the alert message AM displays a question item display field QIF instead of a link ("DD-1") indicating the question item corresponding to the conflicting answer exemplified in the answer input screen AD of Figure 9. The question item display field QIF displays one question item corresponding to each conflicting answer, and the displayed question items can be switched using the left and right switching objects CO. Note that the answer may be directly modified in the question item display field QIF, or the input form for the question item may be displayed on the provider terminal 20 by selecting the question item displayed in the question item display field QIF (for example, by clicking somewhere in the display area).

[0099] The determination unit 114 displays risk messages and alerts on the provider terminal 20 using the language of the question items (the language of the answer input). The language of the question items can be changed, for example, by selection input from the provider terminal 20. Risk messages, alerts, etc., may be registered for multiple languages ​​(for example, Japanese and English).

[0100] <Response Submission Section 115> The response transmission unit 115 is configured to transmit the service provider's response to the security survey, received by the response reception unit 113, to the evaluator.

[0101] Specifically, the response transmission unit 115 receives input from the provider terminal 20 to the transmission input object (send button) that accepts the transmission of responses, registers the service provider's responses as evaluation information, and sends the evaluation information or access information (address) to the evaluator. The response transmission unit 115 may deactivate the transmission input object and not accept transmission input from the service provider if all the required questions in the security survey have not been answered. Conversely, the response transmission unit 115 may activate the transmission input object and accept transmission input from the service provider if all the required questions in the security survey have been answered.

[0102] "Evaluation information" consists of the service provider's answers to multiple questions regarding the service's security, etc., and is the information that evaluators check and evaluate. Evaluation information may be evaluated only once or multiple times. In other words, evaluation of evaluation information may include an initial evaluation (so-called review), an intermediate evaluation, a final evaluation, etc. The initial evaluation and intermediate evaluation are evaluations in which further evaluations are conducted after the initial evaluation. Multiple evaluations may be performed by the same evaluator or by different evaluators (so-called reviewers, etc.). The final evaluation is used to create an evaluation to be used in a report or document provided to the service user. In addition, evaluation information may be evaluated again by the evaluator when it is modified or updated by the service provider.

[0103] The evaluation results of the evaluation information by the evaluators will be used as part of the report or as reference information. In addition to individuals or organizations that use the service being evaluated, "service users" in Information Processing System 1 also include individuals or organizations that request an evaluation of a specific service, such as companies that want to evaluate the security of cloud services they use, or companies that want to confirm such evaluations.

[0104] The evaluation information may include the answers along with the corresponding questions. Furthermore, the evaluation information may include service attributes (information indicating the type of service, the service provider, the types of plans included in the service, or a combination of these).

[0105] The evaluation information is registered, for example, in the answer database of the memory unit 12. The answers to each question item included in the evaluation information are the answers that the service provider entered into the input form for each question item presented in the input form, and these answers are registered in the answer database. The answers to a single question item may be hierarchical.

[0106] The response transmission unit 115 determines whether the service provider's response in the security survey contains any responses that violate the judgment rules for which correction is required. If no such responses are found, the service provider's response may be sent to the evaluator. In other words, the response transmission unit 115 does not have to send the service provider's response to the evaluator if the response to be sent contains any responses that require correction. This prevents responses containing critical deficiencies from being sent to the evaluator, thereby improving the evaluator's work efficiency.

[0107] The response transmission unit 115 does not have to accept the transmission instruction from the service provider if the response to be transmitted includes a response that requires correction. For example, the response transmission unit 115 may deactivate the transmission input object that accepts the transmission of a response if a response that requires correction exists. Conversely, the response transmission unit 115 may activate the transmission input object that accepts the transmission of a response if no response that requires correction exists. In addition, the response transmission unit 115 may display information on the provider terminal 20 indicating that a response that requires correction exists, or information indicating the question item that contains a response that requires correction.

[0108] The response transmission unit 115 may send to the evaluator, along with the service provider's response in the security survey, information indicating that the response still violates the judgment rules. In other words, the evaluation information may include information indicating the status of violations of the judgment rules. This improves the efficiency of the evaluation work, as the evaluator can create comments, score, etc., while checking the status of violations of the judgment rules. Furthermore, the response transmission unit 115 may send to the evaluator information indicating the attributes of the response that violates the judgment rules.

[0109] The response transmission unit 115 may accept confirmation requests from the service provider regarding risk messages and send information to the evaluator indicating that the confirmation request has been received. This allows the evaluator to confirm whether the service provider has reviewed the risk message and maintained the response that violates the judgment rules. As a result, the efficiency of tasks such as comment creation and scoring is improved.

[0110] "Confirmation actions for risk messages" include, for example, entering information into a confirmation input object attached to the risk message (e.g., a "Confirmed" checkbox), scrolling to the bottom of a screen displaying a list of answers and their corresponding questions that violate the judgment rules, and writing comments regarding the violations of the judgment rules. Such comments may include, for example, supplementary explanations from the service provider in cases where there are inconsistencies between answers or where answers are kept private, as well as reasons for entering the answers.

[0111] The response transmission unit 115 may send the service provider's response to the evaluator only if the confirmation operation is accepted. In other words, the response transmission unit 115 does not have to send the service provider's response to the evaluator if the confirmation operation is not accepted. Furthermore, the response transmission unit 115 may make the confirmation operation of the risk message a mandatory condition for transmission only if the response contains a response that violates a predetermined attribute judgment rule (for example, a response that violates a judgment rule for a high warning level).

[0112] <Evaluation Reception Department 116> The evaluation reception unit 116 is configured to receive evaluations from evaluators regarding the service provider's responses in security surveys. The evaluation reception unit 116 is configured to register the evaluated evaluation information along with the evaluation results in a response database or the like.

[0113] "Evaluation" refers to the act of checking for any deficiencies in the answers included in the evaluation information, creating comments on the content of the answers, assessing the content of the answers, and scoring the answers based on predetermined criteria. As mentioned above, evaluation may be carried out by multiple evaluators, and one evaluator may request other evaluators to evaluate the registered evaluation information. In that case, the evaluation reception unit 116 may accept evaluations from other evaluators after the evaluation by one evaluator has been completed.

[0114] For example, if the evaluation is conducted in two stages, the initial evaluation (review) involves checking for deficiencies and creating points of concern. Subsequently, the evaluation of the evaluation information after the initial evaluation is performed as a final evaluation based on predetermined criteria, including assessment and scoring of the content (responses) and creation of comments on the evaluation information as a whole. A report or document (e.g., a security report) containing the results is then created. The report or document is created by the final evaluator or by the evaluation unit of the control unit 11. The evaluation unit is configured to generate part or all of the report or document based on the input evaluation information. The evaluation results of the evaluation information may be included in the report or document as part of the report or as reference information. The report or document is transmitted to the user terminal 40 of the service user who requested the report or document.

[0115] The evaluation reception unit 116 receives input such as characters and sentences used for evaluation from the evaluator terminal 30. Typically, evaluation is performed on evaluation information for which all question items have been answered. Evaluation information with unanswered questions (question items for which answers have not been registered) is not subject to evaluation, and the evaluation reception unit 116 does not need to accept the evaluation. Furthermore, even if evaluation information contains unanswered questions (question items for which answers have not been registered), only the questions that have been answered may be partially subject to evaluation. In addition, only answers that do not violate the judgment rules, or only answers that do not violate the judgment rules or for which the risk message confirmation operation has been accepted, may be subject to evaluation.

[0116] <Report Output Unit 117> The report output unit 117 is configured to output a report or document created based on the evaluation received by the evaluation reception unit 116 to the user terminal 40. The report or document includes at least all or part of the evaluation information entered by the service provider and the evaluation results by the evaluator (e.g., evaluation values, comments, etc.).

[0117] <Display section> The display unit 211 of the provider terminal 20, the display unit 311 of the evaluator terminal 30, and the display unit 411 of the user terminal 40 each display the screen indicated by the screen data transmitted from the server device 10.

[0118] <Operation acquisition section> The operation acquisition unit 212 of the provider terminal 20 accepts operations performed by the provider using the provider terminal 20. The operation acquisition unit 312 of the evaluator terminal 30 accepts operations performed by the evaluator using the evaluator terminal 30. The operation acquisition unit 412 of the user terminal 40 accepts operations performed by the user using the user terminal 40.

[0119] 3. Information Processing Methods This section describes the information processing method of the server device 10. In this information processing method, each part of the server device 10 is executed by a computer as a step.

[0120] This information processing comprises a judgment rule registration step, a response reception step, a judgment step, and an evaluation reception step. In the judgment rule registration step, the system receives input from the evaluator of multiple judgment rules for responses to questions in a security survey, along with a risk message associated with each judgment rule, and registers the judgment rules and their associated risk messages in the database. In the response reception step, the system receives input from the service provider of responses to questions in the survey. In the judgment step, the system determines whether the input response violates any judgment rules, and if a violation occurs, it displays a risk message for that response. In the evaluation reception step, the system receives evaluations from the evaluator of the service provider's responses in the survey.

[0121] Figure 12 is an activity diagram showing an example of the flow of information processing (security investigation processing) performed by information processing system 1. The information processing will be explained below in accordance with each activity in this activity diagram.

[0122] The security investigation process begins with the registration of judgment rules. The evaluator inputs the judgment rules and risk messages in association with each other on the evaluator terminal 30 (Activity A101). The server device 10 receives the judgment rules and risk messages sent from the evaluator terminal 30 (Activity A102). Subsequently, the server device 10 registers the received judgment rules and risk messages in association with each other (Activity A103).

[0123] The service provider enters an answer on the provider terminal 20 with the judgment rules and risk message already registered (Activity A201). The server device 10 receives the answer sent from the provider terminal 20 (Activity A202). Next, the server device 10 determines whether the received answer violates the judgment rules (Activity A203). After determining if there is a violation, the server device 10 outputs a risk message to the provider terminal 20 according to the judgment result (Activity A204). As a result, the risk message is displayed on the provider terminal 20 (Activity A205).

[0124] Upon receiving the risk message, the service provider performs corrective actions on the provider terminal 20, such as correcting the response and confirming the risk message, and also issues a command to send the response (Activity A206). The server device 10 registers the response sent from the provider terminal 20 (Activity A207). Subsequently, the server device 10 transmits the registered response to the evaluator terminal 30 (Activity A208). As a result, the service provider's response is displayed on the evaluator terminal 30 (Activity A209). The evaluator evaluates the response on the evaluator terminal 30 and transmits the results (Activity A210). The server device 10 receives and registers the evaluation transmitted from the evaluator terminal 30 (Activity A211).

[0125] 4. Effect The operation of this embodiment can be summarized as follows: When entering answers to questions in a security survey, the service provider (respondent) can review or correct their answers based on the risk messages displayed for incomplete answers. As a result, security evaluations can be conducted efficiently.

[0126] Although embodiments of the present invention have been described above, the present invention is not limited thereto and can be modified as appropriate without departing from the technical spirit of the invention.

[0127] 5. Others In the above embodiment, the server device 10 performed various storage and control functions, but instead of the server device 10, multiple external devices may be used. That is, various information and programs may be distributed and stored across multiple external devices using blockchain technology or the like.

[0128] The embodiments of this model are not limited to the information processing system 1, but may also be an information processing method or a program. The information processing method comprises each step executed by the information processing system 1. The program causes a computer to execute each step of the information processing system 1.

[0129] The product may be provided in any of the following embodiments.

[0130] (1) An information processing system comprising at least one processor, wherein the processor is configured to perform the following steps by reading a program, wherein in the judgment rule registration step, the system receives input from an evaluator of multiple judgment rules for answers to questions in a security survey and a risk message associated with each of the judgment rules, and registers the judgment rules and the risk messages associated with the judgment rules in a database, wherein the risk message includes a sentence explaining the matter that violates the judgment rule, in the response reception step, the system receives input from a service provider of answers to questions in the survey, in the judgment step, the system determines whether the input answer violates the judgment rule, and if there is a violation, displays the risk message for the answer, and in the evaluation reception step, the system receives an evaluation of the service provider's answers in the survey from the evaluator.

[0131] (2) An information processing system as described in (1) above, wherein the judgment rule includes at least one of the following: a condition that defines a contradiction with other answers, a condition that defines a contradiction with a date, and a condition that defines the non-disclosure of an answer.

[0132] (3) An information processing system as described in (2) above, wherein the other answers include answers to other question items and answers within the same question item.

[0133] (4) An information processing system according to any one of (1) to (3) above, wherein the judgment rule includes a plurality of conflict conditions, wherein each conflict condition defines one answer content that constitutes a condition for satisfying a conflict in a single question item, and in the judgment step, the system determines that there is a conflict with the judgment rule if all of the plurality of conflict conditions are satisfied, or if any of the plurality of conflict conditions are satisfied.

[0134] (5) An information processing system described in any one of (1) to (4) above, wherein the risk message includes a link to other questions related to the risk message.

[0135] (6) An information processing system according to any one of (1) to (5) above, wherein in the determination step, when an answer is entered for a question item in the survey, the information processing system displays the risk message according to the determination result of whether the answer violates the determination rule.

[0136] (7) An information processing system according to any one of (1) to (6) above, wherein in the determination step, the question items and answers that are subject to the display of the risk message are displayed in a list together with the risk message.

[0137] (8) An information processing system according to any one of (1) to (7) above, wherein in the response reception step, the system receives a transmission instruction from the service provider for the answers entered for the questions in the survey, and in the judgment step, the system displays an alert indicating that there is an answer that violates the judgment rule when the transmission instruction is received.

[0138] (9) An information processing system as described in (8) above, wherein the alert includes a link to a question item corresponding to an answer that violates the judgment rule, or an input form for an answer to a question item corresponding to an answer that violates the judgment rule.

[0139] (10) An information processing system according to any one of (1) to (9) above, wherein in the determination step, the question item and answer that are the target of displaying the risk message and other question items and answers related to the risk message are displayed side by side on the same screen.

[0140] (11) An information processing system according to any one of (1) to (10) above, wherein in the judgment rule registration step, the system accepts from the evaluator the setting of a mandatory correction attribute for each judgment rule, indicating that correction of an answer that violates the judgment rule is mandatory, and registers the judgment rule and the mandatory correction attribute in association with the database.

[0141] (12) An information processing system as described in (11) above, wherein in the response transmission step, the system determines whether the response of the service provider in the survey contains any response that violates the determination rule for which the required correction attribute is set, and if no such response is found, the system transmits the response of the service provider to the evaluator.

[0142] (13) An information processing system according to any one of (1) to (12) above, wherein in the response transmission step, the system transmits to the evaluator information indicating that the response in which the violation of the judgment rule has not been resolved, along with the response of the service provider in the survey.

[0143] (14) An information processing system as described in (13) above, wherein in the response transmission step, the information processing system receives a confirmation operation from the service provider regarding the risk message and transmits information to the evaluator indicating that the confirmation operation has been received.

[0144] (15) An information processing method comprising each step performed by the information processing system described in any one of (1) to (14) above.

[0145] (16) A program that causes a computer to perform each step of the information processing system described in any one of (1) to (14) above. Of course, this is not always the case.

[0146] Finally, while various embodiments relating to this disclosure have been described, these are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of Symbols]

[0147] 1: Information Processing System 2: Communication lines 10: Server device 11: Control Unit 12: Storage section 13: Communications Department 14: Communications bus 20: Provider terminal 21: Control Unit 22: Storage section 23: Communications Department 24: Input section 25: Output section 26: Communications bus 30: Evaluator terminal 31: Control Unit 32: Storage section 33: Communications Department 34: Input section 35: Output section 36: Communications bus 40: User terminal 41: Control Unit 42: Storage section 43: Communications Department 44: Input section 45: Output section 46: Communications bus 111: Basic Display Control Unit 112: Judgment Rule Registration Section 113: Response Reception Department 114: Judgment section 115: Reply Submission Section 116: Evaluation Reception Department 117: Report Output Section 211:Display section 212: Operation acquisition section 311: Display section 312: Operation acquisition section 411: Display section 412: Operation acquisition section AC: Answer choices ACF: Overall Condition Input Field AD: Answer input screen AF: Attribute input field AIF: Answer input field AM: Alert Message B11: Register button B12: Add Condition Group Button B13: Delete button B14: Add Input Field Button B21: Search execution button B41: Save Answer Button B42: Proceed button B51: Cancel button B52: Send button CAF: Related Questions Display Area CD: Sending confirmation screen CIF: Comment input field CO: Switching object ICF: Item condition input field IF: ID input field IF1: Question item input field IF2: Input field for answer choices IF3: Input field for auxiliary conditions LD: Judgment Rule List Screen LF: List display field MF: Risk message input field NF: Rule name input field QC: Question content QF: Query input field QIF:Question item display field QN: Question Number RD: Judgment Rule Registration Screen RF: Judgment rule input field RM: Risk Message SC: Auxiliary options

Claims

1. An information processing system, Equipped with at least one processor, The aforementioned processor is configured to perform the following steps by reading a program: In the judgment rule registration step, the evaluator inputs multiple judgment rules for answers to questions in a security survey, along with a risk message associated with each judgment rule. The judgment rules and the associated risk messages are then combined and registered in the database. Here, the risk message includes a sentence explaining the matters that violate the judgment rule. In the response submission step, the service provider submits their answers to the survey questions. In the judgment step, it is determined whether the entered answer violates the judgment rule, and if it does, the risk message for that answer is displayed. In the evaluation acceptance step, an information processing system receives evaluations from evaluators regarding the service provider's responses in the survey.

2. In the information processing system described in claim 1, An information processing system in which the judgment rule includes at least one of the following conditions: a condition that defines a contradiction with other answers, a condition that defines a contradiction regarding dates, and a condition regarding the non-disclosure of answers.

3. In the information processing system described in claim 2, An information processing system in which the aforementioned other responses include responses to other question items and responses within the same question item.

4. In the information processing system described in claim 1, The aforementioned judgment rule includes multiple conflict conditions, where each conflict condition specifies one response content that constitutes a condition for satisfying a conflict in a single question item. An information processing system that, in the determination step, determines that there is a violation of the determination rule if all of the multiple violation conditions are met, or if any of the multiple violation conditions are met.

5. In the information processing system described in claim 1, An information processing system in which the aforementioned risk message includes links to other questions related to the risk message.

6. In the information processing system described in claim 1, In the judgment step, when an answer is entered for a question item in the survey, the information processing system displays the risk message according to the result of the judgment that the answer violates the judgment rule.

7. In the information processing system described in claim 1, In the determination step, the information processing system displays the question items and answers that were selected for displaying the risk message, along with the risk message, in a list.

8. In the information processing system described in claim 1, In the response reception step, the service provider receives instructions to submit the responses entered for the questions in the survey. The aforementioned determination step includes an information processing system that displays an alert indicating that there is a response that violates the determination rule when the transmission instruction is received.

9. In the information processing system described in claim 8, An information processing system in which the alert includes a link to a question item corresponding to an answer that violates the judgment rule, or an input form for an answer to a question item corresponding to an answer that violates the judgment rule.

10. In the information processing system described in claim 1, In the determination step, the information processing system displays the question items and answers that were the target of the risk message display, along with other question items and answers related to the risk message, side by side on the same screen.

11. In the information processing system described in claim 1, In the judgment rule registration step, the information processing system receives from the evaluator the setting of a mandatory correction attribute for each judgment rule, indicating that correction of answers that violate the judgment rule is mandatory, and registers the judgment rule and the mandatory correction attribute in association with each other in the database.

12. In the information processing system according to claim 11, An information processing system that, in the response submission step, determines whether the service provider's response in the survey contains any responses that violate the judgment rule for which the required correction attribute is set, and if no such required correction responses are included, sends the service provider's response to the evaluator.

13. In the information processing system described in claim 1, An information processing system that, in the response submission step, sends to the evaluator information indicating that the response does not resolve the violation of the judgment rules, along with the response of the service provider in the survey.

14. In the information processing system described in claim 13, An information processing system that, in the response transmission step, receives a confirmation operation from the service provider regarding the risk message and transmits information to the evaluator indicating that the confirmation operation has been received.

15. Information processing method, An information processing method comprising each step performed by the information processing system according to any one of claims 1 to 14.

16. It is a program, A program for causing a computer to perform each step of the information processing system described in any one of claims 1 to 14.

Images