Information processing system, information processing method and program

Abstract

An information processing system and the like that can receive more appropriate answers to security-related questions is provided. [Solution] According to one aspect of the present invention, there is provided an information processing system comprising at least one processor, the processor being configured to execute the following steps by reading a program: in a setting step, a first user who is at least one of a plurality of users belonging to the organization being surveyed is set as a respondent for each of a plurality of questions in a survey regarding security assessment; in a determination step, it is determined whether the answer to the question is entered by the first user set as a respondent; and in an acceptance control step, the acceptance of the answer is controlled according to the determination result.

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a technology relating to a security assessment support system that correlates and analyzes the contents of assessment item answers and security diagnosis log contents, and reflects the contents of the security diagnosis log in the security assessment answer results. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-234756 Summary of the Invention [Problem to be solved by the invention]

[0004] There is room for improvement in the technology that accepts appropriate answers to security questions.

[0005] In view of the above circumstances, the present invention provides an information processing system and the like that can receive more appropriate answers to security-related questions. [Means for solving the problem]

[0006] According to one aspect of the present invention, there is provided an information processing system comprising at least one processor, the processor being configured to execute the following steps by reading a program, wherein in a setting step, a first user who is at least one of a plurality of users belonging to an organization being surveyed is set as a respondent for each of a plurality of questions in a survey regarding security assessment, in a determination step, it is determined whether the answer to the question is an input by the first user set as a respondent, and in an acceptance control step, the acceptance of the answer is controlled in accordance with the determination result.

[0007] According to this aspect, it is possible to provide an information processing system or the like that can receive more appropriate answers to security-related questions. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a configuration diagram illustrating an information processing system 1. FIG. [Figure 2] FIG. 2 is a block diagram showing the hardware configuration of the server 2. [Figure 3] 2 is a block diagram showing the hardware configuration of a user terminal 3 and an administrator terminal 4. FIG. [Figure 4] 1 is a block diagram showing functions realized by a server 2 (controller 23), a user terminal 3 (controller 33), an administrator terminal 4 (controller 43), and an evaluator terminal 5 (controller 53). [Figure 5] FIG. 2 is a diagram showing an outline of processing executed by the information processing system 1. [Figure 6] 2 is an activity diagram showing an example of the flow of information processing according to the first embodiment, which is executed by the information processing system 1. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0010] Incidentally, the program for realizing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or may be provided so that it can be downloaded from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] Furthermore, various information processing according to an embodiment may realize input and output corresponding to the input. Here, the form of information referenced in such information processing (hereinafter referred to as reference information) is not limited as long as an output is obtained as a result of the input. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression formula constructed using a statistical method), a trained model that has previously learned the correlation between input and output, or a generative AI such as a large-scale language model (these models include parameters that establish the correlation between input and output) or a visual language model that can output a desired result in response to a prompt.

[0012] In one embodiment, a "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In one embodiment, various information is handled, and this information is represented, for example, by physical values ​​of signal values ​​representing voltage and current, high and low signal values ​​as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculations can be performed on a circuit in the broad sense.

[0013] Furthermore, a circuit in the broad sense is a circuit realized by at least an appropriate combination of a circuit, circuitry, processor, memory, etc. The processor may be a general-purpose processor or a dedicated circuit. That is, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0014] 1. Hardware Configuration This section explains the hardware configuration.

[0015] <Information Processing System 1> FIG. 1 is a configuration diagram illustrating an information processing system 1. The information processing system 1 includes a server 2, a user terminal 3, an administrator terminal 4, and an evaluator terminal 5. The server 2, the user terminal 3, the administrator terminal 4, and the evaluator terminal 5 are configured to be able to communicate with each other via a telecommunications line (network). In an exemplary embodiment, the user terminal 3 can function as a terminal for multiple users belonging to the organization being surveyed. The administrator terminal 4 can function as a terminal for an administrator of multiple users belonging to the organization being surveyed. The evaluator terminal 5 can function as a terminal for an implementer of a security evaluation survey. Here, the system exemplified by the information processing system 1 is composed of one or more devices or components. Therefore, it should be noted that the information processing system 1 includes the server 2 alone, the server 2 and the user terminal 3, the server 2 and the administrator terminal 4, or the server 2 and the evaluator terminal 5. More specifically, the information processing system 1 may include an element selected from the group consisting of the server 2, the user terminal 3, the administrator terminal 4, and the evaluator terminal 5. The unselected elements may be electrically connected to the selected elements as external elements, and may not be included in the information processing system 1. These components will be described below.

[0016] The information processing system 1 constitutes at least a part of a system for security surveys, etc., used by, for example, multiple target organizations and multiple users of the survey results. The information processing system 1 primarily aggregates and provides responses to surveys (security surveys, other surveys regarding products such as organizations and services) related to the target organizations, analyzes the responses, and provides evaluation results. The survey subjects of the surveys related to the target organizations include the target organizations themselves as well as the products provided by the target organizations. Products provided by the target organizations include all forms of business relationships, such as the provision of goods or services (e.g., cloud services) and outsourcing of work. The target organizations themselves refer to the target organizations themselves when the target organizations are organizations, and security surveys include security surveys of the organizations themselves. In one embodiment, the information processing system 1 comprises one or more devices or components. These components are described below.

[0017] The target organization includes business partners or their personnel that conduct transactions, such as providing products, with users of the survey results (e.g., security survey clients). The target organization is, for example, a service provider, supplier, or outsourced organization. The term "business partner organization" includes first-tier business partners that conduct direct transactions with users of the survey results, and N-tier business partners that conduct N-tier transactions with first-tier business partners. In other words, a business partner organization refers to a first-tier business partner organization or an N-tier business partner organization (N>1) from the perspective of the source organization (user of the survey results), and the first-tier business partner organization and N-tier business partner organization for a single transaction constitute the supply chain for that transaction. The target organization may also include individual business owners who conduct transactions. The term "organization" includes for-profit organizations (e.g., companies), non-profit organizations (e.g., cooperatives, foundations), and public organizations (e.g., local governments).

[0018] "Users of survey results" include viewers of responses to security surveys, requesters of security surveys, evaluation users, etc.

[0019] A "viewer" is an individual or organization that uses the security evaluation results of the organization under investigation, conducted by the individual or at the request of another user of the evaluation results. A viewer may be, for example, a provider of a product such as a service that the individual plans to use, a business partner organization with which the individual plans to do business, or an individual or organization seeking the evaluation results of the organization under investigation as a potential candidate for either of these. Viewers may include evaluation users (which may also be referred to as service users) who are registered with a service provided by the information processing system 1 (e.g., a security evaluation service by an evaluator), and other evaluation users who are not registered with the evaluation service (e.g., evaluation users who are not registered with the evaluation service but who have obtained a web page displaying an evaluation provided by the evaluation service, a link to a file containing the evaluation, etc., that is accessible from outside the evaluation service, and may also be referred to as other service users).

[0020] A "security investigation requester" is an evaluation user who requests a security evaluation of the organization being investigated, such as an individual, organization, or person in charge of the organization that has a business relationship with the organization being investigated. The security investigation requester includes, for example, an evaluation user who has registered for a security evaluation service by an evaluator provided by the information processing system 1.

[0021] The user of the survey results is an organization or individual that requests a transaction with a business partner organization (the organization being surveyed), and receives or uses the merchandise such as services or work provided by the business partner organization. For example, if the merchandise being traded is goods, the user of the survey results may be a purchaser of the item (finished product or parts) manufactured by the business partner organization. Also, for example, if the merchandise being traded is services, the user of the survey results may be a user of the service provided by the business partner organization (for example, a user of a cloud service provided by a cloud service provider). Furthermore, for example, if the merchandise being traded is work (task), the user of the survey results may be a contractor that requests or outsources the work.

[0022] Users of the survey results include individuals or organizations that conduct transactions with the surveyed organization that are subject to evaluation (such as the use of services or outsourcing of work), as well as individuals or organizations that request an evaluation of a specific product or organization. For example, users of the survey results may include companies that want to evaluate the security of cloud services that they use or are considering using, or companies that want to confirm such evaluations.

[0023] <Server 2> 2 is a block diagram showing the hardware configuration of server 2. Server 2 includes a communication unit 21, a storage unit 22, and a control unit 23, and these components are electrically connected via a communication bus 20 inside server 2. Each component will be further described below.

[0024] The communication unit 21 is configured by a communication module. The communication module may be a wireless communication module conforming to standards such as IEEE802.11a / b / g / n / ac / ax, LTE, 5G, or 6G, or may be a wired communication module conforming to standards such as IEEE802.3. The communication unit 21 is configured to be able to transmit various electrical signals from the server 2 to external components. The communication unit 21 is also configured to be able to receive various electrical signals from the external components to the server 2. More preferably, the communication unit 21 has a network communication function, which allows various information to be communicated between the server 2 and external devices via a network.

[0025] The memory unit 22 stores various pieces of information defined above. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs and the like related to the server 2 executed by the control unit 23, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to the program operations. The memory unit 22 stores various programs, variables, etc. related to the server 2 executed by the control unit 23.

[0026] The control unit 23 processes and controls the overall operations related to the server 2. The control unit 23 is, for example, a central processing unit (CPU) not shown. The control unit 23 realizes various functions related to the server 2 by reading out predetermined programs stored in the storage unit 22. In other words, information processing by software stored in the storage unit 22 is specifically realized by the control unit 23, which is an example of hardware, and each step related to each function described below can be executed. This will be described in further detail in the next section. Note that the control unit 23 is not limited to being single, and multiple control units 23 may be provided for each function. A combination of these may also be used.

[0027] <User terminal 3> The user terminal 3 is an information processing device used by users of the organization being surveyed. The users of the organization being surveyed are organizations such as companies or their personnel who respond to surveys on security, etc. The users of the organization being surveyed respond to the security survey, for example, from the user terminal 3 via the information processing system 1. The users of the organization being surveyed include a first user who is set as a respondent and a second user who is not set as a respondent.

[0028] 3 is a block diagram showing the hardware configuration of the user terminal 3 and the administrator terminal 4. The user terminal 3 includes a communication unit 31, a storage unit 32, a control unit 33, a display unit 34, and an input unit 35, and these components are electrically connected via a communication bus 30 inside the user terminal 3. Each component will be further described below. The description of the communication unit 31, the storage unit 32, and the control unit 33 will be omitted as they are the same as the description of each unit in the server 2.

[0029] The display unit 34 may be included in the housing of the user terminal 3 or may be externally attached. The display unit 34 displays a graphical user interface (GUI) screen that can be operated by the user. This is preferably implemented by selectively using display devices such as a CRT display, a liquid crystal display, an organic EL display, or a plasma display depending on the type of user terminal 3.

[0030] The display unit 34 displays a screen indicated by the screen data transmitted from the server 2. The display unit 34 displays a system screen relating to the information processing system 1 indicated by the screen data transmitted from the server 2.

[0031] The input unit 35 may be included in the housing of the user terminal 3, or may be externally attached. For example, the input unit 35 may be implemented as a touch panel integrated with the display unit 34. A touch panel allows the user to input tapping, swiping, and the like. Of course, a switch button, a mouse, a QWERTY keyboard, or the like may be used instead of a touch panel. That is, the input unit 35 accepts an operation input made by the user. The input is transferred as a command signal to the control unit 33 via the communication bus 30, and the control unit 33 can execute predetermined control or calculation as necessary.

[0032] <Administrator terminal 4> The administrator terminal 4 includes a communication unit 41, a storage unit 42, a control unit 43, a display unit 44, and an input unit 45, and these components are electrically connected via a communication bus 40 inside the administrator terminal 4. Each component will be further described below. The description of the communication unit 41, storage unit 42, and control unit 43 will be omitted as they are similar to the description of each unit in the server 2. The description of the display unit 44 and input unit 45 will be omitted as they are similar to the description of each unit in the user terminal 3.

[0033] The administrator terminal 4 is an information processing device used by an administrator of the organization being surveyed. The administrator user of the organization being surveyed is an administrator user in an organization such as a company that responds to security surveys. The administrator user here may include, for example, a system administrator in the organization's information systems department, an information security officer (CISO, etc.), an internal control manager in the compliance department, a survey response manager in the human resources department or general affairs department, or a risk management officer in the organization's corporate planning department. The administrator user can also set respondent conditions for users from multiple departments who respond to the survey, manage the response progress, and review or approve the response content as necessary.

[0034] <Evaluator Terminal 5> The evaluator terminal 5 is an information processing device used by the evaluator. The evaluator terminal 5 includes a communication unit 51, a storage unit 52, a control unit 53, a display unit 54, and an input unit 55, and these components are electrically connected within the evaluator terminal 5 via a communication bus 50. Each component will be further described below. The description of the communication unit 51, the storage unit 52, and the control unit 53 is omitted because they are similar to the description of each unit in the server 2. The description of the display unit 54 and the input unit 55 is omitted because they are similar to the description of each unit in the user terminal 3.

[0035] An "evaluator" in the information processing system 1 is an organization or its personnel in charge of managing and operating the entire system. Evaluators configure and monitor the system, provide evaluation services, etc. Evaluation services mainly involve evaluating the security of the organization being surveyed and providing security evaluations. Evaluators can evaluate responses from the organization being surveyed. Evaluators include organizations such as companies that conduct security evaluations (for example, security evaluation companies that conduct security evaluations of services such as cloud services, software, etc.) or their personnel. Evaluators can evaluate responses regarding the security of the organization being surveyed, for example, from the evaluator terminal 5 via the information processing system 1. Evaluators may also include users of the survey results.

[0036] 2. Functional configuration This section describes the functional configuration of this embodiment. Information processing by software stored in the storage unit 22 is specifically realized by the control unit 23, which is an example of hardware, and can be executed as each functional unit included in the control unit 23 (at least one processor included in the information processing system 1).

[0037] FIG. 4 is a block diagram showing functions realized by the server 2 (controller 23), the user terminal 3 (controller 33), the administrator terminal 4 (controller 43), and the evaluator terminal 5 (controller 53).

[0038] 4A is a block diagram showing functions realized by the control unit 23. The control unit 23 includes a setting unit 231, a determination unit 232, a reception control unit 233, a transmission unit 234, a display control unit 235, a recording unit 236, an extraction unit 237, a presentation unit 238, an identification unit 239, an acquisition unit 240, and an artificial intelligence unit 241.

[0039] As shown in Fig. 4B, the user terminal 3 (controller 33) includes a display unit 331 and an operation acquisition unit 332. As shown in Fig. 4C, the administrator terminal 4 (controller 43) includes a display unit 431 and an operation acquisition unit 432. As shown in Fig. 4D, the evaluator terminal 5 (controller 53) includes a display unit 531 and an operation acquisition unit 532.

[0040] <Settings section 231> The setting unit 231 is configured to set an answerer for each of a plurality of questions in a survey related to security evaluation. The setting unit 231 is configured to make various settings for each of the plurality of questions in order to set an answerer for each of the plurality of questions. The setting unit 231 is configured to make various settings for each of a plurality of users belonging to the target organization in order to set an answerer for each of the plurality of questions in a survey related to security evaluation.

[0041] (Set the first user as the answerer for the question) The setting unit 231 pre-sets a first user, who is at least one of a plurality of users belonging to the organization to be surveyed, as a respondent for each of a plurality of questions in the survey regarding security evaluation. The setting unit 231 sets at least some of a plurality of candidate respondents extracted by the extraction unit 237 as respondents. The setting unit 231 sets candidate respondents selected by an administrator or an evaluator as respondents. The setting unit 231 automatically selects at least some of the candidate respondents based on the priority score of the candidate respondents, etc., and sets them as respondents. The setting unit 231 identifies questions to be answered according to the job content, attributes, etc. of each of a plurality of users belonging to the organization to be surveyed, and sets first users (at least some of the users belonging to the organization to be surveyed) as respondents for the identified questions.

[0042] A security assessment survey is a series of surveys that ask business partners or those being assessed to answer security-related questions and use the answers to understand and evaluate the status of the security measures of the organization or service. The "questions" are questions that the surveyed organization is required to answer, and may include, for example, questions about the security of the surveyed organization itself and the security of the surveyed items (goods or services) provided by the surveyed organization. The "questions" may also include questions about the security of other organizations in the surveyed organization's supply chain. "Other organizations" include, for example, business partners of the surveyed organization, such as organizations to which the surveyed organization outsources its business (including contractors, subcontractors, and sub-subcontractors). The questions may also include a so-called security checklist.

[0043] Questions may include, for example, questions regarding the status of security certifications or investigations, service levels, scope of responsibility, security measures within the organization being investigated, handling of data related to users of the investigation results, handling of data managed by the organization being investigated, and service development, maintenance, or operation policies (account management, etc.) (for which responses are requested from the organization being investigated).

[0044] (Question settings) The setting unit 231 has a function for setting conditions for respondents for each question. The conditions for respondents include conditions related to the user's job content or attributes. The job content or attributes of the user include conditions related to the business area, work, product, service, department, position, role (including role, qualifications, etc.), confidentiality classification, tag, etc. Furthermore, the respondent conditions may include information indicating the survey target (product, service, base, etc.) to be answered, the business area to be answered, and the department to be answered. In this way, by setting the conditions for respondents for each question, the extraction unit 237 can extract candidate respondents according to the conditions for the respondent.

[0045] The setting unit 231 can set question groups by grouping multiple questions by type. Here, a type may be, for example, a category such as human resources, finance, compliance, or information security, or a section name or question label in a survey template. A question group is set to handle multiple questions belonging to the same type as a single group. By setting question groups by type in this way, the setting unit 231 can set, for each question group, users belonging to the organization being surveyed as respondents to the questions belonging to the question group.

[0046] The setting unit 231 may also assign tags to the acquired questions. Tags are meta-information that indicate the semantic characteristics of a question or the related business domain, and may include, for example, "human resources-related," "financial settlement," "internal control," and "ISMS." Questions may have tags assigned to them when the survey template was created. In this case, the setting unit 231 can assign tags by directly referencing the existing tags. On the other hand, for questions to which no tags have been assigned, the setting unit 231 may analyze the question and assign appropriate tags. The setting unit 231 can assign tags based on the question text, associated metadata (e.g., category name, section name, question label, etc.), similarity with previously assigned tags, and natural language analysis using a learning model or generative AI. If this analysis process determines that a question belongs to a topic such as "finance" or "compliance," the setting unit 231 assigns tags corresponding to "finance" and "compliance" to the question.

[0047] Here, question groups and tags are conceptually distinct. Question groups are collections for managing and processing questions collectively based on a specific type, and are used in setting answerer conditions and assignment processing. Tags, on the other hand, are labels that indicate the semantic characteristics of questions and are used for searching, categorizing, display control, and estimating answerer condition candidates. For example, a question may belong to the "finance" group but have multiple tags, such as "finance" and "audit."

[0048] The setting unit 231 may analyze the question and set a tag based on the question and the question classification reference information. The question classification reference information includes at least a correlation between the question and a tag related to the question. The question classification reference information may be stored in, for example, the storage unit 22. The question classification reference information may include rule-based information such as a database or a lookup table, a trained model, a large-scale language model, a generative AI, etc. The setting unit 231 can establish the correlation included in the question classification reference information by, for example, statistically analyzing data on past questions and the tags set therefor.

[0049] The question classification reference information may include a question classification model that is a learning model trained by machine learning so as to be able to input a question and output a tag, or a generative AI. In this case, the setting unit 231 inputs a question to the question classification model and causes the model to output a tag. Note that parameters calculated and adjusted by learning in the question classification model form correlations in the question classification reference information. The question classification model is included in the artificial intelligence unit 241. The question classification model trained so as to be able to output a tag is trained using, for example, pair data of a question sentence and its corresponding tag as training data.

[0050] When the question classification model is a generative AI including a general-purpose natural language model (for example, a large-scale language model), the setting unit 231 may input a question and input a prompt including an instruction to output a tag corresponding to the question to the question classification model, and output the tag. Furthermore, the setting unit 231 may input a prompt into which, as an example of an input-output pair, a past question and a sample of the tag corresponding to the question are inserted, in addition to the instruction to set the tag and the question.

[0051] The question classification reference information may include a search formula or classification rules for searching or generating tags according to the question. For example, the question classification reference information may be a table or algorithm that defines the relationship between keywords included in the question and tags. The setting unit 231 may analyze the question and automatically set the "information security" tag when the question contains words such as "personal information" or "ISMS."

[0052] The question classification reference information may include, for example, a template or format for tag setting. For example, it may take the form of "keyword = {specific word contained in the question} → tag = {predefined tag}", and the setting unit 231 may set tags by applying the question to such a template. Alternatively, it may adopt a mode in which tags set for similar questions in past surveys are inherited, or a mode in which AI-recommended tags are presented and reflected after confirmation by the administrator.

[0053] Furthermore, the setting unit 231 may receive input from the evaluator regarding setting question groups or tags, and group questions or set tags based on the received settings. For example, if the evaluator performs an operation such as "group all questions in the finance category" or "set a compliance-related tag for a specific question" on the management screen, the setting unit 231 reflects the setting and can use it for subsequent respondent condition setting and search processing.

[0054] (User settings) The setting unit 231 is configured to set a group setting or a tag setting for each user. The setting unit 231 can accept and set the group setting or tag setting for each user from at least one of the multiple users belonging to the organization being surveyed, such as an administrator user or an evaluator who performs security evaluations. Here, the group setting or tag setting may be input based on the user's job description, department, role, qualifications, or other attributes. For example, an "information security" group can be set for a user belonging to the information systems department, and a "personnel-related" tag can be set for a user belonging to the human resources department. By setting a group or tag for a user in this way, the extraction unit 237 can extract respondent candidates according to the group or tag set for the user by the setting unit 231.

[0055] Furthermore, in one embodiment, the identification unit 239 identifies questions from among the plurality of questions according to the group setting or tag setting for each user. For example, if the "finance" tag is set for the user, questions in the finance-related category are identified.

[0056] The setting unit 231 sets the user as the answerer of the question identified by the identification unit 239. In this way, in addition to the method of assigning users from the questioner, setting groups or tags for users makes it possible to automatically assign questions based on user attributes. This makes it possible to efficiently set up answerers in accordance with roles and job assignments in the organization being surveyed.

[0057] <Judgment unit 232> The determination unit 232 is configured to determine whether or not an answer to a question is an input by a first user set as an answerer. When a second user different from the first user inputs an answer to a question for which the first user is set as an answerer, the determination unit 232 determines that the answer is not an input by the answerer.

[0058] The determination unit 232 may determine whether an answer is an input by the first user, for example, by using reference information for determination stored in the storage unit 22. The reference information for determination may include at least a correspondence between the identification information of the first user and the identification information of the answerer (e.g., a login ID or a terminal ID) acquired at the time of answering. In this case, the determination unit 232 can determine whether the answer is an input by the first user by comparing the identification information acquired together with the answer with the identification information of the first user. The reference information for determination may also include a table, function, algorithm, etc. indicating a correlation between the first user and the answer to the question. Furthermore, the reference information for determination may be constructed by statistically analyzing the past input history data of the first user.

[0059] The reference information for determination may include a learning model that has been machine-learned so as to be able to input an answer received by the reception control unit 233 and output whether or not the answer is from the first user, or a determination model that is a generative AI. In this case, the determination unit 232 inputs the answer to the determination model and causes the determination model to output a determination result of "whether or not the answer is from the first user." Note that the parameters calculated and adjusted by learning in the determination model constitute the correlation of the reference information for determination.

[0060] The determination model is included in the artificial intelligence unit 241. The determination model, which has been trained to be able to output whether or not an answer is from the first user, is trained using, for example, past answers of users including the first user and corresponding label data indicating whether or not the answer is from the first user as training data.

[0061] When the determination model is a generation AI including a general-purpose natural language model (large-scale language model), the determination unit 232 inputs an answer, inputs a prompt including an instruction to determine whether the answer is an input by the first user to the determination model, and causes the determination model to output a determination result. The determination unit 232 may generate a prompt instructing the determination of whether the input is an input by the first user and input the prompt to the determination model. Furthermore, the determination unit 232 may input, in addition to the determination instruction and the answer, a prompt into which, for example, one or more answers and corresponding samples of "information on whether the user is the first user" are inserted as examples, samples, or training data of input and output pairs to the determination model.

[0062] The reference information for determination may include a rule or a determination formula for determining whether or not an input is from the first user, depending on the answer data. For example, the reference information for determination may be a table or algorithm that defines the relationship between the login information at the time of answer input, identification information of the input device, feature quantities such as input speed and input style, and "whether or not an input is from the first user." Furthermore, the determination unit 232 may input an instruction to a rule creation model, which is a generation AI included in the reference information for determination, to create a determination rule based on the answer data, and output the determination rule or a determination result based on the rule.

[0063] When it is determined that the answer is not an input by the first user, the determination unit 232 receives a reason from the answerer via the reception control unit 233, and determines whether or not to accept the answer based on the received reason and first reference information (reason determination reference information). The first reference information includes at least a correlation between the reason and whether or not to accept the answer.

[0064] The determination unit 232 may make a determination based on the correspondence between the reason and whether or not to accept the answer, for example, by using rule-based reason determination reference information stored in the storage unit 22. For example, if the reason is "proxy answer (according to instructions from a superior)" or "emergency response," which is registered in advance in an acceptable list, the answer may be accepted.

[0065] The reason determination reference information may include a learning model that has been machine-learned so that it can input a reason and output whether or not to accept the request. In this case, the determination unit 232 inputs the reason acquired by the reception control unit 233 into the determination model and causes the determination model to output whether or not to accept the request based on the reason. Note that the learned parameters in the determination model form the correlations of the reason determination reference information.

[0066] When the reason determination reference information is a generation AI including a general-purpose natural language model (large-scale language model), the determination unit 232 may generate a prompt including an instruction to determine "whether or not the answer should be accepted" using the reason as input, and input this to the determination model to output whether or not to accept. Furthermore, the accuracy of the determination may be improved by presenting examples of input and output pairs, together with samples of reasons that have been accepted and rejected in the past.

[0067] The reason determination reference information may include a determination of whether to accept the request, taking into account the content of the response data and related survey results in addition to the reason. For example, even if the response is from a second user, if the response is determined to be accurate and useful based on the survey results, the determination of whether to accept the request may be reflected in the determination of whether to accept the request.

[0068] After receiving answers to each of a plurality of questions in a survey regarding security evaluation, the determination unit 232 determines whether the received answers include input from a user other than the first user set as the answerer.

[0069] When the setting unit 231 sets a question that does not limit the answerer, the determining unit 232 does not determine whether or not the answer to the question that does not limit the answerer is input by the first user. <Reception control unit 233> The reception control unit 233 has a function of controlling the reception of answers to questions in accordance with the determination result by the determination unit 232. Specifically, if the determination unit 232 determines that the answer is acceptable, the reception control unit 233 controls the reception of the answer, whereas if the determination unit 232 determines that the answer is unacceptable, the reception control unit 233 controls the reception of the answer in accordance with the reason received via the field. For example, when an answer is input by a user who is not set as an answerer, the reception control unit 233 may receive reason information via the input field presented by the display control unit 235, and re-determine whether or not to accept the answer in accordance with the reason information. If the answer is acceptable, the reception control unit 233 accepts the answer, whereas if the answer is unacceptable, the reception control unit 233 does not accept the answer.

[0070] The reception control unit 233 may perform control so that the first user cannot answer questions for which the first user is not set as the answerer.

[0071] The reception control unit 233 receives answers from the first user to each of a plurality of questions in the security evaluation survey. Answers to questions for which the first user is not set as the answerer are received in association with information indicating that the answer is from a person other than the set answerer. For example, the reception control unit 233 receives the answers in association with the user identification information of the user who entered the answers, and records them in the recording unit 236. The reception control unit 233 also records the determination result by the determination unit 232 together with the received answers in the recording unit 236. The reception control unit 233 receives the determination result by the determination unit 232 and records an alert based on the answer result together with the received answers in the recording unit 236.

[0072] The reception control unit 233 is configured to control the reception of information from the user terminal 3, the administrator terminal 4, the evaluator terminal 5, or other devices. The reception control unit 233 is also configured to be able to receive various pieces of information by reading out various pieces of information stored in a storage area that is at least a part of the memory unit 22 and writing the read out information in a working area that is at least a part of the memory unit 22. The storage area is, for example, an area of ​​the memory unit 22 that is implemented as a storage device such as an SSD. The working area is, for example, an area that is implemented as a memory such as a RAM.

[0073] <Transmitting unit 234> The transmission unit 234 is configured to be able to transmit the generated information and data to a specified destination. The transmission unit 234 transmits a question to the first user set as the answerer. The transmission unit 234 can transmit the question by sending an email, a push notification to a mobile terminal, an in-app notification, sending a message through a chat tool, or the like. The transmission unit 234 may also transmit a notification including a link or button for transitioning to a screen for inputting an answer to the question. Furthermore, the transmission unit 234 may also include, as reference information, other questions for which the first user is not set as the answerer, in addition to the questions for which the first user is set as the answerer, as transmission targets.

[0074] When the setting unit 231 sets the first user as a respondent, the sending unit 234 may send to the first user a notification informing the first user that the first user has been set as a respondent, together with a message such as "You have been set as a respondent. Please answer the question." and the content of the question. In addition, the notification informing the first user that the first user has been set as a respondent may be sent periodically at predetermined intervals (for example, daily or weekly). This allows the first user to know that he or she has been set as a respondent, thereby encouraging the first user to provide an answer.

[0075] The transmission unit 234 transmits an alert to at least one of the first user and the second user according to the determination result. In this specification, "alert" refers to warning or caution information that is notified when the person inputting the answer is different from the user previously set as the answerer, when it is detected that the input answer may be an incorrect answer, etc. When a user (second user) other than the first user set as the answerer inputs an answer, the transmission unit 234 can transmit an alert to the second user and / or the first user.

[0076] The transmission unit 234 transmits an alert including an alert message set for at least one of each question and each organization under investigation. The message of the alert may be set in advance for each question, and may include a standard phrase such as "This question must be answered by a member of the legal department." Alternatively, a common alert message may be set in advance for each organization under investigation, and may include a cross-organizational message such as "Answers from departments other than the designated department may be invalid."

[0077] Furthermore, the transmission unit 234 may include in the alert the content of the input answer and identification information (e.g., user ID, name, department, etc.) of the second user who input the answer. This allows the first user who receives the alert to immediately know who attempted what answer. The transmission unit 234 may also transmit the alert to the administrator or evaluator. This allows the administrator or evaluator to understand the status of the alert.

[0078] Furthermore, the transmitting unit 234 can send an alert if it detects that the input answer may be an incorrect answer. In this specification, an "incorrect answer" refers to an answer that may lack appropriateness for the question. An incorrect answer refers to an answer that significantly deviates from normal answering behavior in terms of, for example, the input mode, temporal characteristics, operation pattern, etc. of the answer. Incorrect answers may include, for example, answers entered all at once in an extremely short period of time, answers entered mechanically at regular intervals, answers in which the same option is selected an abnormal number of times in succession, or answers that show almost no operation traces indicating screen reading. Answers that may be determined to be incorrect are not limited to those entered by the second user, but may also be those entered by the first user set as the answerer.

[0079] The determination unit 232 can determine whether or not an answer is an incorrect answer. For example, the reception control unit 233 receives operation information at the time of answer input along with the input answer, and the determination unit 232 determines whether or not the answer is an incorrect answer based on the received operation information. The operation information includes, for example, answer time, non-operation time, number of times moved to another window, cursor movement amount (x-axis, y-axis, total), number of clicks, number of times the cursor stops for a predetermined period or more (for example, the predetermined period is n seconds, n=1, 3, 5, 10, 30), average time between clicks and its standard deviation, longest or shortest click interval, number of times characters are selected, number of times an answer is selected, number of answers (which may include or exclude duplicates), average cursor movement amount (for example, per second, per answer), average click movement amount (for example, per second, per answer), average number of times a character is selected (for example, per second, per answer), cursor movement speed per n seconds (for example, maximum value, Minimum value, standard deviation, n=0.5, 1, 3, 5, 10), number of answer changes, number of answer character deletions, scroll speed, scroll time, scroll distance, number of reverse scrolls, number of text deletions, maximum number of consecutive identical answers, number of answer characters, number of times a button on the slide bar UI was flipped, amount of button movement, average button speed, maximum button speed, minimum button speed, button speed variance, whether or not a slide operation was performed, time spent on a question (e.g., time spent on a question without scrolling), position on a question (e.g., position on a question without scrolling), number of times copied and pasted, number of times an answer was saved, etc. The types of operation information are not limited to these.

[0080] The determination unit 232 may determine whether or not there is a possibility that an answer corresponds to an incorrect answer based on the answer, the operation information, and the reference information for determining an incorrect answer. The reference information for determining an incorrect answer includes at least a correlation between the answer, the operation information, and an incorrect answer. The reference information for determining an incorrect answer may include an incorrect answer determination rule or an incorrect answer determination model (e.g., a machine learning model). The determination unit 232 may, for example, calculate the degree of deviation from a population distribution through statistical comparison and determine that an answer is incorrect when a deviation of a predetermined value (e.g., twice the standard deviation) or more is found. The determination conditions can be adjusted depending on the type of question and the organization being surveyed. The incorrect answer determination model may include a learning model that has been trained by machine learning so that it can input the answer and the operation information and output the possibility that the answer corresponds to an incorrect answer, or an incorrect answer determination model that is a generative AI. In this case, the determination unit 232 inputs the answer and the operation information into the incorrect answer determination model and causes the model to output the possibility that the answer corresponds to an incorrect answer. When the incorrect answer determination model is a generation AI including a general-purpose natural language model (large-scale language model), the determination unit 232 may input a prompt including an instruction to determine "whether or not there is a high possibility that the answer is an incorrect answer" using the answer and operation information as input to the incorrect answer determination model, and output the determination result. Furthermore, the determination unit 232 may improve the accuracy of determination by the model by presenting past incorrect answer cases and normal answer cases as samples as examples of input and output pairs.

[0081] When the determination unit 232 determines that the input answer is likely to be an incorrect answer, the transmission unit 234 may send an alert to the second user and / or the first user. The alert may include, for example, a notice that the possibility of incorrect answering has been detected, an indicator that triggered the detection (e.g., the answering time is less than a threshold, the maximum number of consecutive identical answers exceeds a threshold, etc.), and identification information of the user who input the answer (user ID, name, department, etc.). The transmission unit 234 may send an alert to an administrator or an evaluator. This can prevent incorrect answers and improve the reliability of the answer data.

[0082] The sending unit 234 may send an alert each time an alert is generated based on the determination result, or may send all alerts generated over a predetermined period at once. For example, the sending unit 234 may compile alerts on a daily or weekly basis and send them all at once to the target users. Alternatively, the sending unit 234 may send alerts at a predetermined timing (for example, immediately before submitting the survey or before the start of the review). Furthermore, the sending unit 234 may be configured to aggregate all alerts generated for the entire survey results for multiple questions and send them all at once.

[0083] <Display control unit 235> The display control unit 235 controls the display of visual information such as screens, images including still images or videos, icons, messages (text), etc., on the display unit of each terminal (e.g., the display unit 34 of the user terminal 3, the display unit 44 of the administrator terminal 4, or the display unit 54 of the evaluator terminal 5). The display control unit 235 may generate rendering information for displaying the visual information on the display unit of each terminal and transmit the information to each terminal, thereby causing each terminal to generate the visual information and display the visual information on the display unit of each terminal. The display control unit 235 may also generate visual information and transmit the information to each terminal, thereby causing each terminal to display the visual information on the display unit of each terminal. The display control unit 235 executes processing for displaying a system screen related to the information processing system 1 on each terminal. For example, the display control unit 235 performs processing such as generating and transmitting an HTML (Hyper Text Markup Language) file and displays a web page showing the system screen on the display unit of each terminal. The display control unit 235 may also perform processing such as generating and transmitting display data for an application for using the information processing system 1.

[0084] The display control unit 235 displays, for the first user, questions for which the first user is set as the answerer and questions for which the first user is not set as the answerer in different display modes. For example, the display control unit 235 displays an input field in which an answer can be entered in a normal text color for questions for which the first user is set as the answerer, and does not display an input field in which an answer can be entered for questions for which the first user is not set as the answerer, or, if displayed, grays out the field so that it cannot be operated. Alternatively, the display control unit 235 displays questions for which the first user is set as the answerer in different modes, marking them with a "responsible" mark and marking other questions with a "reference" mark.

[0085] The display control unit 235 displays an alert when it is determined that the input is from a user other than the first user. The display control unit 235 displays a field for inputting the reason for the answer together with the alert. For example, when a user from the accounting department answers a question about legal affairs, the display control unit 235 pops up an alert on the user terminal 3 saying, "This question should be answered by a legal affairs officer," and displays a field directly below it for entering "the reason for answering instead."

[0086] The display control unit 235 displays each of the answers received to each of the multiple questions in the security evaluation survey in a manner that allows the user to distinguish whether the answer is from a respondent who has been set as the respondent or from a respondent other than the set respondent. For example, the display control unit 235 displays answers by the set answerer with a green check mark on the answer list screen, and displays answers by other than the set answerer with a yellow warning icon.

[0087] The display control unit 235 may display a respondent list screen that displays the respondent and / or user group set for each of multiple questions in the security assessment survey. The respondent list screen may display information about the questions (e.g., the content of the question, a summary of the question, the response rate for all questions, the response rate for each question group, etc.) and information about the respondent (e.g., the job content, department, role, qualification, etc., of the department user to be answered). Also, the percentage of respondents set for all questions and / or for each question group (e.g., the percentage of questions set as respondents to the total number of questions for all questions and / or each question group) may be displayed, and the percentage may be displayed for each job content, department, role, qualification, etc., of the department user to be answered. Furthermore, the display control unit 235 may display the estimated man-hours required to answer questions for each respondent, user group, and job content, department, role, qualification, etc., of the department user to be answered. The estimated man-hours can be calculated, for example, by setting the estimated man-hours for each question in advance and adding up the estimated man-hours for the questions to be answered. This allows the administrator user to manage the answering progress and adjust the respondent settings as necessary.

[0088] <Recording Unit 236> The recording unit 236 is configured to record information acquired from an external source or an internal system. The recording unit 236 receives information received from a first user or a second user and stores it in the memory unit 22. The recording unit 236 records answers received from the first user or the second user and creates or updates answer data. The recording unit 236 records each answer received to each of a plurality of questions in a security assessment survey in association with information indicating whether the answer is from a set answerer.

[0089] "Response data" consists of the surveyed organization's responses to multiple questions regarding the security of the service, and is the information that the evaluator checks and evaluates. The response data may be evaluated once or multiple times. In other words, the evaluation of the response data may include an initial evaluation (also known as a review), an interim evaluation, and a final evaluation. The initial and interim evaluations are surveys in which a separate evaluation is conducted after the initial evaluation. The response data may be revised by the surveyed organization based on the initial or interim evaluation. Multiple evaluations may be performed by the same evaluator or by different evaluators (e.g., reviewers). The final evaluation creates an evaluation that is used in a report or report provided to users of the survey results. Furthermore, the response data may be evaluated again by the evaluator when the surveyed organization makes corrections or updates. The evaluator's evaluation of the response data is used as part of the report or report or as reference information.

[0090] <Extraction part 237> The extraction unit 237 is configured to extract answerer candidates corresponding to questions from among a plurality of users belonging to the organization to be surveyed. The extraction unit 237 extracts answerer candidates for each of the plurality of questions based on each of the plurality of questions, user information of a plurality of users belonging to the organization to be surveyed, and second reference information (reference information for answerer extraction). The user information includes user attributes, job content, work experience, or answer history. The reference information for answerer extraction includes at least correlations between questions, user information, and answerer candidates.

[0091] The reference information for respondent extraction may be stored, for example, in the storage unit 22. The reference information for respondent extraction may include, for example, a table, a function, a simple algorithm, or the like, which indicates the correlation between questions, user information, and candidate respondents. The correlation included in the reference information for respondent extraction can be constructed, for example, by statistically analyzing data recording questions, user information, and corresponding candidate respondents.

[0092] The answerer extraction reference information may include a learning model that has been machine-learned to be capable of inputting a question and user information and outputting answerer candidates, or an answerer extraction model that is a generative AI. In this case, the extraction unit 237 inputs the question and user information into the answerer extraction model and causes the model to output answerer candidates. Note that parameters calculated, adjusted, etc. by learning in the answerer extraction model constitute correlations in the answerer extraction reference information.

[0093] The respondent extraction model is included in the artificial intelligence unit 241. The respondent extraction model, which has been trained to be able to output candidate respondents, is trained using, for example, past question data, user information, and data of users who have actually answered questions as training data.

[0094] When the respondent extraction model is a generation AI including a general-purpose natural language model (large-scale language model), the extraction unit 237 may input a question and user information, input a prompt including an instruction to output appropriate respondent candidates for the question to the respondent extraction model, and output the respondent candidates. Furthermore, the extraction unit 237 may input, as an example of an input and output pair, a prompt into which, for example, a past question and a sample of an actual respondent corresponding to the question are inserted, in addition to the instruction to extract respondent candidates, the question, and the user information, to the respondent extraction model.

[0095] The answerer extraction reference information may include information for determining a search formula for searching for answerer candidates according to the question and user information. For example, the answerer extraction reference information may be a table, algorithm, etc. that defines the relationship between feature quantities such as user attributes, job content, work experience, or answer history and selection conditions for answerer candidates (e.g., specialized knowledge, business field, past answer performance, etc.). Furthermore, the extraction unit 237 may input an instruction to create a search formula based on the question and user information to a search formula creation model, which is a generation AI included in the answerer extraction reference information, and output the search formula or search results.

[0096] The reference information for extracting an answerer may be, for example, a search formula template or format that defines items related to answer selection (e.g., field of expertise, job title, years of experience, most recent answer history, etc.) and variables extracted from user information for each item. For example, the reference information for extracting an answerer may be a search formula template or format such as "field of expertise = {field related to the question}, years of experience = {5 years or more}, past answer history = {answers to similar questions}", and the extraction unit 237 may create search conditions for identifying answerer candidates by inserting the question and user information into such reference information for extracting an answerer.

[0097] The extraction unit 237 may extract answerer candidates based on past answer history included in the answerer extraction reference information. For example, if an answerer to a previous question is identified and the answerer still belongs to the same department, the extraction unit 237 may preferentially extract the answerer as the answerer to the current question. Furthermore, if there is no previous answerer or if the answerer does not satisfy the conditions, other users who have the same attributes as the previous answerer (for example, department, job content, work experience, etc.) may be extracted as answerer candidates.

[0098] The extraction unit 237 may extract answerer candidates based on group information or tag information set for a question or a user. For example, if an "information security" tag is set for a question, users or user groups associated with the tag may be extracted as candidates. Also, if a group or tag such as "Project A" or "System Administrator" is set for a user, answerer candidates may be extracted based on the correspondence between the tag and the tag of the question. Furthermore, the extraction unit 237 may extract user groups associated with groups or tags set for the question as answerer candidates.

[0099] Furthermore, the extraction unit 237 may calculate a priority score for each of the extracted answerer candidates and rank the candidates based on the score.

[0100] The extraction unit 237 analyzes the content of the question and extracts answerer candidates according to the category of the content. The extraction unit 237 may analyze the content of the question and extract appropriate answerer candidates according to the category (for example, technical field, business field, organizational management field, etc.). In addition, the extraction unit 237 extracts answerer candidates according to the conditions of the answerer.

[0101] The extraction unit 237 may extract answerer candidates according to a group or tag set by the user. For example, the extraction unit 237 can extract more appropriate answerers by narrowing down the candidates according to a group or tag such as "compliance officer" or "security survey answer group."

[0102] <Presentation part 238> The presentation unit 238 is configured to present the extracted answerer candidates to at least one administrator user among a plurality of users belonging to the organization to be surveyed or an evaluator who performs a security evaluation.

[0103] <Specific part 239> The identification unit 239 is configured to identify a question corresponding to the answerer. The identification unit 239 identifies a question from among a plurality of questions that corresponds to the group setting or tag setting of each user. Specifically, the identification unit 239 can compare the group or tag set for the user with the group or tag set for the question and identify a question based on the correspondence. For example, if a "finance" tag is set for the user, a group of questions belonging to the finance category can be identified and set as the answer target for the user. Furthermore, if the user belongs to the "information security" group, questions related to information security can be identified.

[0104] The identification unit 239 may determine the correspondence between the question and the user by rule-based matching processing, statistical processing using past answer history, or natural language analysis using a learning model / generation AI included in the artificial intelligence unit 241. For example, the learning model can learn correspondence data between past question sentences and corresponding user attributes as training data, and estimate the question to be answered based on the input user attributes.

[0105] Furthermore, when one question is associated with multiple groups or tags, the identifying unit 239 may determine the identified target based on a priority rule (e.g., compliance > information security > finance > human resources). In this way, an appropriate question is selected according to the user, and the setting unit 231 can set the user as the answerer of the question identified by the identifying unit 239. <Acquisition part 240> The acquisition unit 240 is configured to be able to acquire various types of information from external sources. The acquisition unit 240 can acquire related information from information sources on the Internet, databases, and the like. The acquisition unit 240 is also configured to be able to acquire various types of information by reading out various types of information stored in a storage area that is at least a part of the memory unit 22 and writing the read information into a working area that is at least a part of the memory unit 22. For example, the acquisition unit 240 acquires multiple questions in a security survey conducted by the organization being surveyed. The acquisition unit 240 acquires user information of multiple users belonging to the organization being surveyed.

[0106] <Artificial Intelligence Department 241> The artificial intelligence unit 241 is configured to receive input from each functional unit and return the instructed output. The artificial intelligence used by the server 2 for each functional unit may be a common one, or may be prepared individually for each functional unit.

[0107] The artificial intelligence unit 241 may be an external component of the server 2. In this case, the artificial intelligence unit 241, which is an external component, may be provided by, for example, an artificial intelligence service server, and configured to receive inputs from each functional unit of the server 2, receive requests to execute an artificial intelligence service, and return instructed output as a processing result to the server 2. The artificial intelligence service server may be a server that provides services using a language model as a learning model, or may be a server that executes language processing tasks using a language model. The artificial intelligence service server may be constructed by an LLM. The artificial intelligence service server may receive input of prompts in the form of text, images, voice, etc., and generate and respond to the prompts.

[0108] The artificial intelligence unit 241 may be an AI (Artificial Intelligence) equipped with a learning model such as a language model, such as a Transformer (including GPT (Generative Pretrained Transformer, including GPT-1, GPT-2, GPT-3, and GPT-4)), a Bidirectional Encoder Representations from Transformers (BERT), a Bidirectional and Auto-regressive Transformer (BART), or a Recurrent Neural Network (RNN), and may include a generative AI including a large-scale language model. A large-scale language model is a type of generative AI and includes models provided by services such as OpenAI's GPT, Google's Gemini, and Microsoft's Azure AI Studio. In addition, the artificial intelligence unit 241 may include any machine learning model, deep learning model, artificial intelligence model, etc.

[0109] The language model is an example of a learning model based on a machine learning algorithm. Specific examples of machine learning algorithms include nearest neighbor methods, naive Bayes methods, decision trees, support vector machines, and deep learning using neural networks. The artificial intelligence unit 241 can apply the above algorithms as appropriate.

[0110] The artificial intelligence unit 241 may have a trained model constructed by a learning method such as supervised learning, unsupervised learning, or self-supervised learning. In supervised learning, machine learning is performed using training data (training data). The training data consists of pairs of input data and output data (correct answer data) for training. Furthermore, the language model may not only be one trained for a specific task, but also a general-purpose model that can be used for a wide range of tasks.

[0111] The artificial intelligence unit 241 may be a general-purpose natural language processing learning model, such as a large-scale language model (LLM), which has been trained on a huge amount of data. LLMs are learning models that have previously trained on a large amount of data, such as text data (e.g., (i) web content on the Internet, or (ii) data stored in a specified database). They can execute various language processing tasks when given tasks, and can perform a wide range of natural language processing tasks, such as grasping sentence patterns and contexts, answering questions, and generating sentences, according to given prompts. Such general-purpose learning models include language models that can handle various tasks without fine-tuning, such as through one-shot learning or few-shot learning. Furthermore, general-purpose learning models may also be configured to handle various tasks through zero-shot learning. The artificial intelligence used in each functional unit of the control unit 23 may be a separate learning model, or a common general-purpose learning model.

[0112] The learning models included in the artificial intelligence unit 241 (learning models used in each functional unit, such as the representative response data creation model) can undergo additional learning as transfer learning or fine tuning. For example, each time new data is registered, the artificial intelligence unit 241 may perform additional learning and fine tuning using the new data as new training data. This improves the accuracy of the information output from the learning model.

[0113] The learning model included in the artificial intelligence unit 241 may be a learning model (distilled model) obtained by knowledge distillation using an original learning model. In knowledge distillation, a trained model such as a large-scale language model is used as a teacher model, and the parameters of the student model are adjusted to reduce the output loss (Soft Target Loss) of the student model (distilled model) relative to the output (Soft Target) of the teacher model, thereby learning the student model, which becomes the distilled model. Alternatively, the student model may be trained to reduce the output loss (Hard Target Loss) of the student model relative to the correct label (Hard Target) of the teacher data (combination of input data and output data of the learning model). Compared to the original learning model (teacher model), the distilled model has a smaller number of parameters and a smaller processing load while maintaining performance similar to the learning model. Therefore, using a distilled model can reduce the cost of the information processing system 1.

[0114] For example, the learning model used in each functional unit may be a distilled model trained using a combination of input data and output data in a large-scale language model as training data. Furthermore, when the information processing system 1 is introduced, a large-scale language model may be used as the learning model used in each functional unit, and when training data from the large-scale language model is accumulated, a distilled model obtained by knowledge distillation using the training data may be used as the learning model used in each functional unit.

[0115] <Display section> The display unit 331 of the user terminal 3, the display unit 431 of the manager terminal 4, and the display unit 531 of the evaluator terminal 5 each display a screen indicated by the screen data transmitted from the server 2.

[0116] <Operation acquisition part> The operation acquisition unit 332 of the user terminal 3 accepts operations by the surveyed organization using the user terminal 3. The operation acquisition unit 432 of the administrator terminal 4 accepts operations by the user of the survey results using the administrator terminal 4. The operation acquisition unit 532 of the evaluator terminal 5 accepts operations by the evaluator using the evaluator terminal 5.

[0117] 3. Information processing flow This section describes the flow of an information processing method executed by the information processing system 1. As shown below, the information processing method includes steps executed by the information processing system. The program of this embodiment causes a computer to execute each step of the information processing system. Note that the order of the processes can be changed as appropriate, multiple processes may be executed simultaneously, or some processes may be omitted.

[0118] 5 is a diagram showing an outline of processing executed by the information processing system 1. In this processing, first, the setting unit 231 sets in advance, as a respondent, at least one first user among a plurality of users belonging to the organization to be surveyed, for each of a plurality of questions in a survey regarding security evaluation (step S001). Next, the determination unit 232 determines whether or not the answer to the question is an input by the first user set as the respondent (step S002). Next, the reception control unit 233 controls the reception of the answer depending on the determination result (step S003).

[0119] In summary, an information processing system according to one embodiment includes at least one processor. The processor includes the following units by reading a program. The setting unit 231 pre-sets a first user, who is at least one of a plurality of users belonging to the organization being surveyed, as a respondent for each of a plurality of questions in a security evaluation survey. The determination unit 232 determines whether an answer to the question is an input by the first user set as the respondent. The reception control unit 233 controls the reception of the answer based on the determination result. According to this aspect, it is possible to provide an information processing system that receives appropriate answers for each of a plurality of questions in a security evaluation survey.

[0120] An example of the flow of processing executed by the information processing system 1 will be described below with reference to FIG. 6. This example of the flow may fall within the scope defined in the above-mentioned overview. The information processing may include any exception processing not shown. Exception processing includes the interruption of the information processing or the omission of each process. Selection or input performed in the information processing may be based on a user operation or may be performed automatically without relying on a user operation.

[0121] 6 is an activity diagram showing an example of the flow of information processing according to the first embodiment, which is executed by the information processing system 1. Below, an explanation will be given along with each activity in this activity diagram.

[0122] First, the acquisition unit 240 acquires a plurality of questions for a security survey by the organization to be surveyed (activity A101).

[0123] Next, the setting unit 231 performs various settings for a plurality of questions (activity A102).

[0124] The acquisition unit 240 also acquires user information of a plurality of users who belong to the organization under investigation (activity A103).

[0125] Next, the setting unit 231 performs various settings for a plurality of users who belong to the organization to be investigated (activity A104).

[0126] Next, the extraction unit 237 extracts answerer candidates for each of the multiple questions based on each of the multiple questions, the user information of multiple users belonging to the organization under investigation, and the second reference information (activity A105). Here, the second reference information includes at least the correlation between the question, the user information, and the answerer candidates.

[0127] Here, the second reference information may include a past answer history, and the extraction unit 237 may extract answerer candidates based on the past answer history.

[0128] For example, the extraction unit 237 may analyze the content of the question and extract answerer candidates according to the type of content.

[0129] Next, the setting unit 231 sets at least some of the answerer candidates as answerers (activity A106). The process of setting at least some of the answerer candidates as answerers by the setting unit 231 may be performed automatically, or answerer candidates selected by an administrator user or an evaluator may be set as answerers. The setting unit 231 may automatically set answerer candidates selected based on the priority score calculated for each answerer candidate as answerers. Meanwhile, the presentation unit 238 may present the extracted answerer candidates to at least one administrator user among multiple users belonging to the organization to be surveyed or to an evaluator who performs a security evaluation, and the setting unit 231 may set answerer candidates selected by the administrator user or the evaluator as answerers.

[0130] Next, the transmission unit 234 transmits a question to the first user who has been set as the answerer (activity A107). At this time, when transmitting the question to the first user, the transmission unit 234 may transmit a notification informing the first user that the first user has been set as the answerer, together with a statement such as "You have been set as the answerer. Please answer the question" and the content of the question.

[0131] Next, the display control unit 235 displays to the first user questions for which the first user is set as the answerer and questions for which the first user is not set as the answerer in different display modes (activity A108).

[0132] Next, the reception control unit 233 receives an answer to the question from the first user (activity A109). The reception control unit 233 receives answers from the first user to each of a plurality of questions in the security evaluation survey. When receiving an answer to a question for which the first user is not set as the answerer, the answer is received in association with information indicating that the answer is from someone other than the set answerer.

[0133] Next, the determination unit 232 determines whether the answer to the question is an input by the first user who is set as the answerer (activity A110).

[0134] Next, if the determining unit 232 determines that the input is from a respondent, the process proceeds to activity A115.

[0135] On the other hand, if the determination unit 232 determines that a second user different from the first user has entered an answer to a question for which the first user has been set as the answerer, the process proceeds to activity A111, where the transmission unit 234 transmits an alert to at least one of the first user and the second user in accordance with the determination result (activity A111). At this time, the transmission unit 234 may transmit an alert including an alert message set for at least one of each question and each survey target organization.

[0136] Next, the display control unit 235 displays a field for inputting the reason for the answer together with the alert (activity A112).

[0137] Next, the reception control unit 233 receives the reason via an input field (activity A113).

[0138] Next, the determination unit 232 determines whether or not to accept the answer from the first user based on the accepted reason and the first reference information (activity A114). The first reference information includes at least a correlation between the reason and whether or not to accept the answer.

[0139] Next, if it is determined that the response can be accepted, the process proceeds to activity A115, where the reception control unit 233 controls the response to be accepted. On the other hand, if it is determined that the response cannot be accepted, the reception control unit 233 controls the response not to be accepted and stops information processing. In this way, the reception control unit 233 can control the acceptance of responses depending on the reason for acceptance.

[0140] Next, the recording unit 236 records each of the answers received to each of the multiple questions in the security evaluation survey in association with information indicating whether the answer is from a designated answerer (activity A116).

[0141] Next, the display control unit 235 displays each of the answers received for each of the multiple questions in the security assessment survey in a manner that distinguishes whether the answer is from a respondent set as a respondent or from a respondent other than the set respondent (activity A117). The display control unit 235 may display a respondent list screen that displays the respondent and / or user group set for each of the multiple questions in the security assessment survey.

[0142] In the above embodiment, whether or not an answer is from the first user is determined when the answer is received. However, after receiving the answer, it may be determined whether or not the entire survey result includes answers from users other than the first user. That is, after receiving answers to each of the multiple questions in the security evaluation survey, the determination unit 232 determines whether the received answers include input from users other than the first user set as the respondent. Here, if it is determined that an input from a user other than the first user is included, the transmission unit 234 may send an alert to one or both of the first user and the second user and display the alert. In this case, the alert may include answers to each of the multiple questions in the security evaluation survey, in which the answers from the first user and the answers from a second user different from the first user are displayed in a distinguishable manner. The display control unit 235 displays the alert if it is determined that an input from a user other than the first user is included. In this case, the display control unit 235 may display the answers from the first user in a distinguishable manner from the answers from the second user different from the first user. In this manner, the answers to the multiple questions in the security assessment survey can be compiled and confirmed with either or both of the first user and the second user.

[0143] In the above embodiment, it was assumed that in activity A109, it was possible to accept answers from a second user who is not set as the answerer, but the reception control unit 233 may also control the state so that questions that are not set as the answerer cannot be answered.

[0144] In the above embodiment, the first user is set as the answerer to the question, but the setting unit 231 can set a question that does not limit the answerer. In this case, the determination unit 232 may be configured not to determine whether or not the answer to the question that does not limit the answerer is input by the first user.

[0145] In the above embodiment, the first user is set as the answerer to the question, but a question for the user may be identified, and the first user may be set as the answerer to the identified question.

[0146] 4. Effect The operation of this embodiment can be summarized as follows: That is, according to this aspect, it is possible to provide an information processing system that accepts appropriate answers to each of a plurality of questions in a survey regarding security evaluation.

[0147] Although the embodiment of the present invention has been described above, the present invention is not limited to this and can be modified as appropriate within the scope of the technical idea of ​​the invention.

[0148] 5.Other In the above embodiment, the server 2 performs various storage and control functions. However, multiple external devices may be used instead of the server 2. That is, various information and programs may be distributed and stored in multiple external devices using blockchain technology or the like. In particular, the artificial intelligence unit 241 may be configured external to the server 2. In this case, the artificial intelligence unit 241, which is an external component, is provided, for example, by an artificial intelligence service server and configured to receive inputs from each functional unit of the server 2, receive requests to execute artificial intelligence services, and return the instructed output as a processing result to the server 2. The artificial intelligence service server may be a server that provides services using a language model as a learning model, or a server that executes language processing tasks using a language model. The artificial intelligence service server may be constructed using an LLM. The artificial intelligence service server receives inputs of prompts such as text, images, and voice, and generates and responds to the prompts.

[0149] The aspect of this embodiment is not limited to the information processing system 1, and may be an information processing method or a program. The information processing method includes steps executed by the information processing system 1. The program causes a computer to execute the steps of the information processing system 1.

[0150] It may be provided in the following manner.

[0151] (1) An information processing system comprising at least one processor, the processor being configured to execute each of the following steps by reading a program: in a setting step, a first user, who is at least one of a plurality of users belonging to an organization being surveyed, is set as a respondent in advance for each of a plurality of questions in a survey regarding security assessment; in a determination step, it is determined whether or not the answer to the question is an input by the first user set as the respondent; and in an acceptance control step, the acceptance of the answer is controlled in accordance with the determination result.

[0152] According to this aspect, it is possible to provide an information processing system or the like that can receive more appropriate answers to security-related questions.

[0153] (2) In the information processing system described in (1) above, the sending step further includes sending the question to the first user set as the answerer, and the reception control step includes accepting the answer to the question from the first user.

[0154] (3) In the information processing system described in (2) above, the display control step further causes questions for which the first user is set as the answerer and questions for which the first user is not set as the answerer to be displayed in different display modes to the first user.

[0155] (4) In the information processing system described in any one of (1) to (3) above, in the determination step, when a second user different from the first user enters an answer to a question for which the first user is set as the answerer, it is determined that the input is not made by the answerer, and further, in the sending step, an alert is sent to at least one of the first user and the second user depending on the determination result.

[0156] (5) In the information processing system described in (4) above, in the sending step, the alert is sent including an alert message set for at least one of each question and each survey target organization.

[0157] (6) In the information processing system described in (4) or (5) above, the display control step further displays a field for inputting the reason for the response together with the alert, and the reception control step controls the reception of the response according to the reason received via the field.

[0158] (7) In the information processing system described in (6) above, the judgment step determines whether or not to accept the answer from the second user based on the received reason and first reference information, the first reference information including at least a correlation between the reason and whether or not to accept, and the acceptance control step controls to accept the answer if it is determined that it can be accepted, and controls to not accept the answer if it is determined that it cannot be accepted.

[0159] (8) In the information processing system described in any one of (1) to (7) above, the reception control step controls the first user to be unable to answer questions for which the first user is not set as the answerer.

[0160] (9) In an information processing system described in any one of (1) to (7) above, in the reception control step, answers are received from the first user for each of a plurality of questions in the survey regarding the security evaluation, and the answers to questions for which the first user is not set as the answerer are received in association with information indicating that the answer is from a person other than the set answerer.

[0161] (10) In the information processing system described in (9) above, the recording step further records each of the answers received for each of the multiple questions in the security assessment survey in association with information indicating whether the answer is from the set respondent, and the display control step displays each of the answers received for each of the multiple questions in the security assessment survey in a manner that allows the answer to be distinguished as to whether it is from the respondent set as the respondent or from a respondent other than the set respondent.

[0162] (11) In the information processing system described in any one of (1) to (10) above, in the determination step, after receiving the answers to each of the multiple questions in the survey regarding the security evaluation, it is determined whether the multiple received answers include input from someone other than the first user set as the respondent, and in the display control step, an alert is displayed if it is determined that the multiple received answers include input from someone other than the first user.

[0163] (12) In the information processing system described in any one of (1) to (11) above, further, in the extraction step, based on each of the plurality of questions, user information of a plurality of users belonging to the organization to be surveyed, and second reference information, candidate respondents for each of the plurality of questions are extracted, the user information including the attributes, job content, work experience, or answer history of the user, and the second reference information including at least correlations between the question, the user information, and the candidate respondents, and in the setting step, at least some of the candidate respondents are set as the respondents.

[0164] (13) In the information processing system described in (12) above, the second reference information includes a past answer history, and in the extracting step, the answerer candidates are extracted based on the past answer history.

[0165] (14) In the information processing system described in (12) or (13) above, the extracted candidate respondents are further presented in the presentation step to an administrator user who is at least one of a plurality of users belonging to the organization being surveyed or to an evaluator who performs the security evaluation, and in the setting step, the candidate respondents selected by the administrator user or the evaluator are set as the respondent.

[0166] (15) In the information processing system described in any one of (12) to (14) above, in the extraction step, a priority score is calculated for each of the candidate answerers, and in the setting step, the candidate answerers selected based on the priority score are set as the answerers.

[0167] (16) In the information processing system according to any one of (12) to (15) above, the extraction step analyzes the content of the question and extracts the answerer candidates according to the type of the content.

[0168] (17) In the information processing system described in any one of (12) to (16) above, in the setting step, conditions for the respondent are set for each of the questions, wherein the conditions for the respondent include conditions regarding the job content or attributes of the user, and in the extraction step, the candidate respondent is extracted according to the conditions for the respondent.

[0169] (18) In the information processing system described in any one of (12) to (17) above, in the setting step, group settings or tag settings for each of the users are accepted and set from an administrator user who is at least one of multiple users belonging to the organization being surveyed or an evaluator who performs the security evaluation, and in the extraction step, the respondent candidates are extracted according to the group or tag.

[0170] (19) In the information processing system described in any one of (1) to (11) above, in the setting step, a group setting or tag setting for each of the users is received and set from an administrator user who is at least one of a plurality of users belonging to the organization under investigation or an evaluator who performs the security evaluation, and further, in the identification step, a question from each of the plurality of questions is identified according to the group setting or tag setting for each of the users, and in the setting step, the user is set as the answerer for the identified question.

[0171] (20) In the information processing system described in any one of (1) to (19) above, if a question that does not limit the answerer is set in the setting step, the determination step does not determine whether the answer to the question that does not limit the answerer is input by the first user.

[0172] (21) In the information processing system described in any one of (1) to (11) above, in the setting step, the plurality of questions are grouped into question groups by type, and for each question group, users belonging to the organization being surveyed are set as respondents to questions belonging to the question group.

[0173] (22) The information processing system according to any one of (1) to (21) above, further comprising: a server having the processor; and a terminal that can access the server.

[0174] (23) An information processing method, comprising steps executed by the information processing system according to any one of (1) to (21) above.

[0175] (24) A program for causing a computer to execute each step of the information processing system described in any one of (1) to (21) above. Of course, this is not the case.

[0176] Finally, while various embodiments of the present disclosure have been described, they are presented as examples and are not intended to limit the scope of the invention. The novel embodiments may be embodied in various other forms, and various omissions, substitutions, and modifications may be made without departing from the spirit of the invention. Such embodiments and modifications are intended to be included within the scope and spirit of the invention, as well as within the scope of the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0177] 1: Information processing system 2: Server 20: Communication bus 21: Communications Department 22: Storage section 23: Control section 231: Setting section 232: Judgment section 233: Reception control unit 234: Transmission unit 235: Display control unit 236: Recording section 237:Extraction part 238:Presentation part 239: Specific part 240: Acquisition Department 241: Artificial Intelligence Department 3: User terminal 30: Communication bus 31: Communications Department 32: Storage section 33: Control section 331: Display section 332: Operation acquisition section 34:Display section 35: Input section 4: Administrator terminal 40: Communication bus 41: Communications Department 42: Storage section 43: Control section 431: Display section 432 :Operation acquisition part 44: Display section 45: Input section 5: Evaluator terminal 50: Communication bus 51: Communications Department 52: Storage section 53: Control unit 531: Display section 532: Operation acquisition section 54:Display section 55: Input section

Claims

1. An information processing system, at least one processor; the processor is configured to execute a setting step, a determining step, and a transmitting step by reading a program; In the setting step, a first user, which is at least one of a plurality of users belonging to the organization to be surveyed, is set in advance as a respondent for each of a plurality of questions in the survey regarding security evaluation; In the determining step, it is determined whether or not the answer to the question is an input by the first user set as the answerer, and an input by a second user different from the first user is determined not to be an input by the answerer; In the sending step, an alert is sent to at least one of the first user, the second user, and the evaluator who performs the security evaluation, depending on the judgment result of the judging step.

2. 2. The information processing system according to claim 1, The processor is further configured to perform an admission control step; In the sending step, the question is sent to the first user who is set as the answerer; In the admission control step, Controlling acceptance of the answer to the question according to the determination result of the determination step; If it is determined that the input is made by the respondent, the answer to the question is accepted; If it is determined that the input is not from the respondent, the information processing system does not accept the answer or accepts the answer in association with information indicating that the answer is from someone other than the set respondent.

3. 3. The information processing system according to claim 2, The processor is further configured to perform a display control step; In the display control step, the information processing system displays to the first user questions for which the first user is set as the answerer and questions for which the first user is not set as the answerer in different display modes.

4. 4. The information processing system according to claim 3, In the sending step, the information processing system sends the alert including an alert message set for at least one of each question and each organization to be surveyed.

5. 4. The information processing system according to claim 3, In the display control step, a field for inputting a reason for the response is displayed together with the alert, In the reception control step, reception of the answer is controlled in accordance with the reason received via the field.

6. 6. The information processing system according to claim 5, the determining step determines whether or not the answer from the second user is acceptable based on the received reason and first reference information, and the first reference information includes at least a correlation between the reason and the acceptance or rejection of the answer; In the admission control step, If it is determined that the response is acceptable, control is performed so that the response is accepted; The information processing system performs control so as not to accept the response when it is determined that the response is unacceptable.

7. 3. The information processing system according to claim 2, In the reception control step, the information processing system performs control so that the first user is unable to answer questions for which the first user is not set as the answerer.

8. 3. The information processing system according to claim 2, In the reception control step, answers are received from the first user for each of a plurality of questions in the security assessment survey, and answers to questions for which the first user is not set as the answerer are accepted in association with information indicating that the answer is from a person other than the set answerer.

9. 9. The information processing system according to claim 8, The processor is further configured to perform a recording step and a display control step; In the recording step, each of the answers received for each of the plurality of questions in the survey regarding the security evaluation is recorded in association with information indicating whether the answer is from the set respondent; In the display control step, the information processing system displays each of the answers received to each of the multiple questions in the security assessment survey in a manner that allows it to be distinguished whether the answer is from a respondent set as the respondent or from a respondent other than the set respondent.

10. 2. The information processing system according to claim 1, The processor is further configured to perform a display control step; In the determining step, after receiving the answers to each of a plurality of questions in the survey regarding the security evaluation, it is determined whether or not the received answers include an input by a person other than the first user set as the answerer; In the display control step, an alert is displayed when it is determined that the input is made by a user other than the first user.

11. 2. The information processing system according to claim 1, The processor is further configured to perform the extracting step; In the extraction step, candidate respondents for each of the plurality of questions are extracted based on each of the plurality of questions, user information of a plurality of users belonging to the organization to be surveyed, and second reference information; The user information includes the user's attributes, job content, work experience, or answer history, the second reference information includes at least a correlation between the question, the user information, and the candidate answerer; In the setting step, at least some of the candidate respondents are set as the respondents.

12. 12. The information processing system according to claim 11, the second reference information includes a past response history; In the extracting step, the answerer candidates are extracted based on the past answer history.

13. 12. The information processing system according to claim 11, The processor is further configured to perform the presenting step; In the presenting step, the extracted respondent candidates are presented to at least one administrator user among a plurality of users belonging to the organization to be surveyed or an evaluator who performs the security evaluation; In the setting step, the answerer candidate selected by the administrator user or the evaluator is set as the answerer.

14. 12. The information processing system according to claim 11, In the extraction step, a priority score is calculated for each of the candidate respondents; In the setting step, the answerer candidate selected based on the priority score is set as the answerer.

15. 12. The information processing system according to claim 11, The extraction step analyzes the content of the question and extracts the answerer candidates according to the type of the content.

16. 12. The information processing system according to claim 11, In the setting step, conditions for the respondent are set for each of the questions, and the conditions for the respondent include conditions related to the job content or the attributes of the user; In the extraction step, the answerer candidates are extracted according to the conditions of the answerers.

17. 12. The information processing system according to claim 11, In the setting step, a group setting or a tag setting for each of the users is received and set from at least one administrator user among a plurality of users belonging to the organization to be surveyed or an evaluator who performs the security evaluation; In the extracting step, the answerer candidates are extracted according to a group or a tag.

18. 2. The information processing system according to claim 1, Furthermore, the processor is configured to perform the specific steps: In the setting step, a group setting or a tag setting for each of the users is received and set from at least one administrator user among a plurality of users belonging to the organization to be surveyed or an evaluator who performs the security evaluation; In the identifying step, a question corresponding to the group setting or tag setting of each of the users is identified from among the plurality of questions; In the setting step, the information processing system sets the user as the answerer for the identified question.

19. 2. The information processing system according to claim 1, In the setting step, if a question that does not limit the respondent is set, The information processing system, wherein the determining step does not determine whether the answer to the question that does not limit the answerer is an input by the first user.

20. 2. The information processing system according to claim 1, In the setting step, setting question groups by grouping the plurality of questions by type; An information processing system that sets, for each question group, users belonging to the organization to be surveyed as respondents to questions belonging to the question group.

21. 21. The information processing system according to claim 1, a server having the processor; and a terminal that can access the server.

22. An information processing method, comprising: An information processing method comprising the steps executed by the information processing system according to any one of claims 1 to 20.

23. A program, A program for causing a computer to execute each step of the information processing system according to any one of claims 1 to 20.

Images