Information processing device, information processing method and information processing program

Abstract

To provide an information processing device capable of instantaneously determining whether data in a response returned by a generation AI is appropriate or not, an information processing method, and an information processing program.SOLUTION: An information processing device 10 for controlling external access by user terminals includes an access control unit 11 for, in response to input from a user of a user terminal to a generation AI server, receiving a response from the generation AI server, a response analysis unit 13 for, when the response from the generation AI server contains prescribed data, determining whether the data is appropriate or not. and a response editing unit 14 for, when the prescribed data is inappropriate, editing the response so as to disable access to the data and transmitting the edited response to the user terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] In recent years, AI (artificial intelligence) has been used in various fields, and the use of AI that can generate content, known as generative AI, is spreading rapidly. Some generative AI uses large-scale learning models that have learned a large number of natural languages ​​and programming languages ​​to generate text and summarize text with high accuracy in response to user instructions. By using generative AI, users can accurately obtain the information they need when searching for information on the Internet.

[0003] Conventionally, systems have been disclosed that use generative AI to generate cyber-attack scenarios and evaluate security risks according to those scenarios. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-219898 A Summary of the Invention [Problem to be solved by the invention]

[0005] While utilizing generative AI can make our daily lives and work more convenient, if the generative AI's learning model learns based on incorrect information or if the generative AI is spoofed by a malicious third party, it may be extremely difficult for users to notice if the answer they receive contains a URL or data that leads to the download of malware.

[0006] The present invention has been made in consideration of these circumstances, and aims to provide an information processing device, an information processing method, and an information processing program that can instantly determine whether the data in an answer returned by a generation AI is appropriate. [Means for solving the problem]

[0007] An information processing device according to an embodiment of the present invention is an information processing device that controls external access from a user terminal, and is characterized in that it comprises an access control unit that accepts a response from a generation AI server in response to input from a user of the user terminal to the generation AI server, an answer analysis unit that determines whether or not the answer from the generation AI server contains specified data, and an answer editing unit that edits the answer so that access to the specified data is disabled when the specified data is inappropriate, and transmits the answer to the user terminal. Effect of the Invention

[0008] According to an embodiment of the present invention, an information processing device, an information processing method, and an information processing program are provided that can instantly determine whether or not data in an answer returned by a generation AI is appropriate. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an information processing device according to an embodiment of the present invention. [Diagram 2] An explanatory diagram showing a method of determining data in an answer of a generation AI in an information processing device according to this embodiment. [Diagram 3] 4 is a flowchart showing an example of an information processing method according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a diagram showing an example of the configuration of an information processing device 10 according to the present embodiment.

[0011] The information processing device 10 is a server that acts as an agent for access to an external network by the user terminal 20. The information processing device 10 is disposed between the user terminal 20 and a generation AI server 50 on the external network, for example, as shown in FIG.

[0012] The user terminal 20 indicates a terminal that is capable of communicating with an external network, such as a PC, a smartphone, or a tablet terminal owned by each user, and is capable of communicating with the information processing device 10 via the network. Note that, although FIG. 1 shows three user terminals 20 (20a, 20b, 20c) owned by each user, the present invention is not limited to this configuration.

[0013] The generation AI server 50 is a server that is equipped with a learning model that has learned information on the network and programming languages, and automatically generates answers to user inputs.

[0014] The information processing device 10 accepts an access request to the generation AI server 50 from the user terminal 20, and executes input (input of a question) to the generation AI server 50 on behalf of the user terminal 20. Then, the information processing device 10 returns content such as an answer acquired from the generation AI server 50 to the user terminal 20.

[0015] The information processing device 10 according to the embodiment receives an answer input to the generation AI server 50, and when the answer contains predetermined data, determines whether the data is appropriate or not.

[0016] A specific configuration of the information processing device 10 according to this embodiment will be described. The information processing device 10 includes an access control unit 11, a URL information database 12, a response analysis unit 13, and a response editing unit 14.

[0017] The functions of each unit constituting the information processing device 10 may be realized by executing a predetermined program code using a processor, and are not limited to such software processing. For example, the functions may be realized by hardware processing using an ASIC or the like, or may be realized by a combination of software processing and hardware processing.

[0018] The access control unit 11 controls external access by the user terminal 20, and receives responses from the generation AI server 50 in response to inputs made to the generation AI server 50 by the user.

[0019] The URL information database 12 stores URL category information such as malicious URLs that are harmful to users (URLs corresponding to malicious sites that induce users to download malware), etc. In addition, information such as the extension of data suspected to be malicious may be stored as malicious data.

[0020] When the answer of the generation AI server 50 contains predetermined data, the answer analysis unit 13 judges whether the data is appropriate. The predetermined data means data other than text information, such as URL link information and file data. Specifically, the answer analysis unit 13 analyzes the answer of the generation AI server 50 and searches whether the URL link information is included. When the answer of the generation AI server 50 contains URL link information, the answer analysis unit 13 compares the URL link information with the URL information database 12 to judge whether the URL is malicious. When the URL does not match the malicious URL in the URL information database 12, the answer is judged to be appropriate, whereas when the URL matches the malicious URL, the answer is judged to be inappropriate. In addition, benign URL information that is harmless to the user (no problem if accessed) may be stored in the URL information database 12, and when the link information in the answer of the generation AI server 50 matches the benign URL, the answer is judged to be appropriate, whereas when the link information does not match the benign URL, the answer is judged to be inappropriate. If the link information in the response from the generation AI server 50 does not match the benign and malicious URLs, that is, if the URL is not registered in the URL information database 12, the response may be determined to be inappropriate.

[0021] Furthermore, if the response from the generation AI server 50 contains data such as a file, the response is compared with malicious data registered in the URL information database 12 to determine whether the response is appropriate.

[0022] When certain data is inappropriate, the answer editing unit 14 edits the answer so as to make the data inaccessible, and transmits the edited answer to the user terminal 20. Specifically, when a URL in the answer of the generation AI server 50 is determined to be malicious and inappropriate, the portion describing the link is deleted.

[0023] When the given data is inappropriate, the answer editing unit 14 may include in the answer the reason why access is not permitted.

[0024] FIG. 2 is an explanatory diagram showing a method for determining data in an answer of a generation AI in the information processing device according to this embodiment (see FIG. 1 as appropriate).

[0025] The information processing device 10 accepts an access request to the generation AI server 50 from the user terminal 20, and executes input (input of a question) to the generation AI server 50 on behalf of the user terminal 20.

[0026] When an answer obtained from the generation AI server 50 contains URL link information, the information processing device 10 judges whether the data is malicious or not. If the URL is malicious, the description of the link part in the answer is deleted, and the reason for the inaccessibility is described in the answer.

[0027] Next, the operation of the information processing device 10 according to the present embodiment will be described. Fig. 3 is a flowchart showing an example of an information processing method according to the present embodiment (see Fig. 1 as appropriate).

[0028] The access control unit 11 inputs a user's question to the generation AI server 50 and accepts a response from the generation AI server 50 (S10, S11).

[0029] The answer analysis unit 13 analyzes the answer of the generation AI server 50, and when the answer contains predetermined data (for example, URL link information), it determines whether the link information is appropriate or not (S12).

[0030] When the link information in the answer matches malicious data in the URL information database 12, the answer editing unit 14 deletes the link information portion so as to disable access to the link information, and transmits the deleted link information to the user terminal 20 (S13: YES, S14). If the link information is appropriate, the answer is transmitted as is to the user terminal 20 (S13: NO, end).

[0031] According to the information processing device of the embodiment described above, an input answer to the generation AI server is accepted, and if the answer contains specified data, it is possible to instantly determine whether the data in the answer by the generation AI is appropriate by determining whether the data is appropriate.

[0032] The program executed by the information processing device 10 is provided by being pre-installed in a storage circuit such as a ROM. Alternatively, the program may be provided by being stored in a computer-readable storage medium such as a CD-ROM, CD-R, memory card, DVD, or flexible disk as a file in an installable or executable format. The program executed by the information processing device 10 may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.

[0033] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0034] 10: information processing device, 11: access control unit, 12: URL information database, 13: answer analysis unit, 14: answer editing unit, 20: user terminal, 50: generation AI server.

Claims

1. An information processing device for controlling external access by a user terminal, an access control unit that receives a response from the generation AI server in response to an input from a user of a user terminal to the generation AI server; A response analysis unit that determines whether a response from the generating AI server includes predetermined data and whether the data is appropriate; a response editing unit that edits the response so as to disable access to the data when the predetermined data is inappropriate, and transmits the edited response to the user terminal; An information processing device comprising:

2. the answer editing unit describes in the answer the reason why the access is not allowed when the predetermined data is inappropriate; 2. The information processing apparatus according to claim 1,

3. An information processing method for controlling external access by a user terminal, comprising: A step of receiving a response from the generation AI server in response to an input from a user of a user terminal to the generation AI server; When the answer of the generating AI server includes predetermined data, determining whether the data is appropriate or not; When the predetermined data is inappropriate, editing the answer so as to disable access to the data, and transmitting the answer to the user terminal; 13. An information processing method comprising:

4. Computer, A function of receiving a response from the generation AI server in response to an input from a user of a user terminal to the generation AI server; A function for determining whether a response from the generating AI server contains predetermined data, and whether the data is appropriate; a function of editing the response so as to disable access to the data when the predetermined data is inappropriate, and transmitting the response to the user terminal; An information processing program characterized by causing the program to function as follows.

Images