Information processing device, information processing system, information processing method, and program

Abstract

In the present invention, output of inappropriate analysis results from an AI is more reliably and easily restricted. Provided is an information processing device 1 comprising: a first acquisition unit (control unit 11) that acquires analysis-target information; a second acquisition unit (control unit 11) that acquires policy information; an analysis unit (control unit 11) that analyzes the analysis-target information on the basis of the policy information; and an output unit (control unit 11) that outputs annotation information corresponding to an analysis result obtained by the analysis unit.

Description

Information Processing Apparatus, Information Processing System, Information Processing Method, and Program

[0001] The present invention relates to an information processing apparatus, an information processing system, an information processing method, and a program.

[0002] In recent years, various AIs (artificial intelligence) have been developed, and attention to human rights violations and the like in the results output from AIs has been increasing. Therefore, companies using AI need to be responsible for the output results from AI. For this reason, companies using AI need to control the output from AI.

[0003] Patent Document 1 describes output control so that images with a high security level are not displayed among images for which a security level, which is security information, is set. Also, a method in which the output result from AI is checked by AI already exists.

[0004] Japanese Unexamined Patent Application Publication No. 2007-164632

[0005] However, although Patent Document 1 restricts output according to security information, in recent years, not only confidential information such as security but also information that should not be displayed or information that causes discomfort when displayed from the perspective of human rights violations and the like exist. Therefore, it is not sufficient to determine the presence or absence of output display only based on security information.

[0006] Also, there are problems in the method in which the output result from AI is checked by AI. Specifically, ideas regarding harassment, discrimination, diversity, etc. vary depending on regions, companies, countries, etc., and also change over time. Therefore, relearning the AI on the judgment side according to each situation is too costly in terms of development. Also, since the check by AI is based on the learning result, it is difficult to achieve 100% accuracy, and it is conceivable that it may be output with a misjudgment. If it is displayed with a misjudgment, it is also expected to become a spark for a company's downfall.

[0007] Therefore, an object of the present invention is to more reliably and simply restrict the output of inappropriate analysis results from AI.

[0008] To solve the aforementioned problems, the information processing apparatus according to the present invention comprises: a first acquisition unit for acquiring information to be analyzed; a second acquisition unit for acquiring policy information; an analysis unit for analyzing the information to be analyzed based on the policy information; and an output unit for outputting annotation information corresponding to the analysis results by the analysis unit.

[0009] Furthermore, the information processing system according to the present invention comprises: a first acquisition unit for acquiring information to be analyzed; a second acquisition unit for acquiring policy information; an analysis unit for analyzing the information to be analyzed based on the policy information; and an output unit for outputting annotation information corresponding to the analysis results by the analysis unit.

[0010] Furthermore, the information processing method according to the present invention includes, in an information processing method using an information processing device, a first acquisition step of acquiring information to be analyzed, a second acquisition step of acquiring policy information, an analysis step of analyzing the information to be analyzed based on the policy information, and an output step of outputting annotation information corresponding to the analysis result of the analysis step.

[0011] Furthermore, the program according to the present invention causes the computer of the information processing device to execute a first acquisition step of acquiring information to be analyzed, a second acquisition step of acquiring policy information, an analysis step of analyzing the information to be analyzed based on the policy information, and an output step of outputting annotation information corresponding to the analysis results obtained in the analysis step.

[0012] According to the present invention, the output of inappropriate analysis results from AI can be restricted more reliably and simply.

[0013] This is a block diagram representing the configuration of an information processing device. This is a flowchart of the analysis process. This is an example of policy information. This is an image diagram of the analysis process. This is an image diagram of the analysis process. This is an image diagram of the analysis process. This is an image diagram of the analysis process. This is an image diagram of the analysis process. This is a block diagram representing the configuration of an information processing system.

[0014] Embodiments of the present invention will be described below with reference to the drawings. However, the scope of the present invention is not limited to those described in the following embodiments and drawings.

[0015] <Information Processing Device 1> Information processing device 1 is an information processing device for performing AI processing (analysis processing) on ​​predetermined information (information to be analyzed) using an inference model. The configuration of information processing device 1 will be explained using Figure 1. As shown in Figure 1, information processing device 1 includes a control unit 11, a communication unit 12, a storage unit 13, an operation unit 14, and a display unit 15.

[0016] The control unit 11 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), etc. The CPU of the control unit 11 reads various programs stored in the memory unit 13, expands them into RAM, executes various processes according to the expanded programs, and controls the operation of each part of the information processing device 1. The control unit 11 functions as a first acquisition unit that acquires information to be analyzed. The control unit 11 functions as a second acquisition unit that acquires policy information. The control unit 11 functions as an analysis unit that analyzes the information to be analyzed based on the policy information. The control unit 11 functions as an output unit that outputs annotation information corresponding to the analysis results by the analysis unit. The control unit 11 functions as a generation unit that generates policy information based on information acquired from an external device.

[0017] The communication unit 12 is capable of sending and receiving various signals and data with other devices connected via the communication network N.

[0018] The storage unit 13 is composed of non-volatile semiconductor memory or a hard disk, and stores various programs executed by the control unit 11, parameters necessary for program execution, and various data. For example, the storage unit 13 stores inference models. Also, for example, the storage unit 13 stores information about the installation area of ​​the information processing device 1.

[0019] The operation unit 14 includes a keyboard equipped with cursor keys, number input keys, various function keys, a pointing device such as a mouse, and a touch panel laminated on the surface of the display unit 15. The operation unit 14 is configured to be operated by the operator. The operation unit 14 also outputs various signals to the control unit 11 based on the operations performed by the operator.

[0020] The display unit 15 is composed of a monitor such as an LCD (Liquid Crystal Display) and displays various screens, etc., according to the instructions of the display signals input from the control unit 11.

[0021] <Analysis Process> Next, the analysis process in the information processing device 1 will be explained using Figure 2. The analysis process is the process of analyzing the object to be analyzed displayed on the display unit 15 using an inference model and attaching annotation information to the object to be analyzed. The object to be displayed on the display unit 15 is, for example, various types of information present in image data (video, still images) or document data. Here, the information processing device 1 will analyze the "person" in the image displayed on the display unit 15.

[0022] First, the control unit 11 acquires the information to be analyzed (step S1; first acquisition step). For example, in the image displayed on the display unit 15, the control unit 11 acquires the image information of the area selected by the user using the operation unit 14 as the information to be analyzed.

[0023] Next, the control unit 11 acquires policy information (step S2; second acquisition step). Policy information is information that controls the output of the inference model (AI), which is converted (generated) from various documents such as organizational and regional culture documents, AI utilization policies, and contract information, relating to the location and country where the information processing device 1 is installed, and the contracting company. Variations of policy information include those relating to countries, prefectures, companies, buildings, individuals, religions, politics, and political parties. The policy information includes information on whether all items of the analysis results by the control unit 11 can be output. Items of policy information include physical characteristics (gender, age, height, weight, skin color, hand and foot size, etc.), cultural characteristics (clothing, belongings, etc.), characteristics that identify an individual (face, fingerprints, etc.), and other characteristics (annual income, etc.). Specifically, if the inference model analyzes and outputs the items of age, gender, clothing, height, skin color, belongings, facial expression, weight, hairstyle, and skeletal structure for a "person," the policy information will be, for example, policy information PO1 shown in Figure 3. As shown in Figure 3, the policy information includes output permission information for all items (0: not output, 1: output allowed). As shown in Figure 4, in the control unit 11, the analysis unit performs analysis of the analysis target information acquired from the first acquisition unit using an inference model, and based on the policy information, only the information of items that are output allowed (1: output allowed) is sent to the output unit. The output unit also outputs only the output allowed information as annotation information. As shown in Figure 5, in the analysis unit of the control unit 11, information that is not output allowed (0: not output allowed) may be sent to the output unit as error information (-1000: error), and the output unit may output only the output allowed information as annotation information. The policy information is generated manually or automatically by natural language processing from the various documents mentioned above. For example, the control unit 11 may be configured to acquire the various documents mentioned above from an external device connected via the communication unit 12, determine the output permission of each item output by the inference model from these documents, and generate policy information. It is preferable that the policy information is signed, and the control unit 11 may choose not to acquire policy information that is not signed.

[0024] Here, we will explain the case where multiple policy information items have been acquired. In this case, the control unit 11 selects from among the multiple policy information items based on predetermined conditions. These predetermined conditions include, for example, the regional information in which the policy information is used, or the expiration date of the policy information.

[0025] First, let's explain the case where the predetermined conditions use regional information. As shown in Figure 6, the control unit 11 compares the installation region information of the information processing device 1 with the regional information of the policy information and selects policy information for the installation region that includes the installation region of the information processing device 1. In other words, the control unit 11 selects policy information for the installation region that includes the installation location of the device that displays the output annotation information. Specifically, if the installation region information of the information processing device 1 is Japan, the control unit 11 acquires policy information for Japan. The installation region information of the information processing device 1 is acquired by the control unit 11 from location information such as GPS (Global Positioning System) information, GEO-IP (IP-based Geolocation) information, and Wi-Fi / mobile carrier radio wave information of the information processing device 1. Alternatively, the installation region information of the information processing device 1 may be acquired by the control unit 11 from information such as religious attire acquired from a device such as a camera connected to the information processing device 1.

[0026] As shown in Figure 7, if the installation area is a designated area that has been specified in advance, policy information for the designated area will be selected regardless of the broader installation area (national, prefectural, facility, etc.) to which the installation area belongs. Designated areas that have been specified in advance include areas where crime is frequent (enforcement areas), areas in front of police boxes, areas around prisons, and areas targeted during enforcement strengthening weeks.

[0027] This section describes the case where the installation location of the information processing device 1 overlaps with the installation areas (regional information) of multiple policy information. For example, as shown in Figure 8, the narrowest region may be selected. Specifically, if the multiple policy information includes one for Tokyo Tower and one for Japan, the control unit 11 acquires the policy information for Tokyo Tower. Also, for example, multiple policy information may be used. In this case, the policy information may conflict. Conflict refers to a situation where an item that is not outputtable in the policy information for a wide installation area is outputtable in the policy information for a narrow installation area. When policy information conflicts, the control unit 11 may determine that the conflicting items are not outputtable. In other words, the control unit 11 does not output analysis results for items that it has determined not to output analysis results for based on at least one policy information. The control unit 11 may also display information indicating that a conflict has occurred on the display unit 15.

[0028] Next, we will explain the case where the predetermined condition is based on the expiration date of the policy information. The control unit 11 compares the expiration dates of the policy information and selects the policy information to be used for analysis. For example, as shown in Figure 9, if there are multiple policy information entries with the same name, the policy information with the most recent expiration date is selected. Also, for example, expired policy information is not selected. In this case, the analysis described later will not be performed, or even if the analysis is performed, the analysis results will not be output.

[0029] Next, the control unit 11 analyzes the information to be analyzed based on the policy information (step S3; analysis step). As described above, the inference model analyzes the information to be analyzed and outputs the contents of pre-configured items. The control unit 11 outputs only the contents of items that are allowed to be output in the policy information from among the items output from the inference model as analysis results. On the other hand, the control unit 11 deletes the contents of items that are not allowed to be output in the policy information from among the items output from the inference model. In other words, information that is not allowed to be output is not output as an analysis result.

[0030] Next, the control unit 11 outputs the analysis results as annotation information (step S4; output step).

[0031] This ensures that items designated as non-outputable by policy information are not output, thus allowing for a more reliable and simpler restriction of inappropriate analysis results from the inference model (AI).

[0032] <Other> In the above example, the information processing device 1 is a display device that displays the information to be analyzed and annotation information, and also an analysis device that analyzes the information to be analyzed, but the example is not limited to this. For example, as shown in Figure 10, the information processing system 100 may be configured such that a cloud server 2 is used as the analysis device and a terminal device 3 is used as the display device, connected via a network N. In this case, the control unit 21, communication unit 22, and storage unit 23 have the various functions of the control unit 11, communication unit 12, and storage unit 13. Also, in this case, the above-mentioned installation location should be read as the installation location of the terminal device 3, not the installation location of the information processing device 1.

[0033] <Effects> As described above, the information processing device 1 includes a first acquisition unit (control unit 11) for acquiring information to be analyzed, a second acquisition unit (control unit 11) for acquiring policy information, an analysis unit (control unit 11) for analyzing the information to be analyzed based on the policy information, and an output unit (control unit 11) for outputting annotation information corresponding to the analysis results by the analysis unit. Therefore, the output of inappropriate analysis results from the AI ​​can be restricted more reliably and simply.

[0034] Specifically, the present invention can be utilized in the following scenarios. For example, when an information processing device 1 connected to a surveillance camera analyzes image data, disclosing what kind of analysis results are being collected and that the collected data consists of items for which policy information can be output can avoid claims related to information acquisition. For example, in the development of an inference model, controlling the items output from the inference model using policy information makes it easier to customize according to the customer. In other words, by developing an inference model in advance that can analyze many items, the analysis results output for each customer can be changed simply by changing the policy information. In the future, an era will come when special AIs (general-purpose AIs) that can perform various analyses with just one AI will become mainstream. Under that premise, in a situation where the number of items to be analyzed becomes nearly infinite, it will be difficult for the client to select the items to be analyzed, so it will be necessary to analyze everything that can be analyzed by the AI ​​once, obtain the client's policy, and output accordingly.

[0035] Furthermore, the information processing system 100 includes a first acquisition unit (control unit 21) for acquiring information to be analyzed, a second acquisition unit (control unit 21) for acquiring policy information, an analysis unit (control unit 21) for analyzing the information to be analyzed based on the policy information, and an output unit (control unit 21) for outputting annotation information corresponding to the analysis results by the analysis unit. Therefore, the output of inappropriate analysis results from the AI ​​can be restricted more reliably and simply.

[0036] Furthermore, the information processing method by the information processing device 1 includes a first acquisition step (step S1) for acquiring information to be analyzed, a second acquisition step (step S2) for acquiring policy information, an analysis step (step S3) for analyzing the information to be analyzed based on the policy information, and an output step (step S4) for outputting annotation information corresponding to the analysis results from the analysis step. Therefore, the output of inappropriate analysis results from the AI ​​can be restricted more reliably and simply.

[0037] Furthermore, the program causes the computer of the information processing device 1 to execute a first acquisition step (step S1) to acquire information to be analyzed, a second acquisition step (step S2) to acquire policy information, an analysis step (step S3) to analyze the information to be analyzed based on the policy information, and an output step (step S4) to output annotation information corresponding to the analysis results from the analysis step. This makes it possible to more reliably and simply restrict the output of inappropriate analysis results from the AI.

[0038] Although the present invention has been described in detail based on embodiments above, it goes without saying that the present invention is not limited to the above embodiments and can be modified as appropriate without departing from the spirit of the invention. For example, the above description disclosed examples in which a hard disk or semiconductor non-volatile memory was used as a computer-readable medium for the program according to the present invention, but the invention is not limited to these examples. Portable recording media such as CD-ROMs can be used as other computer-readable media.

[0039] Furthermore, the detailed configuration and operation of each device can be modified as appropriate, without departing from the spirit of the invention.

[0040] This invention can be used in information processing devices, information processing systems, information processing methods, and programs.

[0041] 1 Information Processing Device 11 Control Unit (First Acquisition Unit, Second Acquisition Unit, Analysis Unit, Output Unit, Generation Unit) 12 Communication Unit 13 Storage Unit 14 Operation Unit 15 Display Unit 100 Information Processing System 2 Cloud Server 21 Control Unit (First Acquisition Unit, Second Acquisition Unit, Analysis Unit, Output Unit, Generation Unit) 22 Communication Unit 23 Storage Unit 3 Terminal Device N Communication Network

Claims

1. An information processing device comprising: a first acquisition unit for acquiring information to be analyzed; a second acquisition unit for acquiring policy information; an analysis unit for analyzing the information to be analyzed based on the policy information; and an output unit for outputting annotation information corresponding to the analysis results by the analysis unit.

2. If there are multiple policy information items, the second acquisition unit selects from the multiple policy information items based on predetermined conditions, as described in claim 1.

3. The information processing apparatus according to claim 2, wherein the predetermined conditions are conditions relating to the installation area, and the second acquisition unit selects the policy information for the installation area, which includes the installation location of the device that displays the outputted annotation information.

4. If the installation location overlaps with the installation area of ​​multiple policy information, the second acquisition unit selects the policy information with the narrowest installation area, as described in claim 3.

5. If the installation location overlaps with the installation area of ​​multiple policy information, the analysis unit shall not output analysis results for items for which analysis results are not output, based on at least one of the policy information, as described in claim 3.

6. The information processing apparatus according to claim 3, wherein the installation location of the device to which the annotation information is output is a designated area that has been specified in advance, and the second acquisition unit selects the policy information for the designated area.

7. If multiple policy information entries with the same name exist, the second acquisition unit selects the policy information entry with the most recent expiration date, as described in claim 2.

8. The information processing apparatus according to claim 1, wherein the analysis unit does not output the analysis result if the policy information acquired by the second acquisition unit has expired.

9. The information processing apparatus according to claim 1, wherein the analysis unit deletes the analysis results that were not output based on the policy information.

10. The information processing apparatus according to claim 1, wherein the policy information is signed information.

11. The information processing apparatus according to claim 1, wherein the policy information includes information on whether all items of the analysis results by the analysis unit can be output.

12. The information processing apparatus according to claim 1, comprising a generation unit that generates the policy information based on information obtained from an external device.

13. An information processing system comprising: a first acquisition unit for acquiring information to be analyzed; a second acquisition unit for acquiring policy information; an analysis unit for analyzing the information to be analyzed based on the policy information; and an output unit for outputting annotation information corresponding to the analysis results by the analysis unit.

14. An information processing method using an information processing device, comprising: a first acquisition step of acquiring information to be analyzed; a second acquisition step of acquiring policy information; an analysis step of analyzing the information to be analyzed based on the policy information; and an output step of outputting annotation information corresponding to the analysis result of the analysis step.

15. A program that causes the computer of an information processing device to execute: a first acquisition step for acquiring information to be analyzed; a second acquisition step for acquiring policy information; an analysis step for analyzing the information to be analyzed based on the policy information; and an output step for outputting annotation information corresponding to the analysis results obtained in the analysis step.

Images