Information processing device

Abstract

The data for the corner case will be verified. [Solution] The information processing device (10) includes a determination means (112) that determines whether a component included in one graph structure is included in any of the multiple graph structures, using first information regarding one graph structure generated based on one image data and second information regarding multiple graph structures each generated based on multiple image data registered in a database (DB), and an output means (113) that outputs third information indicating that one image data is new data not registered in the database when it is determined that a component included in one graph structure is not included in any of the multiple graph structures.

Description

Technical Field

[0001] The present invention relates to the technical field of information processing apparatuses.

Background Art

[0002] As an apparatus of this kind, for example, a system has been proposed in which a large language model (LLM) is caused to generate query data based on a document, and a pair of the document and the query data is used for learning a search model for a chatbot (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] A large language model is a language model constructed using a very large dataset and deep learning technology. The data (i.e., training data) used for training such a model may be generated by subjecting the data collected from a data source, for example, to predetermined processing. For example, the data source may include data on situations that rarely occur (so-called corner cases). On the other hand, since the number of such data is extremely small, they are often buried in other data (for example, data on common cases).

[0005] The present invention has been made in view of the above circumstances, and an object thereof is to provide an information processing apparatus capable of inspecting corner case data.

Means for Solving the Problems

[0006] An information processing device according to one aspect of the present invention includes: a determination means for determining whether a component included in the one graph structure is included in any of the multiple graph structures, using first information relating to a one graph structure generated based on one image data and second information relating to multiple graph structures each generated based on multiple image data registered in a database; and an output means for outputting third information indicating that the one image data is new data not registered in the database, when it is determined that the component is not included in any of the multiple graph structures. [Brief explanation of the drawing]

[0007] [Figure 1] This block diagram shows an example of the configuration of an information processing device according to the embodiment. [Figure 2] This block diagram shows an example of the configuration of a computing device according to the embodiment. [Figure 3] This is a conceptual diagram illustrating the operation of the information processing device according to the embodiment. [Figure 4] This figure shows an example of a displayed image. [Modes for carrying out the invention]

[0008] Embodiments relating to the information processing device will be described with reference to Figures 1 to 4. In Figure 1, the information processing device 10 includes an arithmetic unit 11, a storage device 12, a communication device 13, an input device 14, and an output device 15. The arithmetic unit 11, the storage device 12, the communication device 13, the input device 14, and the output device 15 are connected via a data bus 16.

[0009] The arithmetic unit 11 may have a processor. The arithmetic unit 11 may have a single processor or multiple processors. In other words, the arithmetic unit 11 may have one or more processors. Furthermore, the processor may be a multi-core processor. If the arithmetic unit 11 has a single processor that is a multi-core processor, then logically, the arithmetic unit 11 can be said to have multiple processors.

[0010] The processor may be at least one of the following: CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field Programmable Gate Array), and TPU (Tensor Processing Unit).

[0011] The storage device 12 may be at least one of the following: RAM (Random Access Memory), ROM (Read Only Memory), hard disk drive, magneto-optical disk drive, SSD (Solid State Drive), and optical disk array. In other words, the storage device 12 may be implemented by a single device or by multiple devices.

[0012] The communication device 13 may be capable of communicating with devices outside the information processing device 10. The communication device 13 may use either wired or wireless communication.

[0013] The input device 14 is a device capable of receiving information input to the information processing device 10 from an external source. The input device 14 may include an operating device (e.g., a keyboard, mouse, touch panel, etc.) that can be operated by the user of the information processing device 10. The input device 14 may include a recording medium reader capable of reading information recorded on a recording medium that can be attached to and detached from the information processing device 10, such as a USB (Universal Serial Bus) memory. When information is input to the information processing device 10 via the communication device 13 (in other words, when the information processing device 10 acquires information via the communication device 13), the communication device 13 may function as an input device.

[0014] The output device 15 is a device capable of outputting information to the outside of the information processing device 10. The output device 15 has a display device 151 capable of outputting visual information such as characters and images as the above information. The output device 15 may also have a speaker capable of outputting auditory information such as sound as the above information. The output device 15 may also have a vibration motor capable of outputting tactile information such as vibration as the above information. The output device 15 may also have a printer. The output device 15 may be capable of outputting information to a recording medium that can be attached to and detached from the information processing device 10, such as a USB memory stick. When the information processing device 10 outputs information via the communication device 13, the communication device 13 may function as an output device.

[0015] The storage device 12 is capable of storing desired data. The storage device 12 may store the computer program CP that the arithmetic unit 11 will execute. The storage device 12 may temporarily store data that the arithmetic unit 11 will use temporarily when the arithmetic unit 11 is executing the computer program CP.

[0016] Furthermore, the computer program CP may be recorded on a non-temporary recording medium that is readable by a computer. In this case, the computer program CP may be stored in the storage device 12 by reading the recording medium using a recording medium reading device (not shown) provided by the information processing device 10. Furthermore, at least one of the following may be used as the recording medium: an optical disc, a magnetic medium, a magneto-optical disc, a semiconductor memory, and any other medium capable of storing a program. Furthermore, the computer program CP may be obtained from an external device (not shown) of the information processing device 10 via a communication device 13. In other words, the computer program CP may be downloaded from an external device to the storage device 12 of the information processing device 10.

[0017] The arithmetic unit 11 (for example, a processor) may execute the processing that the information processing device 10 should perform together with the memory device 12 in which the computer program CP is stored (in other words, together with the memory device 12 and the computer program CP stored in the memory device 12). For example, by the arithmetic unit 11 executing the computer program CP, a logical functional block for executing the processing that the information processing device 10 should perform may be realized within the arithmetic unit 11 (for example, within the processor).

[0018] As shown in Figure 2, the arithmetic unit 11 includes a generation unit 111, a determination unit 112, and an output unit 113. The generation unit 111, the determination unit 112, and the output unit 113 may be implemented as the logical functional blocks described above. At least one of the generation unit 111, the determination unit 112, and the output unit 113 may be implemented as a physical processing circuit. At least one of the generation unit 111, the determination unit 112, and the output unit 113 may be implemented in a manner that combines a logical functional block and a physical processing circuit.

[0019] The operation of the information processing apparatus 10 configured as described above will be described with reference to FIG. 3. In FIG. 3, a plurality of image data Imgs are registered in the database DB. It is assumed that there is information GSI regarding a plurality of graph structures respectively generated based on the plurality of image data Imgs. The information GSI may be information indicating the plurality of graph structures themselves, or may be information indicating feature vectors obtained by vectorizing each of the plurality of graph structures. The information GSI may be a distribution map showing the distribution of a plurality of feature amounts related to the plurality of graph structures in the feature space.

[0020] Incidentally, the information GSI may be registered in the database DB, or may be stored in a device different from the database DB. Incidentally, the graph structure may mean data composed of a node group representing the relationship between parts of an object in an image related to one image data, and an edge group indicating the relationship between nodes. Incidentally, various existing modes can be applied to the method of generating a graph structure from image data. Therefore, a detailed description of the method of generating a graph structure from image data will be omitted. Incidentally, the feature amount related to the graph structure may be calculated using a learning model (for example, Graph Neural Network: GNN). The "feature amount related to the graph structure" may be a feature amount related to the entire graph structure, or may be a feature amount related to each component (that is, node) included in the graph structure.

[0021] For the image data Img1 not registered in the database DB, the information processing apparatus 10 may perform the processing described below. For example, the image data Img1 may be image data extracted from a data source.

[0022] The generation unit 111 of the information processing apparatus 10 may generate a graph structure GS1 related to the image data Img1 based on the image data Img1. The determination unit 112 of the information processing apparatus 10 may use the information related to the graph structure GS1 and the information GSI to determine whether the components (i.e., nodes) included in the graph structure GS1 are included in any of the plurality of graph structures related to the plurality of image data Imgs. Note that the information related to the graph structure GS1 may be information indicating the graph structure GS1 itself, or may be information indicating a feature vector obtained by vectorizing the graph structure GS1. The information related to the graph structure GS1 may be information indicating a feature amount related to the graph structure GS1. However, the information related to the graph structure GS1 is information comparable to the information GSI.

[0023] For example, the determination unit 112 may use the information related to the graph structure GS1 and the information GSI to compare at least one of the type, positional relationship, shape, and color of the objects in each graph structure, thereby determining whether the components included in the graph structure GS1 are included in any of the plurality of graph structures related to the plurality of image data Imgs. For example, the determination unit 112 may use the information related to the graph structure GS1 and the information GSI to compare the feature vectors related to each graph structure, thereby determining whether the components included in the graph structure GS1 are included in any of the plurality of graph structures related to the plurality of image data Imgs.

[0024] For example, when the information GSI is the above-described distribution map, the determination unit 112 may use the information related to the graph structure GS1 and the information GSI to determine whether the components included in the graph structure GS1 are components corresponding to the blank portions of the distribution map (i.e., regions where data points indicating feature amounts do not exist). When it is determined that the components included in the graph structure GS1 are components corresponding to the blank portions of the distribution map, the determination unit 112 may determine that the components included in the graph structure GS1 are not included in any of the plurality of graph structures related to the plurality of image data Imgs.

[0025] If the determination unit 112 determines that a component included in graph structure GS1 is not included in any of the multiple graph structures relating to multiple image data Imgs, the output unit 113 of the information processing device 10 may output information indicating that image data Img1 is new data not registered in the database DB. For example, when the output unit 113 outputs this information, the image 200 shown in Figure 4 may be displayed on the display device 151. For example, image 200 includes an area 201 where an image relating to image data Img1 is displayed. Among the images displayed in area 201, the area corresponding to a component of graph structure GS1 that is not included in any of the multiple graph structures relating to multiple image data Imgs may be highlighted. In this case, the information output by the output unit 113 can be said to include information indicating a component of graph structure GS1 that is not included in any of the multiple graph structures relating to multiple image data Imgs.

[0026] Furthermore, if the determination unit 112 determines that the components included in graph structure GS1 are not included in any of the multiple graph structures relating to multiple image data Imgs, the arithmetic unit 11 of the information processing device 10 may register the image data Img1 in the database DB.

[0027] (Technical effects) In this embodiment, the determination unit 112 may determine whether a component included in the graph structure GS1 relating to the image data Img1 is included in any of the multiple graph structures relating to the multiple image data Imgs. If the determination unit 112 determines that a component included in the graph structure GS1 is not included in any of the multiple graph structures relating to the multiple image data Imgs, the output unit 113 may output information indicating that the image data Img1 is new data not registered in the database DB. For example, the information output by the output unit 113 can make the user of the information processing device 10 aware of the corner case data. As a result, it can be expected that the user will register the corner case data in the database DB. Therefore, according to the information processing device 10 of this embodiment, corner case data can be accepted.

[0028] The embodiments of the invention derived from the above-described embodiments are described below.

[0029] An information processing device according to one aspect of the invention includes: a determination means for determining whether a component included in the one graph structure is included in any of the multiple graph structures, using first information relating to a one graph structure generated based on one image data and second information relating to multiple graph structures each generated based on multiple image data registered in a database; and an output means for outputting third information indicating that the one image data is new data not registered in the database, when it is determined that the component is not included in any of the multiple graph structures. In the above embodiment, the "determination unit 112" corresponds to an example of the "determination means," and the "output unit 113" corresponds to an example of the "output means."

[0030] In the information processing apparatus according to the above embodiment, the second information may be a distribution map in which the distributions of the plurality of graph structures are mapped, and the determination means may determine that the component is not included in any of the plurality of graph structures if the component corresponds to a blank portion of the distribution map. With this configuration, it is possible to determine relatively easily whether a component included in one graph structure is included in any of the plurality of graph structures.

[0031] In the information processing device according to the above embodiment, the third information may include information indicating a component of one graph structure that is not included in any of the plurality of graph structures. With this configuration, the user of the information processing device can be presented with a component of one graph structure that is not included in any of the plurality of graph structures.

[0032] In the information processing apparatus according to the above embodiment, the first information and the second information may include at least one of the types, positional relationships, shapes, and colors of objects in the graph structure. With this configuration, it is relatively easy to determine whether or not a component included in one graph structure is included in any of the multiple graph structures.

[0033] The present invention is not limited to the embodiments described above, and can be modified as appropriate without contradicting the gist or idea of ​​the invention as can be read from the claims and specification as a whole. Information processing devices and other devices that undergo such modifications are also included within the technical scope of the present invention. [Explanation of symbols]

[0034] 10...Information processing device, 11...Calculation unit, 12...Storage device, 13...Communication device, 14...Input device, 15...Output device, 111...Generation unit, 112...Determination unit, 113...Output unit

Claims

1. A determination means that determines whether a component included in the one graph structure is included in any of the multiple graph structures, using first information relating to a graph structure generated based on one image data and second information relating to multiple graph structures each generated based on multiple image data registered in a database. If it is determined that the aforementioned component is not included in any of the plurality of graph structures, an output means outputs third information indicating that the first image data is new data not registered in the database, An information processing device equipped with the following features.

2. The second piece of information is a distribution map in which the distributions of the plurality of graph structures are mapped. The determination means determines that if the component corresponds to a blank portion of the distribution map, the component is not included in any of the plurality of graph structures. The information processing apparatus according to claim 1.

3. The third information includes information indicating a component of the one graph structure that is not included in any of the plurality of graph structures. The information processing apparatus according to claim 1.

4. The first and second pieces of information include at least one of the following in the graph structure: type of object, positional relationship, shape, and color. The information processing apparatus according to claim 1.

Images