Information processing device

Abstract

Appropriately classify images that contain sensitive elements. [Solution] The information processing device includes a conversion means for converting image data into a graph structure, a determination means for determining whether or not the graph structure contains a pre-set sensitive element, and a classification means for assigning a sensitive tag to the image data and classifying it if a sensitive element is included.

Description

Technical Field

[0001] This disclosure relates to the technical field of information processing devices.

Background Art

[0002] As this type of device, for example, a system has been proposed in which a large language model (LLM) generates query data based on a document, and a pair of the document and the query data is used for learning a search model for a chatbot (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When training a model using machine learning, a large amount of training data (e.g., a large amount of image data) is required. When dealing with a large amount of image data, there is a possibility of viewing sensitive images contained therein. Since sensitive images may have an adverse effect on the viewer's mental state, it is preferable to take measures to prevent unintended viewing. However, it is difficult to determine whether an image is sensitive without viewing it.

[0005] This disclosure has been made in view of the above problems, and an object thereof is to provide an information processing device capable of appropriately classifying sensitive images.

Means for Solving the Problems

[0006] An information processing device according to one aspect of this disclosure includes: a conversion means for converting image data into a graph structure; a determination means for determining whether or not the graph structure contains a pre-set sensitive element; and a classification means for assigning a sensitive tag to the image data and classifying it if the sensitive element is included. [Brief explanation of the drawing]

[0007] [Figure 1] This is a block diagram showing the hardware configuration of an information processing device according to an embodiment. [Figure 2] This is a block diagram showing the functional configuration of an information processing apparatus according to an embodiment. [Figure 3] This is a flowchart showing the flow of the classification operation by the information processing device according to the embodiment. [Figure 4] This is a plan view showing an example of a sensitive image and graph structure. [Figure 5] This is a flowchart showing the flow of the search operation by the information processing device according to the embodiment. [Modes for carrying out the invention]

[0008] The following describes an embodiment of the information processing device with reference to the drawings.

[0009] (Hardware configuration) First, the hardware configuration of the information processing device according to the embodiment will be described with reference to Figure 1. Figure 1 is a block diagram showing the hardware configuration of the information processing device according to the embodiment.

[0010] In Figure 1, the information processing device 10 according to this embodiment comprises an arithmetic unit 110, a storage device 120, a communication device 130, an input device 140, and an output device 150. The arithmetic unit 110, the storage device 120, the communication device 130, the input device 140, and the output device 150 are connected to each other via a data bus.

[0011] The arithmetic unit 110 is configured to perform various arithmetic operations in the information processing device 10. The arithmetic unit 110 may have a processor. The arithmetic unit 110 may have a single processor or may have multiple processors. In other words, the arithmetic unit 110 may have one or more processors. The processor may be a multi-core processor. If the arithmetic unit 110 has a single processor that is a multi-core processor, then logically, the arithmetic unit 110 can be said to have multiple processors.

[0012] The processor in the arithmetic unit 110 may be at least one of the following: CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field Programmable Gate Array), and TPU (Tensor Processing Unit).

[0013] The storage device 120 may be at least one of the following: RAM (Random Access Memory), ROM (Read Only Memory), hard disk drive, magneto-optical disk drive, SSD (Solid State Drive), and optical disk array. In other words, the storage device 120 may be implemented by a single device or by multiple devices.

[0014] The storage device 120 is capable of storing desired data. The storage device 120 may store the computer program CP that the arithmetic unit 110 will execute. The storage device 120 may temporarily store data that the arithmetic unit 110 will use temporarily when the arithmetic unit 110 is executing the computer program CP.

[0015] The computer program CP may be recorded on a non-temporary recording medium that is readable by a computer. In this case, the computer program CP may be stored in the storage device 120 by reading the recording medium using a recording medium reading device (not shown) provided by the information processing device 10. At least one of the following may be used as the recording medium: an optical disc, a magnetic medium, a magneto-optical disc, a semiconductor memory, and any other medium capable of storing a program. The computer program CP may also be obtained from an external device (not shown) of the information processing device 10 via a communication device 130. In other words, the computer program CP may be downloaded from an external device to the storage device 120 of the information processing device 10.

[0016] The arithmetic unit 110 (for example, a processor) may execute the processing that the information processing device 10 should perform together with the memory device 120 in which the computer program CP is stored (in other words, together with the memory device 120 and the computer program CP stored in the memory device 120). For example, by the arithmetic unit 110 executing the computer program CP, a logical functional block for executing the processing that the information processing device 10 should perform may be realized within the arithmetic unit 110 (for example, within the processor).

[0017] The communication device 130 is configured to communicate with devices outside the information processing device 10. The communication device 130 may use wired communication or wireless communication.

[0018] The input device 140 is a device capable of receiving input of information to the information processing device 10 from the outside. The input device 140 may include an operating device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the information processing device 10. The input device 140 may include a recording medium reader that can read information recorded on a detachable recording medium for the information processing device 10, such as a USB (Universal Serial Bus) memory. When information is input to the information processing device 10 via the communication device 130 (in other words, when the information processing device 10 acquires information via the communication device 130), the communication device 130 may function as an input device.

[0019] The output device 150 is a device capable of outputting information to the outside of the information processing device 10. The output device 150 may have a display device capable of outputting visual information such as characters and images as the above information. The output device 150 may also have a speaker capable of outputting auditory information such as sound as the above information. The output device 150 may be configured to output the above information (e.g., control information of other devices, etc.) to other devices. The output device 150 may be able to output information to a detachable recording medium for the information processing device 10, such as a USB memory. When the information processing device 10 outputs information via the communication device 130, the communication device 130 may function as an output device.

[0020] <Functional Configuration> Next, with reference to FIG. 2, the functional configuration of the information processing device 10 according to the embodiment will be described. FIG. 2 is a block diagram showing the functional configuration of the information processing device according to the embodiment.

[0021] In FIG. 2, the information processing apparatus 10 is configured as an apparatus that classifies an image including a sensitive element. Further, the information processing apparatus 10 is configured as an apparatus that searches for a desired image from a group of image data including sensitive images. The information processing apparatus 10 includes, as components for realizing its functions, an image conversion unit 210, a determination unit 220, an image classification unit 230, an image database (DB) 240, and a search unit 250. Each of the image conversion unit 210, the determination unit 220, the image classification unit 230, and the search unit 250 may be a processing block realized by the arithmetic unit 110 described above. Also, the image DB 240 may be a database realized by the storage device 120 described above.

[0022] The image conversion unit 210 is configured to be able to convert an input unclassified image into a graph structure. Here, the graph structure may mean data composed of a group of nodes and a group of edges indicating the relationship between nodes for each part of an object in an image related to one image data. The image conversion unit 210 may further have a function of vectorizing the graph structure into a feature vector. The image conversion unit 210 may convert image data into a graph structure using a machine-learned model. This model may be a model that takes image data as input and outputs a graph structure (or a feature vector of the graph structure).

[0023] The determination unit 220 determines whether or not the original image (that is, the image before being converted into a graph structure by the image conversion unit 210) is an image including a sensitive element based on the graph structure (or the feature vector of the graph structure) returned by the image conversion unit 210. The determination unit 220 may, for example, store in advance the determination criteria for sensitive elements in the graph structure, and determine whether or not the image includes sensitive elements based on the determination criteria. For example, the sensitive elements in the graph structure may be set according to the type and positional relationship of an object. Alternatively, the sensitive elements in the graph structure may be set according to the actions of a person.

[0024] The image classification unit 230 is configured to classify unclassified images based on the determination results from the determination unit 220. Specifically, if the determination unit 220 determines that an image contains sensitive elements, the image classification unit 230 adds a sensitive tag to the image and then stores it in the image database 240. On the other hand, if the determination unit 220 determines that an image does not contain sensitive elements, the image classification unit 230 stores the image in the image database 240 without adding a sensitive tag.

[0025] The image database 240 is configured to store multiple images. The image database stores images to which sensitive tags have been assigned by the image classification unit 230 (hereinafter referred to as "sensitive images" as appropriate) and images to which sensitive tags have not been assigned. The image database 240 may also be configured to store graph structures in addition to images. For example, the image database 240 may store images and graph structures converted from those images by the image conversion unit 210 in a manner that links them together.

[0026] The search unit 250 is configured to search for a desired image from among multiple images stored in the image database 240. The search unit 250 may search for images based on search conditions input by the user, for example. The search unit 250 may output the images obtained as a result of the search to the user. For example, the search unit 250 may display the images obtained as a result of the search on a display or the like. The search unit 250 may not display sensitive images if they are included in the search results. However, the search unit 250 may display sensitive images if the user allows the display of sensitive images.

[0027] (Classification operation) Next, with reference to Figure 3, the flow of the classification operation by the information processing device 10 according to the embodiment (i.e., the operation when classifying an image based on a graph structure) will be described. Figure 3 is a flowchart showing the flow of the classification operation by the information processing device according to the embodiment. Figure 4 is a plan view showing an example of a sensitive image and a graph structure.

[0028] As shown in Figure 3, when the classification operation by the information processing device 10 according to the embodiment is started, the image conversion unit 210 first acquires an unclassified image (step S101). Then, the image conversion unit 210 converts the acquired unclassified image data into a graph structure (step S102).

[0029] Next, the determination unit 220 determines whether or not the image contains sensitive elements based on the graph structure converted by the image conversion unit 210 (step S103). For example, suppose there is an image of a car and a person colliding, as shown in Figure 4. In this case, the graph structure converted from the image shows that the car and the person are in a very close positional relationship. Therefore, the determination unit 220 may determine that the image contains sensitive elements (i.e., it contains the moment of the traffic accident) based on the type and positional relationship of the objects in the graph structure. Alternatively, the determination unit 220 may determine whether or not the image contains sensitive elements based on information about the person's actions included in the graph structure. For example, if the graph structure contains information about "a person holding a knife," the determination unit 220 may determine that the image contains sensitive elements.

[0030] If the image is determined to contain sensitive elements (step S103: YES), the image classification unit 230 adds a sensitive tag to the image (step S104) and stores it in the image database 250 (step S105). On the other hand, if the image is determined not to contain sensitive elements (step S103: NO), the image classification unit 230 stores the image in the image database 250 without adding a sensitive tag.

[0031] (Searching action) Next, with reference to Figure 5, the flow of the search operation by the information processing device 10 according to the embodiment (i.e., the operation when searching for a desired image from the classified images) will be explained. Figure 5 is a flowchart showing the flow of the search operation by the information processing device according to the embodiment.

[0032] As shown in Figure 5, when the search operation by the information processing device 10 according to the embodiment is started, the search unit 250 first searches for the desired image from among a plurality of images stored in the image DB (step S201). When searching for an image, the user may input text information indicating the search conditions.

[0033] Next, the search unit 250 determines whether or not the images obtained as a search result contain sensitive images (i.e., images with sensitive tags) (step S202). If the search results do not contain sensitive images (step S202: NO), the search unit 250 outputs the images obtained as a search result to the user as they are (step S204).

[0034] On the other hand, if the search results include sensitive images (step S202: YES), the search unit 250 determines whether or not the display of sensitive images is permitted (step S203). Note that permission for displaying sensitive images may be set in advance by the user, or it may be confirmed with the user on the spot. For example, the search unit 250 may output a message to the user asking, "Is it okay to display sensitive images?", and if the user replies "Yes", it may determine that the display of sensitive images is permitted.

[0035] If the display of sensitive images is permitted (step S203: YES), the search unit 250 outputs the images obtained as search results to the user as they are (step S204). In other words, even sensitive images are displayed to the user. On the other hand, if the display of sensitive images is not permitted (step S203: NO), the search unit 250 excludes sensitive images from the images obtained as search results before outputting them (step S205). In this case, sensitive images are not displayed to the user.

[0036] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to this embodiment will be described.

[0037] As explained in Figures 1 to 5, in the information processing device 10 according to this embodiment, it is determined whether or not an image contains sensitive elements based on the graph structure, and the image is classified based on the determination result. In this way, images containing sensitive elements can be classified automatically (for example, without human visual inspection). Furthermore, since the device can more easily interpret the elements contained in the image by using a graph structure, the classification accuracy is also improved.

[0038] Furthermore, in the information processing device 10 according to this embodiment, sensitive images are not output (displayed) when searching for classified images. This prevents users searching for images from unintentionally viewing sensitive images. In addition, in this embodiment, sensitive images are displayed if the user has permitted their display. Therefore, sensitive images can be displayed to users who are permitted to view them.

[0039] The embodiments of the invention derived from the above-described embodiments are described below.

[0040] An information processing device according to one aspect of this disclosure includes: a conversion means for converting image data into a graph structure; a determination means for determining whether or not the graph structure contains a pre-set sensitive element; and a classification means for assigning a sensitive tag to the image data and classifying it if the sensitive element is included. In the above embodiment, the "image conversion unit 210" corresponds to an example of the "conversion means," the "determination unit 220" corresponds to an example of the "determination means," and the "image classification unit 230" corresponds to an example of the "classification means."

[0041] In the information processing device according to the above embodiment, the sensitive elements may be set according to the type and positional relationship of the objects in the graph structure. In this way, it becomes possible to appropriately determine the sensitive elements based on the type and positional relationship of the objects in the graph structure.

[0042] In the information processing device according to the above embodiment, the sensitive elements may be set according to the actions of a person in the graph structure. In this way, it becomes possible to appropriately determine the sensitive elements based on the actions of a person in the graph structure.

[0043] In the information processing apparatus according to the above embodiment, the apparatus further comprises storage means for storing the image data classified by the classification means, and search means for searching the image data in the storage means in response to user input, wherein the search means may not output the image data to which the sensitive tag is attached as a search result. In this way, it is possible to prevent images containing sensitive elements from being viewed unintentionally. In the above embodiment, "image DB240" corresponds to an example of "storage means," and "search unit 250" corresponds to an example of "search means."

[0044] In the information processing device according to the above embodiment, the search means may output the image data to which the sensitive tag is attached as a search result when the user has permitted the output of the image data containing the sensitive element. In this way, it is possible to display images containing sensitive elements to some users who have been permitted to view them.

[0045] This disclosure is not limited to the embodiments described above and can be modified as appropriate without contradicting the gist or idea of ​​the invention as can be inferred from the claims and the specification as a whole. Information processing devices with such modifications are also included within the technical scope of the present invention. [Explanation of symbols]

[0046] 10...Information processing unit, 110...Calculation unit, 120...Storage device, 130...Communication device, 140...Input device, 150...Output device, 210...Image conversion unit, 220...Determination unit, 230...Image classification unit, 240...Image DB, 250...Search unit

Claims

1. A means for converting image data into a graph structure, A determination means for determining whether or not the graph structure contains a pre-set sensitive element, A classification means for classifying the image data by assigning a sensitive tag to it if the sensitive element is included, An information processing device equipped with the following features.

2. The sensitive elements are set according to the type and positional relationship of the objects in the graph structure. The information processing apparatus according to claim 1.

3. The aforementioned sensitive elements are set according to the actions of the person in the graph structure. The information processing apparatus according to claim 1.

4. A storage means for storing the image data classified by the classification means, A search means for searching the image data in the storage means in response to the user's input, Furthermore, The search means prevents the output of the image data to which the sensitive tag has been assigned as a search result. The information processing apparatus according to any one of claims 1 to 3.

5. The search means outputs the image data to which the sensitive tag is attached as a search result when the user has permitted the output of the image data containing the sensitive element. The information processing apparatus according to claim 4.

Images