Information processing device

Abstract

To appropriately generate the image intended by the user. [Solution] The information processing device comprises an acquisition means for acquiring a graph structure input by a user, a generation means for generating an image based on the graph structure, and an output means for outputting the generated image. The graph structure may include, for example, information about the type of object and information about the position of the object. The graph structure may also include, for example, information about the shape or color of the object.

Description

Technical Field

[0001] This disclosure relates to the technical field of information processing apparatuses.

Background Art

[0002] As this type of apparatus, for example, a system has been proposed in which a large language model (LLM) is caused to generate query data based on a document, and a pair of the document and the query data is used for learning a search model for a chatbot (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When generating an image using a machine-learned generation model, an image that does not conform to the user's intention (for example, an image slightly deviated from the content of the user's instruction) may be generated. In order to avoid such a situation, for example, it is required to give an instruction that enables the generation model to accurately understand the user's intention, but it is by no means easy for the user to input such an instruction himself / herself.

[0005] This disclosure has been made in view of the above problems, and an object thereof is to provide an information processing apparatus capable of appropriately generating an image intended by a user.

Means for Solving the Problems

[0006] An information processing device according to one aspect of this disclosure comprises an acquisition means for acquiring a graph structure input by a user, a generation means for generating an image based on the graph structure, and an output means for outputting the generated image. [Brief explanation of the drawing]

[0007] [Figure 1] This is a block diagram showing the hardware configuration of an information processing device according to an embodiment. [Figure 2] This is a block diagram showing the functional configuration of an information processing apparatus according to an embodiment. [Figure 3] This is a flowchart showing the operation flow of the information processing device according to the embodiment. [Modes for carrying out the invention]

[0008] The following describes an embodiment of the information processing device with reference to the drawings.

[0009] (Hardware configuration) First, the hardware configuration of the information processing device according to the embodiment will be described with reference to Figure 1. Figure 1 is a block diagram showing the hardware configuration of the information processing device according to the embodiment.

[0010] In Figure 1, the information processing device 10 according to this embodiment comprises an arithmetic unit 110, a storage device 120, a communication device 130, an input device 140, and an output device 150. The arithmetic unit 110, the storage device 120, the communication device 130, the input device 140, and the output device 150 are connected to each other via a data bus.

[0011] The arithmetic unit 110 is configured to perform various arithmetic operations in the information processing device 10. The arithmetic unit 110 may have a processor. The arithmetic unit 110 may have a single processor or may have multiple processors. In other words, the arithmetic unit 110 may have one or more processors. The processor may be a multi-core processor. If the arithmetic unit 110 has a single processor that is a multi-core processor, then logically, the arithmetic unit 110 can be said to have multiple processors.

[0012] The processor in the arithmetic unit 110 may be at least one of the following: CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field Programmable Gate Array), and TPU (Tensor Processing Unit).

[0013] The storage device 120 may be at least one of the following: RAM (Random Access Memory), ROM (Read Only Memory), hard disk drive, magneto-optical disk drive, SSD (Solid State Drive), and optical disk array. In other words, the storage device 120 may be implemented by a single device or by multiple devices.

[0014] The storage device 120 is capable of storing desired data. The storage device 120 may store the computer program CP that the arithmetic unit 110 will execute. The storage device 120 may temporarily store data that the arithmetic unit 110 will use temporarily when the arithmetic unit 110 is executing the computer program CP.

[0015] The computer program CP may be recorded on a non-temporary recording medium that is readable by a computer. In this case, the computer program CP may be stored in the storage device 120 by reading the recording medium using a recording medium reading device (not shown) provided by the information processing device 10. At least one of the following may be used as the recording medium: an optical disc, a magnetic medium, a magneto-optical disc, a semiconductor memory, and any other medium capable of storing a program. The computer program CP may also be obtained from an external device (not shown) of the information processing device 10 via a communication device 130. In other words, the computer program CP may be downloaded from an external device to the storage device 120 of the information processing device 10.

[0016] The arithmetic unit 110 (for example, a processor) may execute the processing that the information processing device 10 should perform together with the memory device 120 in which the computer program CP is stored (in other words, together with the memory device 120 and the computer program CP stored in the memory device 120). For example, by the arithmetic unit 110 executing the computer program CP, a logical functional block for executing the processing that the information processing device 10 should perform may be realized within the arithmetic unit 110 (for example, within the processor).

[0017] The communication device 130 is configured to communicate with devices outside the information processing device 10. The communication device 130 may use wired communication or wireless communication.

[0018] The input device 140 is a device capable of receiving input of information to the information processing device 10 from the outside. The input device 140 may include an operating device (for example, a keyboard, a mouse, a touch panel, etc.) that can be operated by the user of the information processing device 10. The input device 140 may include a recording medium reader that can read information recorded on a detachable recording medium for the information processing device 10, such as a USB (Universal Serial Bus) memory. When information is input to the information processing device 10 via the communication device 130 (in other words, when the information processing device 10 acquires information via the communication device 130), the communication device 130 may function as an input device.

[0019] The output device 150 is a device capable of outputting information to the outside of the information processing device 10. The output device 150 may have a display device capable of outputting visual information such as characters and images as the above information. The output device 150 may also have a speaker capable of outputting auditory information such as sound as the above information. The output device 150 may be configured to output the above information (for example, control information of other devices, etc.) to other devices. The output device 150 may be capable of outputting information to a detachable recording medium for the information processing device 10, such as a USB memory. When the information processing device 10 outputs information via the communication device 130, the communication device 130 may function as an output device.

[0020] <Functional Configuration> Next, with reference to FIG. 2, the functional configuration of the information processing device 10 according to the embodiment will be described. FIG. 2 is a block diagram showing the functional configuration of the information processing device according to the embodiment.

[0021] In FIG. 2, the information processing apparatus 10 is configured as an apparatus that generates an image based on a graph structure input by a user. The information processing apparatus 10 includes, as components for realizing its functions, a graph structure acquisition unit 210, an image generation unit 220, an image output unit 230, and a graph structure change unit 240. Each of the graph structure acquisition unit 210, the image generation unit 220, the image output unit 230, and the graph structure change unit 240 may be a processing block realized by the arithmetic unit 110 described above.

[0022] The graph structure acquisition unit 210 is configured to be able to acquire a graph structure input by a user. Here, the graph structure may mean data composed of a group of nodes and a group of edges indicating the relationship between nodes, which represents the relationship between each part of an object in an image related to one image data. The graph structure acquisition unit 210 may have a function of vectorizing the acquired graph structure into a feature vector. The graph structure may include object type information and object position information. Alternatively, the graph structure may include information regarding the shape or color of an object.

[0023] The image generation unit 220 is configured to be able to generate an image from the graph structure acquired by the graph structure acquisition unit 210. That is, the image generation unit 220 converts what the user expressed as a graph structure into an image. The image generation unit 220 may generate an image using a model that has been machine-learned in advance. This model may be a model that takes a graph structure (or a feature vector of a graph structure) as an input and outputs an image.

[0024] The image output unit 230 is configured to be able to output the image generated by the image generation unit 220 (hereinafter, appropriately referred to as the "generated image") to the user. For example, the image output unit 230 may display the image generated by the image generation unit 220 on a display. Further, in addition to the generated image, the image output unit 230 may display the graph structure used when generating the generated image (in other words, the graph structure input by the user) side by side.

[0025] The graph structure modification unit 240 is configured to modify the graph structure acquired by the graph structure acquisition unit 210 based on modification input from the user. The modification input may include, for example, instructions to modify a part of the graph structure. For example, the user may select the part of the graph structure they want to change and input information to rewrite the selected part as modification input. The graph structure modified by the graph structure modification unit 240 is output to the image generation unit 220. Therefore, when the graph structure modification unit 240 modifies the graph structure, the image generation unit 220 will regenerate the image based on the modified graph structure.

[0026] (Flow of operations) Next, the operation flow of the information processing device 10 according to the embodiment will be described with reference to Figure 3. Figure 3 is a flowchart showing the operation flow of the information processing device according to the embodiment.

[0027] As shown in Figure 3, when the operation of the information processing device 10 according to the embodiment is started, the graph structure acquisition unit 210 first acquires the graph structure from the user (step S101). Then, the image generation unit 220 generates an image from the graph structure acquired by the graph structure acquisition unit 210 (step S102).

[0028] Next, the image output unit 230 outputs the image generated by the image generation unit 220 (step S103). Then, the graph structure modification unit 240 determines whether or not there has been any modification input from the user (step S104). If it is determined that there has been no modification input (step S104: NO), the series of operations may be terminated.

[0029] If a correction input is received (step S104: YES), the graph structure modification unit 240 modifies the graph structure based on the correction input (step S105). Then, using the modified graph structure, processing from step S102 is started. As a result, an image is generated and output based on the modified graph.

[0030] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to this embodiment will be described.

[0031] As explained in Figures 1 to 3, in the information processing device 10 according to this embodiment, an image is generated from a graph structure input by the user. Since the graph structure has a structure that is easy for machines to interpret, by using the graph structure when generating an image, it is possible to output an image that matches the user's intentions.

[0032] Furthermore, a graph structure makes it easy to modify part of the information. For example, suppose a user inputs a graph structure of "tree-leaf (color: green)-person-person," and the image generation unit 220 generates an image of "a summer landscape with people around a tree." After this image is output, if the user modifies the information regarding the leaf color and changes the graph structure to "tree-leaf (color: yellow)-person-person," the image generation unit 220 will generate an image of "an autumn landscape with people around a tree." In this way, using a graph structure allows for the generation of images that align with the user's intentions by simply changing some of the information.

[0033] The embodiments of the invention derived from the above-described embodiments are described below.

[0034] An information processing device according to one aspect of this disclosure includes an acquisition means for acquiring a graph structure input by a user, a generation means for generating an image based on the graph structure, and an output means for outputting the generated image. In the above embodiment, the "graph structure acquisition unit 210" corresponds to an example of the "acquisition means," the "image generation unit 220" corresponds to an example of the "generation means," and the "image output unit 230" corresponds to an example of the "output means."

[0035] In the information processing device according to the above embodiment, the graph structure may include object type information and object position information. In this way, it becomes possible to generate images more appropriately based on the object type information and object position information included in the graph structure.

[0036] In the information processing device according to the above embodiment, the graph structure may include information about the shape or color of the object. In this way, it becomes possible to generate an image more appropriately based on the information about the shape or color of the object included in the graph structure.

[0037] In the information processing apparatus according to the above embodiment, the apparatus further includes a modification means for modifying a part of the graph structure input by the user in response to the user's input, and the generation means may regenerate the image based on the modified graph structure when a part of the graph structure is modified. In this way, it becomes possible to easily modify the generated image. In the above embodiment, the "graph structure modification unit 240" corresponds to an example of the "modification means".

[0038] This disclosure is not limited to the embodiments described above and can be modified as appropriate without contradicting the gist or idea of ​​the invention as can be inferred from the claims and the specification as a whole. Information processing devices with such modifications are also included within the technical scope of the present invention. [Explanation of Symbols]

[0039] 10...Information processing device, 110...Calculation unit, 120...Storage device, 130...Communication device, 140...Input device, 150...Output device, 210...Graph structure acquisition unit, 220...Image generation unit, 230...Image output unit, 240...Graph structure modification unit

Claims

1. A means of obtaining the graph structure input by the user, A generation means for generating an image based on the aforementioned graph structure, Output means for outputting the generated image, An information processing device equipped with the following features.

2. The aforementioned graph structure includes information on the type of object and information on the position of the object. The information processing apparatus according to claim 1.

3. The graph structure includes information about the shape or color of the object. The information processing apparatus according to claim 2.

4. The system further includes a modification means that modifies a part of the graph structure entered by the user in response to the user's input. The generation means regenerates the image based on the modified graph structure when a part of the graph structure is changed. The information processing apparatus according to any one of claims 1 to 3.

Images