Information processing device, information processing method, and program

The information processing device addresses long wait times in printing systems by using AI servers to quickly acquire and print images matching user preferences, enhancing user convenience.

JP2025151608APending Publication Date: 2025-10-09SEIKO EPSON CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024053126
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-28
Publication Date
2025-10-09

AI Technical Summary

Technical Problem

Existing printing systems that acquire images matching user preferences can take a long time, leading to user wait times.

Method used

An information processing device that includes an instruction information acquisition unit, an image request unit, and a print control unit to efficiently acquire and print images from another server when needed, utilizing AI servers for image generation and voice input for user instructions.

Benefits of technology

Reduces user wait times by quickly obtaining and printing images that match user preferences through efficient image acquisition and processing, allowing for a variety of images to be provided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025151608000001_ABST
    Figure 2025151608000001_ABST
Patent Text Reader

Abstract

To solve the problem that, when acquiring an image matching a user's desire from another device, processing of acquiring the image matching the desire of the user may take time, and the user is kept waiting for a long time.SOLUTION: An information processing device 100 includes: an instruction information acquisition section 111 that acquires first print instruction information including designation of a drawing target; an image request section 114 that, when an image corresponding to the acquired first print instruction information is not stored in a storage 300, requests, using the first print instruction information, another server to transmit an image in which the drawing target is drawn; an image acquisition section 115 that acquires the image from another sever; and a print control section 119 that causes an image forming device 200 to print the acquired image.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] There are known systems for providing printed materials to users. For example, Patent Document 1 discloses a printing system that performs printing in accordance with voice input from a user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-56913 Summary of the Invention [Problem to be solved by the invention]

[0004] If the printing system can acquire images that match the user's preferences from other devices, it will be possible to print a variety of image content. However, if it takes time to acquire images that match the user's preferences, the user will have to wait a long time. [Means for solving the problem]

[0005] The information processing device according to the present disclosure includes an instruction information acquisition unit that acquires first print instruction information including a designation of a drawing target, an image request unit that uses the first print instruction information to request another server to send an image on which the drawing target is drawn if an image corresponding to the acquired first print instruction information is not stored in storage, an image acquisition unit that acquires the image from the other server, and a print control unit that causes an image forming device to print the acquired image.

[0006] In addition, in the information processing method disclosed herein, first print instruction information including a designation of a drawing target is acquired, and if an image corresponding to the acquired first print instruction information is not stored in storage, the first print instruction information is used to request another server to send an image on which the drawing target is drawn, the image is acquired from the other server, and the acquired image is printed by an image forming device.

[0007] In addition, the program disclosed herein causes a computer to execute the following steps: an instruction information acquisition step of acquiring first print instruction information including a designation of a drawing target; an image request step of using the first print instruction information to request another server to send an image on which the drawing target is drawn, if an image corresponding to the acquired first print instruction information is not stored in storage; an image acquisition step of acquiring the image from the other server; and a print control step of causing an image forming device to print the acquired image. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing an example of a configuration of a printing system according to an embodiment; [Figure 2] 1 is a block diagram illustrating an example of a configuration of an information processing device according to an embodiment; [Figure 3A] 1 is a sequence chart showing an example of a flow of processing executed in a printing system according to an embodiment. [Figure 3B] 1 is a sequence chart showing an example of a flow of processing executed in a printing system according to an embodiment. [Figure 4A] 10 is a sequence chart showing another example of the flow of processing executed in the printing system according to the embodiment. [Figure 4B] 10 is a sequence chart showing another example of the flow of processing executed in the printing system according to the embodiment. [Figure 4C] 10 is a sequence chart showing another example of the flow of processing executed in the printing system according to the embodiment. [Figure 5] FIG. 10 is a schematic diagram illustrating an example of a list generated by a list output unit. [Figure 6] FIG. 10 is a block diagram showing an example of the configuration of a printing system according to a first modified example. [Figure 7A] 10 is a sequence chart showing an example of the flow of processing executed in a printing system according to a first modification. [Figure 7B] 10 is a sequence chart showing an example of the flow of processing executed in a printing system according to a first modification. [Figure 7C] 10 is a sequence chart showing an example of the flow of processing executed in a printing system according to a first modification. [Figure 8] FIG. 10 is a schematic diagram illustrating an example of a list generated by a list output unit. [Figure 9A] 10 is a sequence chart showing an example of the flow of processing executed in a printing system according to Modification 2. [Figure 9B] 10 is a sequence chart showing an example of the flow of processing executed in a printing system according to Modification 2. [Figure 10] 10 is a sequence chart showing an example of the flow of processing executed in a printing system according to Modification 2. [Figure 11] 10 is a sequence chart showing an example of the flow of processing executed in a printing system according to a third modification. [Figure 12] 10 is a sequence chart showing an example of the flow of processing executed in a printing system according to a third modification. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments and the like will be described with reference to the drawings. For clarity of explanation, the following description and drawings have been omitted and simplified as appropriate. In addition, the same elements in each drawing are given the same reference numerals, and duplicate explanations will be omitted as necessary.

[0010] As described above, when an image that matches the user's desires is obtained from another device, the process of obtaining the image that matches the user's desire may take time, causing the user to wait for a long time. Therefore, this disclosure (particularly, Modification 2 described after the embodiment) describes a printing system that can reduce the number of times the user has to wait for a long time by limiting the execution of the process of obtaining an image from another device. Note that this disclosure first describes the following embodiment as a technology related to a technology that solves the above-mentioned problem.

[0011] <Embodiment> FIG. 1 is a block diagram showing an example of the configuration of a printing system 10 according to an embodiment. In the example shown in FIG. 1, the printing system 10 includes an information processing device 100, an image forming device 200, a storage 300, an audio input / output device 410, an audio processing server 420, an image generation AI server 500, and a text generation AI server 600. The information processing device 100, the image forming device 200, the storage 300, the audio input / output device 410, the audio processing server 420, the image generation AI server 500, and the text generation AI server 600 are connected to a network N such as the Internet. Note that a user U shown in FIG. 1 is a user who wishes to print an image using the image forming device 200. Although one user U is shown in FIG. 1, multiple users may use the printing system 10.

[0012] The information processing device 100 is a device that performs processing to cause the image forming device 200 to print an image based on an instruction from a user U. The information processing device 100 is, for example, a server, but is not limited to a server and may be any device that has the functionality of a computer. The information processing device 100 may be configured from multiple computers (multiple servers). Details of the information processing device 100 will be described later.

[0013] Image forming apparatus 200 is an apparatus having a function for performing printing processing, and specifically, for example, a printer. Image forming apparatus 200 is registered in advance in information processing apparatus 100 as an image forming apparatus to be used for printing. Note that, although one image forming apparatus 200 is illustrated in FIG. 1, multiple image forming apparatuses 200 may be registered in information processing apparatus 100 as image forming apparatuses available for printing. For example, an image forming apparatus 200 may be registered in information processing apparatus 100 for each user. In this embodiment, information processing apparatus 100 causes image forming apparatus 200 associated with user U's account (identification information) to perform printing based on an instruction from user U.

[0014] The storage 300 is a storage that stores images acquired by the information processing device 100 and information related to the images. In the present embodiment, the storage 300 is specifically a cloud storage that stores data, but it does not necessarily have to be configured as a cloud storage. For example, the storage 300 only needs to be communicably connected to the information processing device 100, and does not necessarily have to be connected to the network N. Furthermore, the storage 300 may be built into the information processing device 100.

[0015] The audio input / output device 410 is a device that acquires audio from the user U and outputs audio to the user U. The audio input / output device 410 is, for example, a device that includes a microphone and a speaker. Specifically, the audio input / output device 410 is, for example, a smart speaker, but may also be, for example, a smartphone or a tablet terminal. The audio input / output device 410 transmits audio data of the user U to the audio processing server 420. Furthermore, the audio input / output device 410 outputs the audio data transmitted from the audio processing server 420 as audio. Note that when multiple users use the printing system 10, the printing system 10 may include multiple audio input / output devices 410.

[0016] The voice processing server 420 performs known voice recognition processing to acquire instructions contained in the voice uttered by the user U. In the present embodiment, the voice processing server 420 acquires instructions related to processing of the printing system 10. For example, the voice processing server 420 acquires the instructions of the user U by extracting keywords that may be related to processing of the printing system 10 from the voice of the user U. The voice processing server 420 transmits the acquired instructions to the information processing device 100 as instruction information. Note that the voice processing server 420 may include identification information of the user U, which is registered in advance in the voice processing server 420, in the instruction information of the user U and transmit it to the information processing device 100.

[0017] Furthermore, the voice processing server 420 acquires text data, which is data of a sentence to be output aloud from the voice input / output device 410, from the information processing device 100. The voice processing server 420 converts the acquired text data into voice data and transmits it to the voice input / output device 410. As a result, the voice input / output device 410 outputs the sentence transmitted by the information processing device 100 aloud. Note that the voice processing server 420 may be configured from multiple servers.

[0018] In this disclosure, the audio input / output device 410 and the audio processing server 420 will be collectively referred to as the audio system 400.

[0019] Both the image generation AI server 500 and the text generation AI server 600 are servers that provide so-called generative AI (generative artificial intelligence) services.

[0020] The image generation AI server 500 is a server that provides image generation AI services. The image generation AI server 500 generates an image using an image generation model trained by machine learning such as deep learning. When the image generation AI server 500 receives an image generation command called a prompt, it generates an image using an image generation model based on the received image generation command. In this embodiment, the image generation AI server 500 generates an image based on the image generation command transmitted from the information processing device 100 and transmits the generated image to the information processing device 100. The image generation AI server 500 may provide a known image generation AI service. The image generation AI server 500 may be configured with multiple servers. The printing system 10 may also include multiple image generation AI servers 500 that provide different image generation AI services. In this case, the information processing device 100 may transmit an image generation command to any one image generation AI server 500 selected from the multiple image generation AI servers 500.

[0021] The text generation AI server 600 is a server that provides text generation AI services. The text generation AI server 600 generates text using a large language model (LLM) trained by machine learning such as deep learning. When the text generation AI server 600 receives a text generation command called a prompt, it generates text using the LLM based on the received text generation command. In this embodiment, the text generation AI server 600 generates text based on the text generation command transmitted from the information processing device 100 and transmits the generated text to the information processing device 100. The text generation AI server 600 may provide a known text generation AI service. The text generation AI server 600 may be configured with multiple servers. The printing system 10 may also include multiple text generation AI servers 600 that provide different text generation AI services. In this case, the information processing device 100 may transmit a text generation command to any one of the multiple text generation AI servers 600 selected from the multiple text generation AI servers 600.

[0022] Next, a specific configuration and processing of the information processing device 100 will be described. Fig. 2 is a block diagram showing an example of the configuration of the information processing device 100. As shown in Fig. 2, the information processing device 100 has a processor 110, a memory 130, and a network interface 150. In this way, the information processing device 100 has the functions of a computer.

[0023] The network interface 150 is used for communication over the network N. The network interface 150 may include, for example, a network interface card (NIC).

[0024] The memory 130 is configured, for example, by a combination of volatile memory and non-volatile memory, and is used to store programs executed by the processor 110, data used for various processes, and the like.

[0025] The processor 110 reads and executes a program from the memory 130. As a result, the processor 110 realizes the functions of an instruction information acquisition unit 111, a text request unit 112, a text acquisition unit 113, an image request unit 114, an image acquisition unit 115, a processing unit 116, a storage control unit 117, a list output unit 118, a print control unit 119, and a user interface processing unit 120, which will be described later. The processor 110 may be, for example, a microprocessor, an MPU (Micro Processor Unit), or a CPU (Central Processing Unit). The processor 110 may include multiple processors.

[0026] The instruction information acquisition unit 111, text request unit 112, text acquisition unit 113, image request unit 114, image acquisition unit 115, processing unit 116, memory control unit 117, list output unit 118, print control unit 119, and user interface processing unit 120 will be described below.

[0027] The instruction information acquisition unit 111 acquires instruction information, which is information indicating an instruction from the user U to the printing system 10. The instruction information acquisition unit 111 may acquire the instruction information of the user U together with the identification information of the user U. In this embodiment, the instruction information acquisition unit 111 acquires instruction information input by voice by the user via the voice system 400. This eliminates the need for the user U to manually operate an input device such as a keyboard or a pointing device, or buttons on an operation panel, thereby improving convenience.

[0028] Specifically, the instruction information acquisition unit 111 acquires print instruction information, which is instruction information that includes a designation of a drawing target and instructs printing. For example, when the user U instructs the printing system 10 to print an image, the user U vocally inputs to the printing system 10 a keyword (e.g., "print") that instructs printing and a keyword (e.g., "fox," "raccoon dog," "autumn fruit") that designates an object that the user wants to be drawn in the image printed by the image forming apparatus 200. The information thus input to the printing system 10 is acquired by the instruction information acquisition unit 111 as print instruction information.

[0029] The print instruction information may include information other than the designation of the drawing target. For example, the print instruction information may include designation of a drawing style. Here, designation of a drawing style refers to designating how the drawing target is to be drawn. For example, the designation of the drawing style may designate that the drawing target is to be drawn as a coloring book, or may designate the type of line to be used to draw the drawing target (e.g., crayon, ink, pen, etc.), or may designate what effect (e.g., blur effect, sharp effect, etc.) to be applied to draw the drawing target.

[0030] The instruction information acquisition unit 111 is not limited to print instruction information and can acquire any instruction information from the user U. In this embodiment, the instruction information acquisition unit 111 acquires selection instruction information, which is instruction information including an instruction to select an image to be printed from a plurality of different images listed in a list created by the list output unit 118, which will be described later. For example, when a list listing a plurality of different images is output, the user U performs a voice input to the printing system 10 to select an image to be printed from these images. The information input to the printing system 10 in this manner is acquired by the instruction information acquisition unit 111 as selection instruction information. Note that the instruction information acquisition unit 111 may also acquire instruction information requesting output of the above-mentioned list.

[0031] The image request unit 114 performs processing to request an image from a device other than the information processing device 100. In this embodiment, the image request unit 114 performs processing to request an image from the image generation AI server 500. Specifically, the image request unit 114 transmits to the image generation AI server 500 an image generation command generated based on the print instruction information acquired by the instruction information acquisition unit 111.

[0032] The image generation command is a command instructing the image generation AI server 500 to generate an image, and is a statement known as a prompt. For example, the image request unit 114 generates an image generation command (prompt) instructing the image generation AI server 500 to generate an image in which the drawing target specified in the print instruction information is drawn, and transmits the image generation command (prompt) to the image generation AI server 500. If the print instruction information also includes a drawing style specification, the image request unit 114 generates an image generation command (prompt) instructing the image generation AI server 500 to generate an image in which the drawing target specified in the print instruction information is drawn in the drawing style specified in the print instruction information, and transmits the image generation command (prompt) to the image generation AI server 500. In this way, the image request unit 114 may transmit an image generation command generated based on the drawing target and drawing style specification to the image generation AI server. This makes it easy to obtain an image in which the specified drawing target is drawn in the specified drawing style.

[0033] As described above, the printing system 10 may include multiple image generation AI servers 500 that provide different image generation AI services. In this case, the image request unit 114 transmits an image generation command to a selected image generation AI server 500 from among the multiple image generation AI servers 500. When selecting one of the multiple image generation AI servers 500 that provide different image generation AI services, the image generation AI server 500 (i.e., the image generation AI service) may be selected according to setting information that configures the operation of the information processing device 100 and is pre-stored in the memory 130 or the like. This selection may also be made based on an instruction from the user U. When the image generation AI server 500 (image generation AI service) is selected based on an instruction from the user U, the print instruction information acquired from the user U may include information that identifies the image generation AI service to be used. In this way, the image request unit 114 may transmit an image generation command to a selected image generation AI server 500 from among the multiple different image generation AI servers 500. This enables the user to select a service to use from a variety of image generation AI services, improving convenience.

[0034] The image request unit 114 may request multiple different images in which a specified drawing target is drawn from the image generation AI server 500. In this case, the image request unit 114 sends an image generation command to the image generation AI server 500 instructing the generation of multiple different images. The image request unit 114 may request multiple different images from the image generation AI server 500 when the instruction information acquisition unit 111 acquires instruction information requesting the output of a list in which multiple different images are listed, or may request multiple different images regardless of whether such instruction information has been acquired.

[0035] As described above, the image request unit 114 may generate the image generation command, but the image generation command may also be generated by the text generation AI server 600. In this embodiment, the information processing device 100 has a text request unit 112 and a text acquisition unit 113 as a configuration for transmitting the image generation command generated by the text generation AI server 600 to the image generation AI server 500. Note that when the image generation command is generated by the text generation AI server 600, the image request unit 114 does not need to perform the process of generating the image generation command.

[0036] The text request unit 112 performs processing to request text from the text generation AI server 600. Specifically, the text request unit 112 generates a text generation command based on the print instruction information acquired by the instruction information acquisition unit 111.

[0037] The text generation command is a command that instructs the text generation AI server 600 to generate text, and is a sentence known as a prompt. More specifically, the text request unit 112 generates a text generation command that instructs the text generation AI server 600 to generate an image generation command (prompt) that instructs the image generation AI server 500 to generate an image in which the drawing target specified in the print instruction information is drawn. If the print instruction information also includes a drawing style specification, the text request unit 112 generates a text generation command that instructs the text generation AI server 600 to generate an image generation command (prompt) that instructs the image generation AI server 500 to generate an image in which the drawing target specified in the print instruction information is drawn in the drawing style specified in the print instruction information.

[0038] The text generation instruction preferably includes information identifying the image generation AI service provided by the image generation AI server 500 to which the generated image generation instruction is to be sent. In other words, the text generation instruction preferably specifies for which image generation AI service a prompt should be generated. Generally, different image generation AI services have different prompt formats appropriate for obtaining the desired image. Therefore, in order to generate an appropriate prompt according to the image generation AI service being used, the text request unit 112 preferably generates a text generation instruction including information identifying the image generation AI service.

[0039] If the generation of multiple different images is required, the text request unit 112 generates an image generation instruction that instructs the image generation AI server 500 to generate multiple different images, and generates a text generation instruction that instructs the text generation AI server 600 to generate a text generation instruction.

[0040] The text request unit 112 sends the generated text generation command to the text generation AI server 600.

[0041] As described above, the printing system 10 may include multiple text generation AI servers 600 that provide different text generation AI services. In this case, the text request unit 112 sends a text generation command to a selected text generation AI server 600 from among the multiple text generation AI servers 600. When selecting one of the multiple text generation AI servers 600 that provide different text generation AI services, the text generation AI server 600 (i.e., the text generation AI service) may be selected according to setting information that configures the operation of the information processing device 100 and is pre-stored in the memory 130 or the like. This selection may also be made based on an instruction from the user U. When the text generation AI server 600 (text generation AI service) is selected based on an instruction from the user U, the print instruction information acquired from the user U may include information that identifies the text generation AI service to be used. In this way, the text request unit 112 may send a text generation command to a selected text generation AI server 600 from among the multiple different text generation AI servers 600. This makes it possible to select a service to use from a variety of text generation AI services, improving convenience.

[0042] When a text generation command is sent from the information processing device 100, the text generation AI server 600 generates the text of an image generation command that instructs the image generation AI server 500 to generate an image in which the drawing target specified in the print instruction information is drawn, based on the received text generation command. Note that the text generation AI server 600 may also generate an image generation command in a second natural language (English) based on a text generation command in a first natural language (Japanese).

[0043] When the text generation AI server 600 generates text for the image generation command, it transmits the generated text to the information processing device 100, which is the sender of the text generation command. The information processing device 100 then receives the text. That is, the text acquisition unit 113 acquires from the text generation AI server 600 the text generated by the text generation AI server 600 based on the text generation command transmitted by the text request unit 112. Thereafter, the image request unit 114 transmits the text generated by the text generation AI server 600 to the image generation AI server 500 as an image generation command.

[0044] Generally, the content of images generated by an image generation AI service depends on image generation instructions (prompts). Therefore, in order for the image generation AI server 500 to generate better images, appropriate image generation instructions must be sent to the image generation AI server 500. To send appropriate image generation instructions, it is necessary to generate image generation instructions that include not only the information contained in the print instruction information but also information that complements the information contained in the print instruction information, written in a format appropriate for the image generation AI service. Here, information that complements the information contained in the instruction information includes negative prompts that specify objects that should not be depicted or drawing styles that should be avoided, information specifying composition, parameters that control the image format, such as image size, etc. It is difficult to generate image generation instructions that include this variety of information in a format appropriate for the image generation AI service using a rule base. In particular, when information is obtained through user voice input, the user is allowed to input more freely than when instructions are entered by operating buttons, making it even more difficult to generate appropriate image generation instructions using a rule base. Furthermore, when various image generation AI services are used, the appropriate format and the information that needs to be complemented vary depending on the image generation AI service. This also makes it difficult to generate appropriate image generation instructions using a rule base. In contrast, by having the text generation AI server 600 generate the image generation command, appropriate image generation command can be easily obtained.

[0045] Note that when generating an image using an image generation AI service, an image is generated even if an appropriate image generation command is not given. Therefore, the information processing device 100 does not necessarily need to use the image generation command generated by the text generation AI server 600. That is, the image generation command generated by the image request unit 114 may be sent to the image generation AI server 500. In this case, the information processing device 100 does not need to have the text request unit 112 and the text acquisition unit 113.

[0046] When an image generation command is transmitted from the information processing device 100, the image generation AI server 500 generates an image based on the received image generation command. After generating an image, the image generation AI server 500 transmits the generated image to the information processing device 100, which transmitted the image generation command. The information processing device 100 then receives the image. Specifically, the image acquisition unit 115 acquires, from the image generation AI server 500, an image generated by the image generation AI server 500 based on the image generation command. If the image generation AI server 500 generates multiple different images based on the image generation command, the image acquisition unit 115 acquires the multiple different images as images in which the specified drawing target is drawn. In this manner, in this embodiment, an image that meets the user U's preferences is acquired using the image generation AI server 500, so a variety of images can be provided to the user U. Therefore, compared to a case in which the user can only select images from image content prepared in advance in the printing system, it is possible to prevent the user from becoming bored with the image content. This makes it possible to print images that satisfy the user.

[0047] The processing unit 116 performs image processing corresponding to the drawing style specified in the print instruction information as necessary. In this embodiment, when the print instruction information includes a drawing style specification in addition to a drawing target specification, and the image acquired by the image acquisition unit 115 is an image in which the drawing target is not drawn in the drawing style, the processing unit 116 performs image processing corresponding to the drawing style specified in the print instruction information. For example, when the image request unit 114 transmits an image generation command generated based only on the drawing target specification to the image generation AI server 500, the processing unit 116 may perform image processing corresponding to the drawing style specified in the print instruction information. Furthermore, when the image generation AI server 500 (image generation AI service) used does not have the function of drawing in the specified drawing style, the processing unit 116 may perform image processing corresponding to the drawing style specified in the print instruction information.

[0048] The image processing performed by the processing unit 116 is, for example, a process of converting an image in which the drawing object is drawn in a manner other than the specified drawing manner into an image in which the drawing object is drawn in the specified drawing manner. Specifically, for example, when the drawing manner is specified to draw the drawing object as a coloring book, the processing unit 116 performs binarization processing and edge extraction processing as the image processing. However, the image processing is not limited to this, and may also be a process of changing the line type or a process of applying an effect. By having the processing unit 116, even if the image acquired by the image acquisition unit 115 is an image in which the drawing object is drawn in the drawing manner specified by the user, an image in which the drawing object is drawn in the drawing manner specified by the user can be obtained.

[0049] The storage control unit 117 performs processing to store the image acquired by the image acquisition unit 115 in the storage 300. When the image processing unit 116 performs image processing, the storage control unit 117 may store the image generated by the image processing in the storage 300.

[0050] The storage control unit 117 may also store other information in association with the image in the storage 300. For example, the storage control unit 117 may store an image in association with print instruction information used to acquire the image in the storage 300. The storage control unit 117 may also store an image in association with identification information of the user U who issued the instruction indicated in the print instruction information used to acquire the image in the storage 300. The storage control unit 117 may also store a list generated by the list output unit 118 (described later) in the storage 300.

[0051] The list output unit 118 performs processing to output a list of multiple different images as print candidates. In this embodiment, when the image acquisition unit 115 acquires multiple different images as images in which the specified drawing target is drawn, the list output unit 118 performs processing to output a list of these multiple different images as print candidates. This list is used by the user U to check the images before printing is executed.

[0052] In this embodiment, list output unit 118 generates a list listing multiple different images as print candidates, and requests print control unit 119 to print the generated list so that image forming apparatus 200 can print it out. Note that list output unit 118 only needs to perform processing to output the list, and does not necessarily have to perform processing to print out the list. For example, list output unit 118 may perform processing to display and output the list on a display or the like of user U's terminal device. By outputting a list listing multiple images, user U can check the images that are print candidates, thereby improving convenience.

[0053] The print control unit 119 performs a process of causing the image forming apparatus 200 to execute printing. Note that the print control unit 119 may cause the image forming apparatus 200 to execute printing via another device (for example, a server) that manages or controls printing by the image forming apparatus 200, rather than directly issuing a print instruction to the image forming apparatus 200.

[0054] Specifically, the print control unit 119 causes the image forming apparatus 200 to print an image acquired by the information processing apparatus 100. When the list output unit 118 generates a list listing multiple different images on which the specified drawing target is drawn as print candidates, the print control unit 119 causes the image forming apparatus 200 to print the list. When the instruction information acquisition unit 111 acquires selection instruction information including an instruction to select a print target from the multiple different images listed in the list, the print control unit 119 causes the image forming apparatus 200 to print the image selected from the multiple different images listed by the selection instruction information. This allows the user U to freely select an image from the listed images and obtain a printed copy of that image, thereby improving convenience. When printing an image selected from the multiple different images listed, the print control unit 119 acquires the selected image from the storage 300 and causes the image forming apparatus 200 to print the acquired image. As described above, the images acquired by the image acquisition unit 115 are stored in the storage 300. Therefore, the image acquisition unit 115 does not need to acquire the selected image again, and the processing can be simplified.

[0055] The user interface processing unit 120 performs processing such as outputting a response to the instruction information acquired by the instruction information acquisition unit 111 and outputting the status of processing currently being performed in the printing system 10. In this embodiment, the above-mentioned responses and status are communicated to the user U via the voice system 400, so the user interface processing unit 120 transmits text data, which is data of sentences to be output by voice from the voice input / output device 410, to the voice processing server 420. To transmit the text data, the user interface processing unit 120 may appropriately use information acquired by the instruction information acquisition unit 111, as necessary. For example, the user interface processing unit 120 may generate text data by appropriately referencing print instruction information stored in the storage 300 in association with an image.

[0056] In particular, the user interface processing unit 120 outputs a message prompting the user U to input information to be added as print instruction information, as specifically exemplified in a sequence chart described later. This makes it possible to obtain more specific instructions regarding the image the user desires.

[0057] Next, an example of the processing flow of the printing system 10 will be described using a sequence chart. FIGS. 3A and 3B are sequence charts showing an example of the processing flow executed in the printing system 10 according to the embodiment. Note that, although the description here takes as an example a case where the user U wishes to print an image of a coloring book, the printing system 10 can print various images according to the user U's wishes, such as an image of a pattern for design paper or a photographic image. This also applies to the other sequence charts described later. Below, the processing flow of the printing system 10 will be described with reference to FIGS. 3A and 3B.

[0058] In this example, first, in steps S100 to S113, the information processing device 100 acquires print instruction information via the audio system 400 (audio input / output device 410 and audio processing server 420). Specifically, the information acquired in steps S101, S105, and S109 described below corresponds to the print instruction information.

[0059] In step S100, the user U utters, for example, "Print me a coloring book" to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S101, the voice processing server 420 transmits print instruction information specifying a coloring book as the drawing style to the information processing device 100. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0060] Next, in step S102, the user interface processing unit 120 transmits text data of the sentence "This is a coloring book. What kind of picture would you like it to be?" to the voice processing server 420 as a response to the print instruction information acquired in step S101. The text data is converted into voice data by the voice processing server 420, and in step S103, the voice is output as voice from the voice input / output device 410.

[0061] In step S104, the user U utters, for example, "fox and raccoon dog" to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S105, the voice processing server 420 transmits print instruction information specifying "fox" and "raccoon dog" as the drawing targets to the information processing device 100. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0062] Next, in step S106, the user interface processing unit 120 transmits text data of the sentence "What background would you like?" to the voice processing server 420 as a response to the print instruction information acquired in step S105. The text data is converted into voice data by the voice processing server 420, and in step S107, the voice is output as voice from the voice input / output device 410.

[0063] In step S108, the user U utters, for example, "autumn fruits" to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S109, the voice processing server 420 transmits print instruction information specifying "autumn" and "fruits" as the background to be drawn to the information processing device 100. The instruction information acquisition unit 111 of the information processing device 100 then acquires this information.

[0064] Next, in step S110, the user interface processing unit 120 sends text data of the sentence "Would you like to add anything else?" to the voice processing server 420 as a response to the print instruction information acquired in step S109. The text data is converted into voice data by the voice processing server 420, and in step S111, the voice is output as voice from the voice input / output device 410.

[0065] In step S112, since the user U has no items to add to the drawing subject or drawing style, he or she utters "none" to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S113, the voice processing server 420 transmits instruction information indicating that there is no item to add to the information processing device 100. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0066] Steps S102, S106, and S110 are specific examples of output prompting the user U to input information to be added as print instruction information. By performing such output, the user U can obtain more specific instructions regarding the image that he or she wishes to print.

[0067] Next, in step S114, the text request unit 112 of the information processing device 100 generates a text generation command for causing the text generation AI server 600 to generate text based on the print instruction information acquired in the series of steps described above. In this example, the text request unit 112 generates a text generation command (prompt) that instructs the image generation AI server 500 to generate an image drawn as a coloring book, with autumn fruits arranged in the background and a fox and a raccoon dog arranged in the foreground. Then, the text request unit 112 transmits the generated text generation command to the text generation AI server 600.

[0068] When the text generation AI server 600 receives the text generation command, it generates text for the image generation command based on the received text generation command and transmits it to the information processing device 100 in step S115. Then, the text acquisition unit 113 of the information processing device 100 acquires the image generation command generated by the text generation AI server 600.

[0069] In the example shown here, the image generation command is generated using the text generation AI server 600, but as mentioned above, it is not necessary to use the text generation AI server 600 to generate the image generation command.

[0070] In step S116, in order to notify the user U of the current processing status, the user interface processing unit 120 transmits text data, for example, a sentence such as "Image is currently being generated," to the voice processing server 420. The text data is converted into voice data by the voice processing server 420, and in step S117, the voice is output as voice from the voice input / output device 410.

[0071] Next, in step S118, the image request unit 114 of the information processing device 100 transmits the image generation command acquired in step S115 to the image generation AI server 500. Upon receiving the image generation command, the image generation AI server 500 generates an image based on the received image generation command, and in step S119 transmits the generated image to the information processing device 100. As a result, the image acquisition unit 115 of the information processing device 100 acquires an image drawn as a coloring book, with autumn fruits arranged in the background and a fox and a raccoon dog arranged in the foreground. Note that the memory control unit 117 may store the image acquired by the image acquisition unit 115 in the storage 300. Also, as described above, the processing unit 116 may perform image processing on the image acquired in step S119, as necessary.

[0072] Next, in step S120, in order to notify the user U of the current processing status, the user interface processing unit 120 transmits text data, for example, a sentence such as "Print a coloring book of a fox and a raccoon dog with autumn fruits in the background," to the voice processing server 420. The text data is converted into voice data by the voice processing server 420, and in step S121, the voice is output as voice from the voice input / output device 410.

[0073] Next, in step S122, print control unit 119 performs processing to cause image forming apparatus 200 to print the image acquired in step S119 or an image obtained by performing image processing on that image. In the example shown here, print control unit 119 transmits print data for the image to image forming apparatus 200 and causes image forming apparatus 200 to print the image. As described above, print control unit 119 may cause image forming apparatus 200 to print via another device (e.g., a server) that manages or controls printing by image forming apparatus 200. In this case, print control unit 119 may transmit the image to a device that manages or controls printing, and that device may transmit the print data to image forming apparatus 200. This also applies to other sequence charts described later.

[0074] Next, in step S123, image forming apparatus 200 prints the image, allowing user U to obtain a printed coloring book of a fox and a raccoon dog against a background of autumn fruits.

[0075] Next, Figures 4A to 4C are sequence charts showing another example of the flow of processing executed in the printing system 10 according to the embodiment. In the processing described with reference to Figures 3A and 3B, one image is generated and the generated image is printed. In contrast, in the processing described with reference to Figures 3A and 3B, multiple images are generated and a list of these images is presented to the user U. Hereinafter, another example of the flow of processing in the printing system 10 will be described with reference to Figures 4A to 4C.

[0076] The processing from step S200 to step S211 in Fig. 4A is the same as the processing from step S100 to step S111 shown in Fig. 3A, and therefore description thereof will be omitted. In the example shown here, after step S211, in step S212, the user U utters, for example, "Show me a list of samples" to the voice input / output device 410 to request output of the list. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S213, the voice processing server 420 transmits instruction information instructing output of the list to the information processing device 100. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0077] Next, in step S214, the text request unit 112 of the information processing device 100 generates a text generation command for causing the text generation AI server 600 to generate text based on the instruction information acquired in the series of steps described above. Step S214 differs from the above-described step S114 in that a text generation command (prompt) is generated to instruct the image generation AI server 500 to generate an image generation command (prompt) for generating multiple images. The text request unit 112 transmits the generated text generation command to the text generation AI server 600. Note that when multiple images are generated, the number of images to be generated may be, for example, a predetermined number (e.g., five), or may be specified by the user U. When the number of images is specified by the user U, instruction information specifying the number of images is acquired by the instruction information acquisition unit 111.

[0078] When the text generation AI server 600 receives the text generation command, it generates text of an image generation command for generating multiple images based on the received text generation command, and in step S215 transmits it to the information processing device 100. Then, the text acquisition unit 113 of the information processing device 100 acquires the image generation command generated by the text generation AI server 600.

[0079] In the example shown here, image generation instructions are generated using the text generation AI server 600, but as mentioned above, it is not necessary to use the text generation AI server 600 to generate the image generation instructions. Also, in the example shown here, when an instruction to output a list is given from user U as in step S212, multiple images are acquired and the list is output, but multiple images may be acquired and the list may be output regardless of whether or not such an instruction is given from user U.

[0080] In steps S216 and S217, the same processes as in steps S116 and S117 are performed to notify the user U of the current processing status.

[0081] Next, in step S218, the image request unit 114 of the information processing device 100 transmits the image generation command acquired in step S215 to the image generation AI server 500 for generating multiple images. Upon receiving the image generation command, the image generation AI server 500 generates multiple images based on the received image generation command, and in step S219 transmits the generated multiple images to the information processing device 100. Here, as an example, it is assumed that five images are generated and transmitted to the information processing device 100.

[0082] In step S220, memory control unit 117 stores the images acquired in step S219 in storage 300. Then, in step S221, list output unit 118 generates a list that lists the multiple images acquired in step S219 as candidates for printing.

[0083] 5 is a schematic diagram showing an example of a list generated by the list output unit 118. In the example shown in FIG. 5, the list 90 includes thumbnail images 91_1 to 91_5 of five different images acquired in step S219. Each thumbnail image is assigned a number 92_1 to 92_5 as an identifier for identifying the image. In order to store the correspondence between the identifier and the image, the storage control unit 117 preferably associates the identifier of each image shown in the list with the image corresponding to the identifier and stores the identifier in the storage 300.

[0084] Next, in step S222, in order to notify the user U of the current processing status, the user interface processing unit 120 transmits text data, for example, a sentence such as "Print a coloring list of foxes and raccoon dogs with autumn fruits in the background," to the voice processing server 420. The text data is converted into voice data by the voice processing server 420, and in step S223, the voice data is output as voice from the voice input / output device 410.

[0085] In step S224, list output unit 118 requests print control unit 119 to print the generated list. In response to this, print control unit 119 performs processing to cause image forming device 200 to print the list generated in step S221. As a result, in step S225, image forming device 200 prints a list in which multiple images are listed as print candidates.

[0086] After checking the list, the user U selects an image that he or she wishes to print from the listed images. Then, in step S226, the user U utters, for example, "Print number 3 on the coloring list," to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S227, the voice processing server 420 transmits selection instruction information to the information processing device 100 to select the coloring image number 3 on the list as the image to be printed. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0087] Next, in step S228, the print control unit 119 obtains the image selected by the selection instruction information from the storage 300. Also, in step S229, in order to notify the user U of the current processing status, the user interface processing unit 120 transmits text data, for example, a sentence such as "Print coloring book number 3, featuring a fox and a raccoon dog with autumn fruit in the background," to the voice processing server 420. The text data is converted into voice data by the voice processing server 420, and in step S230, the voice data is output as voice from the voice input / output device 410.

[0088] In step S231, the print control unit 119 performs processing to cause the image forming device 200 to print the image obtained from the storage 300 in step S228. Next, in step S232, the image forming device 200 prints the image. This allows the user U to obtain a printout of the image selected from the list.

[0089] Below, several modifications of the above-described embodiment will be described. <Variation 1> First, a description will be given of Modification 1. Modification 1 differs from the above-described embodiment in that the list includes a code image indicating an access destination for obtaining the images listed in the list from storage 300. Below, a description will be given of features or operations that differ from the above-described embodiment, and a description of similar features or operations will be omitted as appropriate.

[0090] Fig. 6 is a block diagram showing an example of the configuration of a printing system 10a according to Modification 1. The configuration of the printing system 10a shown in Fig. 6 differs from the configuration of the printing system 10 shown in Fig. 1 in that it includes a terminal device 700 for reading code images included in a list. The terminal device 700 is also connected to the network N.

[0091] The terminal device 700 is a device operated by a user U, such as a smartphone, a tablet terminal, or a personal computer. The terminal device 700 includes a reading device 710 such as a camera for reading a code image, an input device 720 such as a button or pointing device for receiving input operations from the user U, and a display 730. The terminal device 700 may also include a touch panel in which the input device 720 and the display 730 are integrated into one unit. Preferably, the terminal device 700 is installed with application software (hereinafter referred to as a print app) for causing the image forming device 200 to print an image in accordance with an instruction from the user U via the input device 720. When the terminal device 700 and the image forming device 200 communicate with each other, the network N does not necessarily need to be used, and the two may communicate directly.

[0092] In this modification, the list output unit 118 of the information processing device 100 lists a plurality of different images as print candidates and generates a list including a code image for retrieving each image stored in the storage 300 from the storage 300. Here, the code image is, for example, a two-dimensional code image such as a QR code (registered trademark), but may also be a one-dimensional code image such as a barcode. The code image is an image in which information indicating an access destination for retrieving the images listed in the list from the storage 300 is coded. More specifically, the code image is an image in which information indicating the storage location of the image data stored in the storage 300 (for example, a Uniform Resource Identifier (URI)) is coded. In this way, in this modification, a list including the code image is output.

[0093] The terminal device 700 reads the code image in the output list using the reading device 710 and accesses the image stored in the storage 300. For example, the user U reads the code image of an image that he or she wishes to print using the reading device 710. This allows the image to be displayed on the display 730 of the terminal device 700, and also allows the image to be printed by the image forming device 200 via a printing app.

[0094] 7A to 7C are sequence charts showing an example of the flow of processing executed in the printing system 10a according to Modification 1. The flow of processing in the printing system 10a according to Modification 1 will be described below with reference to FIGS. 7A to 7C.

[0095] The processing from step S300 to step S318 in FIG. 7A is the same as the processing from step S200 to step S218 shown in FIG. 4A, and the processing from step S319 to step S320 in FIG. 7B is the same as the processing from step S219 to step S220 in FIG. 4B, so description of these will be omitted.

[0096] In the first modification, after step S320, in step S321, the list output unit 118 of the information processing device 100 generates a list that lists the images acquired in step S319 as print candidates. In particular, the list output unit 118 generates a list that includes a code image for acquiring each image stored in the storage 300 from the storage 300.

[0097] Fig. 8 is a schematic diagram showing an example of a list generated by the list output unit 118 in Modification 1. In the example shown in Fig. 8, list 90a lists thumbnail images 91_1 to 91_5 of five different images acquired in step S319. Each thumbnail image is assigned a number 92_1 to 92_5 as an identifier for identifying the image. Furthermore, list 90a lists code images 93_1 to 93_5 that indicate access destinations for acquiring each image corresponding to each thumbnail image from storage 300.

[0098] Next, in steps S322 and S323, the same processes as in steps S222 and S223 are performed to notify the user U of the current processing status.

[0099] Then, in step S324, the list output unit 118 requests the print control unit 119 to print the list including the code image. In response to this, the print control unit 119 performs processing to cause the image forming apparatus 200 to print the list including the code image generated in step S321. As a result, in step S325, the image forming apparatus 200 prints a list in which multiple images are listed as print candidates and which indicates the access destination of each image.

[0100] Next, in step S326, the user U checks the list and reads the code image of the image that the user wants to print from the listed images using the terminal device 700. Here, as an example, this reading is performed via a printing application.

[0101] Next, in step S327, the terminal device 700 acquires the image stored in the storage 300 based on the read code image. This image acquisition process is executed by, for example, a print application. In the example shown here, it is assumed that the code image corresponding to the third image in the list is read and the third image in the list is acquired by the processes of steps S326 and S327.

[0102] Next, in step S328, the user U operates the input device 720 of the terminal device 700 to instruct the print application to print an image corresponding to the read code image.

[0103] Next, in step S329, to inform user U of the current processing status, the printing application displays a message on the display 730 of the terminal device 700, such as "Printing coloring book number 3 of a fox and raccoon dog with autumn fruit in the background."

[0104] In step S330, the printing application of the terminal device 700 performs processing to cause the image forming device 200 to print the image acquired from the storage 300 in step S327. In the example shown here, the printing application transmits print data of the image to the image forming device 200 and causes the image forming device 200 to print the image. Note that the printing application may cause the image forming device 200 to print via the information processing device 100 or via another device that manages or controls printing by the image forming device 200.

[0105] Next, in step S331, the image forming apparatus 200 prints the image, thereby allowing the user U to obtain a printout of the image corresponding to the read code image.

[0106] In this modification, the list output by the information processing device 100 includes a code image indicating an access destination for obtaining the listed images from the storage 300. This allows the terminal device 700 to easily access the images stored in the storage 300, and the images can be easily used on the terminal device 700.

[0107] <Variation 2> Next, Variation 2 will be described. The process by which the information processing device 100 acquires an image that matches the user's wishes, particularly the process of acquiring an image from the image generation AI server 500, can take a long time. This means that the user U has to wait a long time before the image can be printed. Therefore, this variation differs from the above-described embodiment in that the information processing device 100 is limited in its ability to acquire images from other devices, such as the image generation AI server 500. Below, we will describe features or operations that differ from the above-described embodiment or variation, and will omit descriptions of similar features or operations as appropriate.

[0108] In this modification, if an image corresponding to the print instruction information acquired by the instruction information acquisition unit 111 is not stored in the storage 300, the image request unit 114 uses the print instruction information to request the image generation AI server 500 to send an image in which the specified drawing target is drawn. That is, only if an image corresponding to the print instruction information acquired by the instruction information acquisition unit 111 is not stored in the storage 300, the image request unit 114 transmits an image generation command generated based on the print instruction information to the image generation AI server 500. This limits the cases in which the image generation AI server 500 is used, reducing the number of times the user U has to wait for long periods of time.

[0109] More specifically, in this modified example, storage control unit 117 and image request unit 114 operate as follows. Here, print instruction information acquired by instruction information acquisition unit 111 at a first time point is referred to as first print instruction information, and print instruction information acquired by instruction information acquisition unit 111 at a second time point is referred to as second print instruction information. Also, it is assumed that an image corresponding to the first print instruction information is not stored in storage 300 at the first time point.

[0110] In this modification, the image request unit 114 requests the image generation AI server 500 to transmit an image on which the drawing target specified in the first print instruction information is drawn, and the image acquisition unit 115 acquires the image from the image generation AI server 500. At this time, the memory control unit 117 associates the acquired image with tag information obtained from the first print instruction information used to acquire the image and stores the image in the storage 300. Here, the tag information obtained from the print instruction information may specifically be information indicating the drawing target specified by the print instruction information, or information indicating the drawing format specified by the print instruction information. The tag information stored in the storage 300 in association with the image is used to search for the image in the storage 300.

[0111] Then, at a second time point after the first time point, when the instruction information acquisition unit 111 acquires second print instruction information, if there is no image stored in storage 300 in association with tag information corresponding to this second print instruction information, the image request unit 114 uses this second print instruction information to request the image generation AI server 500 to send an image. In this case, the print control unit 119 causes the image forming device 200 to print the image newly acquired from the image generation AI server 500 by the image acquisition unit 115.

[0112] In contrast, if there is an image stored in storage 300 in association with tag information corresponding to the second print instruction information, the image request unit 114 does not request the image generation AI server 500 to send the image, and the print control unit 119 retrieves the image from storage 300 and causes the image forming device 200 to print the retrieved image.

[0113] Here, the tag information corresponding to the second print instruction information is tag information that matches or is similar to the tag information obtained from the second print instruction information. That is, when the second print instruction information is obtained, an image is obtained from the image generation AI server 500 only if there is no image stored in the storage 300 associated with tag information that matches or is similar to the tag information obtained from the second print instruction information. For example, the image acquisition unit 115 searches the storage 300 for an image associated with tag information indicating a drawing object that matches or is similar to the drawing object specified in the second print instruction information, and also associated with tag information indicating a drawing style that matches or is similar to the drawing style specified in the second print instruction information. Then, only if there is no such image, the image acquisition unit 115 acquires the image generated by the image generation AI server 500. Note that it may be possible to check whether an image corresponding to the second print instruction information is stored in the storage 300 by focusing on either the drawing object or the drawing style.

[0114] Note that information other than the tag information described above may be associated with an image acquired from the image generation AI server 500 and stored in the storage 300. For example, the identification information of the user U who issued the instruction indicated in the first print instruction information may be associated with the image. That is, the storage control unit 117 may store an image acquired from the image generation AI server 500 in the storage 300, associating it with the tag information obtained from the first print instruction information used to acquire the image and the identification information of the user U included in the first print instruction information. Then, if the image stored in the storage 300 in association with the identification information of the user U included in the second print instruction information and the tag information corresponding to the second print instruction information is not present in the storage 300, the image request unit 114 uses the second print instruction information to request the image generation AI server 500 to transmit the image. In this case, the print control unit 119 causes the image forming device 200 to print the image newly acquired from the image generation AI server 500 by the image acquisition unit 115. In response to this, if an image stored in storage is associated with the identification information of user U included in the second print instruction information and tag information corresponding to the second print instruction information, the print control unit 119 causes the image forming apparatus 200 to print the image acquired from the storage 300. This configuration allows images to be reused for each user. Note that when print instruction information for a certain user is acquired, if an image of that user is not available in the storage 300, an image of another user may be acquired. In other words, if an image associated with tag information corresponding to the second print instruction information but associated with user identification information different from the identification information of user U included in the second print instruction information is available in the storage 300, the image acquisition unit 115 may acquire the image. This configuration can promote image reuse.

[0115] 9A to 9B and 10 are sequence charts showing an example of the flow of processing executed in the printing system 10 according to Modification 2. In particular, FIGS. 9A to 9B are sequence charts showing an example of processing by the printing system 10 at a first point in time when first instruction information is acquired. Also, FIG. 10 is a sequence chart showing an example of processing by the printing system 10 at a second point in time when second instruction information is acquired. It is assumed that, at the first point in time, an image corresponding to the first print instruction information is not stored in the storage 300. First, the flow of processing by the printing system 10 according to Modification 2 at the first point in time will be described with reference to FIGS. 9A to 9B.

[0116] The processes from step S400 to step S413 in Fig. 9A are the same as the processes from step S100 to step S113 shown in Fig. 3A. That is, in steps S400 to S413, information processing device 100 acquires first print instruction information. Specifically, the information acquired in steps S401, S405, and S409 corresponds to the first print instruction information.

[0117] In Modification 2, after step S413, in step S414, the image acquisition unit 115 references the storage 300 and checks whether an image corresponding to the instruction from the user U is stored in the storage 300. That is, the image acquisition unit 115 checks whether an image stored in association with tag information corresponding to the first print instruction information is in the storage 300. In this case, such an image is not stored in the storage 300, so in step S415, the image acquisition unit 115 fails to acquire the image from the storage 300. Therefore, in the following steps S416 to S421, processing is performed to acquire the image from the image generation AI server 500. Note that the processing from step S416 to step S421 is similar to the processing from step S114 to step S119 shown in FIGS. 3A and 3B, and therefore description thereof will be omitted.

[0118] After step S421, in step S422, the storage control unit 117 associates the image acquired from the image generation AI server 500 in step S421 with tag information obtained from the first print instruction information and stores it in the storage 300. As described above, the storage control unit 117 may also associate the identification information of the user U with the image and store it in the storage 300.

[0119] Thereafter, in steps S423 to S426, processing is performed to print the image acquired from the image generation AI server 500 by the image forming device 200. Note that the processing from steps S423 to S426 is similar to the processing from steps S120 to S123 shown in FIG. 3B, and therefore a description thereof will be omitted.

[0120] Next, the flow of processing of the printing system 10 according to the second modification at the second point in time will be described with reference to FIG.

[0121] The processes from step S500 to step S513 in Fig. 10 are the same as the processes from step S100 to step S113 shown in Fig. 3A. That is, in steps S500 to S513, information processing device 100 acquires second print instruction information. Specifically, the information acquired in steps S501, S505, and S509 corresponds to the second print instruction information.

[0122] After step S513, in step S514, the image acquisition unit 115 refers to the storage 300 and checks whether an image corresponding to the user U's instruction is stored in the storage 300. That is, the image acquisition unit 115 checks whether an image stored in association with tag information corresponding to the second print instruction information is stored in the storage 300. As described above, it may also be checked whether an image associated with the same identification information as the identification information of the user U who issued the instruction at the second time point and stored in association with tag information corresponding to the second print instruction information is stored in the storage 300. In this case, because such an image has already been stored in the storage 300 in step S422 described above, in step S515, the image acquisition unit 115 acquires an image corresponding to the second print instruction information from the storage 300. Therefore, the process for acquiring an image from the image generation AI server 500 is omitted. Therefore, the image generation process by the image generation AI server 500 is also omitted.

[0123] Thereafter, in steps S516 to S519, processing is performed to print the image obtained from storage 300 by image forming apparatus 200. Note that the processing from steps S516 to S519 is similar to the processing from steps S120 to S123 shown in FIG. 3B, and therefore description thereof will be omitted.

[0124] Although the above example does not output a list listing multiple images, this modification may also acquire multiple images and output a list listing the multiple images. That is, when first print instruction information is acquired, the storage control unit 117 may associate each of the multiple images acquired from the image generation AI server 500 with tag information obtained from the first print instruction information and store the associated images in the storage 300. The list output unit 118 may then generate a list listing the multiple images acquired from the image generation AI server 500 and output the list. Similarly, when second print instruction information is acquired, if multiple images corresponding to the second print instruction information can be acquired from the storage 300, the list output unit 118 may generate a list listing the multiple images acquired from the image generation AI server 500 and output the list. Note that images stored in storage 300 may be associated with the number of times the image has been printed. In this case, list output unit 118 may output a list that lists the number of times each listed image has been printed. List output unit 118 may also output a list in which the listed images are sorted by the number of times they have been printed. Specifically, the list may be output in which images with a greater number of times they have been printed are ranked higher. This provides useful information for user U to select images. Also, in this modification, the output list may include code images for accessing the listed images. When the list is output, print control unit 119 causes image forming apparatus 200 to print an image selected by user U from the listed images.

[0125] Furthermore, if user U requests acquisition of a new image rather than an existing image saved in storage 300, the image may be acquired from the image generation AI server 500 regardless of whether an image corresponding to the print instruction information is stored in storage 300. In other words, if the acquired print instruction information includes an instruction to print a new image, the image request unit 114 may request the image generation AI server 500 to send an image using the print instruction information regardless of whether an image corresponding to the print instruction information is stored in storage 300. This allows user U to freely choose whether or not to allow the reuse of an existing image.

[0126] The above describes the second modification. In this modification, as described above, the image request unit 114 transmits an image generation command generated based on the print instruction information to the image generation AI server 500 only if an image corresponding to the print instruction information acquired by the instruction information acquisition unit 111 is not stored in the storage 300. This limits the use cases of the image generation AI server 500, thereby reducing the number of times that the user U has to wait for a long time. Furthermore, this also reduces the number of times that images generated by the image generation AI server 500 are saved in the storage 300, thereby preventing the reduction in free space in the storage 300. In particular, when generating images using the image generation AI server 500 (i.e., an image generation AI service), even if an image generation command is issued to generate an image using the same image generation command, a different image may be generated each time. For this reason, the user U may not be able to reprint an image that was previously printed. In contrast, this modification has the advantage of allowing previously printed images to be retrieved from the storage 300 and printed repeatedly.

[0127] <Variation 3> Next, Modification 3 will be described. This modification differs from the above-described embodiment or modification in that it allows a user to register their favorite images in the printing system and later print the registered images. Below, features and operations that differ from the above-described embodiment or modification will be described, and descriptions of similar features and operations will be omitted as appropriate.

[0128] In this modified example, the instruction information acquisition unit 111 can acquire registration instruction information, which is instruction information including an instruction to register an image as a favorite image. For example, the user U gives voice input to the printing system 10 instructing the printing system 10 to register a favorite image among images printed using the printing system 10 as a favorite image. The information input to the printing system 10 in this manner is acquired by the instruction information acquisition unit 111 as registration instruction information. Furthermore, in this modified example, the instruction information acquisition unit 111 can acquire print instruction information that instructs the printing of the registered favorite image.

[0129] Furthermore, in this modification, when the instruction information acquisition unit 111 acquires registration instruction information, the storage control unit 117 stores, as a favorite image, an image instructed by the registration instruction information to be registered as a favorite image in the storage 300. Specifically, the storage control unit 117 associates tag information indicating that the image is a favorite image with the image to be saved as a favorite image, and stores the images in the storage 300.

[0130] In this modification, when the instruction information acquired by the instruction information acquisition unit 111 is print instruction information instructing printing of a favorite image, the image acquisition unit 115 acquires an image stored as a favorite image from the storage 300. That is, the image acquisition unit 115 acquires an image stored in association with tag information indicating that the image is a favorite image. The print control unit 119 then causes the image forming apparatus 200 to print the image acquired from the storage 300. This allows the user U to repeatedly print a favorite image. In particular, when generating an image using the image generation AI server 500 (i.e., an image generation AI service), even if an image generation command is issued to generate an image, a different image may be generated each time. For this reason, the user U may not be able to reprint a favorite image. In contrast, this modification has the advantage that an image registered as a favorite image can be acquired from the storage 300 and repeatedly printed.

[0131] In order to more reliably identify the favorite image that user U wishes to print, it is preferable that the print instruction information instructing printing of the favorite image includes information that identifies the image registered as a favorite image (hereinafter also referred to as favorite identification information). In this case, image acquisition unit 115 acquires from storage 300, among the images stored in storage 300 as favorite images, the image identified by the favorite identification information, and print control unit 119 causes image forming device 200 to print the acquired image. With this configuration, the favorite image that user U wishes to print can be more reliably acquired from storage 300 and printed.

[0132] The favorite specifying information may be information indicating the drawing target of the image registered as a favorite image, or information indicating the drawing style of the image registered as a favorite image. Therefore, in this modification, as in the second modification, the image stored in the storage 300 may be associated with tag information obtained from the print instruction information.

[0133] The favorite identification information may also be information indicating the time when the image to be identified was registered as a favorite image. In this case, when a favorite image is registered, the storage control unit 117 associates the image to be registered as a favorite image with information indicating the time when the image was registered, and stores the image in the storage 300. By using information indicating the time when the image was registered as the favorite identification information, the user U can identify an image based on the time when the image was registered, thereby improving convenience.

[0134] The favorite identification information is not limited to the information described above. For example, the favorite identification information may be the identification information of the user who issued an instruction to register the image to be identified as a favorite image. In this case, when registering a favorite image, the storage control unit 117 associates the image to be registered as a favorite image with the identification information of the user U included in the registration instruction information, i.e., the identification information of the user U who issued the instruction indicated in the registration instruction information, and stores the image in the storage 300. This makes it possible to identify a favorite image using the user's identification information. Furthermore, the various favorite identification information described above may be used in combination.

[0135] 11 and 12 are sequence charts showing an example of the flow of processing executed in the printing system 10 according to Modification 3. FIG. 11 is a sequence chart showing an example of the flow of processing when a favorite image is registered. More specifically, FIG. 11 shows an example of the flow of processing performed after printing based on print instruction information is performed in the printing system 10. For this reason, it is assumed that a series of processing shown in FIGS. 9A and 9B, for example, is performed before the sequence shown in FIG. 11. However, in this modification, the processing of steps S414 and S415 in FIG. 9A, which are related to the features of Modification 2, may be omitted. FIG. 12 is a sequence chart showing an example of the flow of processing when a favorite image is printed.

[0136] First, an example of the flow of processing when a favorite image is registered will be described with reference to FIG.

[0137] 11, the instruction information acquisition unit 111 of the information processing device 100 acquires registration instruction information via the audio system 400 (the audio input / output device 410 and the audio processing server 420). Specifically, the information acquired in steps S601 and S607 described below corresponds to the registration instruction information.

[0138] In step S600, the user U utters, for example, "Please register the previous image as a favorite" to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S601, the voice processing server 420 transmits to the information processing device 100 registration instruction information instructing the information processing device 100 to register the image to be printed in the previous print process as a favorite image. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0139] Next, in step S602, the storage control unit 117 refers to the storage 300 and searches for candidate images to be registered as favorite images from the storage 300 based on the registration instruction information acquired in step S601. Then, in step S603, the storage control unit 117 acquires information stored in association with the candidate images to be registered as favorite images in order to output a response to the user U. Specifically, the storage control unit 117 acquires information indicating the content of the image, such as the drawing target and drawing style.

[0140] Next, in step S604, the user interface processing unit 120 outputs a response to the registration instruction information acquired in step S601 based on the information acquired in step S603. For example, the user interface processing unit 120 transmits text data of the sentence "Is this a coloring book of a fox and a raccoon dog with autumn fruits in the background?" to the voice processing server 420. The text data is converted into voice data by the voice processing server 420, and in step S605, the voice is output as voice from the voice input / output device 410.

[0141] In step S606, the user U utters, for example, "Yes" to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S607, the voice processing server 420 transmits information to the information processing device 100 indicating that the image to be registered as a favorite image is definitely the image found in step S602. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0142] Next, in step S608, the storage control unit 117 stores the image found in step S602 as a favorite image in the storage 300. Specifically, the storage control unit 117 associates the image with tag information indicating that it is a favorite image and stores the image in the storage 300. As a result, for example, tag information indicating the favorite image is newly added to the image that has already been associated with tag information based on the print instruction information in step S422 of FIG. 9B. Note that in step S608, the storage control unit 117 may associate information indicating the time of registration as a favorite image and identification information of user U with the favorite image and store them in the storage 300, as described above.

[0143] Next, in step S609, the user interface processing unit 120 transmits text data of the sentence "I have registered a coloring book of a fox and a raccoon dog with autumn fruits in the background as a favorite image" to the voice processing server 420 as a response to the information acquired in step S607. The text data is converted into voice data by the voice processing server 420, and in step S610, the voice is output as voice from the voice input / output device 410.

[0144] Next, the flow of processing when a favorite image is printed will be described with reference to Fig. 12. As shown in Fig. 12, the instruction information acquisition unit 111 of the information processing device 100 acquires print instruction information that instructs printing of a favorite image via the audio system 400 (audio input / output device 410 and audio processing server 420). Specifically, the information acquired in steps S701, S705, and S711 described below corresponds to the registration instruction information. In particular, the information acquired in step S705 corresponds to the above-mentioned favorite identification information.

[0145] In step S700, the user U utters, for example, "Print my favorites" to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S701, the voice processing server 420 transmits print instruction information instructing the information processing device 100 to print the favorite images. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0146] Next, in step S702, the user interface processing unit 120 transmits text data of the sentence "I like it, what kind of picture is it?" to the voice processing server 420 as a response to the print instruction information acquired in step S701. The text data is converted into voice data by the voice processing server 420, and in step S703, the voice is output as voice from the voice input / output device 410.

[0147] In step S704, the user U utters, for example, "fox and raccoon dog" to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S705, the instruction information acquisition unit 111 acquires the information "fox" and "raccoon dog" as information for identifying a favorite image.

[0148] Next, in step S706, the image acquisition unit 115 refers to the storage 300 and searches for an image from the storage 300 that is identified by the information acquired in step S705, among the images stored as favorite images. Specifically, for example, the image acquisition unit 115 searches for an image by referring to tag information. Note that in the example shown here, the information "fox" and "raccoon dog" are used as the favorite identification information, but as described above, the identification information of the user U may be used, or information indicating the time of registration as a favorite image may be used. Then, in step S707, the image acquisition unit 115 acquires from the storage 300 the image that is identified by the information acquired in step S705.

[0149] Next, in step S708, the user interface processing unit 120 sends text data of the sentence "I found a coloring book of a fox and a raccoon dog with autumn fruits in the background. Would you like to print it?" to the voice processing server 420 as a response to the print instruction information acquired in step S705. The text data is converted into voice data by the voice processing server 420, and in step S709, the voice data is output as voice from the voice input / output device 410.

[0150] In step S710, the user U utters, for example, "Yes," to the voice input / output device 410. This voice is subjected to voice recognition processing by the voice processing server 420, and in step S711, the voice processing server 420 transmits information indicating that the found favorite image is definitely the image to be printed to the information processing device 100. Then, the instruction information acquisition unit 111 of the information processing device 100 acquires this information.

[0151] Thereafter, in steps S712 to S715, processing is performed to print the image obtained from storage 300 by image forming apparatus 200. Note that the processing from steps S712 to S715 is similar to the processing from steps S120 to S123 shown in FIG. 3B, and therefore description thereof will be omitted.

[0152] 12, one favorite image is found as a candidate image to be printed, but multiple favorite images may be found. If multiple favorite images are found, the list output unit 118 may output a list listing multiple different images stored in the storage 300 as favorite images as candidates to be printed. By outputting the list in this manner, the user U can check the favorite images that are candidates to be printed, improving convenience.

[0153] Also in this modification, images stored in storage 300 as favorite images may be associated with the number of times the image has been printed. In this case, list output unit 118 may output a list that describes the number of times each listed image has been printed. List output unit 118 may also output a list in which the listed images are sorted by the number of times they have been printed. Specifically, an image with a greater number of times it has been printed may be listed higher in the output list. Also in this modification, the output list may include a code image for accessing the listed images. When the list is output, print control unit 119 causes image forming apparatus 200 to print an image selected by user U from the listed images.

[0154] Furthermore, if the image specified by the favorite specifying information is not stored as a favorite image in the storage 300, or if the favorite image to be selected as a print candidate is not stored in the storage 300, the user interface processing unit 120 may output error information indicating that the favorite image to be printed cannot be found. This allows the user U to easily understand that an error has occurred.

[0155] If the image identified by the favorite identification information is not stored in the storage 300 as a favorite image, the following list may be output instead of or in addition to the error information. That is, the list output unit 118 may generate and output a list of images stored in the storage 300 that user U has previously printed. In this case, the print instruction information includes user U's identification information, and the storage control unit 117 associates images printed based on the print instruction information with the identification information included in the print instruction information and stores them in the storage 300. If the image identified by the favorite identification information is not stored in the storage 300 as a favorite image, the list output unit 118 outputs a list of images stored in association with the same identification information as the identification information included in the print instruction information instructing printing of the favorite image. The print control unit 119 then causes the image forming device 200 to print an image selected by user U from the listed images. For example, the list output unit 118 may generate and output a list of a predetermined number of images stored in the storage 300 that have been printed by the user U in the past, in order from most recent to oldest in the print history. In this way, if an image identified by the favorite identification information is not stored in the storage 300 as a favorite image, outputting a list of images that the user has printed in the past allows the user to print an image that is a favorite image of the user but that the user forgot to register, thereby improving convenience. Note that the list output when an image identified by the favorite identification information is not stored in the storage 300 as a favorite image may include a code image for accessing the listed image or the number of times the listed image has been printed.

[0156] In the above-mentioned variant example 3, an example was shown in which an image obtained from another device such as the image generation AI server 500 is registered as a favorite image, but the image registered as a favorite image does not necessarily have to be obtained from another device, and may be an image that has been pre-stored in the storage 300, for example.

[0157] The above describes the embodiment and several modified examples. Of these, in particular, in the configuration described as modified example 2, only when an image corresponding to the print instruction information acquired by the instruction information acquisition unit 111 is not stored in the storage 300, is an image acquired from another device (image generation AI server 500) based on the print instruction information performed. This configuration limits the cases in which image acquisition processing using another device is used, thereby reducing the number of times that user U has to wait for a long time.

[0158] Furthermore, although the present disclosure has described embodiments and several modified examples, the present invention is not limited to the above-described embodiments and modified examples and can be modified as appropriate without departing from the spirit and scope of the present invention. For example, the features described as embodiments or modified examples can be combined as appropriate. Furthermore, for example, in the above-described embodiments and modified examples, instructions from user U are acquired by voice input, but instructions from user U may also be acquired using an input device such as a button or pointing device that accepts input operations from user U. Furthermore, the processing unit 116 may perform image processing according to instructions from user U on any image stored in storage 300 for reprinting, such as a favorite image.

[0159] Furthermore, for example, in the above-described embodiment and modified example, the image request unit 114 of the information processing device 100 requests an image from the image generation AI server 500. However, the image request unit 114 may also request an image from any device (server) other than the information processing device 100. For example, the image request unit 114 may request an image from a search server that searches for images on the Internet. In this case, the image request unit 114 transmits, for example, information specifying a drawing target or a drawing style as a search query to the search server. That is, the image request unit 114 transmits a search query using the print instruction information acquired by the instruction information acquisition unit 111 to the search server. Then, the image acquisition unit 115 may acquire an image found by the search process of the search server. Note that the text generation AI server 600 may be used to obtain the search query. That is, the text request unit 112 and the text acquisition unit 113 may execute processing to acquire text (search query) to be sent to the search server. This is expected to make it easier to obtain an appropriate search query compared to generating a search query from print instruction information based on a rule base. Furthermore, even when a search server is used, the search process may take some time. This may result in the user U having to wait a long time before the image can be printed. Therefore, even if a search server is used instead of the image generation AI server 500, it is beneficial to limit the process of obtaining images from other devices (search servers), as in Variation 2.

[0160] Note that the components (servers, devices, etc.) of the printing system 10 or 10a mentioned in the above-described embodiment or variants may be configured as computers, similar to the information processing device 100. That is, the components of the printing system may include a memory and a processor, and the processor may read and execute a program from the memory to realize the above-described processing.

[0161] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0162] Some or all of the above-described embodiments or modified examples may be described as, but are not limited to, the following supplementary notes. (Appendix 1) an instruction information acquisition unit that acquires first print instruction information including a designation of a drawing target; an image request unit that, when an image corresponding to the acquired first print instruction information is not stored in a storage, requests another server to transmit an image in which the drawing target is drawn, using the first print instruction information; an image acquisition unit that acquires the image from the other server; a print control unit that causes an image forming apparatus to print the acquired image; An information processing device having the above. (Appendix 2) The other server is an image generation AI server, the image request unit transmits an image generation command generated based on the first print instruction information to the image generation AI server to request the image generation AI server to transmit an image in which the drawing target is drawn; The image acquisition unit acquires from the image generation AI server the image generated by the image generation AI server based on the image generation command. 10. The information processing device according to claim 1. (Appendix 3) The instruction information acquisition unit acquires the first print instruction information input by voice from a user. 3. The information processing device according to claim 1 or 2. (Appendix 4) the information processing device has a storage control unit that stores the image acquired from the other server in the storage in association with tag information obtained from the first print instruction information used to acquire the image; the instruction information acquisition unit acquires second print instruction information including a designation of a drawing target; the image request unit, when an image stored in association with tag information corresponding to the second print instruction information is not present in the storage, requests the other server to transmit an image in which the drawing target is drawn using the second print instruction information; When an image stored in association with tag information corresponding to the second print instruction information is in the storage, the print control unit causes the image forming apparatus to print the image acquired from the storage. 4. The information processing device according to claim 1. (Appendix 5) the first print instruction information and the second print instruction information further include user identification information; the storage control unit stores the image acquired from the other server in the storage in association with the tag information and the identification information included in the first print instruction information used to acquire the image; the image request unit, when an image stored in association with the identification information included in the second print instruction information and tag information corresponding to the second print instruction information is not present in the storage, requests the other server to transmit an image in which the drawing target is drawn using the second print instruction information; When an image stored in the storage in association with the identification information included in the second print instruction information and tag information corresponding to the second print instruction information is present, the print control unit causes the image forming apparatus to print the image acquired from the storage. 5. The information processing device according to claim 4. (Appendix 6) the first print instruction information and the second print instruction information further include user identification information; the storage control unit stores the image acquired from the other server in the storage in association with the tag information and the identification information included in the first print instruction information used to acquire the image; the image request unit, when an image stored in association with tag information corresponding to the second print instruction information is not present in the storage, requests the other server to transmit an image in which the drawing target is drawn using the second print instruction information; When an image stored in association with the identification information included in the second print instruction information and tag information corresponding to the second print instruction information is in the storage, or when an image stored in association with user identification information different from the identification information included in the second print instruction information and tag information corresponding to the second print instruction information is in the storage, the print control unit causes the image forming device to print the image obtained from the storage. 5. The information processing device according to claim 4. (Appendix 7) the image acquisition unit acquires a plurality of different images as images in which the drawing target is drawn from the other server; The information processing device has a list output unit that outputs a list of the plurality of different images as print candidates. 7. An information processing device according to any one of claims 1 to 6. (Appendix 8) the information processing device includes a storage control unit that stores the image acquired by the image acquisition unit in the storage; The output list includes a code image in which information indicating an access destination for obtaining the listed images from the storage is coded. 8. The information processing device according to claim 7. (Appendix 9) The output list includes the number of prints of each of the listed images. 9. The information processing device according to claim 7 or 8. (Appendix 10) the instruction information acquisition unit further acquires an instruction to select a print target from the plurality of different images listed in the list; The print control unit causes the image forming apparatus to print an image selected from the plurality of different images. 10. The information processing device according to any one of appendices 7 to 9. (Appendix 11) When the acquired first print instruction information includes an instruction to print a new image, the image request unit uses the first print instruction information to request the other server to transmit an image in which the drawing target is drawn, regardless of whether an image corresponding to the acquired first print instruction information is stored in the storage. 11. The information processing device according to any one of Supplementary Notes 1 to 10. (Appendix 12) Obtain first print instruction information including a designation of a drawing target; If an image corresponding to the acquired first print instruction information is not stored in the storage, request another server to transmit an image in which the drawing target is drawn, using the first print instruction information; Obtaining the image from the other server; The image forming device prints the acquired image. Information processing methods. (Appendix 13) an instruction information acquisition step of acquiring first print instruction information including a designation of a drawing target; an image request step of requesting another server to transmit an image in which the drawing target is drawn, using the first print instruction information, when an image corresponding to the acquired first print instruction information is not stored in a storage; an image acquisition step of acquiring the image from the other server; a print control step of causing an image forming device to print the acquired image; A program that causes a computer to execute the following. [Explanation of symbols]

[0163] 10...printing system, 10a...printing system, 90...list, 90a...list, 91...thumbnail image, 92...number, 93...code image, 100...information processing device, 110...processor, 111...instruction information acquisition unit, 112...text request unit, 113...text acquisition unit, 114...image request unit, 115...image acquisition unit, 116...processing unit, 117...storage control unit, 118...list output unit, 119...printing control unit, 120...user interface processing unit, 130...memory, 150...network interface, 200...image forming device, 300...storage, 400...audio system, 410...audio input / output device, 420...audio processing server, 500...image generation AI server, 600...text generation AI server, 700...terminal device, 710...reading device, 720...input device, 730...display, N...network, U...user

Claims

1. an instruction information acquisition unit that acquires first print instruction information including a designation of a drawing target; an image request unit that, when an image corresponding to the acquired first print instruction information is not stored in a storage, requests another server to transmit an image in which the drawing target is drawn, using the first print instruction information; an image acquisition unit that acquires the image from the other server; a print control unit that causes an image forming apparatus to print the acquired image; An information processing device having the above.

2. The other server is an image generation AI server, the image request unit transmits an image generation command generated based on the first print instruction information to the image generation AI server to request the image generation AI server to transmit an image on which the drawing target is drawn; The image acquisition unit acquires, from the image generation AI server, an image generated by the image generation AI server based on the image generation command. The information processing device according to claim 1 .

3. The instruction information acquisition unit acquires the first print instruction information input by voice from a user.

3. The information processing device according to claim 1 or 2.

4. the information processing device has a storage control unit that associates the image acquired from the other server with tag information obtained from the first print instruction information used to acquire the image, and stores the image in the storage; the instruction information acquisition unit acquires second print instruction information including a designation of a drawing target; the image request unit, when an image stored in association with tag information corresponding to the second print instruction information is not present in the storage, requests the other server to transmit an image in which the drawing target is drawn using the second print instruction information; When an image stored in association with tag information corresponding to the second print instruction information is in the storage, the print control unit causes the image forming apparatus to print the image acquired from the storage. The information processing device according to claim 1 .

5. the first print instruction information and the second print instruction information further include user identification information; the storage control unit stores the image acquired from the other server in the storage in association with the tag information and the identification information included in the first print instruction information used to acquire the image; the image request unit, when an image stored in association with the identification information included in the second print instruction information and tag information corresponding to the second print instruction information is not present in the storage, requests the other server to transmit an image in which the drawing target is drawn using the second print instruction information; When an image stored in the storage in association with the identification information included in the second print instruction information and tag information corresponding to the second print instruction information is present, the print control unit causes the image forming apparatus to print the image acquired from the storage. The information processing device according to claim 4 .

6. the first print instruction information and the second print instruction information further include user identification information; the storage control unit stores the image acquired from the other server in the storage in association with the tag information and the identification information included in the first print instruction information used to acquire the image; the image request unit, when an image stored in association with tag information corresponding to the second print instruction information is not present in the storage, requests the other server to transmit an image in which the drawing target is drawn using the second print instruction information; When an image stored in association with the identification information included in the second print instruction information and tag information corresponding to the second print instruction information is in the storage, or when an image stored in association with user identification information different from the identification information included in the second print instruction information and tag information corresponding to the second print instruction information is in the storage, the print control unit causes the image forming apparatus to print the image obtained from the storage. The information processing device according to claim 4 .

7. the image acquisition unit acquires a plurality of different images as images in which the drawing target is drawn from the other server; The information processing device has a list output unit that outputs a list of the plurality of different images as print candidates. The information processing device according to claim 1 .

8. the information processing device includes a storage control unit that stores the image acquired by the image acquisition unit in the storage; The output list includes a code image in which information indicating an access destination for obtaining the listed images from the storage is coded. The information processing device according to claim 7 .

9. The output list includes the number of prints of each of the listed images.

9. The information processing device according to claim 7 or 8.

10. the instruction information acquisition unit further acquires an instruction to select a print target from the plurality of different images listed in the list; The print control unit causes the image forming apparatus to print an image selected from the plurality of different images. The information processing device according to claim 7 .

11. When the acquired first print instruction information includes an instruction to print a new image, the image request unit uses the first print instruction information to request the other server to transmit an image in which the drawing target is drawn, regardless of whether an image corresponding to the acquired first print instruction information is stored in the storage. The information processing device according to claim 1 .

12. Acquire first print instruction information including a designation of a drawing target; If an image corresponding to the acquired first print instruction information is not stored in the storage, request another server to transmit an image in which the drawing target is drawn, using the first print instruction information; Obtaining the image from the other server; The image forming device prints the acquired image. Information processing methods.

13. an instruction information acquisition step of acquiring first print instruction information including designation of a drawing target; an image request step of requesting another server to transmit an image in which the drawing target is drawn, using the first print instruction information, when an image corresponding to the acquired first print instruction information is not stored in a storage; an image acquisition step of acquiring the image from the other server; a print control step of causing an image forming device to print the acquired image; A program that causes a computer to execute the following.

Citation Information

Patent Citations

  • System and processor

    JP2020056913A