Computer program, apparatus, and method for causing print execution unit of printing apparatus to print image
A computer program with input and print control units, combined with an AI server, addresses the limitations of existing image generation and printing methods by enabling image creation and printing from natural language inputs, enhancing user interaction and process efficiency.
Patent Information
- Application Number
- JP2024124291
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2026-02-13
AI Technical Summary
Existing technologies lack a seamless method for generating and printing images using natural language inputs directly from a user, limiting the flexibility and user interaction in image creation and printing processes.
A computer program that includes an input acceptance unit, a generation instruction unit, and a print control unit to facilitate the generation and printing of images based on natural sentences, utilizing an AI server to process user inputs and generate images that can be printed by a printing device.
Enables the generation and printing of images from natural language inputs, enhancing user interaction and flexibility in image creation, and allowing for efficient image generation and printing processes.
Smart Images

Figure 2026022769000001_ABST
Abstract
Description
[Technical Field]
[0001] The present specification relates to a technique for causing a print execution unit of a printing device to print an image. [Background technology]
[0002] Patent Document 1 discloses a technique for causing a printer to execute printing using an application installed on a terminal. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-085588 Summary of the Invention [Problem to be solved by the invention]
[0004] A novel technique for image generation is provided herein. [Means for solving the problem]
[0005] This specification discloses a computer program for causing a print execution unit of a printing device to print an image. The computer program may cause a computer to function as the following units: an input acceptance unit that accepts input of natural sentences expressing a newly generated image from a user, a first supply unit that, when input of a first natural sentence is accepted, supplies a generation instruction including first natural sentence data expressing the first natural sentence to an image generation unit, an image data acceptance unit that accepts, from the image generation unit, first generated image data expressing a first generated image generated by the image generation unit based on the first natural sentence data, and a print control unit that causes the print execution unit to print the first generated image expressed by the first generated image data.
[0006] According to the above configuration, when the computer accepts input of a first natural sentence, it supplies a generation instruction including the first natural sentence data to the image generation unit, accepts first generated image data representing a generated image generated by the image generation unit based on the first natural sentence data, and causes the print execution unit to print the first generated image. In this way, a novel technology related to image generation is realized.
[0007] A computer-readable recording medium that stores the above computer program, an apparatus implemented by the above computer program, and a method executed by the apparatus are also novel and useful. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a configuration diagram of a communication system. [Figure 2] FIG. 10 is a sequence diagram of a registration process. [Figure 3] FIG. 10 is a screen transition diagram of the registration process. [Figure 4] FIG. 10 is a sequence diagram of the first embodiment, particularly of case A. [Figure 5] FIG. 10 is a sequence diagram of case B. [Figure 6] FIG. 1 is a screen transition diagram of the first embodiment. [Figure 7] This is a screen transition diagram continuing from Figure 6. [Figure 8] This is a continuation of the screen transition diagram in Figure 7. [Figure 9] FIG. 10 is a sequence diagram of case C. [Figure 10] FIG. 10 is a sequence diagram of a second embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0009] (First Example) (Communication system configuration; Figure 1) As shown in FIG. 1, the communication system 2 includes a terminal 10, two printers 100 and 150, and an artificial intelligence (AI) server 200. The terminal 10 and the printers 100 and 150 are connected to a local area network (LAN) 4. The devices 10, 100, and 150 can communicate with each other via the LAN 4. The LAN 4 may be a wired LAN or a wireless LAN. The AI server 200 is installed on the Internet 6. The devices 10, 100, and 150 and the AI server 200 can communicate with each other via the LAN 4 and the Internet 6.
[0010] (Configuration of Terminal 10) The terminal 10 is a portable terminal device such as a mobile phone, smartphone, PDA, or tablet PC. In a modified example, the terminal 10 may be a desktop PC, laptop PC, or the like. The terminal 10 includes an operation unit 12, a display unit 14, a communication interface 16, and a control unit 30. The units 12 to 30 are connected to a bus line. Hereinafter, the interface will be referred to as "I / F."
[0011] The operation unit 12 is a user interface that allows the user to input various information to the terminal 10. The operation unit 12 includes, for example, a touch panel for displaying software keys (operation objects), hardware keys, or both. The hardware keys include, for example, buttons or switches. The display unit 14 is a display or panel for displaying various information. The panel may or may not be a touch panel. The panel is, for example, a liquid crystal panel or an organic EL panel. The communication I / F 16 is connected to the LAN 4.
[0012] The control unit 30 includes a CPU 32 and a memory 34. The memory 34 includes a main storage device and an auxiliary storage device. For example, the main storage device includes RAM and cache memory. For example, the auxiliary storage device may be a ROM, flash memory, a solid-state drive (SSD), a hard disk drive (HDD), or a combination thereof. An OS program 36 and an application program 38 are stored in the auxiliary storage device of the memory 34. Hereinafter, the OS program and the application program will be referred to as "OS" and "app," respectively. The OS 36 controls the basic operations of the terminal 10. For example, the app 38 causes a printer to perform a printing function. The app 38 is downloaded, for example, from a server on the Internet 6 and installed on the terminal 10. In other words, the app 38 is a so-called native app. The CPU 32 performs various processes according to programs loaded from the auxiliary storage device to the main storage device. Hereinafter, various processes performed by the CPU 32 according to programs may be described as being performed primarily by the OS 36 or the app 38.
[0013] The application 38 can cause the AI server 200 to generate an image and print the image on the printer 100 or the like. Hereinafter, this function will be referred to as "image generation and printing." In image generation and printing, the AI server 200 can generate an image according to prompts entered by the user.
[0014] (Configuration of printer 100) The printer 100 is a peripheral device capable of executing a printing function, such as a peripheral device of the terminal 10. In a modified example, the printer 100 may be a multi-function device capable of executing a scanning function, a facsimile function, and the like in addition to a printing function. The printer 100 is assigned a device ID "dv1" that identifies the printer 100. The device ID is, for example, a model name, an IP address, or a combination thereof. In this specification, the device ID is a model name. The model name is model identification information for the device. The model name may be a higher-level model name that encompasses multiple model names. For example, the model name may be "ABC Series," which encompasses the model names ABC1 and ABC2. The printer 100 includes an operation unit 112, a display unit 114, a communication I / F 116, a print execution unit 118, and a control unit 130. Each of the units 112 to 130 is connected to a bus line.
[0015] The operation unit 112 is a user interface that allows a user to input various information to the printer 100. The operation unit 112 includes, for example, a touch panel for displaying software keys, hardware keys, or both. Hardware keys include, for example, buttons or switches. The display unit 114 is a display or panel for displaying various information. The panel may or may not be a touch panel. The panel may also be, for example, a liquid crystal panel or an organic EL panel. The communication I / F 116 is connected to the LAN 4. The print execution unit 118 includes an electrophotographic, inkjet, or thermal print engine. An electrophotographic print engine includes a photosensitive member and an exposure device that emits light to expose the photosensitive member. An inkjet print engine includes a print head that ejects ink droplets. A thermal print engine includes a print head that generates heat using a heater.
[0016] The control unit 130 includes a CPU 132 and a memory 134. The memory 134 includes a main storage device and an auxiliary storage device. As an example, the main storage device includes RAM and cache memory. As an example, the auxiliary storage device may be a ROM, flash memory, SSD, HDD, or a combination thereof. A program 136 is stored in the auxiliary storage device of the memory 134. The CPU 132 performs various processes in accordance with the program loaded from the auxiliary storage device to the main storage device. The configuration of the printer 150 is similar to that of the printer 100, except that the printer 150 is assigned the device ID "dv2."
[0017] (Configuration of AI server 200) The AI server 200 generates images according to instructions from the application 38. The servers described herein (e.g., the AI server 200, the cloud print server (not shown)) are installed on the Internet 6 by the vendor of the printer 100, 150 (hereinafter simply referred to as the "vendor"). While the AI server 200 will be described in particular below, the same applies to other servers described herein, such as the cloud print server. The AI server 200 may be a physical server, a virtual server on the cloud, a virtual machine, or the like. The AI server 200 may be a single server or a collection of multiple servers. The AI server 200 may be a server on an intranet or a cloud server on the Internet 6. In a variant, the AI server 200 may be installed on the Internet 6 by a business operator other than the vendor. In another variant, the vendor may not prepare the AI server 200 hardware themselves, but may use an environment provided by an external cloud computing service. In this case, the vendor may prepare a program (i.e., software) for the AI server 200 and install it in the above environment to realize the AI server 200. In this embodiment, as an example, a form in which the AI server 200 is a physical server will be described.
[0018] The AI server 200 includes a communication I / F 216 and a control unit 230. The communication I / F 216 and the control unit 230 are connected to a bus line. The communication I / F 216 is connected to the Internet 6.
[0019] The control unit 230 includes a processor 232 and a memory 234. The processor 232 includes a CPU, a graphics processing unit (GPU), a neural processing unit (NPU), or a combination thereof. The memory 234 includes a main storage device and an auxiliary storage device. For example, the main storage device includes a RAM and a cache memory. For example, the auxiliary storage device may be a ROM, a flash memory, an SSD, an HDD, or a combination thereof. A program 236 is stored in the auxiliary storage device of the memory 234. The processor 232 performs various processes in accordance with the program loaded from the auxiliary storage device to the main storage device.
[0020] A trained model is incorporated into the program 236. The AI server 200 executes functions such as image generation processing based on the trained model incorporated into the program 236. The trained model includes a program and various parameters. The trained model includes, for example, a language model such as a large-scale language model (LLM) or a small-scale language model (SLM).
[0021] (Registration process; Figures 2 and 3) Next, with reference to FIGS. 2 and 3, a registration process for registering information about each printer 100, 150 in the application 38 will be described. In the following, for ease of understanding, the processes executed by the CPU (e.g., 32, 132) or processor (e.g., 232) of each device (e.g., terminal 10, printer 100, 150, AI server 200) will be described as the subject of the process, rather than the CPU or processor. Unless otherwise specified, the various processes executed by the CPU 32 of the terminal 10 described below are realized by the CPU 32 executing the application 38. Communication between each device is performed via a communication I / F (e.g., 16, 116, 216). Therefore, in the following description, the phrase "via a communication I / F" will be omitted when describing communication.
[0022] When the terminal 10 receives an application launch operation for launching the application 38 at T10, the terminal 10 launches the application 38, and at T12, displays a home screen SC100 on the display unit 14. As shown in FIG. 3, the home screen SC100 is divided into a first area A1 and a second area A2. The first area A1 includes a registration object OB19. The second area A2 includes a plurality of function objects OB13 to OB15. The function objects OB13 to OB15 are objects corresponding to a document printing function, a photo printing function, and an image generation and printing function, respectively. The document printing function is a function for printing an image represented by a document file (e.g., a Word file, a PDF file, a Text file, etc.). The photo printing function is a function for printing an image represented by a photo file (e.g., a JPEG file, etc.). The registration object OB19 is an object for registering a new printer (e.g., printers 100 and 150).
[0023] At T14, the terminal 10 accepts selection of a registration object OB19 from the user. In this case, at T20, the terminal 10 broadcasts a search signal to the LAN 4. The search signal is a signal for searching for devices present within the LAN 4.
[0024] When the printer 100 receives a search signal from the terminal 10 in T20, it transmits a response including the device ID "dv1" to the terminal 10 in T22. As described above, the device ID "dv1" is the model name of the printer 100. Note that the device ID "dv1" may include the IP address of the printer 100 in addition to the model name of the printer 100. When the printer 150 receives a search signal from the terminal 10 in T20, it transmits a response including the device ID "dv2" to the terminal 10 in T24. The device ID "dv2" is the model name of the printer 150. Note that the device ID "dv2" may include the IP address of the printer 150 in addition to the model name of the printer 150.
[0025] The terminal 10 receives a response from the printer 100 at T22, and receives a response from the printer 150 at T24. In this case, the terminal 10 displays a device selection screen SC101 on the display unit 14 at T26. As shown in FIG. 3, the device selection screen SC101 includes a plurality of device objects OB101 and OB102 and a cancel button OB103. The device object OB101 includes the device ID "dv1" included in the response at T22. The device object OB102 includes the device ID "dv2" included in the response at T24.
[0026] When the terminal 10 receives, in T30, a selection of the device object OB101 in the device selection screen SC101 from the user, i.e., a selection of the device ID "dv1", the terminal 10 sends, in T32, a device information request to the printer 100 identified by the device ID "dv1". The device information request is a signal requesting the transmission of device information including the capability information of the printer 100. The capability information of the printer 100 means the range of printing conditions available for the printer 100. The printing conditions include, for example, paper size, resolution, number of colors, etc.
[0027] When the printer 100 receives a device information request from the terminal 10 in T32, it transmits device information including the device ID "dv1" and capability information to the terminal 10 in T34. In this embodiment, the capability information of the printer 100 includes paper sizes "A4", "B5", and "Letter", resolutions ranging from 100 dpi to 1200 dpi, and the number of colors "color" and "monochrome".
[0028] When the terminal 10 receives the device information from the printer 100 in T34, it stores the device ID "dv1" and the capability information in association with each other in the memory 34 in T36. This causes the printer 100 to be registered. Then, in T38, the terminal 10 displays a home screen SC102 on the display unit 14. As shown in FIG. 3, a first area A1 of the home screen SC102 includes a device object OB11. The device object OB11 includes the device ID "dv1" of the registered printer 100. In the first area A1, the entire device object OB11 and the left end of the registered object OB19 are displayed.
[0029] Thereafter, the terminal 10 accepts an operation of sliding the first area A1 from right to left on the home screen SC102, that is, an operation for displaying the entire registered object OB19. In this case, the entire registered object OB19 is displayed on the home screen SC102 (not shown). Then, when the terminal 10 accepts selection of the registered object OB19 from the user at T39, it executes the same processes as those at T20 to T26.
[0030] When the terminal 10 receives, at T40, the user's selection of the device object OB102 in the device selection screen SC101, i.e., the selection of the device ID "dv2", it sends, at T42, a device information request to the printer 150 identified by the device ID "dv2".
[0031] When printer 150 receives a device information request from terminal 10 in T42, it transmits device information including device ID "dv2" and capability information to terminal 10 in T44. In this embodiment, the capability information of printer 150 includes paper sizes of "A4," "B5," and "Letter," resolutions of 100 dpi to 600 dpi, and the number of colors of "monochrome." In other words, printer 150 has a narrower range of available resolutions than printer 100, and is unable to perform color printing.
[0032] When the terminal 10 receives the device information from the printer 150 in T44, it stores the device ID "dv2" and the capability information in association with each other in the memory 34 in T46. This causes the printer 150 to be registered. Then, in T50, the terminal 10 displays the home screen SC1 on the display unit 14. As shown in FIG. 6, the first area A1 of the home screen SC1 further includes a device object OB12. Although it is hidden in FIG. 6, the device object OB12 includes the device ID "dv2" of the printer 150 that is registered in the app 38.
[0033] (Specific cases: Figures 4 to 9) Next, a specific case will be described with reference to Figures 4 to 9. The processing in Figure 4 is a continuation of the processing in Figure 2. That is, in the initial state of Figure 4, information about the two printers 100, 150 (for example, the printer's device ID, IP address, capability information, etc.) has already been registered in the memory 34 of the terminal 10 (i.e., the application 38).
[0034] In T110, the terminal 10 accepts from the user the selection of a function object OB15 corresponding to the image generation and printing function. In this case, the terminal 10 identifies, from the memory 34, the capability information of the printer 100 corresponding to the device object OB11 whose entirety is displayed when the function object OB15 is selected, i.e., the capability information associated with the device ID "dv1." Then, in T112, the terminal 10 displays an image generation setting screen SC2 on the display unit 14.
[0035] As shown in FIG. 6, the image generation setting screen SC2 also includes a first area A1 and a second area A2. The first area A1 of the image generation setting screen SC2 is similar to the first area A1 of the home screen SC1. The second area A2 of the image generation setting screen SC2 includes a selection area R1 for selecting an image setting value, an input area R2 for inputting a prompt, and a generation object OB21. In this way, the user can specify both the image setting value and the prompt related to image generation on the image generation setting screen SC2.
[0036] Selection area R1 is an area for selecting conditions (i.e., image setting values) for causing the AI server 200 to generate an image for printing. In selection area R1, one value for each item within the range of the specified printer 100's capability information (in this case, "A4," "600 dpi," "color," and "landscape") is specified as the default (i.e., initial value). The user can change the image setting values within the range of the printer 100's capability information by selecting a different option in selection area R1. That is, application 38 displays selection area R1 so that the image setting values can be changed within the range of the printer 100's capability information. Image setting values in selection area R1 can be changed using any method, such as a drop-down method or text input method.
[0037] The prompt entered in the input area R2 is a command related to the image the user wants to obtain. The prompt is a string (i.e., natural language) that represents an image newly generated by the AI server 200. Here, a "newly generated image" refers to an image generated by a trained model based primarily on the prompt's expression, for example, for key features such as the contours or the shapes of each part. Such an image may be generated by a trained model based on the prompt entered in the input area R2. Furthermore, such an image may be generated based on an image file representing an image (e.g., a painting) with a specific style and color, in addition to the prompt entered in the input area R2. In this case, the image file may be specified by the user via a file specification object (not shown) displayed by the app 38. In this case, key features such as the contours or the shapes of each part are based on the prompt, but auxiliary information such as the style and color may be generated based on the image file. The input area R2 may be configured to display one or more previously entered prompts as a history. In this case, the input area R2 is configured to allow a user to select one prompt from the history.
[0038] In T114, the terminal 10 accepts from the user the selection (i.e., specification) of image setting values in the selection area R1 and the input of a prompt in the input area R2, and then accepts the selection of a generated object OB21. In this case, a "human face" is input as the prompt. Note that the input prompt does not have to be a "human face" and any prompt can be input. For example, the prompt may be a "car" or a "cloud." In T116, the terminal 10 transmits a generation instruction to the AI server 200. The generation instruction includes the image setting values specified in the selection area R1 and the prompt input in the input area R2. Note that in a modified example, the terminal 10 may accept a voice input of a prompt instead of the input of a prompt in the input area R2 in T114.
[0039] When the AI server 200 receives a generation instruction from the terminal 10 in T116, it generates a data ID in T120 and stores the data ID, the image setting values included in the generation instruction, and the prompt included in the generation instruction in association with each other in the memory 234. Next, in T122, the AI server 200 generates an image according to the image setting values and the prompt. Hereinafter, the image generated by the AI server 200 will be referred to as the "target image." For example, if the image setting values include "A4," "600 dpi," "color," and "landscape" and the prompt is "human face," the AI server 200 generates an image of a human face (e.g., an image such as an illustration of an angry face) as the target image. The target image has a size that fits A4 size and a resolution of 600 dpi. The target image is also a landscape-oriented color image. Here, "size suitable for A4 size" means a size that prevents the target image from being cut off when printed on an A4-sized print medium, and prevents the target image from being too small within the A4-sized print medium. Furthermore, "landscape" means that the up-down direction of the target image matches the direction of the short side of the print medium. Then, in T124, the AI server 200 transmits the generated data ID and image data representing the target image to the terminal 10.
[0040] When the terminal 10 receives the data ID and image data from the AI server 200 at T124, it displays a generated image confirmation screen SC3 on the display unit 14 at T126. As shown in FIG. 6, the generated image confirmation screen SC3 includes a preview area P, a regeneration object OB31, a print object OB32, and a save object OB33. A preview image Im1 is placed in the preview area P. The preview image Im1 is an image corresponding to the image data already received at T124 (i.e., an image corresponding to the target image). The user can confirm the target image by looking at the generated image confirmation screen SC3.
[0041] The regeneration object OB31 is an object for causing the AI server 200 to regenerate an image. If the user is not satisfied with the target image generated by the AI server 200, the user can cause the AI server 200 to regenerate the image by selecting the regeneration object OB31. Although not shown, when the user selects the regeneration object OB31, the terminal 10 may again display the image generation setting screen SC2 on the display unit 14. The input area R2 of the image generation setting screen SC2 displayed at this time may contain the prompt already entered at T114 in FIG. 4.
[0042] The print object OB32 is an object for printing an image. If the user is satisfied with the image generated by the AI server 200, the user selects the print object OB32. In this case, the terminal 10 displays a print preview screen, and when a print object in the print preview screen is selected, the terminal 10 can cause the printer 100 to print the target image.
[0043] The save object OB33 is an object for saving image data received from the AI server 200 in the memory 34. The user can save the image data in the memory 34 by selecting the save object OB33.
[0044] The preview area P further includes an object OB34. By selecting the object OB34, the user can see the image settings and prompts that were used to generate the target image.
[0045] When the terminal 10 accepts selection of a print object OB32 from the user in T130, it displays a print preview screen SC4 on the display unit 14 in T132. As shown in FIG. 7, the print preview screen SC4 includes a preview area P, a print object OB41, and a setting object OB42. A preview image Im1 is placed in the preview area P. The print object OB41 is an object for printing an image. The setting object OB42 is an object for displaying a print setting screen related to the specification of print setting values. The user can check the target image by looking at the print preview screen SC4.
[0046] (Case A; Figure 4) First, referring to Figure 4, we will explain Case A, in which a print object OB41 in the print preview screen SC4 is selected by the user. When the terminal 10 accepts the selection of the print object OB41 from the user at T134, it converts image data representing the target image into print data, and at T136 sends the converted print data to the printer 100. The print data has a data format that can be interpreted by the printer 100.
[0047] When the printer 100 receives the print data from the terminal 10 at T136, it causes the print execution unit 118 to print the target image represented by the print data at T138. As a result, the target image generated by the AI server 200 is printed by the printer 100.
[0048] As described above, when the terminal 10 receives input of the prompt "human face" (T114 in FIG. 4), it transmits a generation instruction including the prompt to the AI server 200 (T116). The AI server 200 generates a target image based on the prompt (T122) and transmits image data representing the target image to the terminal 10 (T124). The terminal 10 receives the image data from the AI server 200 and causes the printer 100 to print the target image represented by the image data. In this way, the application 38 for causing the printer 100 or the like to print can cause the AI server 200 to generate the target image and cause the printer 100 to print the target image.
[0049] (Case B; Figure 5) Next, case B will be described with reference to Fig. 5. Case B is a case where a setting object OB42 in the print preview screen SC4 is selected by the user. The processing in Fig. 5 is a continuation of the processing in T132 in Fig. 4.
[0050] When the terminal 10 accepts the selection of the setting object OB42 from the user in T140, the terminal 10 displays the print setting screen SC5 on the display unit 14 in T142. As shown in FIG. 7, the print setting screen SC5 includes a selection area R3 for selecting a print setting value and a cancel button OB51. The selection area R3 is an area for selecting (i.e., specifying) a print setting value. The user can change the print setting value within the range of the printer 100's capability information by selecting another option in the selection area R3. In the selection area R3, values corresponding to each item of the image setting value selected on the image generation setting screen SC2 (see FIG. 6) are specified as defaults. Here, "values corresponding to each item of the image setting value" refers to the value of an item that is suitable as a print setting value among the items of the selected image setting value. For example, in this case, four image setting values are selected: "A4," "600 dpi," "Color," and "Landscape." However, the print setting values include three values: "A4," "600 dpi," and "Color," but not "Landscape." This is because the item "Portrait or Landscape" corresponding to the image setting value "Landscape" does not exist among the print setting value items. In this way, values corresponding to each image setting value are specified as default print setting values (i.e., the values specified in selection area R3), so the user can easily have printer 100 print the target image using print setting values that conform to the image setting values without having to specify the print setting values again. However, as described below, the user may change the print setting values.
[0051] When the terminal 10 accepts an operation to change the print setting values from the user in T144, in T146 the terminal 10 displays the dialog D1 on the display unit 14, superimposed on the print setting screen SC5. In this case, the operation to change the print setting values includes an operation to change the value "A4" specified in the selection area R3 to "B5." The dialog D1 includes a message indicating that the print setting values have been changed, a message asking the user whether or not to regenerate the image, a YES button B1, and a NO button B2.
[0052] The reason why dialog D1 is displayed when the print setting value is changed is as follows. For example, as in the example above, when the print setting value is changed from "A4" to "B5," the size of the print medium used by printer 100 becomes smaller. However, the target image has already been generated to fit A4-sized paper. Therefore, when the target image is printed on the changed B5-sized paper, there is a possibility that part of the target image will be missing. In this embodiment, to prevent such an event from occurring, dialog D1 is displayed to ask the user whether or not to regenerate the image.
[0053] When the terminal 10 accepts the user's selection of the YES button B1 in the dialog D1 in T150, the terminal 10 displays the image generation setting screen SC6 on the display unit 14 in T152. As shown in FIG. 8, the changed print setting value is specified in the selection area R1 of the image generation setting screen SC6. That is, in the selection area R1 of the image generation setting screen SC6, "B5" is specified instead of the value "A4". Furthermore, the prompt "human face" already entered in T114 of FIG. 4 is entered in the input area R2 of the image generation setting screen SC6. The rest is the same as the image generation setting screen SC2 (see FIG. 6). In this way, in a situation where the user wishes to re-generate an image, the image generation setting screen SC6 is displayed without re-executing the processes such as T110 to T114 of FIG. 4. This improves user convenience.
[0054] (Case B-1) Case B-1 will be described, in which the image setting values and prompt are changed on the image generation setting screen SC6. At T154, the terminal 10 accepts from the user an operation to change "horizontal" to "vertical" in the selection area R1 and an operation to delete the prompt "human face" and input a new prompt "smiling face" in the input area R2. After that, the terminal 10 accepts the selection of a generated object OB21. In this case, at T156, the terminal 10 transmits a regeneration instruction to the AI server 200. The regeneration instruction includes the data ID already received at T124 in FIG. 4 and information changed compared to the previous generation instruction (i.e., the generation instruction at T116 in FIG. 4). Specifically, in this case, since both the image setting values and the prompt have been changed compared to the previous generation instruction, the regeneration instruction includes the data ID, the changed image setting values, and the changed prompt. In addition to the "smiling face," the new prompt to be input may be, for example, a "long-faced face," a "sad face," a "feminine face," a "masculine face," a "child's face," or the like.
[0055] When the AI server 200 receives a regeneration instruction from the terminal 10 in T156, in T160, it deletes the image setting values and prompts associated with the stored data ID and stores the image setting values and prompts included in the regeneration instruction in association with the data ID. Then, in T162, the AI server 200 generates an image in accordance with the image setting values and prompts included in the regeneration instruction. Hereinafter, the image generated in this manner will be referred to as the "regenerated image." Then, in T164, the AI server 200 transmits the data ID and image data representing the regenerated image to the terminal 10.
[0056] When the terminal 10 receives the data ID and image data from the AI server 200 in T164, it displays a generated image confirmation screen SC7 on the display unit 14 in T166. As shown in FIG. 8, on the generated image confirmation screen SC7, a preview image Im2 is placed in the preview area P. The preview image Im2 is an image corresponding to the image data already received in T164 (i.e., an image corresponding to the regenerated image). The rest is the same as the generated image confirmation screen SC3 (see FIG. 6).
[0057] When the terminal 10 accepts selection of print object OB32 from the user in T168, it displays a print preview screen SC8 on the display unit 14 in T170. As shown in FIG. 8, on the print preview screen SC8, a preview image Im2 is arranged in the preview area P. The rest is the same as the print preview screen SC4 (see FIG. 7). The processing of T172 to T176 is the same as the processing of T134 to T138 in FIG. 4, except that the print data is data representing a reproduced image.
[0058] (Case B-2) Next, we will explain case B-2, in which the prompt is not changed on the image generation setting screen SC6. In T184, the terminal 10 accepts selection of the generated object OB21 from the user without accepting changes to the image setting value and prompt. In this case, in T186, the terminal 10 sends a regeneration instruction to the AI server 200. Compared to the previous generation instruction, the image setting value has been changed from "A4" to "B5," so the regeneration instruction sent here includes the data ID and the changed image setting value. In other words, the regeneration instruction does not include a prompt. The subsequent processing is the same as the processing in T160 to T176, except that image data is generated in accordance with the regeneration instruction.
[0059] (Case C; Figure 9) Next, case C will be described with reference to Fig. 9. Case C is a case in which the target image is printed by printer 150 instead of printer 100. The processing in Fig. 9 is a continuation of the processing in Fig. 2. Note that in Fig. 9, the same processes as in Fig. 3 are assigned the same reference numerals as in Fig. 3, and detailed descriptions thereof will be omitted.
[0060] At T210, the terminal 10 accepts an operation of sliding the first area A1 of the image generation setting screen SC2 from right to left to display the entire device object OB12, i.e., an operation of selecting the device ID "dv2." In this case, the terminal 10 identifies, from the memory 34, the capability information of the printer 150 corresponding to the device object OB12, i.e., the capability information associated with the device ID "dv2."
[0061] Next, at T212, the terminal 10 displays the image generation setting screen SC11 on the display unit 14. As shown in FIG. 9, the image generation setting screen SC11 displays the entire device object OB12 in the first area A1. In addition, in the selection area R1, one value for each item included in the range of the capability information of the identified printer 150 (in this case, "A4," "300 dpi," "monochrome," and "landscape") is specified as a default. In this way, the selection area R1 includes each value that matches the capability information of the selected printer 150 as a default. The user can change the image setting values within the range of the capability information of the printer 150 by selecting another option in the selection area R1. That is, the application 38 displays the selection area R1 so that the image setting values can be changed within the range of the capability information of the printer 150. This allows the user to easily select image setting values for generating an image that the printer 150 can print appropriately. The rest is the same as the image generation setting screen SC2. The subsequent processing from T114 to T138 is the same as the processing from T114 to T138 in Figure 4, except that the target image is different (in particular, the image setting values used when the target image is generated by the AI server 200 are different) and the target image is printed by printer 150 instead of printer 100.
[0062] (Correspondence) Printers 100 and 150 are examples of "printing devices." In particular, printer 100 and printer 150 are examples of a "first printing device" and a "second printing device," respectively. In case A, etc., print execution unit 118 of printer 100 is an example of a "printing execution unit." In case C, print execution unit 150 (not shown) is an example of a "printing execution unit." CPU 32 and app 38 of terminal 10 are examples of a "computer" and a "computer program," respectively. AI server 200 is an example of an "image generation unit." Display unit 14 of terminal 10 is an example of a "display device." Performance information of printer 100, etc. is an example of "related information." In particular, performance information of printer 100 and performance information of printer 150 are examples of "first related information" and "second related information," respectively. The prompts "human face" and "smiling face" input in input area R2 are examples of a "first natural sentence" and a "second natural sentence," respectively. The prompt included in the generation instruction T116 in FIG. 4 and the prompt included in the regeneration instruction T156 in FIG. 5 are examples of "first natural language data" and "second natural language data", respectively. The image generated in T122 in FIG. 4 and the image generated in T162 in FIG. 5 are examples of "first generated image" and "second generated image", respectively. The image data T124 in FIG. 4 and the image data T164 in FIG. 5 are examples of "first generated image data" and "second generated image data", respectively. Preview image Im1, etc. are examples of "print preview image".
[0063] Image generation setting screens SC2 and SC6 are examples of an "image setting screen." First area A1, selection area R1, and input area R2 are examples of a "selection field," a "first setting field," and an "input field," respectively. The values specified in selection area R1 of image generation setting screen SC2 and the values specified in selection area R1 of image generation setting screen SC6 are examples of a "first image setting value" and a "second image setting value," respectively. Print setting screen SC5 displayed at T142 in FIG. 5 is an example of a "print setting screen." Selection area R3 is an example of a "second setting field." The print setting value specified in selection area R3 at T142 in FIG. 5 and the print setting value changed at T144 are examples of a "first print setting value" and a "second print setting value," respectively. Dialog D1 displayed at T146 in FIG. 5 is an example of an "inquiry screen."
[0064] The processes of T34 and T44 in FIG. 2 are examples of processes executed by a "related information receiving unit." The process of T114 in FIG. 4 is an example of processes executed by an "input receiving unit." The process of T116 in FIG. 4 is an example of processes executed by a "first supply unit." The processes of T132 and T112 in FIG. 4 and the processes of T142, T146, and T152 in FIG. 5 are examples of processes executed by a "first display control unit," a "second display control unit," a "third display control unit," a "fourth display control unit," and a "fifth display control unit," respectively. The processes of T156 and T186 in FIG. 5 are examples of processes executed by a "second supply unit." The processes of T124 in FIG. 4 and T164 in FIG. 5 are examples of processes executed by an "image data receiving unit." The processes of T136 in FIG. 4 and T174 in FIG. 5 are examples of processes executed by a "print control unit."
[0065] (Second embodiment; Figure 10) Next, a second embodiment will be described with reference to FIG. 10. The second embodiment differs from the first embodiment in that it further receives correspondence information from the AI server 200. The processing in FIG. 10 is a continuation of the processing in FIG. 2. In particular, in the second embodiment, the terminal 10 may receive device information including only the device ID without including capability information for the printer 100, etc., at T34, etc. in FIG. 2. The AI server 200 also stores capability information for each printer 100, 150 in advance. Specifically, the AI server 200 stores, for each printer model, a model name representing the model and the range of printing conditions (i.e., capability information) that can be used by the printer having that model name, in association with each other. Note that in FIG. 10, the same processes as in FIG. 3 are denoted by the same reference numerals as in FIG. 3, and detailed description thereof will be omitted.
[0066] In T110, the terminal 10 accepts from the user the selection of a function object OB15 corresponding to the image generation and printing function. In this case, the terminal 10 identifies, from the memory 34, the device ID "dv1" of the printer 100 corresponding to the device object OB11 whose entirety is displayed when the function object OB15 is selected. Then, in T310, the terminal 10 transmits the identified device ID "dv1" to the AI server 200.
[0067] When the AI server 200 receives the device ID "dv1" from the terminal 10 in T310, it identifies the capability information of the printer 100 identified by the device ID "dv1." Specifically, the AI server 200 identifies the model name of the printer 100 based on the received device ID "dv1." Next, the AI server 200 identifies the capability information stored in association with the identified model name as the capability information of the printer 100. Furthermore, the AI server 200 identifies its own capabilities related to image generation (i.e., image generation conditions). Then, in T312, the AI server 200 transmits the correspondence information to the terminal 10. The correspondence information includes values that are common between the identified capability information of the printer 100 and the identified image generation conditions, but does not include values that are not common. For example, if the printer 100's capability information includes the values "A4," "B5," and "Letter" as the item "paper size," and the image generation conditions include the values "A4" and "B5" as the item "paper size," the corresponding information includes "A4" and "B5" as values corresponding to the item "paper size," but does not include "Letter."
[0068] When the terminal 10 receives the corresponding information from the AI server 200 in T312, it displays the image generation setting screen SC2 on the display unit 14 in T112. The subsequent processing is the same as the processing from T114 to T132 in FIG. 4. In this embodiment, too, the application 38 for causing the printer 100 or the like to execute printing can cause the AI server 200 to generate a target image and cause the printer 100 to print the target image. The device ID included in the device information in T34 in FIG. 2 is an example of "related information."
[0069] Although specific examples of the technology disclosed in this specification have been described in detail above, these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and variations of the specific examples exemplified above. Modifications of the above examples are listed below.
[0070] (Variation 1) In the above embodiment, the application 38 is an example of a native application installed on the terminal 10. In a variation, the application 38 may be an application installed on, for example, the printer 100. In this case, the printer 100 may display the various screens of the above embodiment on the display unit 114 of the printer 100. In this variation, the CPU 132 of the printer 100 is an example of a "computer," and the display unit 114 of the printer 100 is an example of a "display device."
[0071] (Variation 2) Instead of app 38, which is a native app installed on terminal 10, for example, a web app may be used, a cloud app may be used, or an app realized by a combination of at least two of a native app, a web app, and a cloud app may be used. Here, "a combination of at least two" means, for example, a combination of a native app and a web app (a so-called hybrid app), a combination of a native app and a cloud app, etc.
[0072] For example, in an example where a web application is used instead of the application 38, the various processes of the above embodiment are realized by a cloud print server (not shown). In this modification, the CPU of the cloud print server is an example of a "computer," and the web application is an example of a "computer program." The display unit 14 of the terminal 10 is an example of a "display device." The cloud print server operates according to the web application on the server. The cloud print server transmits corresponding screen data (e.g., web page data, etc.) to the terminal 10, thereby displaying the various screens (SC1 to SC8, SC11, SC100 to SC102, etc.) described in the above embodiment on the display unit 14 of the terminal 10 via a web browser or WebView. The cloud print server receives information indicating an operation accepted on the various screens (e.g., an operation ID), various data for which a selection has been accepted, etc. from the terminal 10, and executes processing according to the operation. The operation ID is information indicating that an operation (i.e., selection) of an object, such as objects OB31 and OB32, has been accepted. The various data whose selection has been accepted include, for example, the selected device ID "dv1" (or "dv2"), the image setting values specified in the selection area R1, and data indicating the prompt entered in the input area R2. That is, the cloud print server accepts operations on various screens through the reception of the above-mentioned operation ID, various data, and the like. When the cloud print server receives an operation ID indicating that the operation of the print object OB41 has been accepted from the terminal 10, it transmits print data to the printer 100 (or printer 150) identified by the device ID "dv1" (or "dv2"). In this modified example, the device ID "dv1" (or "dv2") may include, in addition to the model name, a token for the cloud print server to communicate with the printer 100 (or printer 150), authentication information, the global IP address to which the printer 100 (or printer 150) belongs, and the like.
[0073] Furthermore, if the cloud print server cannot acquire local information such as the device ID from a web browser or the like due to security settings, a hybrid application may be created by combining a web application with a native application installed on the terminal 10. In this case, the native application can acquire local information such as the device ID stored in the memory 34 of the terminal 10 and send that information to the cloud print server. In this case, the cloud print server performs the same process as described above via the native application. The same applies when a cloud application is used instead of a web application.
[0074] (Variation 3) The communication system 2 may not include the AI server 200. In this variation, for example, an AI engine that executes various processes in place of the AI server 200 described above may be provided in the terminal 10. The AI engine includes a trained model. In this variation, the terminal 10 includes an "image generation unit." In another variation, an AI engine that executes various processes in place of the AI server 200 described above may be provided in the printer 100. The AI engine includes a trained model. In this variation, the printer 100 includes an "image generation unit."
[0075] (Variation 4) When the terminal 10 receives the data ID and image data at T124 in Fig. 4, the terminal 10 may omit the processes of T126 to T134 and send the print data to the printer 100 at T136. Generally speaking, the "first display control unit" can be omitted.
[0076] (Variation 5) The terminal 10 does not need to receive the printer 100's capability information from an external device such as the printer 100 or the AI server 200. In this case, the selection area R1 of the image generation setting screen SC2 may be configured to allow image setting values to be specified based on conditions outside the range of printing conditions available to the printer 100 (i.e., the capability information). In this variation, the "related information receiving unit" can be omitted. In another variation, when the function object OB15 corresponding to the image generation printing function is selected at T110 in FIG. 4, the terminal 10 may display a screen for inputting a prompt without displaying the image generation setting screen SC2, and when the prompt is input, send a generation instruction including the prompt to the AI server 200. In this variation, the "second display control unit" can be omitted.
[0077] (Variation 6) Image generation setting screen SC2 does not have to include input area R2 for inputting a prompt. In this case, terminal 10 may, for example, display a screen for inputting a prompt before image generation setting screen SC2 is displayed, or may display a screen for inputting a prompt after image generation setting screen SC2 is displayed. Generally speaking, an "image setting screen" does not have to include an "input field."
[0078] (Variation 7) The image generation setting screen SC2 does not need to include the first area A1. In this variation, in order to select a printer to print the target image, it is necessary to select the printer on the home screen SC1 or the like before the selection of the function object OB15 corresponding to the image generation and printing function is accepted. Generally speaking, the "image setting screen" does not need to include a "selection field."
[0079] (Variation 8) The print preview screen SC4 does not have to include the setting object OB42. That is, the terminal 10 does not have to display the print setting screen SC5. In this variation, the "third display control unit" can be omitted.
[0080] (Variation 9) In the above embodiment, the terminal 10 displays the print setting screen SC5 when the setting object OB42 is selected on the print preview screen SC4 (T140, T142 in FIG. 5). In a variation, the terminal 10 may display the print preview screen SC4 including a selection area R3 for changing the print setting values at T132 in FIG. 4. In another variation, the terminal 10 may display the print setting screen SC5 when the print object OB32 is selected on the generated image confirmation screen SC3 at T130. In another variation, the terminal 10 may display the print setting screen SC5 when image data is received from the AI server 200 at T124. Generally speaking, the timing for the "third display control unit" to display the print setting screen may be any time after the first generated image data has been accepted.
[0081] (Variation 10) Even if the print setting values are changed on the print setting screen SC5, the terminal 10 may re-display the print preview screen SC4 without displaying the dialog D1 (i.e., without regenerating the image). In this variation, the "fourth display control unit" and the "second supply unit" can be omitted.
[0082] (Variation 11) When the YES button B1 is selected in the dialog D1 (T150 in FIG. 5), the terminal 10 may send a regeneration instruction to the AI server 200 without displaying the image generation setting screen SC6. In this variation, the processes of T152 and T154 (or the processes of T152 and T184) can be omitted. Generally speaking, the "fifth display control unit" can be omitted.
[0083] (Variant 12) In the above embodiment, the processing of each step in Figure 2, etc. is realized by software (e.g., OS 36, application 38, programs 136, 236), but at least one of these processes may be realized by hardware such as a logic circuit.
[0084] The technical elements described in this specification or drawings may exhibit technical utility either alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. Furthermore, the technologies illustrated in this specification or drawings may achieve multiple objectives simultaneously, and achieving one of those objectives alone is technically useful.
[0085] In the scope of the claims at the time of filing, even if each claim depends on only some of the claims, it is not limited to the fact that each claim can depend on only those some of the claims. To the extent that there is no technical contradiction, each claim can also depend on other claims that were not dependent at the time of filing. In other words, the technology of each claim can be combined in various ways as follows: (Item 1) A computer program for causing a print execution unit of a printing device to print an image, The computer program controls a computer to operate in the following manner: an input receiving unit that receives input of natural language from a user to express a newly generated image; a first supply unit that, when an input of a first natural sentence is accepted, supplies a generation instruction including first natural sentence data representing the first natural sentence to an image generation unit; an image data receiving unit that receives, from the image generating unit, first generated image data representing a first generated image generated by the image generating unit based on the first natural sentence data; a print control unit that causes the print execution unit to print the first generated image represented by the first generated image data; A computer program that functions as a (Item 2) The computer program further causes the computer to: when the first generated image data is received from the image generation unit, functioning as a first display control unit that displays, on a display device, a print preview screen including a print preview image corresponding to the first generated image data; Item 2. The computer program according to item 1, wherein the print control unit causes the print execution unit to print the first generated image when printing of the first generated image is instructed on the print preview screen. (Item 3) The computer program further causes the computer to: a related information receiving unit that receives related information related to the capabilities of a printing device that includes the print execution unit; a second display control unit that, after the related information is received, causes a display device to display an image setting screen including a first setting field for specifying an image setting value for the first generated image, the first setting field being configured to allow the image setting value to be specified from candidates based on the related information; and It functions as the first supply unit, when the input of the first natural sentence is accepted and a first image setting value is specified in the first setting field included in the image setting screen, supplies the generation instruction including the first natural sentence data and the first image setting value to the image generation unit; 3. The computer program according to item 1 or 2, wherein the first generated image is generated by the image generation unit based on the first natural language data and the first image setting value. (Item 4) the image setting screen further includes an input field for accepting input of natural language; Item 3. The computer program of claim 3, wherein the first supply unit supplies the generation instruction including the first natural sentence data and the first image setting value to the image generation unit when input of the first natural sentence is accepted in the input field included in the image setting screen and the first image setting value is specified in the first setting field included in the image setting screen. (Item 5) the image setting screen further includes a selection field for selecting one printing device from one or more printing devices; The related information receiving unit accepting first related information relating to capabilities of a first printing device when a first printing device is selected from the one or more printing devices in the selection field; when a second printing device different from the first printing device is selected from the one or more printing devices in the selection field, receiving second related information related to capabilities of the second printing device; when the first printing device is selected in the selection field, the first setting field is configured to allow the image setting value to be specified from candidates based on the first related information; 5. The computer program according to item 3 or 4, wherein when the second printing device is selected in the selection field, the first setting field is configured to allow the image setting value to be specified from among candidates based on the second related information. (Item 6) The computer program further causes the computer to: a third display control unit that, when the first generated image data is accepted from the image generation unit, causes the display device to display a print setting screen including a second setting field for specifying print setting values for printing the first generated image, the second setting field including, as initial values, first print setting values corresponding to the first image setting values already specified in the first setting field; 6. The computer program according to any one of items 3 to 5, (Item 7) The computer program further causes the computer to: a fourth display control unit that causes the display device to display an inquiry screen for inquiring of the user whether or not the user wishes to regenerate an image when the print setting value is changed from the first print setting value to a second print setting value in the second setting field included in the print setting screen; a second supply unit that supplies a regeneration instruction including the first natural language data and second image setting values corresponding to the second print setting values to the image generation unit when the user selects on the inquiry screen that they wish to regenerate the image; It functions as the image data receiving unit receives, from the image generating unit, second generated image data representing a second generated image generated by the image generating unit based on the first natural language data and the second image setting value; 7. The computer program according to item 6, wherein the print control unit causes the print execution unit to print the second generated image represented by the second generated image data. (Item 8) The computer program further causes the computer to: a fifth display control unit that, when the user selects on the inquiry screen that he or she wishes to regenerate an image, causes the display device to display an image setting screen including an input field for receiving input of natural language; the second supply unit supplies the regeneration instruction, which includes second natural sentence data representing the second natural sentence and the second image setting value, to the image generation unit when input of a second natural sentence is accepted in the input field included in the image setting screen; 8. The computer program according to item 7, wherein the second generated image is generated by the image generation unit based on the second natural language data and the second image setting value. [Explanation of symbols]
[0086] 2: Communication system, 4: LAN, 6: Internet, 10: Terminal, 12, 112: Operation unit, 14, 114: Display unit, 16, 116, 216: Communication I / F, 30, 130, 230: Control unit, 32, 132: CPU, 34, 134, 234: Memory, 36: OS program, 38: Application program, 118: Print execution unit, 136, 236: Program, 200: AI server, 232: Processor
Claims
1. A computer program for causing a print execution unit of a printing device to print an image, The computer program controls a computer to operate in the following manner: an input receiving unit that receives input of natural language from a user to express a newly generated image; a first supply unit that, when an input of a first natural sentence is accepted, supplies a generation instruction including first natural sentence data representing the first natural sentence to an image generation unit; an image data receiving unit that receives, from the image generating unit, first generated image data representing a first generated image generated by the image generating unit based on the first natural sentence data; a print control unit that causes the print execution unit to print the first generated image represented by the first generated image data; A computer program that functions as a
2. The computer program further causes the computer to: when the first generated image data is received from the image generation unit, functioning as a first display control unit that displays, on a display device, a print preview screen including a print preview image corresponding to the first generated image data; The computer program product according to claim 1 , wherein the print control unit causes the print execution unit to print the first generated image when printing of the first generated image is instructed on the print preview screen.
3. The computer program further causes the computer to: a related information receiving unit that receives related information related to the capabilities of a printing device that includes the print execution unit; a second display control unit that, after the related information is received, causes a display device to display an image setting screen including a first setting field for specifying an image setting value for the first generated image, the first setting field being configured to allow the image setting value to be specified from candidates based on the related information; and It functions as the first supply unit, when the input of the first natural sentence is accepted and a first image setting value is specified in the first setting field included in the image setting screen, supplies the generation instruction including the first natural sentence data and the first image setting value to the image generation unit; The computer program according to claim 1 , wherein the first generated image is generated by the image generating unit based on the first natural language data and the first image setting value.
4. the image setting screen further includes an input field for accepting input of natural language; 4. The computer program of claim 3, wherein the first supply unit supplies the generation instruction including the first natural sentence data and the first image setting value to the image generation unit when input of the first natural sentence is accepted in the input field included in the image setting screen and the first image setting value is specified in the first setting field included in the image setting screen.
5. the image setting screen further includes a selection field for selecting one printing device from one or more printing devices; The related information receiving unit accepting first related information relating to capabilities of a first printing device when a first printing device is selected from the one or more printing devices in the selection field; when a second printing device different from the first printing device is selected from the one or more printing devices in the selection field, second related information relating to the capabilities of the second printing device is received; when the first printing device is selected in the selection field, the first setting field is configured to allow the image setting value to be specified from candidates based on the first related information; 4. The computer program product according to claim 3, wherein when the second printing device is selected in the selection field, the first setting field is configured to allow the image setting value to be specified from candidates based on the second related information.
6. The computer program further causes the computer to: a third display control unit that, when the first generated image data is accepted from the image generation unit, causes the display device to display a print setting screen including a second setting field for specifying print setting values for printing the first generated image, the second setting field including, as initial values, first print setting values corresponding to the first image setting values already specified in the first setting field; The computer program according to claim 3,
7. The computer program further causes the computer to: a fourth display control unit that causes the display device to display an inquiry screen for inquiring of a user as to whether or not the user wishes to regenerate an image when the print setting value is changed from the first print setting value to a second print setting value in the second setting field included in the print setting screen; a second supply unit that supplies a regeneration instruction including the first natural sentence data and second image setting values corresponding to the second print setting values to the image generation unit when the user selects on the inquiry screen that they wish to regenerate an image; It functions as the image data receiving unit receives, from the image generating unit, second generated image data representing a second generated image generated by the image generating unit based on the first natural sentence data and the second image setting value; The computer program product according to claim 6 , wherein the print control unit causes the print execution unit to print the second generated image represented by the second generated image data.
8. The computer program further causes the computer to: a fifth display control unit that, when the user selects on the inquiry screen that he or she wishes to regenerate an image, causes the display device to display an image setting screen including an input field for receiving input of natural language; the second supply unit supplies the regeneration instruction, which includes second natural sentence data representing the second natural sentence and the second image setting value, to the image generation unit when input of a second natural sentence is accepted in the input field included in the image setting screen; The computer program according to claim 7 , wherein the second generated image is generated by the image generating unit based on the second natural language data and the second image setting value.
9. A device for causing a print execution unit of a printing device to print an image, an input receiving unit that receives input of natural language from a user to express a newly generated image; a first supply unit that, when an input of a first natural sentence is accepted, supplies a generation instruction including first natural sentence data representing the first natural sentence to an image generation unit; an image data receiving unit that receives, from the image generating unit, first generated image data representing a first generated image generated by the image generating unit based on the first natural sentence data; a print control unit that causes the print execution unit to print the first generated image represented by the first generated image data; An apparatus comprising:
10. 1. A method for causing a print execution unit of a printing device to print an image, comprising: an input receiving step of receiving an input of natural language from a user expressing a newly generated image; a first supply step of, when an input of a first natural sentence is accepted, supplying a generation instruction including first natural sentence data representing the first natural sentence to an image generation unit; an image data receiving step of receiving, from the image generation unit, first generated image data representing a first generated image generated by the image generation unit based on the first natural sentence data; a print control step of causing the print execution unit to print the first generated image represented by the first generated image data; A method comprising:
Citation Information
Patent Citations
Computer program for terminal device and method to be executed by terminal device
JP2022085588A