Computer program, control method, and printing system

Abstract

To provide a mechanism for suitably determining a print setting on the basis of a print instruction input in a natural language, for example.SOLUTION: A user terminal (computer 110) receives a natural language input related to a print instruction from a user via a generative AI interaction area of a setting screen provided by a print application, and generates an instruction sentence to a generative AI service on the basis of the received natural language input. The user terminal also transmits the generated instruction sentence to a generative AI server, and acquires a print setting determined by a plug-in that extends a function of the generative AI service via the print application. The user terminal further generates a print job based on the acquired print setting and print data, and transmits the print job to a target printer to start printing.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a computer program, a control method, and a printing system. [Background technology]

[0002] In recent years, conversational AI such as chatbots and generative AI has been rapidly developed. Along with this development, a variety of services using conversational AI have been provided. Patent Document 1 proposes a printing assistance system that performs print settings for a print job via a chatbot. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-207513 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional technology has the following problem: Although the above-mentioned conventional technology performs print settings by repeating question and answer sessions via a chatbot, when an instruction for performing an operation other than print settings, such as a print instruction to a printer, is input, the input text is not accurately (appropriately) interpreted and the print settings are not performed. As a result, there is a problem in that it is difficult for a computer to automatically send a print job to a printer based on an input print instruction.

[0005] The present invention has been made in consideration of at least one of the above problems, and provides a mechanism for appropriately determining print settings based on print instructions input in natural language. [Means for solving the problem]

[0006] The present invention is characterized by the fact that, for example, a computer program functions as an acquisition means that acquires print settings via the print application, which are obtained when natural language input related to a print instruction from a user accepted via a print application running on the user terminal is input to a server that provides a generation AI service, and a control means that generates a print job based on the acquired print settings and print data, and sends the print job to a target printing device to start printing.

[0007] The present invention is also characterized by, for example, a computer program that causes a computer of a user terminal that provides a generation AI service to function as: a receiving means that receives natural language input related to printing instructions from a user via a generation AI dialogue area of ​​a settings screen; a generating means that generates an instruction statement for the generation AI service based on the received natural language input; an acquiring means that sends the generated instruction statement to a server that provides the generation AI service and acquires print settings determined by a plug-in that extends the functionality of the generation AI service; and a control means that inputs the acquired print settings into a printer driver.

[0008] The present invention also provides a printing system that includes, for example, a user terminal, a generation AI server that provides a generation AI service, an information processing device that extends the functionality of the generation AI service, and a printing device, wherein the user terminal includes: a receiving means for receiving natural language input related to a printing instruction from a user via a generation AI dialogue area of ​​a setting screen provided by a printing application; a generating means for generating an instruction statement for the generation AI service based on the received natural language input; a first acquisition means for sending the generated instruction statement to the generation AI server and acquiring print settings determined by a plug-in that extends the functionality of the generation AI service via the printing application; and a control means for generating a print job based on the acquired print settings and print data and sending the print job to a target printing device to start printing, and the information processing device includes: a second acquisition means for acquiring the instruction statement from the user terminal; a determination means for determining print settings based on the natural language input related to the print instruction; and a response means for responding to the user terminal with the determined print settings. [Effects of the Invention]

[0009] According to the present invention, print settings can be suitably determined based on print instructions input in natural language. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of a network configuration of a printing system according to an embodiment. [Figure 2A] FIG. 2 is a block diagram showing the hardware configuration of each device in the printing system according to the embodiment. [Figure 2B] FIG. 2 is a block diagram showing the hardware configuration of each device in the printing system according to the embodiment. [Figure 3] FIG. 1 is a block diagram showing the hardware configuration of a printer according to an embodiment. [Figure 4A] FIG. 2 is a block diagram showing a software configuration related to printing according to an embodiment. [Figure 4B]FIG. 2 is a block diagram showing a software configuration related to printing according to an embodiment. [Figure 5A] FIG. 10 is a diagram showing an example of a print application according to an embodiment. [Figure 5B] FIG. 10 is a diagram showing an example of a print application according to an embodiment. [Figure 6] FIG. 4 is a diagram showing a printing sequence according to an embodiment. [Figure 7] FIG. 10 is a diagram showing an example of an instruction sent to a generation AI server according to an embodiment. [Figure 8] FIG. 11 is a diagram showing an example of print settings transmitted to a print application 1110 according to an embodiment. [Figure 9] 4 is a diagram showing print setting possible values ​​stored in the storage unit 403 of the generation AI plug-in server 400 according to an embodiment. FIG. [Figure 10] 10 is a flowchart showing the processing procedure of a generation AI plug-in server 400 according to an embodiment. [Figure 11] 4 is a flowchart showing a processing procedure of a computer 110 according to an embodiment. [Figure 12] 10 is a flowchart showing a processing procedure of a printer driver 1420 according to an embodiment. [Figure 13] 10 is a flowchart showing a processing procedure of a printer driver 1420 according to an embodiment. [Figure 14] 11 is a flowchart showing a processing procedure of a print application 1110 according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0012] First Embodiment <System configuration> A first embodiment of the present invention will be described below. First, the network configuration of a printing system according to this embodiment will be described with reference to FIG.

[0013] As shown in FIG. 1, the printing system 100 includes a computer 110, which is a terminal device, a printer (printing device) 200 configured to be capable of printing, a generation AI server 300, and a generation AI plug-in server 400. For example, the computer 110 and the printer 200 are located in an office and are communicatively connected to each other via an internal company network 500. The internal company network 500 is connected to the external Internet 600 via a router (not shown). Here, the computer 110 is an example of a user terminal, and the generation AI plug-in server 400 is an example of an information processing device.

[0014] The generation AI server 300 is communicably connected to the computer 110, the printer 200, and the generation AI plug-in server 400 via the Internet 600 and the internal network 500. The generation AI server 300 is a server managed by a business providing a generation AI service. The generation AI plug-in server 400 is communicably connected to the computer 110, the printer 200, and the generation AI server 300 via the Internet 600 and the internal network 500. The generation AI plug-in server 400 is a server managed by a business providing a print service. In this embodiment, the generation AI server 300, the generation AI plug-in server 400, and the generation AI control (generation AI dialogue area) 1150 on the computer 110 shown in FIG. 5 are collectively referred to as a "generation AI system." Note that the hardware on which the generation AI server 300, the generation AI plug-in server 400, and the generation AI control 1150 reside may be separate entities or may reside as an integrated unit on the same hardware. The internal network 500 may be a wired or wireless connection.

[0015] <Hardware configuration> The hardware configuration of each device in the printing system 100 according to this embodiment will be described with reference to Figures 2A to 3. Figure 2A shows the hardware configuration of the computer 110 and the generation AI server 300. Figure 2B shows the hardware configuration of the generation AI plug-in server 400. Figure 3 shows the hardware configuration of the printer 200.

[0016] 2A, computer 110 has a display unit 101, an operation unit 102, a storage unit 103, a control unit 104, and a network communication unit 105, which are connected to each other so that they can communicate with each other. There are no particular limitations on the computer 110, and for example, a desktop or notebook personal computer, a tablet terminal, a smartphone, etc. can be applied. The control unit 104 is configured to include a CPU (Central Processing Unit) 141 and a memory 142, and controls the entire computer 110.

[0017] The display unit 101 is configured with a display such as an LCD panel and can display images, etc. The operation unit 102 is configured with a mouse, keyboard, etc. and can accept input operations by a user. The storage unit 103 is configured with a storage medium such as a hard disk or SSD and stores various programs (software) necessary for the computer 110 to operate. The programs are loaded into the memory 142 as needed and executed by the CPU 141. The programs include programs that cause the CPU 141 to execute each unit and function of the printing system 100. Note that these programs are not limited to those stored in the computer 110. The programs may be stored in, for example, the printer 200, the generation AI server 300, or the generation AI plug-in server 400, or may be stored in a distributed manner in the computer 110, the printer 200, the generation AI server 300, and the generation AI plug-in server 400. The network communication unit 105 inputs and outputs data to and from external devices via an external network.

[0018] The generation AI server 300 has a display unit 301, an operation unit 302, a memory unit 303, a control unit 304, and a network communication unit 305, which are connected to each other so that they can communicate with each other. The control unit 304 is configured to include a CPU 341, a memory 342, and a GPU (Graphics Processing Unit) 343, and controls the entire generation AI server 300. As such, the hardware configuration of the generation AI server 300 is almost the same as the hardware configuration of the computer 110, and therefore a detailed description will be omitted.

[0019] 2B, the hardware configuration of the generation AI plug-in server 400 is almost the same as the hardware configuration of the computer 110. Therefore, in this embodiment, a description of the hardware configuration of the generation AI server 300 and the generation AI plug-in server 400 will be omitted. It is preferable that the generation AI server 300 has a GPU 343, and the generation AI plug-in server 400 has a GPU 443.

[0020] 3, printer 200 has a display unit 201, an operation unit 202, a storage unit 203, a control unit 204, a network communication unit 205, and a printing unit 206, which are connected to each other so that they can communicate with each other. There are no particular limitations on printer 200 as long as it has a printing function, and for example, an MFP (Multi-Function Printer) or an SFP (Single Function Printer) can be used. Control unit 204 is configured to include a CPU 241 and memory 242, and controls printer 200 as a whole.

[0021] The display unit 201 is configured with a display such as a liquid crystal panel and can display, for example, images. The operation unit 202 is configured with a touch panel, various buttons, etc., and allows a user to input operations. The storage unit 203 is configured with a storage medium such as a hard disk or SSD, and stores various programs (software) necessary for the printer 200 to operate. The programs are loaded into the memory 242 as needed and executed by the CPU 241. The network communication unit 205 inputs and outputs data to and from external devices via an external network. The printing unit 206 converts digital data stored in the storage unit 203 or memory 242 into an image and prints it on printing paper in accordance with instructions from the control unit 204. The printing method is not particularly limited, and for example, an ink method, a toner method, or other method can be used.

[0022] <Software configuration> The software configuration of each device included in the printing system 100 according to this embodiment will be described with reference to Fig. 4. Fig. 4A shows the printing-related modules in the software configuration of the computer 110. Fig. 4B shows the printing-related modules in the software configuration of the generation AI server 300 and the generation AI plug-in server 400.

[0023] As shown in FIG. 4A, computer 110 has application 1100, generation AI client 1200, and OS (Operating System) 1400. Application 1100 includes any software such as security software, spreadsheet software, browser software, etc., and in the example of FIG. 4A, includes print application 1110. Print application 1110 is an application with a print function. There are no particular limitations on print application 1110, and examples include spreadsheet software with a print function, browser software, presentation software, etc.

[0024] When a print function of the print application 1110 is executed by a user operation, information displayed on the display unit 101 of the computer 110 is sent to the printer 200 and printing is performed. The print function is realized by calling an interface of a GDI (Graphic Device Interface) 1410 (described later).

[0025] The generation AI client 1200 represents client software executed on the computer 110. The generation AI client 1200 receives a user instruction from the print application 1110, generates an instruction to be sent to the generation AI server 300, and sends it to the generation AI server 300. Here, the instruction to be sent represents an instruction from the user to which additional instructions have been added.

[0026] The OS 1400 is software that controls the basic operations of the computer 110. The OS 1400 includes a GDI 1410, a printer driver 1420, and a spooler 1430. The printer driver 1420 is provided by a company that provides the printer 200. The application 1100, the printer driver 1420, and the like are all managed by the OS 1400 and become usable by being installed in the OS 1400. The printer driver 1420 may be provided by a company that provides the OS 1400 and pre-installed in the OS 1400. The GDI 1410 is a component within the OS 1400 that provides an interface related to drawing, such as printing, to the outside. The printer driver 1420 displays print settings for printing on the printer 200 on a UI (User Interface). The printer driver 1420 also generates drawing data (PDL: Page Description Language) that can be interpreted by the printer 200 when printing. The spooler 1430 performs processing to transmit the PDL generated by the printer driver 1420 to the printer 200. Note that although the configuration using Microsoft (registered trademark) Windows (registered trademark) as the OS has been described here, other OSs may also be used as the OS 14000. Furthermore, the print data that the printer driver 1420 receives from the print application 1110 may be not only GDI format data but also XML Paper Specification format data (XPS format data).

[0027] As shown in FIG. 4B, the generation AI server 300 includes an application 3100 and an OS 3400. The OS 3400 has a software configuration similar to that of the OS 1400, and therefore a description of the OS 3400 is omitted here. The application 3100 includes any software, and in the example of FIG. 4B, it includes a generation AI application 3110. The generation AI application 3110 is an application with a generation AI interpretation processing function. The generation AI application 3110 interprets instructions from the user sent from the generation AI client 1200 and determines a response to the instructions. Furthermore, the generation AI application 3110 determines whether a plug-in needs to be called and which plug-in should be called to perform the specified operation, depending on the given instruction. Furthermore, the generation AI application 3110 inputs information about the instruction sent from the generation AI client 1200 to the called plug-in. The plug-in referred to here is the generation AI plug-in 4100, which will be described later.

[0028] As shown in FIG. 4B, the generation AI plug-in server 400 has a generation AI plug-in 4100, a print setting generation AI 4200, and an OS 4400. Note that the OS 4400 has a software configuration that is almost the same as that of the OS 1400, and therefore a description of the OS 4400 will be omitted here. The generation AI plug-in 4100 is any software associated with the generation AI application 3110 and is called from the generation AI application 3110. The generation AI plug-in 4100 inputs instructions received from the generation AI application 3110 into the print setting generation AI 4200 and responds with the processing results to the generation AI application 3110. One or more generation AI plug-ins 4100 exist within the generation AI plug-in server 400.

[0029] The generation AI application 3110 determines which generation AI plug-in 4100 to call based on the interpretation process results of the input natural language. For example, if the generation AI application 3110 determines that the interpretation process results are related to changing print settings, it calls generation AI plug-in X; if it determines that the interpretation process results are related to executing print settings, it calls generation AI plug-in Y. The print setting generation AI 4200 is a language model constructed using big data such as text data and deep learning technology. The print setting generation AI 4200 determines the optimal combination of print settings contained in the input instruction text to achieve the user's desired printing.

[0030] <Example of setting screen> 5A, a print setting screen 1111 that the print application 1110 according to this embodiment displays on the display unit 101 will be described. On the print setting screen 1111 that the print application 1110 displays on the display unit 101, it is possible to input output condition instructions including print conditions when printing with the printer 200. In this way, in this embodiment, the print application 1110 also functions as an input means for inputting output conditions.

[0031] The print setting screen 1111 includes a printer selection control 1120, a print setting control 1130, a printer driver control 1140, a generation AI control 1150, and a print button 1161 as printing conditions. Note that the print setting screen 1111 may include output conditions other than these printing conditions. For example, if the printer 200 is configured to be capable of stapling, it may include a staple condition that sets the position and number of staples, etc. Furthermore, if the printer 200 is configured to be capable of cutting, it may include a cut condition that sets the cutting position, etc. The print button 1161 is an example of an operation object, and printing is performed by operating it.

[0032] In the printer selection control 1120, a list of printers that can be used by the computer 110, i.e., printers that can receive print jobs from the computer 110, is displayed on the UI based on printer data that has been stored in advance in the storage unit 103. By operating the printer selection control 1120, the user can select the printer 200 as the destination to which the print job will be sent. In FIG. 5A, the name of the printer 200 is "CCC Printer."

[0033] Print setting control 1130 is a setting area for setting print settings and includes number of copies control 1131, layout control 1132, color mode control 1133, and layout control 1134. Number of copies control 1131 is an item for setting the number of copies to be printed. In FIG. 5A, number of copies control 1131 is set to "1." Layout control 1132 is an item for selecting the print orientation relative to the paper. In this embodiment, "portrait" which sets the print orientation vertically and "landscape" which sets the print orientation horizontally can be selected. In FIG. 5A, layout control 1132 is set to "portrait." Color mode control 1133 is an item for selecting "color" to set color printing and "monochrome" to set monochrome printing. In FIG. 5A, color mode control 1133 is set to "color." Note that print setting control 1130 is not limited to including number of copies control 1131 to color mode control 1133, and it is sufficient if it includes at least one of these items. The print setting control 1130 may also include other setting items, such as an item for selecting paper size, an item for selecting single-sided printing or double-sided printing, and an item for selecting the number of pages to be printed per sheet of paper. The layout control 1134 is an item for selecting the manuscript pages to be printed per sheet of paper in layout printing. The layout control 1134 has setting values ​​such as "1 in 1," which prints one manuscript page per sheet of paper, "2 in 1," which prints two manuscript pages per sheet of paper, and "4 in 1," which prints four manuscript pages per sheet of paper. In FIG. 5A, the layout control 1134 is set to "4 in 1." If a user wishes to conserve paper when printing, setting the setting value of the layout control 1134 allows the user to obtain the intended printed matter.

[0034] When the user operates the printer driver control 1140, it displays a detailed print setting screen provided by the printer driver corresponding to the "CCC Printer" displayed in the printer selection control 1120. This allows the user to change the print setting values ​​on the print setting screen of the printer driver in detail. When the user closes the print setting screen of the printer driver, the changes to the print setting values ​​on the print setting screen are saved in the storage unit 103.

[0035] The generation AI control 1150 includes a chat display area 1151, an instruction input area 1152, and an execute button 1153. The print application 1110 interactively displays instructions (natural language) entered by the user in the chat display area 1151 and statements corresponding to processing execution results received from the generation AI server 300. The print application 1110 provides a function for inputting arbitrary instructions representing processing content in the instruction input area 1152. The user can input instructions, for example, via the operation unit 102 such as a keyboard. Alternatively, the user's speech may be received as voice input via a microphone (not shown). In FIG. 5A, the instruction "Print in a paper-saving manner" is input in Japanese into the instruction input area 1152. Note that the text entered into the instruction input area 1152 is not limited to text instructing changes to layout printing settings, and can be any text, such as changing the color mode or enlarging or reducing the print area. The execute button 1153 is a button for sending instructions, including the instruction entered in the instruction input section 1152, to the generation AI server 300. Furthermore, it is desirable to reflect the determined print settings, such as 4 in 1, in the corresponding control, layout control 1134, as shown in Figure 5A, according to the instruction entered in the instruction input section 1152. In other words, each control of the print settings can be set according to user input, but settings according to the interaction of the generation AI control 1150 may also be reflected.

[0036] <Preview display> 5B, a preview display that the printer driver 1420 according to this embodiment displays on the display unit 101 will be described. The processing described here corresponds to the processing from S626 to S631 in the sequence diagram of FIG. 6, which will be described later. When the user presses the print button 1161 on the print setting screen 1111 displayed by the print application 1110, a print execution instruction is sent to the printer driver 1420 via the spooler 1430. The printer driver 1420 references the print settings determined by the print setting generation AI 4200 and the print settings set via the print setting control 1130 to generate a print preview image and presents a print preview image display UI 1170 to the user.

[0037] The print preview image display UI 1170 includes a print preview display area 1171 and a cancel button 1172. When the printer driver 1420 sends a print job to the printer 200, the printer driver 1420 displays a preview image of the print result generated by the printer driver 1420 in the print preview display area 1171. This allows the user to check the printed material to be printed by the printer 200 before the printed material is output. It is possible that the preview image displayed in the print preview image display UI 1170 may differ from the image the user envisioned. If the user feels that they want to change the print settings, the user can cancel the print job transmission process for the content displayed in the print preview image display UI 1170 by pressing the cancel button 1172. Alternatively, the user can stop printing that has already started. In this way, the cancel button 1172 is an example of an operation object. The cancel button 1172 may be operable until a predetermined timing. The predetermined timing may be, for example, the timing when printing starts, the timing when feeding of the last sheet of paper starts if multiple sheets of paper are used in the print job, or the timing immediately before printing is completed. Also, if a print button (not shown) is provided, the predetermined timing may be the timing when the print button is operated.

[0038] Note that the print setting screen 1111 of the print application 1110 may display a preview preview button (not shown) that allows a print preview image to be displayed in advance. In this case, a preview display such as that shown in FIG. 5B is performed when the button is pressed. At this time, the preview display screen may include an operation object for printing, similar to the print button 1161 included in the print setting screen 1111. In this way, the present invention is not intended to be limited to displaying the print preview image display UI 1170 when the printer driver 1420 sends a print job to the printer 200. For example, the print preview image display UI 1170 may be displayed at any timing, such as by providing a preview display button in the printer driver 1420 and displaying the print preview image display UI 1170 to the user when the user presses the preview display button.

[0039] <sequence> 6, we will explain the processing sequence performed between the components constituting the computer 110, the generation AI server 300, and the generation AI plug-in server 400 in this embodiment. The numbers following "S" below indicate the step numbers in the sequence.

[0040] In S601, the print application 1110 creates content to be printed in accordance with user instructions. Examples of content include presentation slides, document materials, charts, and graphs. After content creation is complete, the print application 1110 accepts instructions from the user in S602 and displays a print setting screen 1111 on the display unit 101 in S603. Next, in S604, the print application 1110 accepts print instructions for achieving desired printing using natural language in an instruction input unit 1152 within the print setting screen 1111. An example of a print instruction is an instruction that includes printing conditions, such as "I want to print using as little paper as possible." In S605, the print application 1110 inputs the print instructions input by the user, the IP address of the computer 110, and the name of the printer (print queue name) selected as the print job destination to the generation AI client 1200. In this way, the print application 1110 inputs the IP address, which is the identification information of the device (user terminal) that requested the print instruction, and the name (printer name), which is the identification information of the selected print device, along with natural language input via the print setting screen 1111. Note that it is possible that the printer queue selected by the print application does not match the print queue determined by the generation AI plug-in server 400. In such a case, a printer queue change instruction may be sent to the print application.

[0041] Upon receiving the print instruction, in S606 the generation AI client 1200 uses the received information to generate an instruction statement to be sent to the generation AI server 300. In addition to the print instruction entered by the user, the instruction statement includes additional information such as the IP address of the computer 110 to identify the sender of the instruction statement and the name of the printer selected as the destination of the print job on the print setting screen 1111. The instruction statement to be sent to the generation AI server 300 will be described later using a specific example in Figure 7. Next, in S607 the generation AI client 1200 sends the generated instruction statement to the generation AI application 3110 of the generation AI server 300.

[0042] Upon receiving the instruction, in S608 the generation AI application 3110 interprets the contents of the instruction and determines the generation AI plug-in 4100 to call. Then, in S609 the generation AI application 3110 inputs the instruction received from the generation AI client 1200 to the determined generation AI plug-in.

[0043] Upon receiving the instruction statement, the generation AI plug-in 4100 inputs the received instruction statement to the print setting generation AI 4200 in S610. In S611, the print setting generation AI 4200 interprets the print instruction from the user contained in the instruction statement, and then references the settable print setting value combinations shown in FIG. 9 (described later) to determine the optimal combination of print settings for obtaining the output result desired by the user. Note that the settable print settings differ depending on the type of printer 200.

[0044] With this configuration, the print setting generation AI 4200 can determine print settings that can be specified on the printer 200. Next, in step S612, the print setting generation AI 4200 responds to the generation AI plug-in 4100 with the determined combination of print settings as a determination result. For example, in response to a print instruction such as "I want to print while saving as much paper as possible" input to the instruction input unit 1152, the print setting generation AI 4200 responds with a value of "4 in 1" as the value of the layout 805 in FIG. 8 (described later). If the print settings to be set obtained by interpreting the instruction are not executable on a selectable printing device, the AI ​​plug-in 4100 may instead respond with an error indicating that the print settings cannot be set according to the instruction. For example, if a user inputs an instruction generated in accordance with the natural language command "Print in color," it is possible that a selectable printing device cannot print in color. In this case, the print setting generation AI may return an error instead of the print settings, and the print application 1110 may display an error message stating, "Print settings cannot be set because this printer is not a color printer."

[0045] As in S612, in S613 the generation AI plug-in 4100 responds to the generation AI application 3110 with the determined combination of print settings as the judgment result. Then, in S614 the generation AI application 3110 responds to the generation AI client 1200 with the received combination of print settings as the judgment result, and in S615 the generation AI client 1200 responds to the print application 1110 with the received combination of print settings as the judgment result.

[0046] Next, in S616, the print application 1110 refers to the received determination result and sends a print setting reflection instruction to the spooler 1430. For example, if the value of "4in1" is received as the value of the allocation 805, the print application 1110 sends an instruction to the spooler 1430 to reflect the value of "4in1" as the print setting of the printer driver 1420. In S617, the spooler 1430 sends a print setting reflection instruction to the printer driver 1420 in accordance with the request from the print application 1110.

[0047] In S618, the printer driver 1420 references the print setting reflection instruction and reflects the print setting values. In S619, the printer driver 1420 responds to the print application 1110 with the print setting reflection result in the printer driver 1420. For example, if the print setting values ​​are successfully reflected in S618, a response indicating that the reflection was successful is returned. In S620, the print application 1110 reflects the settings in the layout control 1134. In S621, the print application 1110 responds to the generation AI client 1200 with the print setting reflection result in the print application 1110. For example, if the print setting values ​​are successfully reflected in S620, a response indicating that the reflection was successful is returned.

[0048] In S622, the generation AI client 1200 generates a response sentence to be displayed in the chat display area 1151, and in S623, the generation AI client 1200 displays the generated response sentence in the chat display area 1151. For example, if the response in S621 indicates that the reflection was successful, the generation AI client 1200 generates and displays the response sentence "4-in-1 setting completed." Note that, after accepting the natural language input, a communication error may occur between the computer 110 and the generation AI server 300 or the generation AI plug-in server 400. In such a case, instead of the response sentence, information indicating a network error may be presented to the user. Next, in S624, the generation AI client 1200 responds with the display result to the print application 1110. For example, if the generation and display of the response sentence in S623 was successful, the response indicates that the display was successful. Then, in S625, the print application 1110 displays a response sentence indicating that the display was successful to the user.

[0049] In S626, the print application 1110 receives a print execution instruction from the user. This instruction is realized, for example, when the user presses the print button 1161. Then, in S627, the print application 1110 sends a print instruction to the spooler 1430, and in S628, the spooler 1430 sends a print execution instruction to the printer driver 1420. This print execution instruction may include print setting value data and content to be printed.

[0050] In S629, the printer driver 1420 acquires the content to be printed. The content to be printed may be included in the print instruction, or data stored in the computer 110 or data stored in the printer 200 or another external device may be used. In S630, the printer driver 1420 references the print setting value data and the content to be printed and generates a print preview image. In S631, the printer driver 1420 displays the generated print preview image to the user. Having received the instruction to execute the print process, the printer driver 1420 generates a print job based on the instruction in S632 and sends the generated print job to the printer in S633. The printer that received the print job executes the print process according to the contents of the print job in S634, and this sequence ends.

[0051] <Example of a directive> Referring to Figure 7, an example of the instruction sent to the generation AI server 300 in S607 above will be described. The instruction includes information 701 to 704. 701 indicates the print instruction entered by the user in the instruction input section 1152 in S604. 702 indicates the printer name set in the printer selection control 1120 as the printer to which the print job is to be sent. 703 describes the IP address of the computer 110. 704 describes the instruction content for the generation AI application 3110. Specifically, this instruction content inquires about the combination of print settings according to the instruction statement from the user. Note that 702, 703, and 704 are not explicitly entered in the instruction input section 1152, but are text automatically added by the generation AI client 1200. The generation AI application 3110 determines the plug-in to be called by interpreting the content of this instruction statement.

[0052] <Print settings> 8, the print setting value data that the generation AI plug-in server 400 according to this embodiment sends to the print application 1110 via the generation AI server 300 will be described. As shown in Fig. 8, the print setting value data includes print setting data related to paper size 803, paper type 804, layout 805, and color mode 806, using the IP address 801 and printer name 802 of the printing device that will perform printing as keys.

[0053] Furthermore, the print setting value data includes a print standby time 807. This indicates the print standby time when the print application 1110 sends a print execution instruction to the spooler 1430. The print standby time is stored in the storage unit 103 of the computer 110, and when the print standby time is "0 seconds," for example, the print application 1110 sends a print instruction to the spooler 1430 without any standby time upon receiving a print instruction from the user. On the other hand, when the print standby time is "100 seconds," for example, the print application 1110 sends a print instruction to the spooler 1430 after 100 seconds have elapsed upon receiving a print instruction from the user.

[0054] Next, the combination data of print setting values ​​stored in the storage unit 403 of the generation AI plug-in server 400 according to this embodiment will be described with reference to Fig. 9. Fig. 9 illustrates data relating to settable combinations of print setting values, including a printer name 901, settable paper sizes 902, settable paper types 903, settable layouts 904, and settable color modes 905. This data will be referred to as print setting value data.

[0055] The print setting value data and print setting possible value data may be stored in the memory unit 103 of the computer 110, the memory unit 303 of the generation AI server 300, the memory unit 403 of the generation AI plug-in server 400, or the memory unit 203 of the printer 200. Alternatively, the generation AI plug-in server 400 may obtain the data from an external network (not shown).

[0056] The generated AI plug-in server 400 can identify the print setting value data shown in Fig. 8 by referencing the print setting value data shown in Fig. 9. For example, with regard to paper size, when the printer name 802 in the print setting value data is "AAA Printer," the generated AI plug-in server 400 refers to the value in the row corresponding to "AAA Printer" in the print setting value data in Fig. 9. The generated AI plug-in server 400 then refers to the settable paper size 901 and determines that the values ​​"A4" and "A5" are selectable.

[0057] Furthermore, the generation AI plug-in server 400 references the natural language input entered by the user and determines whether "A4" or "A5" is the appropriate setting value for the paper size 803 to be returned to the computer 110. If it cannot be determined from the natural language input, it may be controlled to select a default setting value, for example. This allows the generation AI plug-in server 400 to appropriately select a paper size value that can be used with the printer corresponding to the printer name in the print setting value data. Note that the print settings shown in Figures 8 and 9 are merely examples and are not intended to limit the present invention. For example, any other print settings can be combined instead or in addition. Furthermore, the print standby time does not have to be added to the print setting data in FIG.

[0058] <Print setting generation AI processing procedure> The processing procedure of the print setting generation AI 4200 executed by the generation AI plug-in server 400 according to this embodiment will be described with reference to Fig. 10. The processing described below corresponds to the processing from S609 to S613 in the sequence diagram of Fig. 6. The processing described below is realized, for example, by the CPU 441 of the generation AI plug-in server 400 reading a program stored in the storage unit 403 into the memory 442 and executing it.

[0059] In S101, the CPU 441 acquires, via the generation AI server 300, an instruction statement created from a user instruction input to the computer 110. As shown in Fig. 7, the instruction statement includes a print instruction 701 from the user, an IP address 703 of the computer 110 that identifies the sender of the instruction statement, and a destination printer name 702. In S102, the CPU 441 acquires the printer name from the received instruction statement.

[0060] In S103, the CPU 441 interprets the instruction statement acquired in S101. Specifically, the CPU 441 interprets the instruction content 704 shown in FIG. 7 and the print instruction 701 from the user. For example, here, keywords related to print settings are extracted from the instruction content and used as search keys when acquiring a combination of print settings. Next, in S104, the CPU 441 searches for specifiable print settings from the print setting available value data in FIG. 9 using the printer name acquired in S102 and the search keywords extracted in S103. Then, in S105, the CPU 441 determines the combination of print settings that was searched for, and in S106, responds with the processing result to the generation AI server 300, thereby ending the processing of this flowchart.

[0061] Note that the above description describes an example in which specifiable print settings are searched for from the print setting available value data of Figure 9 using the printer name acquired in S102 and the search keyword extracted in S103, but the method of searching for specifiable print settings is not limited to this. For example, the generation AI plug-in server 400 may have a recommendation function that stores data related to print settings searched for in the past in the memory unit 403, learns patterns from the data, and uses them as search patterns for the next print settings. In this case, the generation AI plug-in server 400 may use the recommendation function to search for specifiable print settings.

[0062] <User terminal processing procedure> The processing procedure of the computer (user terminal) 110 according to this embodiment will be described with reference to Fig. 11. The processing described below is realized, for example, by the CPU 141 of the computer 110 reading a program stored in the storage unit 103 into the memory 142 and executing the program.

[0063] First, in S201, the CPU 141 displays the print setting screen 1111 on the display unit 101 in response to an instruction from the print application 1110. Therefore, the print setting screen 1111 is an example of a receiving means. In S202, the CPU 141 determines whether or not natural language input has been received from the user via the generation AI control (generation AI dialogue area) 1150 of the print setting screen 1111. If natural language input has been received, the process proceeds to S203; if not, the process proceeds to S206.

[0064] In S203, the CPU 141 generates an instruction statement as shown in FIG. 7 based on the received natural language input and printing device selection information, etc. Next, in S204, the CPU 141 inputs the generated instruction statement to the generation AI server 300, thereby acquiring the print settings determined by the generation AI plug-in server 400. Thereafter, in S204, the CPU 141 confirms the acquired print settings with the user via the print setting screen 1111. Here, as shown in FIG. 5A, the CPU 141 may confirm that the determined print settings (e.g., 4 in 1) have been set in the generation AI control 1150 of the print setting screen 1111, and may also inquire as to whether or not to execute printing. Then, in S205, the CPU 141 updates the setting contents of the print setting control 1130 on the print setting screen 1111 according to the acquired print settings.

[0065] Thereafter, in S206, the CPU 141 determines whether a print instruction has been received. The print instruction here is a print instruction received by operating the print button 1161 or via the generation AI control 1150. If a print instruction has been received, the process proceeds to S207; if not, the process of this flowchart ends. Note that the process here may also end when the print setting screen 1111 is closed by pressing the cancel button on the screen. Then, in S207, the CPU 141 causes the selected printing device via the printer driver 1420 to execute printing, and the process of this flowchart ends.

[0066] <Send print job> The print job transmission processing procedure of the printer driver 1420 according to this embodiment will be described with reference to Fig. 12. The processing described below is realized, for example, by the CPU 141 of the computer 110 reading a program stored in the storage unit 103 into the memory 142 and executing it.

[0067] The processing of this flowchart begins when the printer driver 1420 accepts a print execution instruction in S301. Then, in S302, the printer driver 1420 acquires the print settings sent from the print application 1110. Furthermore, in S303, the printer driver 1420 acquires the print content sent from the print application 1110. Then, in S304, the printer driver 1420 generates a preview image by referencing the print settings acquired in S302 and the image content acquired in S303.

[0068] In S305, the printer driver 1420 displays the print preview image display UI 1170. Then, in S306, the printer driver 1420 generates a print job from the print settings acquired in S302 and the image content acquired in S303. Furthermore, in S307, the printer driver 1420 transmits the print job generated in S306 to the printer 200.

[0069] When the print job is sent, in S308 the printer driver 1420 determines whether the user has pressed the cancel button 1172 on the print preview image display UI 1170. If the cancel button 1172 has been pressed, the printer driver 1420 performs processing to cancel the print job sent in S309, aborts the print job sending processing in S307, and ends the processing of this flowchart. On the other hand, if the cancel button 1172 has not been pressed, the printer driver 1420 ends the processing of this flowchart when it receives a job sending completion notification from the printer. Note that the cancel button 1172 may be pressed in S308 not only during the print job sending processing, but also before the start or after the end of the print job sending processing, and the print job cancellation processing may be performed in S309.

[0070] <Consumables shortage monitoring> Referring to Figure 13, the process procedure for sending a print job by the printer driver 1420 when monitoring a shortage of consumables in this embodiment will be described. The process described below is realized, for example, by the CPU 141 of the computer 110 reading a program stored in the storage unit 103 into the memory 142 and executing it. Control for monitoring a shortage of consumables may be enabled or disabled according to settings made by a user operation. Also, this flowchart is a modified example of the flowchart in Figure 12, and may be executed in combination with the flowchart in Figure 12. In that case, control related to consumables is added to the flowchart in Figure 12.

[0071] The processing of this flowchart begins when the printer driver 1420 accepts a print execution instruction in S401. Next, in S402, the printer driver 1420 acquires the planned usage amount of consumables sent from the print application 1110. This planned usage amount of consumables represents the amount of consumables, such as ink and paper, that the print application 1110 estimates will be used in the current print process. For example, assume that the total number of pages of the content to be printed this time is "6 sheets," the number of copies 1131 is "1 copy," and the layout 1134 is "2 in 1." In this case, the print application 1110 can estimate that the number of sheets of paper to be used this time will be "3 sheets." The print application 1110 sends this estimated planned usage amount, along with print settings, to the printer driver 1420 via the spooler 1430.

[0072] The method for estimating the planned ink usage is not limited to the above method, and any other method can be applied. For example, when estimating the planned ink usage, the printer driver 1420 may acquire ink usage data per page from the storage unit 203 of the printer 200 and estimate the planned ink usage by combining this with data on the number of pages to be printed.

[0073] In S403, the printer driver 1420 acquires the print content sent from the print application 1110. Then, in S404, the printer driver 1420 acquires the available amount, which indicates how much of the consumables are currently available for use, from the printer 200. Here, the printer 200 acquires the available amount by acquiring, from the storage unit 303, information indicating how much of the consumables remain in ink tanks and trays (not shown).

[0074] Next, in S405, printer driver 1420 compares the planned usage amount acquired in S402 with the available usage amount acquired in S404, and determines whether the planned usage amount is greater. For example, when data is acquired indicating that the planned usage amount is "3 sheets" of paper and the available usage amount is "2 sheets," printer driver 1420 determines that the planned usage amount is greater. If it determines that the planned usage amount is greater than the available usage amount, the process proceeds to S406; otherwise, the process proceeds to S407. Note that even if the planned consumable amount does not exceed the available usage amount, if the difference between the available usage amount and the planned consumable amount (available usage amount - planned usage amount) is below a threshold amount indicating a predetermined lower limit allowable amount, it may be determined that there is a shortage of consumables and the process may proceed to S406.

[0075] In step S406, the printer driver 1420 displays an error message such as "Consumables are missing" on the display unit 101 of the computer 110, and the process of this flowchart ends. This allows the user to notice that the consumables set in the printer 200 are missing, and by properly setting the missing consumables in the printer 200, the user can resume printing.

[0076] If it is determined that the planned usage amount and the available amount are equal or that the available amount is greater than the planned usage amount, the printer driver 1420 generates a print job in S407. Then, in S408, the printer driver 1420 sends the print job to the printer 200, and the processing of this flowchart ends.

[0077] <Print standby control> The print instruction processing procedure in the print application 1110 when controlling the print standby time according to this embodiment will be described with reference to Fig. 14. The processing described below is realized, for example, by the CPU 141 of the computer 110 reading a program stored in the storage unit 103 into the memory 142 and executing it.

[0078] First, in S501, the CPU 141 displays the print setting screen 1111 on the display unit 101 in response to an instruction from the print application 1110. In S502, the CPU 141 determines whether or not natural language input has been accepted from the user via the generation AI control 1150 of the print setting screen 1111. If natural language input has been accepted, the process proceeds to S503; otherwise, the process proceeds to S505. Here, in this embodiment, the natural language input entered by the user into the instruction input unit 1152 is assumed to be natural language input including instructions regarding print wait time, such as "print immediately," "print in 5 minutes," or "print when the printer print queue is cleared."

[0079] 7 based on the received natural language input and the printing device selection information, etc. Next, in S504, the CPU 141 inputs the generated instruction to the generation AI server 300, thereby acquiring the print standby time 807 included in the print settings determined by the generation AI plug-in server 400. For example, when the user inputs "print immediately" and "print in 5 minutes" as natural language inputs into the instruction input unit 1152, the values ​​"0 seconds" and "300 seconds," respectively, are acquired as the print standby time 807. Then, in S505, the CPU 141 receives a press of the print button 1161 by the user.

[0080] When the print button 1161 is pressed, in S506 the CPU 141 checks whether "0 seconds" or positive number data other than "0 seconds" has been entered in the print standby time 807. If "0 seconds" has been entered in the print standby time 807, the process proceeds to S509, where the CPU 141 sends a print instruction to the printer driver 1420 via the spooler 1430, and the processing of this flowchart ends.

[0081] On the other hand, if positive number data other than "0 seconds" is input into the print standby time 807, in S507 the CPU 141 uses the timer function of the OS 1400 to set a timer for the time input into the print standby time 807. Then, in S508 the CPU 141 puts printing on hold until the number of seconds set into the print standby time 807 has elapsed. When the number of seconds set into the print standby time 807 has elapsed, in S509 the CPU 141 sends a print instruction to the printer driver 1420 via the spooler 1430, and ends the processing of this flowchart.

[0082] As described above, the printing system according to this embodiment includes a user terminal, a generation AI server that provides a generation AI service, an information processing device that extends the functionality of the generation AI service, and a printing device. The user terminal (computer 110) accepts natural language input related to print instructions from a user via the generation AI dialogue area of ​​a settings screen provided by a printing application, and generates instructions for the generation AI service based on the accepted natural language input. The user terminal then sends the generated instructions to the generation AI server and acquires print settings determined by a plug-in that extends the functionality of the generation AI service via the printing application. The user terminal then generates a print job based on the acquired print settings and print data, and sends the print job to the target printing device to start printing. The information processing device (generation AI plug-in server 400) acquires the instructions from the user terminal, determines print settings based on the natural language input related to the print instructions, and returns the determined print settings to the user terminal. As described above, according to this embodiment, the print setting generation AI interprets the print instructions provided by the user in natural language, enabling optimal print settings to be automatically determined. Furthermore, since the generation AI plug-in server 400 provided by the business that provides the printer 200 determines the print settings, it is possible to determine print settings that can be specified on the printer 200 and that take advantage of the printing capabilities of the printer 200. Furthermore, in this embodiment, the print application 1110 can use the determined print settings and the content to be printed to perform printing using the automatically determined print settings.

[0083] <Modification> The present invention is not limited to the above-described embodiments, and various modifications and variations are possible within the scope of the gist of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or storage medium, and having one or more processors in the computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0084] In the above embodiment, the computer 110 has an operation unit for inputting output conditions for the printer 200. However, the present invention is not limited to this, and it is sufficient that at least one of the computer 110, the generation AI server 300, the generation AI plug-in server 400, and the printer 200 has the operation unit. The operation unit may be displayed on a browser UI such as Microsoft (registered trademark) Edge or Google (registered trademark) Chrome. The operation unit may also be displayed on a generation application UI such as ChatGPT, a print application UI such as Microsoft (registered trademark) Office, or a chat application UI such as Microsoft Teams.

[0085] Furthermore, in the above embodiment, print settings such as the number of copies, layout, and allocation that are included in a standard printer driver 1420 have been described, but the present invention is not limited to this. Depending on the printer 200, there may be cases where functions such as stapling settings and bookbinding settings are included or not. Even in this case, automatic print settings such as those in the above embodiment can be achieved by performing a process such as obtaining device information about the printer 200 in advance.

[0086] Furthermore, in the above embodiment, it is conceivable that the print setting data stored in the storage unit may actually be transmitted and received in different data formats, such as PrintTicket or devmode, depending on the OS 1400 or printer driver 1420. The present invention is applicable to transmission and reception of such various data formats. Furthermore, in the above embodiment, it is assumed that in S637 the printer driver 1420 transmits a print job to the printer 200 connected to the same network 500 as the computer 110. However, the present invention is not limited to this. For example, in S637 the printer driver 1420 may upload the print job to a print service on the cloud, and print the job via the cloud on a printer connected to a network different from that of the computer 110.

[0087] Furthermore, in the printing system 100, for example, the generation AI server 300 (hereinafter referred to as the "server") may be located outside Japan, while the terminal device, computer 110 (hereinafter referred to as the "terminal device"), may be located within Japan. Even in this case, files and data may be transmitted from the server to the terminal device, and the terminal device may receive the files and data. Even if the server is located outside Japan, the transmission and reception (transmission and reception) of files and data in this system are performed as a single entity. Since the system functions when a terminal device located within Japan receives the files and data, the transmission and reception can be considered to have occurred within Japan. In this system, for example, even if the server is located outside Japan and the terminal device is located within Japan, the terminal device can perform the main functions of the system, and the effects of those functions can be realized within Japan. For example, even if the server is located outside Japan, if the terminal device constituting the system is located within Japan, the system can be used within Japan using the terminal device. Furthermore, the use of this system may affect the economic interests of, for example, the patent holder.

[0088] In the above embodiment, the content has been described as being created using the print application 1110. However, the present invention is not limited to this, and the content may not be created using the print application 1110, but may instead be imported from, for example, the storage unit 103 of the computer 110, or may be imported from an external storage device such as a USB or SD card.

[0089] In addition, in this embodiment, the print application 1110 and the generation AI client 1200 are described as separate configurations, but the processing of the generation AI client 1200 may be included in the print application 1110. In addition, in the above embodiment, the print preview image is described as being generated by the printer driver 1420, but the print preview image may also be generated by a separate program having a print preview image generation function.

[0090] In the above embodiment, the printer driver 1420 was described as displaying a print preview image. However, a separate program with a print preview image display function may also display the print preview image. For example, the print application 1110 may display the print preview image. This configuration has the advantage that the generation AI plug-in server 400 does not need to reflect the settings in the printer driver 1420, and the print application 1110 can directly reflect the print settings received from the generation AI server 300 on the print setting screen 1111.

[0091] The print setting generation AI may also determine user authority information when determining print settings in accordance with instructions based on natural language input by the user. In this case, the instructions include information about the user, and the AI ​​determines whether the user has the authority to execute the determined print settings by referencing specified user management information. If the user has the authority, the AI ​​may respond with the determined print settings. If the user does not have the authority, the AI ​​may respond with error information indicating that the user does not have the authority to use the print settings instead. For example, if color printing is specified as the print setting but the user's permissions only allow monochrome printing, the print setting generation AI may return an error and present the error details to the user in the print application. Furthermore, if the printable number of pages is managed for each user or group to which the user belongs, and printing beyond the printable number is requested, the AI ​​may respond with that information instead of the print settings. Alternatively, the AI ​​may respond with print settings changed to the printable number up to the printable number.

[0092] The generation AI plug-in server 400 may save print settings determined from natural language input. The saved print settings may be kept as a history and taken into consideration for future determinations. The generation AI plug-in server 400 may also use an external service when determining print settings from an instruction. For example, a search engine may be used to search a printing example site, and the print setting "4 in 1" may be derived from a phrase included in the instruction "save paper." If the print settings cannot be determined even after using an external service, an error may be returned instead of the print settings. The generation AI plug-in server 400 may also determine print settings using another external plug-in server. For example, a command may be notified from server X to server Y, and server Y may determine the corresponding print settings and respond to server X, which then responds to the print application with the print settings.

[0093] The disclosure of this specification includes the following computer program, control method, and printing system. (Item 1) A computer program for causing a computer of a user terminal to: An acquisition means for acquiring print settings obtained by inputting a natural language input related to a print instruction from a user, which is accepted via a print application running on the user terminal, into a server that provides a generation AI service, via the print application; a control means for generating a print job based on the acquired print settings and print data, and transmitting the print job to a target printing device to start printing; A computer program characterized by causing the computer to function as follows. (Item 2) 2. The computer program according to item 1, wherein the control means further generates a preview image based on the acquired print settings and print data and displays the preview image on a display unit. (Item 3) The computer program described in item 2 is characterized in that the control means displays an operation object for canceling the printing execution on the screen displaying the preview image, and when the operation object is operated, stops the execution of the print job on the target printing device. (Item 4) the acquisition unit acquires from the printing application a planned amount of the consumable to be used when the print job is executed, and acquires from the target printing device a usable amount of the consumable; 4. The computer program according to claim 2, wherein the control means, when the planned usage amount exceeds the available amount, causes the display unit to display an error without generating the print job. (Item 5) Item 4. The computer program according to item 4, characterized in that the control means, when the planned usage amount does not exceed the available amount and the difference between the available amount and the planned usage amount is below a threshold amount indicating a lower limit allowable amount, displays an error on the display unit without generating the print job. (Item 6) 6. The computer program according to any one of items 1 to 5, wherein the acquired print settings include the IP address, name, and various print setting values ​​of the target printing device. (Item 7) Item 6. The computer program according to item 6, wherein the various print setting values ​​include at least one of the setting values ​​related to paper size, paper type, layout, color mode, and print standby time. (Item 8) A computer program that configures a computer of a user terminal that provides a generation AI service, A receiving means for receiving a natural language input related to a print instruction from a user via an AI dialogue area for generating a setting screen; A generation means for generating an instruction sentence for the generation AI service based on the received natural language input; an acquisition means for transmitting the generated instruction text to a server that provides the AI ​​service and acquiring print settings determined by a plug-in that extends the functionality of the AI ​​service; a control means for inputting the acquired print settings into a printer driver; A computer program characterized by causing the computer to function as follows. (Item 9) 9. The computer program according to item 8, wherein the setting screen includes an area for selecting a printing device to print on in accordance with user input, and a setting area for making print settings. (Item 10) 10. The computer program according to item 9, wherein the acquired print settings are reflected in the setting area for performing the print settings. (Item 11) the setting screen further includes an operation object for receiving an instruction to display a preview image; 11. The computer program according to any one of items 8 to 10, wherein the control means displays a preview image on a display unit when the operation object is operated. (Item 12) Item 12. The computer program according to item 11, wherein the control means causes the printer driver to generate the preview image and display it on the display unit. (Item 13) 13. The computer program according to any one of items 8 to 12, wherein an operation object for instructing printing is displayed on the setting screen. (Item 14) The acquired print settings include at least a setting value for a waiting time until printing starts, Item 14. The computer program according to item 13, wherein the control means, when an operation object that instructs printing is operated, issues a print instruction to the printer driver after a time corresponding to the set value of the waiting time has elapsed. (Item 15) The computer program according to any one of items 8 to 14, wherein the acquisition means, when the server determines that the natural language input is not an input related to printing, acquires information indicating that the input is not related to printing from the server instead of the print settings. (Item 16) A method for controlling a user terminal, comprising: an acquisition step in which an acquisition means acquires, via the print application, print settings obtained by inputting a natural language input related to a print instruction from a user, which is accepted via a print application running on the user terminal, into a server that provides a generation AI service; a control step in which a control means generates a print job based on the acquired print settings and print data, and transmits the print job to a target printing device to start printing; A method for controlling a user terminal, comprising: (Item 17) A method for controlling a user terminal that provides a generation AI service, a receiving step in which a receiving means receives a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​the setting screen; a generation step in which a generation means generates an instruction sentence for the generation AI service based on the received natural language input; an acquisition step in which an acquisition means transmits the generated instruction text to the generation AI service and acquires print settings determined by a plug-in that extends the functionality of the generation AI service; a control step in which a control means inputs the acquired print settings into a printer driver; A method for controlling a user terminal, comprising: (Item 18) A printing system including a user terminal, a generation AI server that provides a generation AI service, an information processing device that extends the functionality of the generation AI service, and a printing device, The user terminal A receiving means for receiving a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​a setting screen provided by a print application; A generation means for generating an instruction sentence for the generation AI service based on the received natural language input; a first acquisition means for transmitting the generated instruction text to the generation AI server and acquiring, via the print application, print settings determined by a plug-in that extends the functionality of the generation AI service; a control means for generating a print job based on the acquired print settings and print data, and transmitting the print job to a target printing device to start printing; Equipped with The information processing device includes: a second acquisition means for acquiring the instruction sentence from the user terminal; a determination unit for determining print settings based on a natural language input relating to the print instruction; a response means for responding to the user terminal with the determined print settings; A printing system comprising:

[0094] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0095] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0096] 100: Printing system, 110: Computer, 1010: Display unit, 1110: Printing application, 1133: Allocation control, 1150: Generation AI control, 1151: Chat display area, 1152: Instruction input unit, 1153: Execution button, 200: Printer, 300: Generation AI server, 400: Generation AI plug-in server

Claims

1. A computer program for causing a computer of a user terminal to: An acquisition means for acquiring print settings obtained by inputting a natural language input related to a print instruction from a user, which is accepted via a print application running on the user terminal, into a server that provides a generation AI service, via the print application; a control means for generating a print job based on the acquired print settings and print data, and transmitting the print job to a target printing device to start printing; A computer program characterized by causing the computer to function as follows.

2. 2. The computer program according to claim 1, wherein the control means further generates a preview image based on the acquired print settings and print data, and displays the preview image on a display unit.

3. The computer program according to claim 2, wherein the control means displays an operation object for canceling the printing execution on the screen displaying the preview image, and when the operation object is operated, causes the target printing device to stop executing the print job.

4. the acquisition unit acquires from the printing application a planned amount of the consumable to be used when the print job is executed, and acquires from the target printing device a usable amount of the consumable; 3. The computer program according to claim 2, wherein the control means, when the planned usage amount exceeds the available usage amount, causes the display unit to display an error without generating the print job.

5. The computer program according to claim 4, characterized in that the control means, when the planned usage amount does not exceed the available amount and the difference between the available amount and the planned usage amount is below a threshold amount indicating a lower limit allowable amount, does not generate the print job and displays an error on the display unit.

6. 6. The computer program according to claim 1, wherein the acquired print settings include an IP address, a name, and various print setting values ​​of the target printing device.

7. 7. The computer program according to claim 6, wherein the various print setting values ​​include at least one of setting values ​​relating to paper size, paper type, layout, color mode, and print standby time.

8. A computer program that includes a computer of a user terminal that provides a generation AI service, a receiving means for receiving a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​the setting screen; A generation means for generating an instruction sentence for the generation AI service based on the received natural language input; an acquisition means for transmitting the generated instruction statement to a server that provides the generation AI service and acquiring print settings determined by a plug-in that extends the functionality of the generation AI service; a control means for inputting the acquired print settings into a printer driver; A computer program characterized by causing the computer to function as follows.

9. 9. The computer program according to claim 8, wherein the setting screen includes an area for selecting a printing device to be used for printing in accordance with user input, and a setting area for making print settings.

10. 10. The computer program according to claim 9, wherein the acquired print settings are reflected in the setting area for performing the print settings.

11. the setting screen further includes an operation object for receiving an instruction to display a preview image; 11. The computer program according to claim 8, wherein the control means causes a preview image to be displayed on a display unit when the operation object is operated.

12. 12. The computer program according to claim 11, wherein the control means causes the printer driver to generate the preview image and display it on the display unit.

13. 12. The computer program according to claim 11, wherein an operation object for instructing printing is displayed on the setting screen.

14. The acquired print settings include at least a setting value for a waiting time until printing starts, 14. The computer program according to claim 13, wherein the control means, when an operation object that instructs printing is operated, issues a print instruction to the printer driver after a time corresponding to a set value of the waiting time has elapsed.

15. 9. The computer program according to claim 8, wherein the acquisition means, when the server determines that the natural language input is not an input related to printing, acquires from the server, instead of the print settings, information indicating that the input is not related to printing.

16. A method for controlling a user terminal, comprising: an acquisition step in which an acquisition means acquires, via the print application, print settings obtained by inputting a natural language input related to a print instruction from a user, which is accepted via a print application running on the user terminal, into a server that provides a generation AI service; a control step in which a control unit generates a print job based on the acquired print settings and print data, and transmits the print job to a target printing device to start printing; A method for controlling a user terminal, comprising:

17. A control method for a user terminal that provides a generation AI service, a receiving step in which a receiving means receives a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​the setting screen; A generation step in which a generation means generates an instruction sentence for the generation AI service based on the received natural language input; an acquisition step in which an acquisition means transmits the generated instruction sentence to the generation AI service to acquire print settings determined by a plug-in that extends the function of the generation AI service; a control step in which a control means inputs the acquired print settings into a printer driver; A method for controlling a user terminal, comprising:

18. A printing system including a user terminal, a generating AI server that provides a generating AI service, an information processing device that extends the function of the generating AI service, and a printing device, The user terminal A receiving means for receiving a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​a setting screen provided by the print application; A generation means for generating an instruction sentence for the generation AI service based on the received natural language input; a first acquisition means for transmitting the generated instruction statement to the generation AI server and acquiring print settings determined by a plug-in that extends the function of the generation AI service via the print application; a control means for generating a print job based on the acquired print settings and print data, and transmitting the print job to a target printing device to start printing; Equipped with The information processing device includes: a second acquisition means for acquiring the instruction sentence from the user terminal; a determination unit for determining print settings based on a natural language input relating to the print instruction; a response means for responding to the user terminal with the determined print settings; A printing system comprising:

Images