Computer program, control method and printing system

Abstract

To a mechanism that suitably determines print setting based on a print instruction input in, for example, natural language.SOLUTION: An information processing device acquires natural language input related to a print instruction from a user terminal, which is received via a generative AI service. The information processing device also determines print setting based on the natural language input related to the print instruction, and responds with the determined print setting to the user terminal.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a computer program, a control method, and a printing system. [Background technology]

[0002] In recent years, conversational AI such as chatbots and generative AI has been rapidly developed. Along with this development, a variety of services using conversational AI have been provided. Patent Document 1 proposes a printing assistance system that performs print settings for a print job via a chatbot. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-207513 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional technology has the following problem: Although the above-mentioned conventional technology performs print settings by repeating question and answer sessions via a chatbot, when an instruction for performing an operation other than print settings, such as a print instruction to a printer, is input, the input text is not accurately (appropriately) interpreted and the print settings are not performed. As a result, there is a problem in that it is difficult for a computer to automatically send a print job to a printer based on an input print instruction.

[0005] The present invention has been made in consideration of at least one of the above problems, and provides a mechanism for appropriately determining print settings based on print instructions input in natural language. [Means for solving the problem]

[0006] The present invention is, for example, a computer program that expands the functionality of a generation AI service, and is characterized in that it causes a computer of an information processing device to function as an acquisition means that acquires natural language input related to a print instruction from a user received via the generation AI service from a user terminal, a determination means that determines print settings based on the natural language input related to the print instruction, and a response means that responds to the user terminal with the determined print settings.

[0007] The present invention is also characterized by, for example, a computer program that uses a generation AI service, which causes a computer on a user terminal to function as: an acceptance means for accepting natural language input related to printing instructions from a user via a generation AI dialogue area of ​​a settings screen; a generation means for generating an instruction statement for the generation AI service based on the accepted natural language input; an acquisition means for sending the generated instruction statement to the generation AI service and acquiring print settings determined by a plug-in that extends the functionality of the generation AI service; and a confirmation means for allowing the user to confirm the acquired print settings via the settings screen.

[0008] The present invention also provides a printing system that includes, for example, a user terminal, a generation AI server that provides a generation AI service, an information processing device that extends the functionality of the generation AI service, and a printing device, wherein the user terminal comprises: a reception means for receiving natural language input related to a printing instruction from a user via a generation AI dialogue area of ​​a setting screen; a generation means for generating an instruction statement for the generation AI service based on the received natural language input; a first acquisition means for sending the generated instruction statement to the generation AI service to acquire print settings determined by a plug-in that extends the functionality of the generation AI service; and a confirmation means for having the user confirm the acquired print settings via the setting screen, and the information processing device comprises: a second acquisition means for acquiring the instruction statement from the user terminal; a determination means for determining print settings based on the natural language input related to the print instruction; and a response means for responding to the user terminal with the determined print settings. [Effects of the Invention]

[0009] According to the present invention, print settings can be suitably determined based on print instructions input in natural language. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of a network configuration of a printing system according to an embodiment. [Figure 2A] FIG. 2 is a block diagram showing the hardware configuration of each device in the printing system according to the embodiment. [Figure 2B] FIG. 2 is a block diagram showing the hardware configuration of each device in the printing system according to the embodiment. [Figure 3] FIG. 1 is a block diagram showing the hardware configuration of a printer according to an embodiment. [Figure 4A] FIG. 2 is a block diagram showing a software configuration related to printing according to an embodiment. [Figure 4B] FIG. 2 is a block diagram showing a software configuration related to printing according to an embodiment. [Figure 5A] FIG. 10 is a diagram showing an example of a print application according to an embodiment. [Figure 5B] FIG. 10 is a diagram showing an example of a print application according to an embodiment. [Figure 6] FIG. 4 is a diagram showing a printing sequence according to an embodiment. [Figure 7] FIG. 10 is a diagram showing an example of an instruction sent to a generation AI server according to an embodiment. [Figure 8] FIG. 4 is a diagram showing print settings stored in a print setting database according to an embodiment. [Figure 9] 10 is a flowchart showing the processing procedure of a generation AI plug-in server 400 according to an embodiment. [Figure 10] 4 is a flowchart showing a processing procedure of a computer 110 according to an embodiment. [Figure 11] 4 is a flowchart showing a processing procedure of a computer 110 according to an embodiment. [Figure 12A] FIG. 4 is a diagram showing a printing sequence according to an embodiment. [Figure 12B] FIG. 4 is a diagram showing a printing sequence according to an embodiment. [Figure 13] FIG. 4 is a diagram showing a printing sequence according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0012] First Embodiment <System configuration> A first embodiment of the present invention will be described below. First, the network configuration of a printing system according to this embodiment will be described with reference to FIG.

[0013] As shown in FIG. 1, the printing system 100 includes a computer 110, which is a terminal device, a printer (printing device) 200 configured to be capable of printing, a generation AI server 300, and a generation AI plug-in server 400. For example, the computer 110 and the printer 200 are located in an office and are communicatively connected to each other via an internal company network 500. The internal company network 500 is connected to the external Internet 6000 via a router (not shown). Here, the computer 110 is an example of a user terminal, and the generation AI plug-in server 400 is an example of an information processing device.

[0014] The generation AI server 300 is communicably connected to the computer 110, the printer 200, and the generation AI plug-in server 400 via the Internet 6000 and the internal network 500. The generation AI server 300 is a server managed by a business that provides a generation AI service. The generation AI plug-in server 400 is communicably connected to the computer 110, the printer 200, and the generation AI server 300 via the Internet 6000 and the internal network 500. The generation AI plug-in server 400 is a server managed by a business that provides a print service. In this embodiment, the generation AI server 300, the generation AI plug-in server 400, and the generation AI control (generation AI dialogue area) 1150 on the computer 110 shown in FIG. 5 are collectively referred to as a "generation AI system." Note that the hardware on which the generation AI server 300, the generation AI plug-in server 400, and the generation AI control 1150 reside may be separate entities or may reside as an integrated unit on the same hardware. Furthermore, the in-house network 500 may be a wired connection or a wireless connection.

[0015] <Hardware configuration> The hardware configuration of each device in the printing system 100 according to this embodiment will be described with reference to Figures 2A to 3. Figure 2A shows the hardware configuration of the computer 110 and the generation AI server 300. Figure 2B shows the hardware configuration of the generation AI plug-in server 400. Figure 3 shows the hardware configuration of the printer 200.

[0016] 2A, computer 110 has a display unit 101, an operation unit 102, a storage unit 103, a control unit 104, and a network communication unit 105, which are connected to each other so that they can communicate with each other. There are no particular limitations on the computer 110, and for example, a desktop or notebook personal computer, a tablet terminal, a smartphone, etc. can be applied. The control unit 104 is configured to include a CPU (Central Processing Unit) 141 and a memory 142, and controls the entire computer 110.

[0017] The display unit 101 is configured with a display such as an LCD panel and can display images, etc. The operation unit 102 is configured with a mouse, keyboard, etc. and can accept input operations by a user. The storage unit 103 is configured with a storage medium such as a hard disk or SSD and stores various programs (software) necessary for the computer 110 to operate. The programs are loaded into the memory 142 as needed and executed by the CPU 141. The programs include programs that cause the CPU 141 to execute each unit and function of the printing system 100. Note that these programs are not limited to those stored in the computer 110. The programs may be stored in, for example, the printer 200, the generation AI server 300, or the generation AI plug-in server 400, or may be stored in a distributed manner in the computer 110, the printer 200, the generation AI server 300, and the generation AI plug-in server 400. The network communication unit 105 inputs and outputs data to and from external devices via an external network.

[0018] The generation AI server 300 has a display unit 301, an operation unit 302, a memory unit 303, a control unit 304, and a network communication unit 305, which are connected to each other so that they can communicate with each other. The control unit 304 is configured to include a CPU 341, a memory 342, and a GPU (Graphics Processing Unit) 343, and controls the entire generation AI server 300. As such, the hardware configuration of the generation AI server 300 is almost the same as the hardware configuration of the computer 110, and therefore a detailed description will be omitted.

[0019] 2B, the hardware configuration of the generation AI plug-in server 400 is almost the same as the hardware configuration of the computer 110. Therefore, in this embodiment, a description of the hardware configuration of the generation AI server 300 and the generation AI plug-in server 400 will be omitted. It is preferable that the generation AI server 300 has a GPU 343, and the generation AI plug-in server 400 has a GPU 443.

[0020] 3, printer 200 has a display unit 201, an operation unit 202, a storage unit 203, a control unit 204, a network communication unit 205, and a printing unit 206, which are connected to each other so that they can communicate with each other. There are no particular limitations on printer 200 as long as it has a printing function, and for example, an MFP (Multi-Function Printer) or an SFP (Single Function Printer) can be used. Control unit 204 is configured to include a CPU 241 and memory 242, and controls printer 200 as a whole.

[0021] The display unit 201 is configured with a display such as a liquid crystal panel and can display, for example, images. The operation unit 202 is configured with a touch panel, various buttons, etc., and allows a user to input operations. The storage unit 203 is configured with a storage medium such as a hard disk or SSD, and stores various programs (software) necessary for the printer 200 to operate. The programs are loaded into the memory 242 as needed and executed by the CPU 241. The network communication unit 205 inputs and outputs data to and from external devices via an external network. The printing unit 206 converts digital data stored in the storage unit 203 or memory 242 into an image and prints it on printing paper in accordance with instructions from the control unit 204. The printing method is not particularly limited, and for example, an ink method, a toner method, or other method can be used.

[0022] <Software configuration> The software configuration of each device included in the printing system 100 according to this embodiment will be described with reference to Fig. 4. Fig. 4A shows the printing-related modules in the software configuration of the computer 110. Fig. 4B shows the printing-related modules in the software configuration of the generation AI server 300 and the generation AI plug-in server 400.

[0023] As shown in FIG. 4A, the computer 110 has an application 1100, a generation AI client 1200, an assist tool 1300, and an OS (Operating System) 1400. The application 1100 includes any software such as security software, spreadsheet software, browser software, etc., and in the example of FIG. 4A, includes a print application 1110. The print application 1110 is an application with a print function. The print application 1110 is not particularly limited, and examples include spreadsheet software with a print function, browser software, presentation software, etc.

[0024] When the print function of the print application 1110 is executed by a user operation, information displayed on the display unit 101 of the computer 110 is sent to the printer 200, and printing is performed. The print function is realized by calling an interface of a GDI (Graphic Device Interface) 1410 (described later). The assist tool 1300 is software that generates a print preview image and operates the printer driver 1420 using content created using the print application 1110 and various print settings acquired from a print setting database 4300 (described later).

[0025] The generation AI client 1200 represents client software executed on the computer 110. The generation AI client 1200 receives a user instruction from the print application 1110, generates an instruction to be sent to the generation AI server 300, and sends it to the generation AI server 300. Here, the instruction to be sent represents an instruction from the user to which additional instructions have been added.

[0026] The OS 1400 is software that controls the basic operations of the computer 110. The OS 1400 includes a GDI 1410, a printer driver 1420, and a spooler 1430. The printer driver 1420 is provided by a company that provides the printer 200. The application 1100, the printer driver 1420, and the like are all managed by the OS 1400 and become usable by being installed in the OS 1400. The printer driver 1420 may be provided by a company that provides the OS 1400 and pre-installed in the OS 1400. The GDI 1410 is a component within the OS 1400 that provides an interface related to drawing, such as printing, to the outside. The printer driver 1420 displays print settings for printing on the printer 200 on a UI (User Interface). The printer driver 1420 also generates drawing data (PDL: Page Description Language) that can be interpreted by the printer 200 when printing. The spooler 1430 performs processing to transmit the PDL generated by the printer driver 1420 to the printer 200. Note that although the configuration using Microsoft (registered trademark) Windows (registered trademark) as the OS has been described here, other OSs may also be used as the OS 14000. Furthermore, the print data that the printer driver 1420 receives from the print application 1110 may be not only GDI format data but also XML Paper Specification format data (XPS format data).

[0027] As shown in FIG. 4B, the generation AI server 300 includes an application 3100, an organization information database 3500, and an OS 3400. The OS 3400 has a software configuration similar to that of the OS 1400, and therefore a description of the OS 3400 is omitted here. The application 3100 includes any software, and in the example of FIG. 4B, it includes a generation AI application 3110. The generation AI application 3110 is an application with a generation AI interpretation processing function. The generation AI application 3110 interprets instructions from the user sent from the generation AI client 1200 and determines a response to the instructions. Furthermore, the generation AI application 3110 determines whether a plug-in needs to be invoked and which plug-in should be invoked to realize the specified operation, depending on the given instruction. Furthermore, the generation AI application 3110 inputs information about the instruction sent from the generation AI client 1200 to the invoked plug-in. The plug-in referred to here is the generation AI plug-in 4100, which will be described later. The organizational information database 3500 is a database referenced by the generating AI application 3110. The organizational information database 3500 stores various content, such as spreadsheet files and presentation files, created within organizations that can use the generating AI application 3110. The generating AI application 3110 can reference information about files stored in the organizational information database 3500 in response to instructions from the user.

[0028] The generation AI plug-in server 400 has a generation AI plug-in 4100, a print setting generation AI 4200, a print setting database 4300, a model information database 4500, a print history database 4600, and an OS 4400. Note that the OS 4400 has a software configuration that is substantially the same as that of the OS 1400, and therefore a description of the OS 4400 will be omitted here. The generation AI plug-in 4100 is any software linked to the generation AI application 3110 and is called from the generation AI application 3110. The generation AI plug-in 4100 inputs instructions received from the generation AI application 3110 into the print setting generation AI 4200 and responds with the processing results to the generation AI application 3110. One or more generation AI plug-ins 4100 exist within the generation AI plug-in server 400. The model information database 4500 is a database referenced by the generation AI plug-in 4100. The model information database 4500 stores model-specific information such as available paper sizes and paper types for each printer model, as well as device configuration information. The generation AI plug-in 4100 can input information dependent on the printer model into the print setting generation AI 4200 by referencing the model information database 4500. The print history database 4600 is a database referenced by the generation AI plug-in 4100. The print history database 4600 stores combinations of print settings that have been used for printing by each user. The generation AI plug-in 4100 can input information about print settings that have been used for printing by the user into the print setting generation AI 4200 by referencing the print history database 4600.

[0029] The generation AI application 3110 determines which generation AI plug-in 4100 to call based on the interpretation process results of the input natural language. For example, if the generation AI application 3110 determines that the interpretation process results are related to changing print settings, it calls generation AI plug-in X; if it determines that the interpretation process results are related to executing print settings, it calls generation AI plug-in Y. The print setting generation AI 4200 is a language model constructed using big data such as text data and deep learning technology. The print setting generation AI 4200 determines the optimal combination of print settings contained in the input instruction text to achieve the user's desired printing.

[0030] The print setting database 4300 refers to a database that records information specifying the computer that sent the instruction text in association with the combination of print settings determined by the print setting generation AI 4200.

[0031] <Example of setting screen> 5A, a screen 1111 that the print application 1110 according to this embodiment displays on the display unit 101 will be described. On the screen 1111 that is displayed on the display unit 101 by the print application 1110, output condition instructions including print conditions when printing with the printer 200 can be input. In this way, in this embodiment, the print application 1110 also functions as an input means for inputting output conditions.

[0032] Screen 1111 includes, as printing conditions, a printer selection control 1120, a print setting control 1130, a printer driver control 1140, a generation AI control 1150, a print button 1161, and a preview display button 1162. Note that screen 1111 may also include output conditions other than these printing conditions. For example, if printer 200 is configured to be capable of stapling, it may also include staple conditions that set the position and number of staples, etc. Furthermore, if printer 200 is configured to be capable of cutting, it may also include cut conditions that set the cutting position, etc. The print button 1161 and preview display button 1162 are examples of operation objects, and operating them will execute printing and preview display, respectively.

[0033] In the printer selection control 1120, a list of printers that can be used by the computer 110, i.e., printers that can receive print jobs from the computer 110, is displayed on the UI based on printer data that has been stored in advance in the storage unit 103. By operating the printer selection control 1120, the user can select the printer 200 as the destination to which the print job will be sent. In FIG. 5A, the name of the printer 200 is "CCC Printer."

[0034] Print setting control 1130 is a setting area for setting print settings and includes number of copies control 1131, layout control 1132, color mode control 1133, and layout control 1134. Number of copies control 1131 is an item for setting the number of copies to be printed. In FIG. 5A, number of copies control 1131 is set to "1." Layout control 1132 is an item for selecting the print orientation relative to the paper. In this embodiment, "portrait" which sets the print orientation vertically and "landscape" which sets the print orientation horizontally can be selected. In FIG. 5A, layout control 1132 is set to "portrait." Color mode control 1133 is an item for selecting "color" to set color printing and "monochrome" to set monochrome printing. In FIG. 5A, color mode control 1133 is set to "color." Note that print setting control 1130 is not limited to including number of copies control 1131 to color mode control 1133, and it is sufficient if it includes at least one of these items. The print setting control 1130 may also include other setting items, such as an item for selecting paper size, an item for selecting single-sided printing or double-sided printing, and an item for selecting the number of pages to be printed per sheet of paper. The layout control 1134 is an item for selecting the manuscript pages to be printed per sheet of paper in layout printing. The layout control 1134 has setting values ​​such as "1 in 1," which prints one manuscript page per sheet of paper, "2 in 1," which prints two manuscript pages per sheet of paper, and "4 in 1," which prints four manuscript pages per sheet of paper. In FIG. 5A, the layout control 1134 is set to "4 in 1." If a user wishes to conserve paper when printing, setting the setting value of the layout control 1134 allows the user to obtain the intended printed matter.

[0035] When the user operates the printer driver control 1140, it displays a detailed print setting screen provided by the printer driver corresponding to the "CCC Printer" displayed in the printer selection control 1120. This allows the user to change the print setting values ​​on the print setting screen of the printer driver in detail. When the user closes the print setting screen of the printer driver, the changes to the print setting values ​​on the print setting screen are saved in the storage unit 103.

[0036] The generation AI control 1150 includes a chat display area 1151, an instruction input area 1152, and an execute button 1153. The print application 1110 interactively displays instructions (natural language) entered by the user in the chat display area 1151 and statements corresponding to processing execution results received from the generation AI server 300. The print application 1110 provides a function for inputting arbitrary instructions representing processing content in the instruction input area 1152. The user can input instructions, for example, via the operation unit 102 such as a keyboard. Alternatively, the user's speech may be received as voice input via a microphone (not shown). In FIG. 5A, the instruction "Print in a paper-saving manner" is input in Japanese into the instruction input area 1152. Note that the text entered into the instruction input area 1152 is not limited to text instructing changes to layout printing settings, and can be any text, such as changing the color mode or enlarging or reducing the print area. The execute button 1153 is a button for sending instructions, including the instruction entered in the instruction input section 1152, to the generation AI server 300. Furthermore, it is desirable to reflect the determined print settings, such as 4 in 1, in the corresponding control, layout control 1134, as shown in Figure 5A, according to the instruction entered in the instruction input section 1152. In other words, each control of the print settings can be set according to user input, but settings according to the interaction of the generation AI control 1150 may also be reflected.

[0037] <Preview display> 5B, a preview display that the assist tool 1300 according to this embodiment displays on the display unit 101 will be described. When the print button 1161 on the screen 1111 is operated, the print application 1110 does not display the print preview image display UI 1170, but sends the print job to the printer 200 based on the print settings specified in the print setting control 1130. On the other hand, when the preview display button 1162 on the screen 1111 is operated, the print application 1110 displays the print preview image display UI 1170 provided by the assist tool 1300.

[0038] The print preview image display UI 1170 includes a print preview display area 1171 and a print button 1172. The assist tool 1300 displays a preview image of the print result in the print preview display area 1171 based on the print settings determined by the print setting generation AI 4200 and the content created by the print application 1110. This allows the user to check the printed material to be printed by the printer 200 in advance before the printed material is output. When the print button 1172 is operated, the print application 1110 starts print job transmission processing for the content displayed in the print preview image display UI 1170. In this way, the print button 1172 is an example of an operation object.

[0039] <sequence> 6, we will explain the processing sequence performed between the components constituting the computer 110, the generation AI server 300, and the generation AI plug-in server 400 in this embodiment. The numbers following "S" below indicate the step numbers in the sequence.

[0040] In S601, the print application 1110 creates content to be printed in accordance with user instructions. Examples of content include presentation slides, document materials, charts, and graphs. After content creation is complete, the print application 1110 accepts instructions from the user in S602 and displays a print setting screen 1111 on the display unit 101 in S603. Next, in S604, the print application 1110 accepts print instructions for achieving desired printing using natural language in an instruction input unit 1152 within the print setting screen 1111. An example of a print instruction is an instruction that includes printing conditions, such as "I want to print using as little paper as possible." In S605, the print application 1110 inputs the print instructions input by the user, the IP address of the computer 110, and the name of the printer (print queue name) selected as the print job destination to the generation AI client 1200. In this way, the print application 1110 inputs the IP address, which is the identification information of the device (user terminal) that requested the print instruction, and the name (printer name), which is the identification information of the selected printing device, along with natural language input via the print setting screen 1111.

[0041] Upon receiving the print instruction, in S606 the generation AI client 1200 uses the received information to generate an instruction statement to be sent to the generation AI server 300. In addition to the print instruction entered by the user, the instruction statement includes additional information such as the IP address of the computer 110 to identify the sender of the instruction statement and the name of the printer selected as the destination of the print job on the print setting screen 1111. The instruction statement to be sent to the generation AI server 300 will be described later using a specific example in Figure 7. Next, in S607 the generation AI client 1200 sends the generated instruction statement to the generation AI application 3110 of the generation AI server 300.

[0042] Upon receiving the instruction, in S608 the generation AI application 3110 interprets the contents of the instruction and determines the generation AI plug-in 4100 to call. Then, in S609 the generation AI application 3110 inputs the instruction received from the generation AI client 1200 to the determined generation AI plug-in.

[0043] Upon receiving the instruction statement, the generation AI plug-in 4100 inputs the received instruction statement to the print setting generation AI 4200 in S610. In S611, the print setting generation AI 4200 interprets the print instruction from the user contained in the instruction statement and determines the optimal combination of print settings for obtaining the user's desired output result. The settable print settings vary depending on the type of printer 200. The print setting generation AI 4200 may be configured to refer to a print setting function database (not shown) and determine the print settings that can be set on the printer 200 identified by the printer name to which the print job is to be sent, contained in the instruction statement received in S609. Furthermore, in S611, the print setting generation AI 4200 may determine the combination of print settings based on the determined settable print settings and the instruction statement. This configuration allows the print setting generation AI 4200 to determine the print settings that can be specified on the printer 200. Subsequently, in S612, the print setting generation AI 4200 responds to the generation AI plug-in with the determined combination of print settings as the determination result.

[0044] Upon receiving the response, in S613 the generation AI plug-in 4100 links the combination of print settings included in the response with the IP address and printer name of the computer 110 included in the instruction received in S609 and records them in the print setting database 4300. Specific examples of information to be recorded in the print setting generation database will be described later with reference to Figure 8. Next, in S615, the generation AI plug-in 4100 returns the response received in S612 to the generation AI application 3110 as the processing result for S609.

[0045] Thereafter, in S616, the generation AI application 3110 responds to the generation AI client 1200 with the processing result received in S615 as the processing result for S607. Next, in S617, the generation AI client 1200 generates a response statement for the print application 1110 from the received processing result. The response statement is a sentence that explains to the user in natural language the combination of print settings determined by the print setting generation AI 4200 in S611, and is displayed on the generation AI control 1150. In S618, the generation AI client 1200 responds to the print application 1110 with the response statement generated as the processing result for S605.

[0046] In S619, the print application 1110 displays the received response to the user. Examples of the response include the content of the applied print settings ("4-in-1 settings completed"), a message confirming whether or not to execute printing, and a button that allows the user to specify whether or not to execute subsequent printing, as shown in the chat display area 1151. In addition, in S612 above, the print setting generation AI 4200 may respond with information that displays buttons that can be specified for one or more print settings so that the user can specify additional print settings that they desire.

[0047] In S620, the print application 1110 accepts a user operation on a preview display button arranged on the print setting screen 1111. When the preview display button is operated, in S621 the print application 1110 starts the assist tool 1300 and issues a preview image display instruction. The instruction in S621 includes information for identifying the print settings to be acquired from the print setting database 4300. This information includes the IP address of the computer 110, the name of the printer specified as the target for sending the print job, and location information (file path name) where the content to be printed and used to generate the print preview image is saved.

[0048] Upon receiving the above instruction, in S622 the assist tool 1300 accesses the print setting database 4300 and instructs it to acquire a combination of print settings to be used for preview display. Here, the instruction in S622 includes the IP address of the computer 110 and the name of the printer specified as the target for sending the print job as information for identifying the print settings to be acquired. In response to the instruction, in S623 the print setting database 4300 acquires the combination of print settings recorded in association with the IP address and printer name included in the instruction. Thereafter, in S624 the print setting database 4300 responds to the assist tool 1300 with the acquired combination of print settings.

[0049] In S625, the assist tool 1300 instructs the spooler 1430 to reflect the acquired combination of print settings in the printer driver 1420. In S626, the spooler 1430, having received the instruction, instructs the printer driver 1420 associated with the printer set as the printer to which the print job is to be sent to reflect the various print settings. In S627, the printer driver 1420, having received the instruction, reflects the various print settings specified, and in S628, returns the processing results to the spooler 1430. In S629, the spooler 1430 returns the processing results to the assist tool 1300.

[0050] Next, in S630, the assist tool 1300 acquires the content to be printed based on the location information where the content to be printed is stored, received in S621. Note that the assist tool 1300 may acquire the location information where the content to be printed is stored from the print setting database 4300, rather than from the print application 1110. Alternatively, the assist tool 1300 may acquire the content to be printed itself from the print setting database 4300. In these cases, the location information where the content to be printed is stored, or the content to be printed itself, is specified by the print application 1110 or the generation AI client 1200, and as a result, this information is included in the instruction statement of S607.

[0051] Next, in S631, the assist tool 1300 generates a print preview image based on a combination of the print-specific content acquired in S630 and the print settings acquired in S624. Thereafter, in S632, the assist tool 1300 displays the generated print preview image to the user. The print preview image is displayed on a print preview display screen displayed by the assist tool 1300. Thereafter, in S633, the assist tool 1300 accepts an instruction to execute a print job from the user who has checked the print preview image by operating the print button on the print preview display screen. Having received the instruction to execute the print job, the assist tool 1300 instructs the spooler 1430 to execute the print job in S634. Then, in S635, the spooler 1430 instructs the printer driver 1420 to execute print processing. Having received the instruction to execute print processing, the printer driver 1420 generates a print job based on the instruction in S636 and sends the generated print job to the printer in S637. Upon receiving the print job, the printer executes printing processing according to the contents of the print job in S638, and then ends this sequence.

[0052] <Example of a directive> Referring to Figure 7, an example of the instruction sent to the generation AI server 300 in S606 above will be described. The instruction includes information 701 to 705. 701 indicates the print instruction entered by the user in the instruction input section 1152 in S604. 702 indicates the printer name set in the printer selection control 1120 as the printer to which the print job is to be sent. 703 describes the IP address of the computer 110. 704 describes the instruction content for the generation AI application 3110. Specifically, this instruction content inquires about the combination of print settings according to the instruction statement from the user. 705 describes user identification information for identifying the user who entered the instruction. Note that 702, 703, 704, and 705 are not explicitly entered in the instruction input section 1152, but are text automatically added by the generation AI client 1200. The generation AI application 3110 determines the plug-in to be called by interpreting the content of this instruction statement.

[0053] <Print settings> The print settings stored in the print setting database 4300 according to this embodiment will be described with reference to FIG. 8. The database stores combinations of print settings related to paper size 803, paper type 804, layout 805, and color mode 806, using an IP address 801 and a printer name 802 as keys. The assist tool 1300 can identify the combination of print settings stored in the database to be acquired using the IP address of the computer 110 and the name of the printer set as the destination of the print job as keys. Note that the print settings shown in FIG. 8 are merely an example and are not intended to limit the present invention. For example, any other print settings can be combined instead or in addition.

[0054] <Print setting generation AI processing procedure> 9, the processing procedure of the print setting generation AI 4200 executed by the generation AI plug-in server 400 according to this embodiment will be described. The processing described below is realized, for example, by the CPU 441 of the generation AI plug-in server 400 reading a program stored in the storage unit 403 into the memory 442 and executing it.

[0055] In S101, the CPU 441 acquires, via the generation AI server 300, an instruction statement created from a user instruction entered in the computer 110. The instruction statement includes a print instruction from the user, the IP address of the computer 110 that identifies the sender of the instruction statement, and the name of the destination printer, as shown in Figure 7. In S102, the CPU 441 acquires the printer name from the received instruction statement.

[0056] In S103, the CPU 441 interprets the instruction. Specifically, the CPU 441 interprets the instruction content 704 shown in FIG. 7 and the print instruction 701 from the user. For example, in this case, keywords related to print settings are extracted from the instruction content and used as search keys when obtaining a combination of print settings. Next, in S104, the CPU 441 searches the print setting database 4300 for specifiable print settings using the printer name obtained in S102 and the search keywords extracted in S103, and determines the combination of print settings found in S105.

[0057] In S106, the CPU 441 returns the processing result to the generation AI server 300. Furthermore, in S107, the CPU 441 associates the determined combination of print settings with the IP address and printer name of the computer 110, records them in the print setting database 4300, and ends the processing of this flowchart.

[0058] <User terminal processing procedure> The processing procedure of the computer (user terminal) 110 according to this embodiment will be described with reference to Fig. 10. The processing described below is realized, for example, by the CPU 141 of the computer 110 reading a program stored in the storage unit 103 into the memory 142 and executing the program.

[0059] First, in S201, the CPU 141 displays the print setting screen 1111 on the display unit 101 in response to an instruction from the print application 1110. In S202, the CPU 141 determines whether or not natural language input has been received from the user via the generation AI control (generation AI dialogue area) 1150 of the print setting screen 1111. If natural language input has been received, the process proceeds to S203; otherwise, the process proceeds to S206.

[0060] In S203, the CPU 141 generates an instruction statement as shown in FIG. 7 based on the received natural language input and printing device selection information, etc. Next, in S204, the CPU 141 inputs the generated instruction statement to the generation AI server 300, thereby acquiring the print settings determined by the generation AI plug-in server 400. Thereafter, in S204, the CPU 141 confirms the acquired print settings with the user via the print setting screen 1111. Here, as shown in FIG. 5A, the CPU 141 may confirm that the determined print settings (e.g., 4 in 1) have been set in the generation AI control 1150 of the print setting screen 1111, and may also inquire as to whether or not to execute printing. Furthermore, the CPU 141 updates the setting contents of the print setting control 1130 on the print setting screen 1111 according to the acquired print settings.

[0061] Thereafter, in S206, the CPU 141 determines whether or not a print instruction has been received. The print instruction here is a print instruction received by operating the print button 1161 or via the generation AI control 1150. If a print instruction has been received, the process proceeds to S207; if not, the process proceeds to S208. In S207, the CPU 141 causes the selected printing device via the printer driver 1420 to execute printing, and the process of this flowchart ends.

[0062] On the other hand, in S208, the CPU 141 determines whether or not a preview display has been accepted via the preview display button 1162. If a preview display has been accepted, the process proceeds to S209; if not, the process of this flowchart ends. In S209, the CPU 141 performs a preview display and ends the process of this flowchart. Preview display will be described in detail using FIG. 11.

[0063] (Preview display) The detailed processing procedure for the preview display in S209 above will be described with reference to Fig. 11. Here, the preview display function of the assist tool 1300 will be described. The assist tool 1300 is an example of a display control means. The processing described below is realized, for example, by the CPU 141 of the computer 110 reading a program stored in the storage unit 103 into the memory 142 and executing it.

[0064] In S301, the CPU 141 receives an instruction to display a preview image via the print application 1110, and the assist tool 1300 is activated. Specifically, when the preview display button 1162 on the screen 1111 is operated, the CPU 141 determines that the instruction to display a preview image has been received, and activates the assist tool 1300. Processing from this point onwards is carried out by the assist tool 1300. Next, in S302, the CPU 141 accesses the print setting database 4300 and acquires the print settings for the print job. The print settings acquired here are the print settings recorded in S107 above. In S303, the CPU 141 instructs the printer driver 1420 to reflect the acquired combination of print settings.

[0065] In S304, the CPU 141 acquires the content included in the preview display instruction. For example, the preview display instruction does not need to include the content data itself, in which case it includes information about the storage location of the content data. The storage location of the content data may be the computer 110 or the print setting database 4300 of the generation AI plug-in server 400. Note that when data stored in a database is used as content data, information about the storage location is included in the instruction.

[0066] In S305, CPU 141 generates a print preview image from the content data based on the print settings, and displays the generated print preview image to the user via a print application, etc. In S307, CPU 141 determines whether a print instruction has been received via the display screen of the preview image, and if so, proceeds to S308. In S308, CPU 141 instructs printer driver 1420 to execute printing, and ends the processing of this flowchart.

[0067] As described above, the printing system according to this embodiment includes a user terminal, a generation AI server that provides a generation AI service, an information processing device that extends the functionality of the generation AI service, and a printing device. In particular, the user terminal accepts natural language input related to print instructions from a user via the generation AI dialogue area of ​​the settings screen and generates instructions for the generation AI service based on the accepted natural language input. The user terminal then transmits the generated instructions to the generation AI service, acquires print settings determined by a plug-in that extends the functionality of the generation AI service, and prompts the user to confirm the acquired print settings via the settings screen. The information processing device also acquires instructions from the user terminal, determines print settings based on the natural language input related to the print instructions, and returns the determined print settings to the user terminal. Thus, according to this embodiment, the print setting generation AI interprets print instructions provided by the user in natural language, thereby automatically determining optimal print settings. Furthermore, because the generation AI plug-in server 400 provided by the business that provides the printer 200 determines print settings, it is possible to determine print settings that can be specified on the printer 200 and that take advantage of the printer's printing capabilities. Furthermore, in this embodiment, the assist tool acquires the determined print settings and the content to be printed, making it possible to perform printing using the automatically determined print settings.

[0068] The present invention is not limited to the above-described embodiments, and various modifications and variations are possible within the scope of the gist of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or storage medium, and having one or more processors in the computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0069] In the above embodiment, the computer 110 has an operation unit for inputting output conditions for the printer 200. However, the present invention is not limited to this, and it is sufficient that at least one of the computer 110, the generation AI server 300, the generation AI plug-in server 400, and the printer 200 has the operation unit. The operation unit may be displayed on a browser UI such as Microsoft (registered trademark) Edge or Google (registered trademark) Chrome. The operation unit may also be displayed on a generation application UI such as ChatGPT, a print application UI such as Microsoft (registered trademark) Office, or a chat application UI such as Microsoft Teams.

[0070] Furthermore, in the above embodiment, print settings such as the number of copies, layout, and allocation that are included in a standard printer driver 1420 have been described, but the present invention is not limited to this. Depending on the printer 200, there may be cases where functions such as stapling settings and bookbinding settings are included or not. Even in this case, automatic print settings such as those in the above embodiment can be achieved by performing a process such as obtaining device information about the printer 200 in advance.

[0071] Furthermore, in the above embodiment, it is conceivable that the print setting data stored in the storage unit may actually be transmitted and received in different data formats, such as PrintTicket or devmode, depending on the OS 1400 or printer driver 1420. The present invention is applicable to transmission and reception of such various data formats. Furthermore, in the above embodiment, it is assumed that in S637 the printer driver 1420 transmits a print job to the printer 200 connected to the same network 500 as the computer 110. However, the present invention is not limited to this. For example, in S637 the printer driver 1420 may upload the print job to a print service on the cloud, and print the job via the cloud on a printer connected to a network different from that of the computer 110.

[0072] Furthermore, in the printing system 100, for example, the generation AI server 300 (hereinafter referred to as the "server") may be located outside Japan, while the terminal device, computer 110 (hereinafter referred to as the "terminal device"), may be located within Japan. Even in this case, files and data may be transmitted from the server to the terminal device, and the terminal device may receive the files and data. Even if the server is located outside Japan, the transmission and reception (transmission and reception) of files and data in this system are performed as a single entity. Since the system functions when a terminal device located within Japan receives the files and data, the transmission and reception can be considered to have occurred within Japan. In this system, for example, even if the server is located outside Japan and the terminal device is located within Japan, the terminal device can perform the main functions of the system, and the effects of those functions can be realized within Japan. For example, even if the server is located outside Japan, if the terminal device constituting the system is located within Japan, the system can be used within Japan using the terminal device. Furthermore, the use of this system may affect the economic interests of, for example, the patent holder.

[0073] In the above embodiment, the content has been described as being created using the print application 1110. However, the present invention is not limited to this, and the content may not be created using the print application 1110, but may instead be imported from, for example, the storage unit 103 of the computer 110, or may be imported from an external storage device such as a USB or SD card.

[0074] In the present embodiment, the print application 1110 and the generation AI client 1200 are described as separate components. However, the processing of the generation AI client 1200 may be included in the print application 1110. In the above embodiment, the assist tool 1300 is described as being launched in response to a preview screen display instruction from the print application 1110. However, this is not limited to this. For example, the assist tool 1300 may be automatically launched upon OS startup and reside within the computer 110. In this case, the assist tool 1300 periodically accesses the print setting database 4300 to acquire the latest print settings registered in the database, and acquires content to be displayed as a print preview using any method to display a print preview image. The assist tool 1300 may also be configured to automatically display the print preview image display UI 1170 upon acquiring the print settings. In the above embodiment, the print preview image is described as being generated by the assist tool 1300. However, the print preview image may be generated by a separate program having a print preview image generation function.

[0075] In the above embodiment, the assist tool 1300 completes the process of acquiring print setting information from the print setting database 4300 in one go, but this is not limited to this. For example, if desired information cannot be acquired from the print setting database 4300, the print setting acquisition process may be repeated for a certain period of time. In the above embodiment, an IP address is used as information for identifying the computer 110, which is recorded in association with a combination of print settings in the print setting database 4300. However, the present invention is not limited to this. Information other than an IP address may be used as long as it can uniquely identify the computer 110. For example, a MAC address or an ID for uniquely identifying the computer 110 may be generated by internal processing of the assist tool 1300, and this value may be linked to the print settings. In the above embodiment, information such as paper size, paper type, layout, and color mode is recorded as print setting items stored in the print setting database 4300. However, other information may also be recorded. For example, other printing-related items, such as print quality, print direction, whether or not to staple, and paper feed slot settings, may also be recorded.

[0076] <Second embodiment> A second embodiment of the present invention will be described below. In this embodiment, components similar to those in the first embodiment are given the same reference numerals and will not be described again. With reference to Figures 12A and 12B, the sequence of processing performed between the components constituting the computer 110, generation AI server 300, and generation AI plug-in server 400 in this embodiment will be described. The numbers following "S" below indicate the step numbers in the sequence.

[0077] In S1201, the print application 1110 creates any content in accordance with user instructions. Examples of content include presentation slides, document materials, charts, and graphs. After content creation is complete, the print application 1110 accepts instructions from the user in S1202 and displays a print setting screen 1111 on the display unit 101 in S1203. Next, in S1204, the print application 1110 accepts a print instruction using natural language in the instruction input unit 1152 on the print setting screen 1111 to achieve the desired printing. An example of a print instruction is an instruction that includes printing conditions and content to be printed (which may be content different from the content currently being created), such as "Print the material created yesterday as a handout, keeping it to 10 pages or less with the usual settings." In S1205, the print application 1110 inputs the print instruction input by the user, the IP address of the computer 110, and the name of the printer (print queue name) selected as the print job destination to the generation AI client 1200.

[0078] Upon receiving the print instruction, in S1206 the generation AI client 1200 uses the received information to generate an instruction statement to send to the generation AI server 300. In addition to the print instruction entered by the user, the instruction statement includes additional information such as the IP address of the computer 110 to identify the sender of the instruction statement and the name of the printer selected as the destination for the print job on the print settings screen 1111. Next, in S1207 the generation AI client 1200 sends the generated instruction statement to the generation AI application 3110 of the generation AI server 300.

[0079] Upon receiving the instruction, in S1208 the generation AI application 3110 interprets the contents of the instruction and determines the generation AI plug-in 4100 to be called and the data to be referenced. In this embodiment, the user specifies "material created yesterday" as the file to be printed. Therefore, in S1209 to S1210, the generation AI application 3110 references the organization information database 3500 to obtain information on the corresponding file as the data to be referenced. An example of the information to be obtained is a URL indicating the storage location of the file to be printed. Thereafter, in S1211, the generation AI application 3110 adds the information on the file to be printed obtained in S1210 to the instruction received from the generation AI client 1200, and inputs the instruction to the determined generation AI plug-in.

[0080] Upon receiving the instruction, in S1212 and S1213, the generation AI plug-in 4100 retrieves the corresponding model-specific information from the model information database 4500 using the name of the printer selected as the print job destination, which is included in the received instruction, as a key. The retrieved model-specific information includes a list of paper sizes available for the relevant model, available post-processing (stapling), and information on whether layout printing is available. Next, in S1214 and S1215, the generation AI plug-in 4100 retrieves print history information performed by the user who issued the print instruction from the print history database 4600, using the user identification information 705 included in the received instruction as a key. The retrieved print history information includes combined information on print settings (e.g., paper size, whether layout printing is performed, and post-processing information used) that were set during previous printing.

[0081] Then, in S1216, the generation AI plug-in 4100 inputs the instruction statement to which the information acquired in S1213 and S1215 has been added to the print setting generation AI 4200. In S1217, the print setting generation AI 4200 interprets the various information included in the instruction statement and the content to be printed to determine the optimal combination of print settings for obtaining the output result desired by the user. Next, in S1218, the print setting generation AI 4200 responds to the generation AI plug-in with the determined combination of print settings as the determination result.

[0082] Upon receiving the response, in S1219 to S1220, the generation AI plug-in 4100 associates the combination of print settings included in the response with the IP address and printer name of the computer 110 included in the instruction received in S1211, and records them in the print setting database 4300. Furthermore, in S1221 to S1222, the generation AI plug-in 4100 associates the combination of print settings included in the response with the user identification information 705 and records them in the print history database. Next, in S1223, the generation AI plug-in 4100 responds to the generation AI application 3110 with the response received in S1218 as the processing result for S1211. The subsequent processing from S1224 to S1246 is the same as S616 to S638, so description thereof will be omitted.

[0083] As described above, according to this embodiment, the print setting generation AI interprets the print instruction given by the user in natural language based on information acquired from the organization information database 3500, the model information database 4500, and the print history database, thereby automatically determining optimal print settings. For example, even if the user instructs printing of content different from the content currently being created by the print application 1110, the AI ​​can issue a print instruction for previously created content by referencing information recorded in the organization information database 3500. Furthermore, by inputting information recorded in the model information database 4500 into the print setting generation AI 4200, the AI ​​4200 can estimate optimal print settings based on information specific to the printer to which the print job is sent. Furthermore, by inputting information recorded in the print setting history database 4600 into the print setting generation AI 4200, the AI ​​4200 can estimate optimal print settings based on information about print settings previously used by the user.

[0084] In the present embodiment, a sequence has been described in which information acquired from the model information database 4500 and the print history database 4600 is always added as input information to the print setting generation AI 4200, but the method of determining the input information to the print setting generation AI 4200 is not limited to this. For example, a command statement input by the user may be first input to the print setting generation AI to determine whether or not to use information from the model information database 4500 and the print history database, and then the generation AI plug-in 4100 may acquire information from various databases.

[0085] Furthermore, although the organization information database 3500, model information database 4500, and print history database 4600 have been described as being included in the generation AI server 300 and the generation AI plug-in server 400, respectively, they may have other configurations. For example, the organization information database 3500 may be located on a server different from the server on which the generation AI application 3100 runs. Similarly, the model information database 4500 and print history database 4600 may be located on a server different from the server on which the generation AI plug-in 4100 runs.

[0086] Furthermore, in this embodiment, an example has been described in which the generation AI application 3100 acquires content information from the organization information database 3500, but the information acquired is not limited to this. For example, print settings that an organization's administrator wants to apply uniformly throughout the organization may be registered in the organization information database 3500. In this case, the generation AI application 3100 can add the print setting information specified by the administrator to the instruction statement for the generation AI plug-in 4100 by acquiring it from the organization information database 3500. This allows the print setting generation AI 4200 to determine the optimal print settings, taking into account the print settings that the organization's administrator wants to apply uniformly throughout the organization.

[0087] <Third embodiment> The following describes a third embodiment of the present invention. The sequence of processing performed between the components constituting the computer 110, the generation AI server 300, and the generation AI plug-in server 400 in this embodiment will be described with reference to Figure 13. The numbers following "S" below indicate the step numbers in the sequence.

[0088] In S1301, the print application 1110 creates content to be printed in accordance with user instructions. Examples of content include presentation slides, document materials, charts, and graphs. After content creation is complete, the print application 1110 accepts instructions from the user in S1302 and displays a print setting screen 1111 on the display unit 101 in S1303. Next, in S1304, the print application 1110 accepts print instructions using natural language in the instruction input unit 1152 on the print setting screen 1111 to achieve the desired printing. An example of a print instruction is an instruction that includes printing conditions, such as "I want to print using as little paper as possible." In S1305, the print application 1110 inputs the print instructions input by the user, the IP address of the computer 110, and the name of the printer (print queue name) selected as the print job destination to the generation AI client 1200.

[0089] Upon receiving the print instruction, in S1306 the generation AI client 1200 uses the received information to generate an instruction statement to send to the generation AI server 300. In addition to the print instruction entered by the user, the instruction statement includes additional information such as the IP address of the computer 110 to identify the sender of the instruction statement and the name of the printer selected as the destination for the print job on the print settings screen 1111. Next, in S1307 the generation AI client 1200 sends the generated instruction statement to the generation AI application 3110 of the generation AI server 300.

[0090] Upon receiving the instruction, the generation AI application 3110 interprets the contents of the instruction and determines the generation AI plug-in 4100 to be called in S1308. Subsequently, in S1309, the generation AI application 3110 interprets the contents of the instruction to determine the print settings to be input to the generation AI plug-in 4100. Thereafter, in S1310, the generation AI application 3110 inputs the instruction received from the generation AI client 1200 to the determined generation AI plug-in. For example, in this embodiment, in response to an instruction to "print while saving paper," the generation AI application 3110 determines that print settings that select A4 paper size, double-sided printing, and layout printing are valid. If this determination is made, the information input in S1310 includes these setting information. Upon receiving the print setting information, the generation AI plug-in 4100 generates a URL for launching the assist tool 1300 in S1311. This URL includes a character string indicating the print settings determined by the generation AI application 3110 in S1309, in addition to a character string instructing the assist tool 1300 to be launched. An example of the generated character string is "assittool:size=A4&duplex=True&layout=4". Here, "assittool:" is a character string instructing the assist tool 1300 to be launched. "size=A4&duplex=True&layout=4" indicates that the paper size is A4, double-sided printing is enabled, and that four pages of content are to be printed (layout printing) per page. Next, in S1312, the generation AI plug-in 4100 responds with the URL generated in S1311 as the processing result for S1310.

[0091] Thereafter, in S1313, the generation AI application 3110 responds to the generation AI client 1200 with the processing result received in S1313 as the processing result for S1307. Next, in S1314, the generation AI client 1200 generates a response sentence for the print application 1110 from the received processing result. The response sentence is a natural language sentence including a character string that instructs the generation AI plug-in 4100 to launch the assist tool 1300 generated in S1311, and is displayed on the generation AI control 1150. In S1315, the generation AI client 1200 responds to the print application 1110 using the response sentence generated as the processing result for S1305. In S1316, the print application 1110 displays the received response sentence to the user in the chat display area 1151. An example of the response message is a message urging the user to start the assist tool 1300 together with a URL for starting the assist tool 1300 ("Select this URL to start the assist tool.assittool:size=A4&duplex=True&layout=4").

[0092] In step S1317, when the user selects the URL for launching the assist tool 1300 displayed in the chat display area 1151, the print application 1110 launches the assist tool 1300. At this time, the print application 1110 specifies, to the assist tool 1300, the character string "size=A4&duplex=True&layout=4" that indicates the print setting information included in the URL. Furthermore, the print application 1110 specifies, as a launch parameter, to the assist tool 1300, the location information (file path name) where the content to be printed is saved.

[0093] In S1319, the assist tool 1300 acquires print setting information from the character string indicating the print setting information input as a startup parameter. Specifically, by analyzing "size=A4&duplex=True&layout=4", information regarding the paper size, whether double-sided printing is enabled, and whether layout printing is enabled can be acquired. From the character string, it is possible to acquire that the paper size is A4, double-sided printing is enabled, and that the setting is to print four pages of content per page (layout printing). The processes from S1320 to S1324 are the same as those from S625 to S629, and therefore a description thereof will be omitted. In S1325, the assist tool 1300 acquires the content to be printed based on the location information where the content to be printed is saved, which was received as one of the startup parameters in S1318. From there, the processes from S1326 to S1333 are the same as those from S631 to S638, and therefore a description thereof will be omitted.

[0094] As described above, the printing system according to this embodiment includes a user terminal, a generation AI server that provides a generation AI service, an information processing device that enhances the functionality of the generation AI service, and a printing device. According to this embodiment, the generation AI application interprets a user's natural language print instruction to automatically determine optimal print settings. This allows the generation AI plug-in 4100 to create a URL for launching the assist tool 1300 that includes the print setting information determined by the generation AI application 3110. The URL created by the generation AI plug-in 4100 is ultimately presented to the user, and the user can select the URL to print using the print settings automatically determined by the assist tool 1300. While this embodiment illustrates examples of print setting information included in the URL generated by the generation AI plug-in 4100, such as paper size, whether or not to perform double-sided printing, and whether or not to perform layout printing, the print settings that can be included in the URL are not limited to these. For example, other print settings, such as paper type, the paper feed slot used for printing, and color information (color or monochrome) used for printing, may also be included.

[0095] The disclosure of this specification includes the following computer program, control method, and system. (Item 1) A computer program that expands the functionality of a generation AI service, comprising: an acquisition means for acquiring, from a user terminal, a natural language input relating to a print instruction from the user, which is accepted via the generation AI service; a determination unit for determining print settings based on a natural language input relating to the print instruction; a response unit that responds to the user terminal with the determined print settings; A computer program characterized by causing the computer to function as follows. (Item 2) the acquiring means acquires identification information of the selected printing device in addition to the natural language input related to the printing instruction; The computer program according to item 1, characterized in that the determination means acquires print settings that can be specified on the printing device from a database that pre-stores print settings based on the natural language input and identification information of the printing device. (Item 3) The computer of the information processing device further comprises: The computer program described in item 2 is characterized in that it functions as a storage means that links the print settings determined by the determination means with the identification information of the device that requested the print instruction and the identification information of the selected printing device and stores them in the database. (Item 4) The database further stores at least one of organizational information including content created within an organization that can use the generation AI service, model-specific information associated with each model of printing device, and printing history information for each user; The computer program described in item 2 or 3, characterized in that the determination means determines print settings based on at least one of the organizational information, the model-specific information, and the print history information in addition to natural language input related to the print instruction. (Item 5) The print instruction includes user identification information, 5. The computer program according to item 4, wherein the determining unit uses the print history information stored in association with the user identification information. (Item 6) The computer of the information processing device further comprises: a creation unit that creates a URL that reflects the print settings determined by the determination unit and that can be accessed from the user terminal; 6. The computer program according to any one of items 1 to 5, wherein the response means responds to the user terminal with the URL instead of the print settings. (Item 7) 7. The computer program according to item 6, wherein the creation means includes, as a startup parameter of the URL, location information where the content to be printed is stored, together with the print setting information. (Item 8) A computer program that uses a generation AI service, which configures a computer on a user terminal to: A receiving means for receiving a natural language input related to a print instruction from a user via an AI dialogue area for generating a setting screen; A generation means for generating an instruction sentence for the generation AI service based on the received natural language input; an acquisition means for transmitting the generated instruction text to the generation AI service and acquiring print settings determined by a plug-in that extends the functionality of the generation AI service; a confirmation means for allowing a user to confirm the acquired print settings via the setting screen; A computer program characterized by causing the computer to function as follows. (Item 9) The computer program according to item 8, wherein the confirmation means inquires of the user via the generated AI dialogue area of ​​the setting screen whether or not to perform printing using the acquired print settings. (Item 10) 10. The computer program according to item 8 or 9, wherein the setting screen includes an area for selecting a printing device to print on in accordance with user input, and a setting area for making print settings. (Item 11) Item 11. The computer program according to item 10, wherein the setting area relating to the print settings reflects the print settings acquired by the acquisition means. (Item 12) 12. The computer program according to any one of items 8 to 11, wherein the setting screen further includes an operation object that accepts an instruction to display a preview image. (Item 13) The computer of the user terminal further comprises: Item 13. The computer program according to item 12, characterized in that when a command to display a preview image is issued via the operation object, the computer program functions as a display control means that obtains corresponding print settings from a database that stores print settings determined by the plug-in, generates a preview image of the content to be printed according to the obtained print settings, and displays a screen showing the preview image to the user. (Item 14) Item 14. The computer program according to item 13, wherein an operation object for instructing printing is displayed on the screen displaying the preview image. (Item 15) A control method for an information processing device that expands the function of a generation AI service, an acquisition step in which an acquisition means acquires, from a user terminal, a natural language input related to a print instruction from the user, which is accepted via the generation AI service; a determination step of determining print settings based on the natural language input relating to the print instruction; a response step of responding to the user terminal with the determined print settings; A control method for an information processing device including: (Item 16) A method for controlling a user terminal that uses a generation AI service, a receiving step in which a receiving means receives a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​the setting screen; a generation step in which a generation means generates an instruction sentence for the generation AI service based on the received natural language input; an acquisition step in which an acquisition means transmits the generated instruction text to the generation AI service and acquires print settings determined by a plug-in that extends the functionality of the generation AI service; a confirmation step in which a confirmation means causes a user to confirm the acquired print settings via the setting screen; A method for controlling a user terminal, comprising: (Item 17) A printing system including a user terminal, a generation AI server that provides a generation AI service, an information processing device that extends the functionality of the generation AI service, and a printing device, The user terminal A receiving means for receiving a natural language input related to a print instruction from a user via an AI dialogue area for generating a setting screen; A generation means for generating an instruction sentence for the generation AI service based on the received natural language input; a first acquisition means for transmitting the generated instruction text to the AI ​​service and acquiring print settings determined by a plug-in that extends the functionality of the AI ​​service; a confirmation means for allowing a user to confirm the acquired print settings via the setting screen; Equipped with The information processing device includes: a second acquisition means for acquiring the instruction sentence from the user terminal; a determination unit for determining print settings based on a natural language input relating to the print instruction; a response means for responding to the user terminal with the determined print settings; A printing system comprising:

[0096] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0097] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0098] 100: Printing system, 110: Computer, 1010: Display unit, 1110: Printing application, 1133: Allocation control, 1150: Generation AI control, 1151: Chat display area, 1152: Instruction input unit, 1153: Execution button, 200: Printer, 300: Generation AI server, 400: Generation AI plug-in server

Claims

1. A computer program for expanding the functionality of a generation AI service, comprising: an acquisition means for acquiring, from a user terminal, a natural language input relating to a print instruction from the user, which is accepted via the generation AI service; a determination unit for determining print settings based on a natural language input relating to the print instruction; a response unit that responds to the user terminal with the determined print settings; A computer program characterized by causing the computer to function as follows.

2. the acquiring means acquires identification information of the selected printing device in addition to the natural language input related to the printing instruction; 2. The computer program according to claim 1, wherein the determining means obtains print settings that can be specified on the printing device from a database that pre-stores print settings based on the natural language input and identification information of the printing device.

3. The computer of the information processing device further comprises: The computer program according to claim 2, characterized in that the computer program functions as a storage means that stores the print settings determined by the determination means in the database, linked to the identification information of the device that requested the print instruction and the identification information of the selected printing device.

4. The database further stores at least one of organizational information including content created within an organization that can use the generation AI service, model-specific information associated with each model of printing device, and print history information for each user; 4. The computer program according to claim 3, wherein the determining means determines the print settings based on at least one of the organizational information, the model-specific information, and the print history information in addition to the natural language input related to the print instruction.

5. The print instruction includes user identification information, 5. The computer program according to claim 4, wherein the determining unit uses the print history information stored in association with the user identification information.

6. The computer of the information processing device further comprises: a creating unit that creates a URL that reflects the print settings determined by the determining unit and that can be accessed from the user terminal; 2. The computer program according to claim 1, wherein the response unit responds to the user terminal with the URL instead of the print settings.

7. 7. The computer program according to claim 6, wherein the creating unit includes, as start-up parameters of the URL, location information where the content to be printed is stored, together with the print setting information.

8. A computer program that uses a generation AI service, comprising: a receiving means for receiving a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​the setting screen; A generation means for generating an instruction sentence for the generation AI service based on the received natural language input; an acquisition means for transmitting the generated instruction statement to the generation AI service and acquiring print settings determined by a plug-in that extends the function of the generation AI service; a confirmation means for allowing a user to confirm the acquired print settings via the setting screen; A computer program characterized by causing the computer to function as follows.

9. 9. The computer program according to claim 8, wherein the confirmation unit inquires of the user via the generation AI dialogue area of ​​the setting screen whether or not to execute printing using the acquired print settings.

10. 9. The computer program according to claim 8, wherein the setting screen includes an area for selecting a printing device to be used for printing in accordance with user input, and a setting area for making print settings.

11. 11. The computer program according to claim 10, wherein the setting area relating to the print settings reflects the print settings acquired by the acquisition means.

12. 11. The computer program according to claim 10, wherein the setting screen further includes an operation object for receiving an instruction to display a preview image.

13. The computer of the user terminal further comprises:

13. The computer program according to claim 12, wherein when a preview image display is instructed via the operation object, the computer program functions as a display control means that obtains corresponding print settings from a database that stores print settings determined by the plug-in, generates a preview image of the content to be printed in accordance with the obtained print settings, and displays a screen showing the preview image to the user.

14. 14. The computer program according to claim 13, wherein an operation object for instructing printing is displayed on the screen displaying the preview image.

15. A control method for an information processing device that expands the function of a generation AI service, an acquisition step in which an acquisition means acquires, from a user terminal, a natural language input related to a print instruction from the user, which is accepted via the generation AI service; a determination step of determining print settings based on the natural language input relating to the print instruction; a response step of responding to the user terminal with the determined print settings; A control method for an information processing device including:

16. A control method for a user terminal that uses a generation AI service, a receiving step in which a receiving means receives a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​the setting screen; A generation step in which a generation means generates an instruction sentence for the generation AI service based on the received natural language input; an acquisition step in which an acquisition means transmits the generated instruction sentence to the generation AI service and acquires print settings determined by a plug-in that extends the function of the generation AI service; a confirmation step in which a confirmation means causes a user to confirm the acquired print settings via the setting screen; A method for controlling a user terminal, comprising:

17. A printing system including a user terminal, a generating AI server that provides a generating AI service, an information processing device that extends the function of the generating AI service, and a printing device, The user terminal a receiving means for receiving a natural language input related to a print instruction from a user via a generation AI dialogue area of ​​the setting screen; A generation means for generating an instruction sentence for the generation AI service based on the received natural language input; a first acquisition means for transmitting the generated instruction statement to the generation AI service and acquiring print settings determined by a plug-in that extends the function of the generation AI service; a confirmation means for allowing a user to confirm the acquired print settings via the setting screen; Equipped with The information processing device includes: a second acquisition means for acquiring the instruction sentence from the user terminal; a determination unit for determining print settings based on a natural language input relating to the print instruction; a response means for responding to the user terminal with the determined print settings; A printing system comprising:

Images