Computer program, control method, and printing system

Abstract

To a mechanism that suitably determines print setting based on a print instruction input in, for example, natural language.SOLUTION: An information processing device acquires natural language input related to a print instruction from a user terminal, which is received via a generative AI service. The information processing device also determines print setting based on the natural language input related to the print instruction, and responds with the determined print setting to the user terminal.SELECTED DRAWING: Figure 6

Description

Technical Field

[0004] ,

[0006] , , ,

[0005] , , ,

[0001] The present invention relates to a computer program, a control method, and a printing system.

Background Art

[0002] In recent years, conversational AIs such as chatbots and generative AIs have been rapidly developed. Along with this development, various services using conversational AIs are being provided. Patent Document 1 proposes a printing assistance system that performs printing settings for a printing job via a chatbot.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the above prior art has the following problems. In the above prior art, although printing settings are performed by repeating questions and answers via a chatbot, when an instruction for an execution other than printing settings, such as a printing instruction to a printer, is input, the input text is not accurately (appropriately) interpreted to perform printing settings. Therefore, there has been a problem that it is difficult for a computer to automatically transmit a printing job to a printer based on an input instruction for a printing instruction.

[0005] The present invention has been made in view of at least one of the above problems, and provides a mechanism for suitably determining printing settings based on a printing instruction input in natural language.

Means for Solving the Problems

[0006] The present invention relates to, for example, a computer program that enhances the functionality of a generation AI service, and the computer of an information processing device, before via the AI ​​service for generating text From the user The natural language received First Instructions relating to the data specified by the user The first Instructions The second instruction includes The means of receiving data and the print settings used to print the specified data 、 The aforementioned The method of registration is Reception 2 digits The output means functions to output based on the instruction text, and the data is printed according to the output print settings, and the receiving means receives the data after the user has specified it. Second It is characterized by its ability to accept instructions.

[0007] Furthermore, the present invention relates to, for example, a computer program that utilizes a generation AI service, characterized in that the computer of a user terminal functions as: a receiving means that receives natural language input related to print instructions from the user via a generation AI dialogue area on a settings screen; a generating means that generates instruction text for the generation AI service based on the received natural language input; an acquiring means that transmits the generated instruction text to the generation AI service and obtains print settings determined by a plugin that extends the functionality of the generation AI service; and a confirming means that allows the user to confirm the acquired print settings via the settings screen.

[0008] Furthermore, the present invention relates to a printing system including, for example, a user terminal, a generation AI server that provides generation AI services, an information processing device that extends the functionality of the generation AI service, and a printing device, wherein the user terminal includes a receiving means for receiving natural language input related to printing instructions from the user via a generation AI dialogue area on a settings screen, a generating means for generating instruction text to the generation AI service based on the received natural language input, a first acquisition means for transmitting the generated instruction text to the generation AI service and obtaining print settings determined by a plugin that extends the functionality of the generation AI service, and a confirmation means for allowing the user to confirm the acquired print settings via the settings screen, and the information processing device includes a second acquisition means for obtaining the instruction text from the user terminal, a determination means for determining print settings based on the natural language input related to the printing instructions, and a response means for responding to the user terminal with the determined print settings. [Effects of the Invention]

[0009] According to the present invention, print settings can be suitably determined based on print instructions entered in natural language. [Brief explanation of the drawing]

[0010] [Figure 1] A block diagram showing an example of the network configuration of a printing system according to one embodiment. [Figure 2A] A block diagram showing the hardware configuration of each device in a printing system according to one embodiment. [Figure 2B] A block diagram showing the hardware configuration of each device in a printing system according to one embodiment. [Figure 3] A block diagram showing the hardware configuration of a printer according to one embodiment. [Figure 4A] A block diagram showing the software configuration related to printing according to one embodiment. [Figure 4B] A block diagram showing the software configuration related to printing according to one embodiment. [Figure 5A] A figure showing an example of a printing application according to one embodiment. [Figure 5B] A diagram showing an example of a printing application according to an embodiment. [Figure 6] A diagram showing a printing sequence according to an embodiment. [Figure 7] A diagram showing an example of an instruction text transmitted to a generative AI server according to an embodiment. [Figure 8] A diagram showing print settings stored in a print setting database according to an embodiment. [Figure 9] A flowchart showing the processing procedure of a generative AI plugin server 400 according to an embodiment. [Figure 10] A flowchart showing the processing procedure of a computer 110 according to an embodiment. [Figure 11] A flowchart showing the processing procedure of a computer 110 according to an embodiment. [Figure 12A] A diagram showing a printing sequence according to an embodiment. [Figure 12B] A diagram showing a printing sequence according to an embodiment. [Figure 13] A diagram showing a printing sequence according to an embodiment.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0012] <First Embodiment> <System Configuration> Hereinafter, the first embodiment of the present invention will be described. First, referring to FIG. 1, the network configuration of the printing system according to the present embodiment will be described.

[0013] As shown in Figure 1, the printing system 100 comprises a terminal device, a computer 110, a printer (printing device) 200 configured to print, a generation AI server 300, and a generation AI plug-in server 400. For example, the computer 110 and the printer 200 are located within an office and are connected to each other via an internal network 500. The internal network 500 is connected to the external internet 6000 via a router (not shown). Here, the computer 110 is an example of a user terminal, and the generation AI plug-in server 400 is an example of an information processing device.

[0014] The generation AI server 300 is connected to the computer 110, printer 200, and generation AI plug-in server 400 via the internet 6000 and the company network 500. The generation AI server 300 is a server managed by the provider of the generation AI service. The generation AI plug-in server 400 is connected to the computer 110, printer 200, and generation AI server 300 via the internet 6000 and the company network 500. The generation AI plug-in server 400 is a server managed by the provider of the print service. In this embodiment, the generation AI server 300, the generation AI plug-in server 400, and the generation AI control (generation AI dialogue area) 1150 on the computer 110 shown in Figure 5 may be collectively referred to as the "generation AI system". The hardware on which the generation AI server 300, the generation AI plug-in server 400, and the generation AI control 1150 reside may be separate or they may reside together on the same hardware. Furthermore, the internal network 500 may be connected via a wired connection or a wireless connection.

[0015] <Hardware Configuration> Referring to Figures 2A to 3, the hardware configuration of each device in the printing system 100 according to this embodiment will be described. Figure 2A shows the hardware configuration of the computer 110 and the generation AI server 300. Figure 2B shows the hardware configuration of the generation AI plug-in server 400. Figure 3 shows the hardware configuration of the printer 200.

[0016] As shown in Figure 2A, the computer 110 has a display unit 101, an operation unit 102, a storage unit 103, a control unit 104, and a network communication unit 105, which are connected to each other so as to be able to communicate with one another. The computer 110 is not particularly limited and can be a desktop or notebook personal computer, a tablet terminal, a smartphone, etc. The control unit 104 is composed of a CPU (Central Processing Unit) 141 and memory 142 and controls the entire computer 110.

[0017] The display unit 101 is composed of a display such as an LCD panel and can display images, etc. The operation unit 102 is composed of a mouse, keyboard, etc. and can accept input operations from the user. The storage unit 103 is composed of a storage medium such as a hard disk or SSD and stores various programs (software) necessary for the operation of the computer 110. The programs are loaded into memory 142 as needed and executed by the CPU 141. The programs include programs that cause the CPU 141 to execute each part and function of the printing system 100. Note that these programs are not limited to those stored in the computer 110. The programs may be stored in the printer 200, the generation AI server 300, or the generation AI plug-in server 400, or they may be distributed and stored across the computer 110, printer 200, generation AI server 300, and generation AI plug-in server 400. The network communication unit 105 performs data input and output with external devices via an external network.

[0018] The generation AI server 300 includes a display unit 301, an operation unit 302, a storage unit 303, a control unit 304, and a network communication unit 305, which are connected to each other for communication. The control unit 304 consists of a CPU 341, a memory 342, and a GPU (Graphics Processing Unit) 343, and controls the entire generation AI server 300. As the hardware configuration of the generation AI server 300 is almost the same as that of the computer 110, a detailed explanation will be omitted.

[0019] As shown in Figure 2B, the hardware configuration of the generation AI plugin server 400 is almost the same as that of the computer 110. Therefore, in this embodiment, the hardware configurations of the generation AI server 300 and the generation AI plugin server 400 will not be described. It is preferable that the generation AI server 300 has a GPU 343 and the generation AI plugin server 400 has a GPU 443.

[0020] As shown in Figure 3, the printer 200 includes a display unit 201, an operation unit 202, a storage unit 203, a control unit 204, a network communication unit 205, and a printing unit 206, which are connected to each other in a communicative manner. The printer 200 is not particularly limited as long as it has a printing function; for example, an MFP (Multi-Function Printer) or an SFP (Single Function Printer) can be used. The control unit 204 is configured to include a CPU 241 and a memory 242, and controls the entire printer 200.

[0021] The display unit 201 is composed of a display such as an LCD panel and can display images, for example. The operation unit 202 is composed of a touch panel and various buttons, allowing user input operations. The storage unit 203 is composed of a storage medium such as a hard disk or SSD and stores various programs (software) necessary for the printer 200 to operate. The programs are loaded into memory 242 as needed and executed by the CPU 241. The network communication unit 205 performs data input and output with external devices via an external network. The printing unit 206, according to the instructions of the control unit 204, converts the digital data stored in the storage unit 203 and memory 242 into images and prints them on printing paper. The printing method is not particularly limited and can be, for example, an ink system, a toner system, or other methods.

[0022] <Software Configuration> Referring to Figure 4, the software configuration of each device included in the printing system 100 according to this embodiment will be described. Figure 4A shows the modules related to printing in the software configuration of the computer 110. Figure 4B shows the modules related to printing in the software configuration of the generation AI server 300 and the generation AI plug-in server 400.

[0023] As shown in Figure 4A, the computer 110 includes an application 1100, a generation AI client 1200, an assist tool 1300, and an OS (Operating System) 1400. The application 1100 includes any software, such as security software, spreadsheet software, and browser software, and in the example in Figure 4A, it includes a printing application 1110. The printing application 1110 is an application that has a printing function. The printing application 1110 is not particularly limited and can include, for example, spreadsheet software, browser software, presentation software, etc., that have a printing function.

[0024] When the printing function of the printing application 1110 is executed by user operation, the information displayed on the display unit 101 of the computer 110 is sent to the printer 200 and printing is performed. The printing function is realized by calling the interface of the GDI (Graphic Device Interface) 1410, which will be described later. The assist tool 1300 is software that generates print preview images and operates the printer driver 1420 using content created using the printing application 1110 and various print settings obtained from the print setting database 4300, which will be described later.

[0025] The generation AI client 1200 refers to client software running on computer 110. The generation AI client 1200 receives user instructions from the print application 1110, generates instructions for transmission to the generation AI server 300, and sends them to the generation AI server 300. Here, the instructions for transmission refer to the user's instructions with additional instructions added.

[0026] OS1400 is the software that controls the basic operation of computer 110. OS1400 includes GDI1410, printer driver 1420, and spooler 1430. Printer driver 1420 is provided by the vendor that provides printer 200. Applications 1100 and printer driver 1420, etc., are all managed by OS1400 and become usable after being installed on OS1400. Printer driver 1420 is provided by the vendor that provides OS1400 and may be pre-installed on OS1400. GDI1410 is an internal component of OS1400 that provides an external interface for drawing, such as printing. Printer driver 1420 displays the print settings for printing with printer 200 as a UI (User Interface). In addition, printer driver 1420 generates drawing data (PDL: Page Description Language) that printer 200 can interpret when printing. The spooler 1430 processes the PDL generated by the printer driver 1420 and sends it to the printer 200. While this description uses Microsoft's Windows® as the operating system, other operating systems may be used as OS 14000. Furthermore, the print data received by the printer driver 1420 from the print application 1110 may be in XML Paper Specification format (XPS format), not just GDI format.

[0027] As shown in Figure 4B, the generation AI server 300 includes an application 3100, an organizational information database 3500, and an OS 3400. Since the OS 3400 has almost the same software configuration as the OS 1400, a description of the OS 3400 is omitted here. The application 3100 contains arbitrary software; in the example in Figure 4B, it includes the generation AI application 3110. The generation AI application 3110 is an application that has the function of interpreting the generation AI. The generation AI application 3110 interprets the user instruction sent from the generation AI client 1200 and determines the response to the instruction. Furthermore, the generation AI application 3110 determines whether a plugin needs to be called and which plugin should be called to perform the instructed operation, depending on the given instruction. In addition, the generation AI application 3110 inputs information about the instruction sent from the generation AI client 1200 to the called plugin. The plugin referred to here is the generation AI plugin 4100, which will be described later. The organizational information database 3500 is a database referenced by the generation AI application 3110. The organizational information database 3500 stores various content, such as spreadsheet files and presentation files, created within organizations where the generation AI application 3110 is available. The generation AI application 3110 can access information about files stored in the organizational information database 3500 in response to instructions from the user.

[0028] The generation AI plugin server 400 contains a generation AI plugin 4100, a print setting generation AI 4200, a print setting database 4300, a model information database 4500, a print history database 4600, and an OS 4400. Note that the OS 4400 has almost the same software configuration as the OS 1400, so a description of the OS 4400 is omitted here. The generation AI plugin 4100 is arbitrary software linked to the generation AI application 3110 and is called from the generation AI application 3110. The generation AI plugin 4100 inputs the instructions received from the generation AI application 3110 into the print setting generation AI 4200 and responds to the generation AI application 3110 with the processing result. One or more generation AI plugins 4100 exist within the generation AI plugin server 400. The model information database 4500 is a database referenced by the generation AI plugin 4100. The model information database 4500 stores model-specific information for each printer model, such as available paper sizes, paper types, and equipment configuration information. The generation AI plugin 4100 can input printer model-dependent information into the print setting generation AI 4200 by referring to the model information database 4500. The print history database 4600 is a database referenced by the generation AI plugin 4100. The print history database 4600 stores combinations of print settings used for printing by each user. The generation AI plugin 4100 can input information about the print settings used by the user into the print setting generation AI 4200 by referring to the print history database 4600.

[0029] The generation AI application 3110 determines which generation AI plugin 4100 to call based on the result of interpreting the input natural language. For example, if the generation AI application 3110 determines that the interpretation result is related to changing print settings, it will call generation AI plugin X; if it determines that it is related to executing print settings, it will call generation AI plugin Y. The print setting generation AI 4200 is a language model built using big data, including text data, and deep learning technology. The print setting generation AI 4200 determines the optimal combination of print settings to achieve the user's desired printout as contained in the input instruction.

[0030] The print settings database 4300 refers to a database that records information identifying the computer that sent the instruction message for each combination of print settings determined by the print settings generation AI 4200.

[0031] <Example of settings screen> Referring to Figure 5A, the screen 1111 displayed on the display unit 101 by the printing application 1110 according to this embodiment will be described. The screen 1111 displayed on the display unit 101 by the printing application 1110 allows input of output condition instructions, including printing conditions when printing with the printer 200. Thus, in this embodiment, the printing application 1110 also functions as an input means for inputting output conditions.

[0032] Screen 1111 includes a printer selection control 1120, a print settings control 1130, a printer driver control 1140, a generated AI control 1150, a print button 1161, and a preview display button 1162, all of which are print conditions. Screen 1111 may also include other output conditions besides these print conditions. For example, if printer 200 is configured to perform stapling, it may include stapling conditions to set the position and number of staples. Similarly, if printer 200 is configured to perform cutting, it may include cutting conditions to set the cutting position. The print button 1161 and the preview display button 1162 are examples of operation objects; operating them will perform printing and preview display, respectively.

[0033] The printer selection control 1120 displays a UI list of printers available to the computer 110, i.e., printers that can receive print jobs from the computer 110, based on printer data pre-stored in the storage unit 103. By operating the printer selection control 1120, the user can select the printer 200 to which the print job will be sent. In Figure 5A, the name of printer 200 is "CCC Printer".

[0034] The print settings control 1130 is a setting area for setting print settings and includes the number of copies control 1131, layout control 1132, color mode control 1133, and layout control 1134. The number of copies control 1131 is an item for setting the number of copies to print. In Figure 5A, the number of copies control 1131 is set to "1". The layout control 1132 is an item for selecting the orientation of the print on the paper. In this embodiment, you can select "Portrait" for vertical printing and "Landscape" for horizontal printing. In Figure 5A, the layout control 1132 is set to "Portrait". The color mode control 1133 is an item for selecting "Color" for color printing and "Monochrome" for monochrome printing. In Figure 5A, the color mode control 1133 is set to "Color". Note that the print settings control 1130 is not limited to including the number of copies control 1131 to the color mode control 1133, but may include at least one of these items. Furthermore, the print settings control 1130 may include other settings, such as an item for selecting the paper size, an item for selecting single-sided or double-sided printing, and an item for selecting the number of pages to be placed per sheet of paper. The layout control 1134 is an item for selecting the number of original pages to be allocated per sheet of paper in layout printing. The layout control 1134 has settings such as "1in1" which allocates and prints one original page per sheet of paper, "2in1" which allocates and prints two original pages per sheet of paper, and "4in1" which allocates and prints four original pages per sheet of paper. In Figure 5A, the layout control 1134 is set to "4in1". If the user intends to save paper when printing, they can obtain the desired printed output by setting the value of the layout control 1134.

[0035] The printer driver control 1140 displays a detailed print settings screen provided by the printer driver corresponding to "CCC Printer" displayed on the printer selection control 1120, when the user operates the control. This allows the user to make detailed changes to the print settings on the printer driver's print settings screen. When the printer driver's print settings screen is closed, the changes to the print settings on the print settings screen are saved in the storage unit 103.

[0036] The generation AI control 1150 includes a chat display area 1151, an instruction input unit 1152, and an execution button 1153. The print application 1110 displays, in a dialogue format, the instruction text (natural language) entered by the user in the chat display area 1151 and the text corresponding to the processing execution results received from the generation AI server 300. The print application 1110 provides a function to input arbitrary instructions representing the processing content in the instruction input unit 1152. The user can input instructions, for example, via an operation unit 102 such as a keyboard. Alternatively, the user's speech may be accepted as voice input via a microphone (not shown). In Figure 5A, the instruction text "Print using paper saving" is entered in Japanese into the instruction input unit 1152. Note that the text entered into the instruction input unit 1152 is not limited to text indicating a change in the layout printing settings, but can be any text, such as changing the color mode, or expanding or shrinking the print range. The execution button 1153 is a button for sending instructions, including the instructions entered in the instruction input unit 1152, to the generation AI server 300. Furthermore, it is desirable that the determined print settings, such as 4-in-1, based on the instructions entered in the instruction input unit 1152, be reflected in the corresponding control, the allocation control 1134, as shown in Figure 5A. In other words, each print setting control can be set according to user input, but settings based on the interaction with the generation AI control 1150 may also be reflected.

[0037] <Preview display> Referring to Figure 5B, the preview display shown on the display unit 101 by the assist tool 1300 according to this embodiment will be described. When the print button 1161 on the screen 1111 is operated, the print application 1110 does not display the print preview image display UI 1170, but sends the print job to the printer 200 based on the print settings specified in the print setting control 1130. On the other hand, when the preview display button 1162 on the screen 1111 is operated, the print application 1110 displays the print preview image display UI 1170 provided by the assist tool 1300.

[0038] The print preview image display UI 1170 includes a print preview display area 1171 and a print button 1172. The assist tool 1300 displays a preview image of the print result in the print preview display area 1171 based on the print settings determined by the print setting generation AI 4200 and the content created by the print application 1110. This allows the user to check the printout to be printed by the printer 200 in advance before the printout is output. When the print button 1172 is operated, the print application 1110 starts the process of sending a print job for the content displayed in the print preview image display UI 1170. Thus, the print button 1172 is an example of an operation object.

[0039] <Sequence> Referring to Figure 6, the sequence of processing that takes place between the elements constituting the computer 110, the generation AI server 300, and the generation AI plugin server 400 in this embodiment will be described. The numbers following "S" below indicate the step numbers in the sequence.

[0040] In S601, the print application 1110 creates the content to be printed according to the user's instructions. Examples of content include presentation slides, documents, charts, and graphs. After the content creation is complete, in S602, the print application 1110 receives instructions from the user, and in S603, displays the print settings screen 1111 on the display unit 101. Next, in S604, the print application 1110 receives print instructions using natural language in the instruction input unit 1152 within the print settings screen 1111 to achieve the desired print job. An example of a print instruction is one that includes conditions for printing, such as "I want to print while saving as much paper as possible." In S605, the print application 1110 inputs the print instructions entered by the user, the IP address of the computer 110, and the printer name (print queue name) selected as the destination for the print job to the generation AI client 1200. In this way, the printing application 1110 inputs the IP address, which is the identification information of the device (user terminal) that requested the print command via the print settings screen 1111, and the name (printer name), which is the identification information of the selected printing device, along with natural language input.

[0041] Upon receiving a print command, in S606, the generation AI client 1200 uses the received information to generate a command message to send to the generation AI server 300. In addition to the print command entered by the user, the command message includes additional information such as the IP address of computer 110 to identify the source of the command message and the printer name selected as the print job destination on the print settings screen 1111. A specific example of the command message to send to the generation AI server 300 will be described later using Figure 7. Subsequently, in S607, the generation AI client 1200 sends the generated command message to the generation AI application 3110 on the generation AI server 300.

[0042] Upon receiving the instruction, in S608 the generation AI application 3110 interprets the content of the instruction and determines which generation AI plugin 4100 to call. Then, in S609, the generation AI application 3110 inputs the instruction received from the generation AI client 1200 to the determined generation AI plugin.

[0043] Upon receiving the instruction, in S610, the generation AI plugin 4100 inputs the received instruction to the print setting generation AI 4200. In S611, the print setting generation AI 4200 interprets the user's print instructions contained in the instruction to determine the optimal combination of print settings to obtain the output desired by the user. Note that the configurable print settings differ depending on the type of printer 200. The print setting generation AI 4200 may be configured to refer to a print setting function database (not shown) and determine the print settings that can be set on the printer 200 identified by the printer name of the target printer for print job transmission contained in the instruction received in S609. Furthermore, in S611, the print setting generation AI 4200 may determine a combination of print settings based on the determined configurable print settings and the instruction. With this configuration, the print setting generation AI 4200 can determine the print settings that can be specified on the printer 200. Subsequently, in S612, the print setting generation AI 4200 responds to the generation AI plugin with the determined combination of print settings as the determination result.

[0044] Upon receiving the response, in S613, the generation AI plugin 4100 associates the combination of print settings included in the response with the IP address of computer 110 and the printer name included in the instruction received in S609, and records this in the print setting database 4300. A specific example of the information recorded in the print setting generation database will be described later using Figure 8. Subsequently, in S615, the generation AI plugin 4100 responds to the generation AI application 3110 with the response received in S612 as the processing result for S609.

[0045] Subsequently, in S616, the generation AI application 3110 responds to the generation AI client 1200 with the processing result received in S615 as the processing result for S607. Then, in S617, the generation AI client 1200 generates a response statement for the print application 1110 from the received processing result. The response statement is a text that explains to the user, using natural language, the combination of print settings determined by the print setting generation AI 4200 in S611, and is displayed on the generation AI control 1150. In S618, the generation AI client 1200 responds to the print application 1110 using the response statement generated as the processing result for S605.

[0046] In S619, the print application 1110 displays the received response message to the user. Examples of the response message include the content of the applied print settings ("4in1 settings applied") as exemplified in the chat display area 1151, a message to confirm whether to proceed with printing, and buttons that allow the user to specify whether to proceed with printing afterward. In addition, in S612, the print setting generation AI 4200 may respond with information such as displaying buttons that allow the user to specify one or more print settings as desired.

[0047] In S620, the print application 1110 accepts user input on the preview display button located on the print settings screen 1111. When the preview display button is pressed, in S621, the print application 1110 starts the assist tool 1300 and issues a command to display the preview image. Here, the command in S621 includes information to identify the print settings to be retrieved from the print settings database 4300. This information includes the IP address of computer 110, the name of the printer designated as the target for sending the print job, and location information (file path name) where the content to be printed used to generate the print preview image is stored.

[0048] Upon receiving the above instructions, at S622, the assist tool 1300 instructs the assist tool 1300 to access the print settings database 4300 and obtain the combination of print settings to be used for preview display. Here, the instructions at S622 include the IP address of computer 110 and the printer name specified as the target for print job transmission as information to identify the print settings to be obtained. Upon receiving the instructions, the print settings database 4300 retrieves the combination of print settings recorded in association with the IP address and printer name included in the instructions at S623. Then, at S624, the print settings database 4300 responds to the assist tool 1300 with the retrieved combination of print settings.

[0049] In S625, the assist tool 1300 instructs the spooler 1430 to reflect the acquired print settings combination to the printer driver 1420. Upon receiving the instruction, the spooler 1430 instructs the printer driver 1420 associated with the printer set as the target for sending the print job in S626 to reflect the various print settings. Upon receiving the instruction, the printer driver 1420 reflects the various print settings specified in S627 and responds to the spooler 1430 with the processing result in S628. Upon receiving the processing result from the printer driver 1420, the spooler 1430 responds to the assist tool 1300 with the processing result in S629.

[0050] Next, in S630, the assist tool 1300 retrieves the print target content based on the location information of the print target content received in S621. The assist tool 1300 may also retrieve the location information of the print target content from the print settings database 4300, rather than from the print application 1110. Alternatively, the assist tool 1300 may retrieve the print target content itself from the print settings database 4300. In these cases, the location information of the print target content, or the print target content itself, is specified by the print application 1110 or the generating AI client 1200, and as a result, this information is included in the instruction statement in S607.

[0051] Next, in S631, the assist tool 1300 generates a print preview image based on the combination of the print handling content acquired in S630 and the print settings acquired in S624. Then, in S632, the assist tool 1300 displays the generated print preview image to the user. The print preview image is displayed on the print preview display screen shown by the assist tool 1300. Then, in S633, the assist tool 1300 receives a print job execution instruction from the user who has confirmed the print preview image by operating the print button on the print preview display screen. Having received the print job execution instruction, the assist tool 1300 instructs the spooler 1430 to execute the print job in S634. Next, in S635, the spooler 1430 instructs the printer driver 1420 to execute the print process. Having received the print process execution instruction, the printer driver 1420 generates a print job based on the instruction in S636 and sends the generated print job to the printer in S637. Upon receiving a print job, the printer executes the printing process according to the content of the print job in S638, and then terminates this sequence.

[0052] <Example of instructions> Referring to Figure 7, an example of an instruction message sent to the generation AI server 300 in S606 will be explained. The instruction message contains information 701 to 705. 701 indicates the print instruction entered by the user in the instruction input unit 1152 in S604. 702 indicates the printer name set as the printer to which the print job will be sent in the printer selection control 1120. 703 contains the IP address of the computer 110. 704 contains the instruction content for the generation AI application 3110. Specifically, it is an instruction that asks for a combination of print settings corresponding to the instruction message from the user. 705 contains user identification information to identify the user who entered the instruction message. Note that 702, 703, 704, and 705 are not content explicitly entered in the instruction input unit 1152, but are automatically added by the generation AI client 1200. The generation AI application 3110 determines which plugin to call by interpreting the content of this instruction message.

[0053] <Print Settings> Referring to Figure 8, the print settings stored in the print settings database 4300 according to this embodiment will be described. The database stores combinations of print settings related to paper size 803, paper type 804, layout 805, and color mode 806, using the IP address 801 and printer name 802 as keys. The assist tool 1300 can identify the combination of print settings stored in the database to be retrieved, using the IP address of the computer 110 and the printer name set as the target for sending the print job as keys. Note that the print settings shown in Figure 8 are just an example and are not intended to limit the present invention. For example, other arbitrary print settings can be combined as alternatives or additionally.

[0054] <Processing procedure for generating print settings AI> Referring to Figure 9, the processing procedure of the print setting generation AI 4200 executed by the generation AI plug-in server 400 according to this embodiment will be described. The processing described below is realized, for example, by the CPU 441 of the generation AI plug-in server 400 reading a program stored in the storage unit 403 into the memory 442 and executing it.

[0055] In S101, the CPU 441 obtains the instruction statement created from the user instruction input in the computer 110 via the generation AI server 300. As shown in Figure 7, this instruction statement includes the print instruction from the user, the IP address of the computer 110 that identifies the source of the instruction statement, and the name of the destination printer. In S102, the CPU 441 obtains the printer name from the received instruction statement.

[0056] In S103, the CPU 441 interprets the instruction. Specifically, the CPU 441 interprets the instruction content 704 shown in Figure 7 and the print instruction 701 from the user. For example, here, keywords related to print settings are extracted from the instruction content and used as search keys when obtaining combinations of print settings. Next, in S104, the CPU 441 uses the printer name obtained in S102 and the search keywords extracted in S103 to search the print setting database 4300 for available print settings, and in S105 determines the combination of print settings found.

[0057] In S106, CPU 441 returns the processing result to the generation AI server 300. Furthermore, in S107, CPU 441 associates the determined print setting combination with the IP address of computer 110 and the printer name, records it in the print setting database 4300, and terminates the processing of this flowchart.

[0058] <Processing procedure on the user terminal> Referring to Figure 10, the processing procedure of the computer (user terminal) 110 according to this embodiment will be described. The processing described below is achieved, for example, by the CPU 141 of the computer 110 reading a program stored in the storage unit 103 into the memory 142 and executing it.

[0059] First, in S201, the CPU 141 displays the print settings screen 1111 on the display unit 101 in response to instructions from the print application 1110. In S202, the CPU 141 determines whether or not it has received natural language input from the user via the generation AI control (generation AI dialogue area) 1150 of the print settings screen 1111. If natural language input is received, the process proceeds to S203; otherwise, it proceeds to S206.

[0060] In S203, the CPU 141 generates an instruction statement as shown in Figure 7 based on the received natural language input and the selection information of the printing device. Subsequently, in S204, the CPU 141 inputs the generated instruction statement to the generation AI server 300, thereby obtaining the print settings determined by the generation AI plug-in server 400. After that, in S204, the CPU 141 confirms the obtained print settings with the user via the print settings screen 1111. Here, as shown in Figure 5A, the CPU 141 may confirm that the determined print settings (e.g., 4in1) have been set in the generation AI control 1150 of the print settings screen 1111, and may also ask whether or not to proceed with printing. The CPU 141 also updates the settings of the print settings control 1130 on the print settings screen 1111 according to the obtained print settings.

[0061] Subsequently, in S206, the CPU 141 determines whether or not a print command has been received. A print command here can be issued by operating the print button 1161 or by sending a print command via the generated AI control 1150. If a print command is received, the process proceeds to S207; otherwise, it proceeds to S208. In S207, the CPU 141 sends the selected printer via the printer driver 1420 to execute the print command, and the process of this flowchart ends.

[0062] Meanwhile, in S208, the CPU 141 determines whether or not it has received a preview request via the preview button 1162. If it has received a preview request, it proceeds to S209; otherwise, it terminates the processing of this flowchart. In S209, the CPU 141 performs the preview and terminates the processing of this flowchart. The preview display will be explained in detail using Figure 11.

[0063] (Preview display) Referring to Figure 11, the detailed processing procedure for the preview display in S209 described above will be explained. Here, the preview display function of the assist tool 1300 will be described. The assist tool 1300 is an example of a display control means. The processing described below is realized, for example, when the CPU 141 of the computer 110 reads the program stored in the storage unit 103 into the memory 142 and executes it.

[0064] In S301, the CPU 141 receives a command to display a preview image via the print application 1110, and the assist tool 1300 is launched. Specifically, when the preview display button 1162 on screen 1111 is operated, the CPU 141 determines that a command to display a preview image has been received and launches the assist tool 1300. From this point onward, the process is handled by the assist tool 1300. Next, in S302, the CPU 141 accesses the print settings database 4300 to obtain the print settings for the print job. The print settings obtained here are the print settings recorded in S107 above. In S303, the CPU 141 instructs the printer driver 1420 to reflect the combination of print settings obtained.

[0065] In S304, CPU 141 retrieves the content included in the preview display instruction. For example, the preview display instruction does not necessarily contain the content data itself; in that case, it contains information about where the content data is stored. The content data may be stored on computer 110, or in the print settings database 4300 of the generation AI plugin server 400. When using data stored in the database as content data, the instruction statement includes information about that storage location.

[0066] In S305, CPU 141 generates a print preview image from the content data based on the print settings, and displays the generated print preview image to the user via a printing application or the like. In S307, CPU 141 determines whether or not a print command has been received via the preview image display screen, and if it has been received, proceeds to S308. In S308, CPU 141 instructs printer driver 1420 to execute printing, and the processing of this flowchart ends.

[0067] As described above, the printing system according to this embodiment comprises a user terminal, a generation AI server that provides generation AI services, an information processing device that extends the functionality of the generation AI service, and a printing device. In particular, the user terminal receives natural language input related to printing instructions from the user via the generation AI dialogue area of ​​the settings screen, and generates instruction text for the generation AI service based on the received natural language input. The user terminal also sends the generated instruction text to the generation AI service to obtain the print settings determined by the plugin that extends the functionality of the generation AI service, and allows the user to confirm the obtained print settings via the settings screen. The information processing device also obtains the instruction text from the user terminal, determines the print settings based on the natural language input related to printing instructions, and responds to the user terminal with the determined print settings. In this way, according to this embodiment, the optimal print settings can be automatically determined by the print setting generation AI interpreting the user's natural language printing instructions. Furthermore, since the generation AI plugin server 400 provided by the business operator that provides the printer 200 determines the print settings, it is possible to determine print settings that can be specified on the printer 200 and that bring out the full printing capabilities of the printer 200. Furthermore, in this embodiment, the assist tool can acquire the determined print settings and the content to be printed, making it possible to perform printing using the automatically determined print settings.

[0068] The present invention is not limited to the embodiments described above, and various modifications and changes are possible within the scope of its gist. The present invention can also be realized by supplying a program that implements one or more of the functions of the embodiments described above to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. Furthermore, the present invention can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0069] Furthermore, in the above embodiment, the computer 110 has an operation unit for inputting output conditions for the printer 200. However, the present invention is not limited to this, and it is sufficient if at least one of the following devices—the computer 110, the generation AI server 300, the generation AI plugin server 400, and the printer 200—has such an operation unit. The operation unit may be displayed on a browser UI such as Microsoft® Edge or Google® Chrome. Alternatively, the operation unit may be displayed on a generation application UI such as ChatGPT, a printing application UI such as Microsoft® Office, or a chat application UI such as Microsoft Teams.

[0070] Furthermore, while the above embodiment describes standard printer driver 1420 print settings such as number of copies, layout, and allocation, the present invention is not limited to these. Depending on the printer 200, the availability of certain functions, such as stapling settings and binding settings, may differ. Even in this case, automatic setting of print settings as in the above embodiment becomes possible by performing processes such as acquiring device information of the printer 200 in advance.

[0071] Furthermore, in the above embodiment, the print setting data stored in the memory unit may actually differ in format depending on the OS 1400 and the printer driver 1420, such as PrintTicket or devmode. The present invention is applicable to the transmission and reception of such diverse data formats. Moreover, in the above embodiment, S637 is written assuming that the printer driver 1420 sends a print job to the printer 200 connected to the same network 500 as the computer 110. However, the present invention is not limited to this. For example, in S637, the printer driver 1420 may upload the print job to a print service on the cloud and be configured to print to a printer connected to a different network from the computer 110 via the cloud.

[0072] Furthermore, in the printing system 100, for example, the generation AI server 300 (hereinafter referred to as the "server") may be located outside of Japan, while the terminal device, the computer 110 (hereinafter referred to as the "terminal device"), may be located within Japan. Even in this case, files and data can be transmitted from the server to the terminal device, and the terminal device can receive these files and data. Thus, even when the server is located outside of Japan, the transmission and reception (sending and receiving) of files and data in this system are performed as a single unit. And, since the system functions because the terminal device in Japan receives these files and data, such transmission and reception can be considered as having taken place domestically. In this system, for example, even if the server is located outside of Japan and the terminal device is located within Japan, the terminal device can perform the main functions of this system, and the effects of those functions can be realized within Japan. For example, even if the server is located outside of Japan, if the terminal device constituting this system is located within Japan, it is possible to use the system domestically using that terminal device. And the use of this system may affect the economic interests of, for example, the patent holder.

[0073] Furthermore, in the above embodiment, the method of creating content using the printing application 1110 was described. However, the present invention is not limited to this, and content may not be created using the printing application 1110, but rather content stored in the storage unit 103 of the computer 110 may be imported, or content may be imported from an external storage device such as a USB or SD card.

[0074] Furthermore, although the print application 1110 and the generation AI client 1200 were described as separate configurations in this embodiment, the processing of the generation AI client 1200 may be included in the print application 1110. Also, although the assist tool 1300 was described as being started in response to a preview screen display instruction from the print application 1110 in the above embodiment, it is not limited to this. For example, it may be started automatically when the OS starts and reside in the computer 110. In that case, the assist tool 1300 periodically accesses the print setting database 4300 to obtain the latest print settings registered in the database and displays the print preview image by obtaining the content to be displayed in the print preview using any method. The assist tool 1300 may also be configured to automatically display the print preview image display UI 1170 when the print settings have been obtained. Also, although it was described in the above embodiment that the print preview image is generated by the assist tool 1300, the print preview image may be generated by a separate program that has a print preview image generation function.

[0075] Furthermore, in the above embodiment, the process of acquiring print setting information from the print setting database 4300 by the assist tool 1300 is completed in one step, but this is not limited to this. For example, if the desired information cannot be acquired from the print setting database 4300, the print setting acquisition process may be repeated for a certain period of time. Also, in the above embodiment, an IP address was described as being used as information to identify the computer 110 to be recorded in the print setting database 4300 in association with the combination of print settings. However, the present invention is not limited to this, and information other than an IP address may be used as long as it can uniquely identify the computer 110. For example, a MAC address or an ID to uniquely identify the computer 110 may be generated through the internal processing of the assist tool 1300, and that value may be associated with the print settings. Also, in the above embodiment, it was described that information such as paper size, paper type, layout, and color mode is recorded as print setting items to be stored in the print setting database 4300, but other information may be recorded. For example, other printing-related items such as print quality, print direction, presence or absence of staples, and paper feed settings may be recorded.

[0076] <Second Embodiment> A second embodiment of the present invention will be described below. In this embodiment, components similar to those in the first embodiment will be given the same reference numerals and their descriptions will be omitted. Referring to Figures 12A and 12B, the sequence of processing performed between the elements constituting the computer 110, the generation AI server 300, and the generation AI plugin server 400 in this embodiment will be described. The numbers following "S" below indicate the step numbers in the sequence.

[0077] In S1201, the print application 1110 creates arbitrary content according to the user's instructions. Examples of content include presentation slides, documents, charts, and graphs. After the content creation is complete, in S1202, the print application 1110 receives instructions from the user, and in S1203, displays the print settings screen 1111 on the display unit 101. Subsequently, in S1204, the print application 1110 receives print instructions using natural language in the instruction input unit 1152 within the print settings screen 1111 to achieve the desired print job. An example of a print instruction is one that includes conditions for printing and the content to be printed (which may be different from the content currently being created), such as "Print the document created yesterday, keeping it under 10 pages, using the usual settings, as a handout." In S1205, the print application 1110 inputs the print instructions entered by the user, the IP address of the computer 110, and the printer name (print queue name) selected as the print job destination to the generation AI client 1200.

[0078] Upon receiving a print command, in S1206, the generation AI client 1200 uses the received information to generate a command to send to the generation AI server 300. In addition to the print command entered by the user, the command includes additional information such as the IP address of computer 110 to identify the source of the command and the printer name selected as the print job destination on the print settings screen 1111. Subsequently, in S1207, the generation AI client 1200 sends the generated command to the generation AI application 3110 on the generation AI server 300.

[0079] Upon receiving an instruction, in S1208 the generation AI application 3110 interprets the content of the instruction and determines which generation AI plugin 4100 to call and which data to reference. In this embodiment, the user specifies "documents created yesterday" as the file to be printed. Therefore, in S1209 to S1210, the generation AI application 3110 refers to the organizational information database 3500 as the data to be referenced and obtains information about the corresponding file. An example of the information to be obtained is the URL indicating the storage location of the file to be printed. Subsequently, in S1211, the generation AI application 3110 adds the information about the file to be printed obtained in S1210 to the instruction received from the generation AI client 1200 and inputs the instruction to the determined generation AI plugin.

[0080] Upon receiving an instruction, in S1212-S1213, the AI ​​generation plugin 4100 uses the printer name selected as the print job destination in the received instruction as a key to retrieve the corresponding model-specific information from the model information database 4500. The retrieved model-specific information includes a list of paper sizes available for the corresponding model, information on available post-processing (stapling), and information on whether layout printing is available. Subsequently, in S1214-S1215, the AI ​​generation plugin 4100 uses the user identification information 705 included in the received instruction as a key to retrieve print history information executed by the user who issued the print instruction from the print history database 4600. The retrieved print history information includes combination information of print settings set during past printing (e.g., paper size, whether layout printing was performed, and post-processing information used).

[0081] Subsequently, in S1216, the generation AI plugin 4100 inputs an instruction statement to the print setting generation AI 4200, with the information acquired in S1213 and S1215 added. In S1217, the print setting generation AI 4200 interprets the various information contained in the instruction statement and the content to be printed to determine the optimal combination of print settings to obtain the output result desired by the user. Then, in S1218, the print setting generation AI 4200 responds to the generation AI plugin with the determined combination of print settings as the decision result.

[0082] Upon receiving a response, in S1219-S1220, the generation AI plugin 4100 associates the combination of print settings included in the response with the IP address of computer 110 and the printer name included in the instruction received in S1211, and records this in the print setting database 4300. Furthermore, in S1221-S1222, the generation AI plugin 4100 associates the combination of print settings included in the response with user identification information 705 and records this in the print history database. Subsequently, in S1223, the generation AI plugin 4100 responds to the generation AI application 3110 with the response received in S1218 as the processing result for S1211. The processing from S1224 to S1246 is the same as S616-S638, so the explanation is omitted.

[0083] As described above, according to this embodiment, in addition to the user's natural language print instructions, the print setting generation AI interprets the information obtained from the organization information database 3500, the model information database 4500, and the print history database to automatically determine the optimal print settings. For example, even if the user instructs the printing of content different from the content being created in the print application 1110, it is possible to issue a print instruction for previously created content by referring to the information recorded in the organization information database 3500. Furthermore, by inputting the information recorded in the model information database 4500 into the print setting generation AI 4200, the print setting generation AI 4200 can estimate the optimal print settings after understanding the information specific to the printer to which the print job is sent. Furthermore, by inputting the information recorded in the print setting history database 4600 into the print setting generation AI 4200, it is possible to estimate the optimal print settings after understanding the print setting information previously used by the user.

[0084] In this embodiment, a sequence has been described in which information obtained from the machine information database 4500 and the print history database 4600 is always added as input information to the print setting generation AI 4200. However, the method for determining the input information to the print setting generation AI 4200 is not limited to this. For example, the instruction text entered by the user may be first input to the print setting generation AI to determine whether or not to use the information from the machine information database 4500 and the print history database, and then the generation AI plugin 4100 may obtain information from the various databases.

[0085] Furthermore, although the organizational information database 3500, the machine information database 4500, and the print history database 4600 were described as being included in the generation AI server 300 and the generation AI plugin server 400, respectively, other configurations are also possible. For example, the organizational information database 3500 may be located on a different server from the server on which the generation AI application 3100 runs. Similarly, the machine information database 4500 and the print history database 4600 may be located on a different server from the server on which the generation AI plugin 4100 runs.

[0086] Furthermore, although this embodiment describes an example in which the generation AI application 3100 obtains content information from the organization information database 3500, the information to be obtained is not limited to this. For example, an organization administrator may register print settings that they wish to apply uniformly within the organization in the organization information database 3500. In this case, the generation AI application 3100 can obtain the print setting information specified by the administrator from the organization information database 3500 and add it to the instructions for the generation AI plugin 4100. As a result, the print setting generation AI 4200 can take into account the print settings that the organization administrator wishes to apply uniformly within the organization and determine the optimal print settings.

[0087] <Third Embodiment> A third embodiment of the present invention will be described below. Referring to Figure 13, the sequence of processing performed between the elements constituting the computer 110, the generation AI server 300, and the generation AI plugin server 400 in this embodiment will be described. The numbers following "S" below indicate the step numbers in the sequence.

[0088] In S1301, the print application 1110 creates the content to be printed according to the user's instructions. Examples of content include presentation slides, documents, charts, and graphs. After the content creation is complete, in S1302 the print application 1110 receives instructions from the user and in S1303 displays the print settings screen 1111 on the display unit 101. Subsequently, in S1304, the print application 1110 receives print instructions using natural language in the instruction input unit 1152 within the print settings screen 1111 to achieve the desired print job. An example of a print instruction is one that includes conditions for printing, such as "I want to print while saving as much paper as possible." In S1305, the print application 1110 inputs the print instructions entered by the user, the IP address of the computer 110, and the printer name (print queue name) selected as the destination for the print job to the generation AI client 1200.

[0089] Upon receiving a print command, in S1306, the generation AI client 1200 uses the received information to generate a command to send to the generation AI server 300. In addition to the print command entered by the user, the command includes additional information such as the IP address of computer 110 to identify the source of the command and the printer name selected as the print job destination on the print settings screen 1111. Subsequently, in S1307, the generation AI client 1200 sends the generated command to the generation AI application 3110 on the generation AI server 300.

[0090] Upon receiving an instruction, in S1308 the generation AI application 3110 interprets the content of the instruction and determines which generation AI plugin 4100 to call. Subsequently, in S1309, the generation AI application 3110 interprets the content of the instruction to determine the print settings to be entered into the generation AI plugin 4100. Then, in S1310, the generation AI application 3110 inputs the instruction received from the generation AI client 1200 to the determined generation AI plugin. For example, in response to the instruction "I want to print while saving paper" in this embodiment, the generation AI application 3110 determines that the print settings should be A4 paper size, double-sided printing, and layout printing enabled. When this determination is made, the information entered in S1310 includes this setting information. Upon receiving the print setting information, in S1311 the generation AI plugin 4100 generates a URL to launch the assist tool 1300. This URL contains a string that instructs the activation of the assist tool 1300, as well as a string that represents the print settings determined by the AI ​​application 3110 generated in S1309. An example of a generated string is "assittool:size=A4&duplex=True&layout=4". Here, "assittool:" is a string that instructs the activation of the assist tool 1300. "size=A4&duplex=True&layout=4" means that the paper size is A4, double-sided printing is enabled, and the instruction is to print four pages' worth of content on one page (layout printing). Subsequently, in S1312, the AI ​​plugin 4100 generates the URL generated in S1311 and responds to S1310 as the processing result.

[0091] Subsequently, in S1313, the generation AI application 3110 responds to the generation AI client 1200 with the processing result received in S1313 as the processing result for S1307. Next, in S1314, the generation AI client 1200 generates a response message for the print application 1110 from the received processing result. The response message is a natural language sentence containing a string that instructs the activation of the assist tool 1300, which was generated by the generation AI plugin 4100 in S1311, and is displayed on the generation AI control 1150. In S1315, the generation AI client 1200 responds to the print application 1110 using the response message generated as the processing result for S1305. In S1316, the print application 1110 displays the received response message to the user in the chat display area 1151. An example of a response message is a message prompting the user to launch AssistTool 1300, along with a URL to launch AssistTool 1300 ("Please select this URL to launch AssistTool. assisttool:size=A4&duplex=True&layout=4").

[0092] When the user selects a URL to launch the assist tool 1300 displayed in the chat display area 1151 in S1317, the print application 1110 launches the assist tool 1300. At this time, the print application 1110 specifies to the assist tool 1300 the string "size=A4&duplex=True&layout=4", which indicates the print settings information contained in the URL. Furthermore, the print application 1110 specifies to the assist tool 1300 the location information (file path name) where the content to be printed is stored as a launch parameter.

[0093] In S1319, the assist tool 1300 obtains print setting information from a string indicating print setting information entered as a startup parameter. Specifically, by parsing "size=A4&duplex=True&layout=4", it obtains information regarding the paper size, whether or not double-sided printing is enabled, and whether or not layout printing is enabled. From the aforementioned string, it can be obtained that the paper size is A4, double-sided printing is enabled, and the setting is to print four pages' worth of content on one page (layout printing). The processing from S1320 to S1324 is the same as S625 to S629, so the explanation is omitted. In S1325, the assist tool 1300 obtains the print target content based on the location information of the print target content that was received as one of the startup parameters in S1318. The processing from S1326 to S1333 is the same as S631 to S638, so the explanation is omitted.

[0094] As described above, the printing system according to this embodiment comprises a user terminal, a generation AI server that provides generation AI services, an information processing device that extends the functionality of the generation AI service, and a printing device. According to this embodiment, the generation AI application interprets the user's natural language printing instructions, thereby automatically determining the optimal printing settings. This allows the generation AI plugin 4100 to create a URL for launching the assist tool 1300, which contains the printing setting information determined by the generation AI application 3110. The generation AI plugin 4100 ultimately presents the created URL to the user, and the user can select the URL to enable the assist tool 1300 to print using the automatically determined printing settings. In this embodiment, paper size, whether or not to print on both sides, and whether or not to print with layout are given as examples of printing setting information included in the URL generated by the generation AI plugin 4100, but the printing settings that can be included in the URL are not limited to these. For example, other printing settings such as paper type, paper feed slot used for printing, and color information (color or monochrome) used for printing may also be included.

[0095] The disclosures herein include the following computer programs, control methods, and systems. (Item 1) A computer program that extends the functionality of a generation AI service, wherein the computer of the information processing device An acquisition means for acquiring natural language input related to print instructions from the user, received via the aforementioned generation AI service, from the user terminal, A determination means for determining print settings based on natural language input related to the print instructions, A response means for responding to the user terminal with the determined print settings, A computer program characterized by being designed to function as such. (Item 2) The acquisition means acquires, in addition to natural language input related to the print instruction, identification information of the selected printing device. The computer program according to item 1, characterized in that the determination means obtains print settings that can be specified by the printing device from a database that stores print settings in advance, based on the natural language input and the identification information of the printing device. (Item 3) The computer of the aforementioned information processing device is further, The computer program according to item 2, characterized in that it functions as a storage means for storing the print settings determined by the determination means in the database, linked to the identification information of the device that requested the print instruction and the identification information of the selected printing device. (Item 4) The database further stores at least one of the following: organizational information including content created within an organization that can utilize the AI ​​generation service; model-specific information related to each model of printing device; and print history information for each user. The computer program according to item 2 or 3, characterized in that the determination means determines the print settings based on at least one of the organizational information, the machine-specific information, and the print history information, in addition to the natural language input related to the print instruction. (Item 5) The print instruction includes user identification information. The computer program according to item 4, characterized in that the determination means uses the print history information stored in association with the user identification information. (Item 6) The computer of the aforementioned information processing device is further, A URL that reflects the print settings determined by the determination means, comprising a creation means for creating a URL to be accessed from the user terminal, The computer program according to any one of items 1 to 5, characterized in that the response means responds to the user terminal with the URL instead of the print settings. (Item 7) The computer program according to item 6, characterized in that the creation means includes, as a startup parameter of the URL, information about the location where the content to be printed is stored, along with the information about the print settings. (Item 8) A computer program that uses a generation AI service, and which uses the user terminal computer, A reception means that accepts natural language input related to printing instructions from the user via an AI dialogue area that generates a settings screen, A generation means that generates instruction sentences for the generation AI service based on the natural language input received, An acquisition means that sends the generated instruction text to the generation AI service and obtains the print settings determined by a plugin that extends the functionality of the generation AI service, A means for allowing the user to confirm the acquired print settings via the settings screen, A computer program characterized by being designed to function as such. (Item 9) The computer program according to item 8, characterized in that the confirmation means asks the user whether or not to perform printing with the acquired print settings via the AI ​​interaction area of ​​the settings screen. (Item 10) The computer program according to item 8 or 9, characterized in that the settings screen includes an area for selecting a printing device to print to according to user input and a settings area for configuring print settings. (Item 11) The computer program according to item 10, characterized in that the setting area for the print settings reflects the print settings acquired by the acquisition means. (Item 12) The computer program according to any one of items 8 to 11, characterized in that the settings screen further includes an operation object that accepts instructions to display a preview image. (Item 13) The computer of the aforementioned user terminal is further, The computer program according to item 12, characterized in that when the display of a preview image is instructed via the operation object, it retrieves the corresponding print settings from a database that stores the print settings determined by the plugin, generates a preview image of the content to be printed according to the retrieved print settings, and functions as a display control means to display a screen to the user that displays the preview image. (Item 14) The computer program according to item 13, characterized in that the screen displaying the preview image displays an operation object that instructs printing. (Item 15) A control method for an information processing device that extends the functionality of a generation AI service, The acquisition means includes an acquisition step of acquiring natural language input related to print instructions from the user, received via the generation AI service, from the user terminal, A decision step in which print settings are determined based on natural language input related to the print instructions, A response step that sends the determined print settings to the user terminal. A control method for an information processing device, including the device itself. (Item 16) A method for controlling a user terminal that uses a generation AI service, The reception method includes a reception process that accepts natural language input related to print instructions from the user via the AI ​​dialogue area that generates the settings screen, The generation means includes a generation step of generating instructions for the generation AI service based on the received natural language input, The acquisition means includes an acquisition step of sending the generated instruction text to the generation AI service and acquiring the print settings determined by a plugin that extends the functionality of the generation AI service, The verification means includes a verification step in which the user confirms the acquired print settings via the settings screen. A method for controlling a user terminal, characterized by including the following: (Item 17) A printing system including a user terminal, a generation AI server that provides generation AI services, an information processing device that extends the functionality of the generation AI service, and a printing device, The aforementioned user terminal is A reception means that accepts natural language input related to printing instructions from the user via an AI dialogue area that generates a settings screen, A generation means that generates instruction sentences for the generation AI service based on the natural language input received, A first acquisition means that sends the generated instruction text to the generation AI service and obtains the print settings determined by a plugin that extends the functionality of the generation AI service, A confirmation means that allows the user to confirm the acquired print settings via the settings screen. Equipped with, The aforementioned information processing device is A second acquisition means for obtaining the aforementioned instruction from the user terminal, A determination means for determining print settings based on natural language input related to the print instructions, A response means for responding to the user terminal with the determined print settings. A printing system characterized by comprising the following features.

[0096] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0097] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0098] 100: Printing system, 110: Computer, 1010: Display unit, 1110: Printing application, 1133: Allocation control, 1150: Generation AI control, 1151: Chat display area, 1152: Instruction input unit, 1153: Execute button, 200: Printer, 300: Generation AI server, 400: Generation AI plugin server

Claims

1. A computer program that enhances the functionality of a generation AI service, wherein the computer of the information processing device A receiving means that receives a first instruction in natural language received from a user via the generation AI service, the second instruction including the first instruction relating to data specified by the user, An output means that outputs print settings used for printing the specified data based on the second instruction statement received by the receiving means, To make it function as, The aforementioned data is printed according to the outputted print settings. The receiving means receives the second instruction after the user has specified the data. A computer program characterized by the following features.

2. The receiving means further receives identification information of a printing device selected by the user, on which the specified data is printed. The output means retrieves print settings that can be specified on the selected printing device from a database where print settings are pre-stored, based on the received input and the identification information of the printing device, and outputs them. The computer program according to feature 1.

3. The computer of the aforementioned information processing device is further, The output means is configured to function as a storage means that stores the print settings output by the output means in the database, associating the second instruction received by the receiving means with the identification information of the device entered by the user and the identification information of the printing device that was received. The computer program according to feature 2.

4. The database further stores at least one of the following: organizational information including content created within an organization that can utilize the AI ​​generation service; unique information corresponding to the printing device; and print history information corresponding to the user. The output means outputs print settings based on the second instruction statement received by the receiving means, plus at least one of the organizational information, the unique information, and the print history information. The computer program according to feature 3.

5. The receiving means further receives the user's identification information, The output means outputs the print settings based on the print history information stored in correspondence with the user's identification information. The computer program according to feature 4.

6. The output means outputs a URL indicating the print settings used for printing the specified data, which are based on the second instruction received by the receiving means. As a result of the user selecting the URL, the data and the print settings are associated by a printer driver available to the device into which the second instruction received by the receiving means is input. The computer program according to feature 1.

7. The output means outputs the print settings and the URL indicating the location where the specified data is stored. The computer program according to feature 6.

8. The computer program according to claim 1, characterized in that the receiving means receives the second instruction statement received by the receiving means from the generation AI service.

9. The computer program according to claim 1, characterized in that a preview image showing the specified data based on the print settings output by the output means is displayed.

10. The computer program according to claim 9, characterized in that the preview image is displayed by a display means of the device into which the user inputs the first instruction.

11. The computer program according to claim 9, characterized in that the preview image is displayed by selecting an object located in a region different from the region where the first instruction in natural language received from the user is displayed.

12. The computer program according to claim 1, characterized in that the print settings output by the output means are displayed in a first area where the first instruction sentence in natural language received from the user is displayed, and a second area where the user can specify the print settings.

13. The computer program according to claim 1, characterized in that the print settings output by the output means are performed by a printer driver available to the device into which the user inputs the first instruction, and the data is printed based on the print settings output by the output means.

14. A computer program that uses a generation AI service, wherein the computer of a user terminal having a display unit, A first receiving means that receives a first instruction sentence in natural language, relating to data specified by the user, via a first area displayed by the display unit, Output means for outputting a second instruction sentence generated based on the first instruction sentence received to the generation AI service, Print settings output by a plugin that extends the functionality of the AI ​​generation service, comprising a second receiving means that accepts print settings based on the outputted second instruction statement, A display means for displaying the received print settings on the display unit, To make it function as, The display means, upon receiving the outputted print settings from the second receiving means, displays the received print settings in a second area where the user can specify the print settings. The specified data will be printed according to the accepted print settings. A computer program characterized by the following features.

15. The computer program according to claim 14, characterized in that the display means displays a message via the first area asking the user whether or not to print the specified data with the accepted print settings.

16. The computer program according to claim 14, characterized in that the display means further displays a third area in which the user's selection of a printing device on which the data is printed is accepted.

17. The computer program according to claim 16, further characterized in that the display means displays a first object that accepts an instruction from the user to display a preview image.

18. The computer program according to claim 17, characterized in that, when the instruction to display the preview image is received via the first object, a preview image based on the received print settings and showing the specified data is displayed.

19. The computer program according to claim 18, characterized in that a second object that accepts a print command is displayed on the screen where the preview image is displayed.

20. The computer program according to claim 16, characterized in that the third region is different from the second region.

21. The computer program according to claim 14, characterized in that the print settings received by the second receiving means are associated with the data by a printer driver available to the user terminal, and the data is printed according to the received print settings.

22. The first receiving means further receives the selection of a printing device on which the data will be printed, The second instruction statement output by the output means includes information about the selected printing device. The second receiving means receives the print settings that can be specified on the selected printing device. The computer program according to feature 14.

23. The second receiving means receives a URL indicating the print settings used for printing the specified data, which are based on the outputted second instruction statement. The display means displays the received URL, When the aforementioned URL is selected by the user, the printer driver available on the user terminal associates the data with the print settings. The computer program according to feature 14.

24. The computer program according to claim 23, characterized in that the second receiving means receives the print settings and the URL indicating the location where the specified data is stored.

25. The computer program according to claim 14, characterized in that the first receiving means receives the first instruction statement from the user via another program running on the user terminal.

26. A control method for an information processing device that enhances the functionality of a generation AI service, A receiving step of receiving a first instruction in natural language received from a user via the generation AI service, which includes a second instruction containing the first instruction relating to data specified by the user, An output step that outputs the print settings used for printing the specified data based on the second instruction received in the reception step, It has, The aforementioned data is printed according to the outputted print settings. In the reception process, the second instruction statement is received after the user has specified the data. A control method for an information processing device characterized by the following features.

27. A control method for a user terminal having a display unit and utilizing a generation AI service, A first receiving step of receiving a first instruction sentence in natural language, relating to data specified by the user, via a first area displayed by the display unit, Output step of outputting a second instruction statement generated based on the first instruction statement received to the generation AI service, Print settings output by a plugin that extends the functionality of the generation AI service, comprising a second receiving step that accepts print settings based on the outputted second instruction statement, A display step in which the received print settings are displayed on the display unit, It has, In the display step, the outputted print settings are displayed in a second area where the user can specify the print settings, since the outputted print settings have been received in the second reception step. The specified data will be printed according to the accepted print settings. A method for controlling a user terminal, characterized by the following features.

28. A printing system comprising a user terminal having a display unit, a generation AI server providing generation AI services, an information processing device for extending the functionality of the generation AI service, and a printing device, The aforementioned user terminal is A receiving means that receives a first instruction sentence in natural language, relating to data specified by the user, via a first area displayed on the display unit, A transmission means for transmitting a second instruction sentence, generated based on the first instruction sentence received, to the generation AI server, A receiving means for receiving print settings output by the information processing device, which are print settings based on the second instruction statement, Upon receiving the outputted print settings, the receiving means provides a display means that displays the received print settings in a second area where the user can specify the print settings. Equipped with, The aforementioned information processing device is Receiving means for receiving the second instruction from the user terminal, An output means that outputs the print settings used for printing the specified data based on the received second instruction, A printing system characterized by comprising the following features.

Images