Storage medium, print control method, system, and computer program product

Abstract

The invention relates to a storage medium, a print control method, a system, and a computer program product. A non-transitory computer-readable storage medium stores a computer program for extending functionality of a generative AI service. The computer program causes a computer of the information processing apparatus to execute the following operations: upon acceptance of a print request via the generative AI service, generating a print job based on the print request; and registering a reservation of the generated print job in the print server. Further, the computer program also causes an information processing apparatus to run to: acquire, from the print server, information related to a connection destination for executing the reserved print job; and presenting the generated print job and information related to the connection destination to a user via the generative AI service.

Description

Technical Field

[0001] The present invention relates to a storage medium storing a computer program for extending functions of an artificial intelligence system, a print control method, a system, and a computer program product. Background Art

[0002] Artificial intelligence systems (referred to as generative AI) that can generate text, images, or other media in response to prompts are known. In generative AI such as , functions can be extended by plug-ins. For example, when text containing the keyword "print" is input as an instruction to the generative AI, a print-related plug-in is selected, and instead of the generative AI, the plug-in performs processing that the generative AI cannot handle, thereby enabling function extension.

[0003] Meanwhile, in an image forming apparatus, print data can be input from a cloud server and printed. For example, Japanese Unexamined Patent Application Publication No. 2018-128843 proposes the following technique: enabling a document managed by a cloud server to be printed through a chat conversation.

[0004] However, when printing an output (such as text generated by generative AI) on an image forming apparatus, a user or the like needs to copy it to a file or the like and execute printing from a print driver or the like. That is, the user needs to copy the output generated by the generative AI to execute printing, which is very troublesome. Summary of the Invention

[0005] The present invention enables an apparatus for appropriately printing an output from generative AI on an image forming apparatus to be realized.

[0006] One aspect of the present invention provides a non-transitory computer-readable storage medium storing a computer program for extending functions of a generative AI service, wherein the computer program causes a computer of an information processing apparatus to run to perform the following operations: when accepting a print request via the generative AI service, generating a print job based on the print request; registering a reservation of the generated print job in a print server; obtaining information related to a connection destination for executing the reserved print job from the print server; and presenting the generated print job and the information related to the connection destination to a user via the generative AI service.

[0007] Another aspect of the present invention provides a printing control method, which includes: when receiving a printing request via a generative AI service provided by an information processing device, generating a printing job based on the printing request; registering a reservation of the generated printing job in a printing server; obtaining information related to a connection destination for executing the reserved printing job from the printing server; and presenting the generated printing job and the information related to the connection destination to a user via the generative AI service.

[0008] Another aspect of the present invention provides a printing system, which includes an information processing device that provides a generative AI service to a user terminal, a printing server, and an image forming device. The information processing device includes: one or more first memory devices that store an instruction set; and one or more first processors that execute the instruction set to perform the following operations: when receiving a printing request via the generative AI service, generating a printing job based on the printing request; registering a reservation of the generated printing job in the printing server; obtaining information related to a connection destination for executing the reserved printing job from the printing server; and presenting the generated printing job and the information related to the connection destination to a user via the generative AI service. And the printing server includes: one or more second memory devices that store an instruction set; and one or more second processors that execute the instruction set to perform the following operations: when the printing job is reserved, providing the information related to the connection destination; and when a user accesses the information related to the connection destination, inputting the printing job to the image forming device.

[0009] Another aspect of the present invention provides a computer program product that stores a computer program for expanding the functions of a generative AI service. Wherein, the computer program is used to make a computer of an information processing device run to perform the following operations: when receiving a printing request via the generative AI service, generating a printing job based on the printing request; registering a reservation of the generated printing job in a printing server; obtaining information related to a connection destination for executing the reserved printing job from the printing server; and presenting the generated printing job and the information related to the connection destination to a user via the generative AI service.

[0010] Other features of the present invention will become apparent from the following description of exemplary embodiments with reference to the accompanying drawings. Description of the Drawings

[0011] Figure 1 is a diagram showing the configuration of a system according to an embodiment.

[0012] Figure 2It is a diagram showing the configuration of an MFP according to an embodiment.

[0013] Figure 3 It is a diagram showing the configuration of a user terminal according to an embodiment.

[0014] Figure 4 It is a diagram showing the configuration of a generative AI server according to an embodiment.

[0015] Figure 5 It is a diagram showing the configuration of an extended application server according to an embodiment.

[0016] Figure 6 It is a diagram showing the configuration of a cloud printing server according to an embodiment.

[0017] Figure 7 It is a diagram showing an example of a screen for interacting with a generative AI server displayed on a user terminal according to an embodiment.

[0018] Figure 8A and Figure 8B It is a sequence diagram of document printing according to an embodiment.

[0019] Figure 9 It is a flowchart related to an extended application server according to an embodiment.

[0020] Figure 10 It is a sequence diagram of reprinting according to an embodiment.

[0021] Figure 11 It is a diagram showing an example of a response of a generative AI server according to an embodiment.

[0022] Figure 12 It is a diagram showing an example of a browser screen when a reserved job URL has expired according to an embodiment. Detailed Description of the Embodiment

[0023] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the present invention. In the embodiments, multiple features are described, but the invention is not limited to inventions that require all of these features, and these features can be appropriately combined. In addition, in the drawings, the same or similar configurations are given the same reference numerals, and redundant descriptions thereof will be omitted.

[0024] <First Embodiment>

[0025] <System Configuration>

[0026] A first embodiment of the present invention will be described below. In this embodiment, a multifunction peripheral (MFP) including printing, scanning, and FAX functions will be described as an example of an image processing apparatus. Figure 1 An example of a diagram showing the overall configuration of a printing system that provides a printing service through a generative AI service according to the present invention. The printing system is configured to include an image forming apparatus 10 (e.g., a printing apparatus), a user terminal 20, a generative AI server 30, an extended application server 40, and a cloud printing server 50. They are connected so as to be able to communicate with each other via a network 70. The network 70 is a wireless network or a wired network composed of a WAN or a LAN.

[0027] The image forming apparatus 10 denotes a printing apparatus that includes a function of printing an image notified from the cloud printing server 50. The user terminal 20 denotes an information terminal such as a smartphone, a tablet terminal, or a personal computer when a user uses a generative AI service such as ChatGPT. The user accesses the generative AI server 30 on the cloud by operating the user terminal 20 and executes a generative AI application. The user terminal 20 and the generative AI server 30 are connected to a wired or wireless communication network and are each capable of sending and receiving data. In this embodiment, a public line on the Internet is assumed as an example of the communication network, but a dedicated line may also be used.

[0028] The generative AI server 30 is a cloud server (information processing apparatus) arranged on the cloud 60 that provides a generative AI such as ChatGPT, that is, a text generation AI. The generative AI server 30 provides services in cooperation with the extended application server 40. The generative AI server 30 interprets a message sent from the user terminal 20, generates an appropriate response, and displays the response on the screen of the user terminal 20. In addition, the generative AI server 30 can also extend its functions by communicating with the extended application server 40.

[0029] The extended application server 40 is a cloud server (information processing apparatus) arranged on the cloud 60 and includes a function of providing an additional function (plugin) to the generative AI server 30. The generative AI server 30 can perform processing that it cannot perform alone by implementing a predetermined plugin in cooperation with the extended application server 40. When the cloud printing server 50 receives a print request from the user terminal 20, it notifies the image forming apparatus 10 that a print job has been received. The image forming apparatus 10 receives the print job from the cloud printing server 50 and performs printing according to the notification from the cloud printing server 50. Here, an example of separately disposing various servers will be described, but each server may be disposed to be integrated with other servers. For example, the generative AI server 30 and the extended application server 40 may be disposed in an integrated manner.

[0030] <Hardware Configuration of Image Forming Apparatus>

[0031] will be referred to Figure 2 to describe an example of the hardware configuration of the image forming apparatus 10 according to the present embodiment. The image forming apparatus 10 includes a control unit 110, an operation unit 116, a reading unit 118, a printing unit 120, a wireless communication unit 122, a FAX communication unit 124, and a communication unit 126. The control unit 110 includes a CPU 111, a ROM 112, a RAM 113, an HDD 114, an operation unit I / F 115, a reading unit I / F 117, a printing unit I / F 119, a wireless communication unit I / F 121, a FAX unit I / F 123, and a communication unit I / F 125.

[0032] The control unit 110 including the CPU 111 controls the operation of the entire image forming apparatus 10. The CPU 111 reads a control program stored in the ROM 112 or the HDD 114 into the RAM 113, and performs various controls such as reading control and printing control. The ROM 112 stores a control program executable by the CPU 111. The ROM 112 also stores a startup program, font data, and the like. The RAM 113 is a main storage memory, and is used as a work area and a temporary storage area for expanding various control programs stored in the ROM 112 and the HDD 114. The HDD 114 stores image data, print data, various programs, various addresses, and various setting information. The HDD 114 is a storage medium, but it does not necessarily have to be an HDD, and it may also be a solid state drive (SSD), an embedded multimedia card (eMMC), or the like.

[0033] The image forming apparatus 10 according to the present embodiment is assumed to have one CPU 111 execute each process indicated in the flowchart described later using one memory (RAM 113), but is not limited thereto. For example, a plurality of CPUs, RAMs, ROMs, and HDDs may cooperate to perform each process. In addition, some processes may be executed using a hardware circuit such as an ASIC or an FPGA.

[0034] The operation unit I / F 115 connects the control unit 110 and the following operation unit 116, which includes a display unit (such as a touch panel) and hardware keys. The operation unit 116 displays information to the user and detects input from the user. The reading unit I / F 117 connects the reading unit 118 (such as a scanner) and the control unit 110. The reading unit 118 reads the image of the original document, and the CPU 111 converts the image into image data such as binary data. The image data generated based on the image read by the reading unit 118 is sent to an external device or printed on a print sheet. The printing unit I / F 119 connects the printing unit 120 (such as a printer) and the control unit 110. The CPU 111 transfers the image data (print data) stored in the RAM 113 to the printing unit 120 through the printing unit I / F 119. The printing unit 120 prints the image based on the transferred image data on the print sheet fed from the paper feed cassette.

[0035] The wireless communication unit I / F 121 is an I / F for controlling the wireless communication unit 122 and wirelessly connects the control unit 110 and an external wireless device. The FAX unit I / F 123 controls the FAX communication unit 124 to connect to the public line network 80. The FAX unit I / F 123 is an I / F for controlling the FAX communication unit 124 and can be connected to the public line network and control the FAX communication protocol, for example, by controlling a facsimile communication modem (NCU).

[0036] The communication unit I / F 125 connects the control unit 110 and the network 70. Regarding the communication unit I / F 125, the communication unit 126 sends the image data and various information inside the device to an external device on the network 70 and receives the information on the network 70 and the print data from the external device on the network 70. Sending and receiving can be performed using email (e-mail) as a method of sending and receiving via the network 70, and file transfer can be performed using other protocols (such as FTP, SMB, WEBDAV, etc.). It is also possible to access from the user terminal 20 and the generative AI server 30 through HTTP communication to send and receive image data and message data on the network 70. In addition, it is also possible to access the image forming apparatus 10 via the network from the web browser of the user terminal 20 and perform various settings (remote UI function) of the image forming apparatus 10.

[0037] <Hardware Configuration of User Terminal>

[0038] Will refer to Figure 3Describe an example of the hardware configuration of the user terminal 20 according to this embodiment. Assume that the user terminal 20 of this embodiment is a device such as a smartphone or a tablet PC, but it can also be other devices as long as it is an information processing device that can be connected to the network 70 using Wi-Fi communication or the like. The user terminal 20 includes an operation panel 201, a camera 204, an NFC communication unit 205, a communication unit 206, a CPU 207, a ROM 208, a RAM 209, an HDD 210, and a wireless LAN communication unit 211.

[0039] The CPU 207 reads the control program stored in the ROM 208 and executes various processes for controlling the operation of the user terminal 20. The ROM 208 stores the above control program. The RAM 209 is used as the main memory of the CPU 207 and a temporary storage area such as a work area. The HDD 210 stores various data such as photos and electronic documents.

[0040] The operation panel 201 is provided with a touch panel function capable of detecting a user's touch operation and displays various screens provided by the OS and the email sending application. The operation panel 201 is also used to confirm the information stored in the generative AI server 30. By inputting a touch operation to the operation panel 201, the user can input a desired operation instruction to the user terminal 20. The user terminal 20 includes hardware keys (not shown), and the user can use the hardware keys to input operation instructions to the user terminal 20.

[0041] The camera 204 performs imaging according to the user's imaging instruction. The photos taken by the camera 204 are stored in a predetermined area of the HDD 210. In addition, a program capable of analyzing can be used to obtain information from the QR code read by the camera 204.

[0042] The user terminal 20 can exchange data with various peripheral devices via the NFC communication unit 205, the Bluetooth communication unit 206, and the wireless LAN communication unit 211. The Bluetooth communication unit 206 of the user terminal 20 can support Bluetooth Low Energy (BLE).

[0043] <Hardware Configuration of the Generative AI Server>

[0044] Will refer to Figure 4 Describe an example of the hardware configuration of the generative AI server 30 according to this embodiment. The generative AI server 30 includes a CPU 301, a ROM 302, a RAM 303, a communication unit 304, and an HDD 305.

[0045] The CPU 301 uses the control program stored in the ROM 302 and the learning model stored in the HDD 305 to execute processing for controlling operations to generate appropriate responses. The ROM 302 stores the above control program. The RAM 303 serves as the main memory of the CPU 301 and a temporary storage area such as a work area. The HDD 305 stores various data such as learning models and generative AI applications.

[0046] Data can be exchanged with various devices such as the user terminal 20, the image forming apparatus 10, and the extended application server 40 through the communication unit 304. The communication unit 304 can use to perform wired communication, or can perform wireless communication such as Wi-Fi.

[0047] <Hardware Configuration of Extended Application Server>

[0048] Figure 5 is a diagram showing an example of the hardware configuration of the extended application server 40. The extended application server 40 includes a CPU 401, a ROM 402, a RAM 403, a communication unit 404, and an HDD 405.

[0049] The CPU 401 reads the control program stored in the ROM 402 and executes processing according to the message received from the generative AI server 30. The ROM 402 stores the above control program. The RAM 403 serves as the main memory of the CPU 401 and a temporary storage area such as a work area. The HDD 405 stores the content of the message received from the generative AI server 30 and some of its content, etc. Data can be sent and received with various devices such as the generative AI server 30 through the communication unit 404.

[0050] <Hardware Configuration of Cloud Print Server>

[0051] Figure 6 is a diagram showing an example of the hardware configuration of the cloud print server 50. The cloud print server 50 includes a CPU 501, a ROM 502, a RAM 503, a communication unit 504, and an HDD 505.

[0052] The CPU 501 reads the control program stored in the ROM 502, so that it can receive a print job from the user terminal 20 and obtain the stored print job. The ROM 502 stores the above control program. The RAM 503 serves as the main memory of the CPU 501 and a temporary storage area such as a work area. The HDD 505 stores, for example, the print job received from the user terminal 20. Data can be sent and received with various devices such as the generative AI server 30 through the communication unit 504.

[0053] <Print instruction>

[0054] will refer to Figure 7 Describe the interaction between the user and the generative AI server 30 when the generative AI server 30 is instructed to print according to this embodiment. By accessing the generative AI server 30 from a browser operating on the user terminal 20, the screen 600 is displayed on the operation panel 201.

[0055] The prompt input field 601 is an input field for the user to input instruction text (prompt) to the generative AI server 30. The user inputs in the natural language text format from the operation panel 201 of the user terminal 20. The user can input the instruction text by operating the touch panel of the user terminal 20. The input of the instruction text can be achieved by voice input. The send button 602 is a trigger button for sending the prompt input to the prompt input field 601 to the generative AI server 30.

[0056] The print request prompt 603 is an example of a prompt for instructing the generative AI server 30 to perform printing. It needs to include a guide for the text to be generated and printed by the generative AI server 30.

[0057] The print request response 604 is a response to the print request prompt 603 jointly generated by the generative AI server 30 and the extended application server 40. Thereafter, the interactive interaction between the user and the generative AI server 30 is arranged in chronological order in the form of a combination of prompts and responses. The print request response 604 includes: the print settings to be performed, the reserved job URL 605 and the preview image 606 to be described later.

[0058] The reserved job URL 605 is a URL indicating the print job stored in the cloud print server 50 and is an example of information related to the connection destination. The information related to the connection destination is not limited to the URL, but can be any information as long as it is information indicating the location where the print job is stored or information for identifying the print job. By accessing this URL, the user can perform cloud printing (input the print job from the cloud print server 50 to the image forming apparatus 10). In addition, when changing the print settings of the reserved job, an HTTP request is sent to the reserved job URL. The preview image 606 is a preview image of an image representing the output when printing is performed using the current print settings. Using this image, the user can roughly understand the appearance of the output before printing.

[0059] The print setting change prompt 607 is an example of a prompt that instructs the generative AI server 30 to change settings when the user wishes to change the print settings confirmed in the print request response 604. Regarding this instruction, the user can also input an instruction in the prompt input field 601 and send the instruction to the generative AI server 30 by pressing the send button 602. In this embodiment, it is instructed to change the number of copies to two, but other settings can also be instructed to be changed (such as changing the sheet size, setting the layout to 2-in-1, etc.). In addition, an instruction to change multiple settings can also be included.

[0060] The print setting change response 608 is a response to the print setting change prompt 607 generated by the cooperation of the generative AI server 30 and the extended application server 40. The basic content has not changed compared to the content of the print request response 604, but the indicated changes are reflected in the print settings. In addition, when settings for preview images (such as color mode or layout) are changed, the preview image 606 is also replaced.

[0061] <Sequence>

[0062] Reference will be made Figures 8A to 8B to describe the interaction between the component elements of the system from when the user instructs the generative AI server 30 to print until the print job is actually input to the image forming apparatus 10 according to this embodiment. In the sequence to be described below, in the case where the generative AI server 30 and the extended application server 40 are configured in an integrated manner, the control of these two devices will be integrated.

[0063] In step S701, the user terminal 20 sends the content of the print request prompt 603 to the generative AI server 30 through the browser according to the user operation. Then, in step S702, the generative AI server 30 generates the text (text data) to be printed and sends a print request to the extended application server 40 in step S703. In step S703, the text data generated in step S702 is sent together.

[0064] Then, in step S704, the extended application server 40 generates and stores a JobID. The JobID is unique identification information for managing various data to be processed in an associated manner in the future. In addition, the extended application server 40 converts the text data received from the generative AI server 30 into a format (such as PDF) that the cloud print server 50 can accept. If the cloud print server 50 can accept the text data, this process can be skipped. Then, the extended application server 40 stores the default print settings as the current print settings. Then, in step S705, the extended application server 40 sends a job reservation request to the cloud print server 50. At this time, the converted data generated in step S704 and the current print settings are sent together.

[0065] In step S706, the cloud printing server 50 generates a reservation job based on the conversion data received from the extended application server 40 and the current printing settings. In addition, the cloud printing server 50 generates a reservation job URL 605 indicating the reservation job and a preview image 606 that is the output image of the reservation job, and stores them together with the generated reservation job. Then, in step S707, the cloud printing server 50 returns the reservation job URL 605 and the preview image 606 to the extended application server 40 as a response to the job reservation request.

[0066] Next, in step S708, the extended application server 40 stores the reservation job URL 605 in association with the JobID. Then, in step S709, the extended application server 40 returns the current printing settings, the reservation job URL 605, and the preview image 606 to the generative AI server 30 as information to be presented to the user as a response to the printing request. In step S710, the generative AI server 30 returns the current printing settings, the reservation job URL 605, and the preview image 606 to the user terminal 20 as a response to the printing request prompt 603. The user terminal 20 presents the information to the user via a browser based on the received information.

[0067] In step S711, the user terminal 20 sends the content of the printing settings change prompt 607 to the generative AI server 30 via the browser according to the user input. If there is no need to change the printing settings, steps S711 to S718 can be skipped. In step S712, the generative AI server 30 sends a printing settings change request to the extended application server 40. In step S713, the extended application server 40 reads the current printing settings associated with the JobID and stores the settings changed according to the printing settings change request (change content) by overwriting and updating the current printing settings. In step S714, the extended application server 40 reads the reservation job URL associated with the JobID, sends a reservation job settings change request to the cloud printing server 50, and makes a re - reservation. At this time, the extended application server 40 sends the conversion data generated in step S704 together with the current printing settings overwritten in step S713.

[0068] In step S715, the cloud printing server 50 regenerates and updates the reservation job and the preview image 606 using the new printing settings. It is expected that the reservation job URL 605 remains unchanged. Thus, it can be indicated from the outside that this is the same reservation job. In step S716, the cloud printing server 50 returns the reservation job URL 605 and the regenerated preview image 606 to the extended application server 40 as a response to the reservation job settings change request.

[0069] In step S717, the extended application server 40 returns the print settings reflecting the changes, the reserved job URL 605, and the regenerated preview image 606 to the generative AI server 30 as a response to the print settings change request. In step S718, the generative AI server 30 returns the current print settings reflecting the changes, the reserved job URL 605, and the regenerated preview image 606 to the user terminal 20 as a response to the print request prompt 603.

[0070] Then, in step S719, the user terminal 20 accesses the reserved job URL 605 according to the user operation through the browser. In step S720, the cloud printing server 50 returns a login screen (not shown) of the cloud printing service to the user terminal 20. The user terminal 20 displays the login screen on the operation panel 201. In step S721, the user terminal 20 receives the login information according to the user operation and logs in to the cloud printing service. If the user does not have a cloud printing service account, an account creation operation (not shown) is required.

[0071] In step S722, the cloud printing server 50 designates the MFP used by the user according to the logged-in user information. If the user has not registered the MFP, an MFP registration operation (not shown) is required. In addition, when registering multiple MFPs associated with the user information, the MFP can be selected before printing through interactive communication with the user (not shown). In step S723, the cloud printing server 50 inputs the reserved job into the designated image forming apparatus 10.

[0072] In step S724, the image forming apparatus 10 performs printing according to the reserved job input from the cloud printing server 50. In step S725, the image forming apparatus 10 notifies the cloud printing server 50 that the printing of the reserved job has been completed. In step S726, the cloud printing server 50 returns a print completion screen (not shown) to the user terminal 20, and causes the user terminal 20 to display the screen, and then terminates the sequence.

[0073] <Processing procedure of the extended application server>

[0074] Will be referred to Figure 9Describe the processing procedure of the extended application server 40 according to this embodiment. For example, the program stored in the ROM 402 is read into the RAM 403 by the CPU 401 and the program is executed to implement the processing to be described below. In addition, the following processing is implemented by executing a plug-in that implements the functions of the extended generative AI server 30. In this embodiment, the plug-in (program) will be described as being managed and executed by the extended application server 40, but this is not intended to limit the present invention. For example, the plug-in managed by the extended application server 40 can be installed in the generative AI server 30 and executed in the generative AI server 30. Alternatively, the generative AI server 30 and the extended application server 40 can be configured in an integrated manner. In this case, the integrated server controls the management, installation, and execution of the plug-in.

[0075] In step S901, the CPU 401 receives a print request and text data to be printed from the generative AI server 30. In step S902, the CPU 401 generates and stores a unique JobID. In step S903, the CPU 401 converts the text data to be printed into a format acceptable to the cloud print server 50, generates print data, and stores the print data associated with the JobID in a memory such as the RAM 403 or the HDD 405. Various storage processes to be described below are similarly performed on a memory such as the RAM 403 or the HDD 405. The memory can be connected to a unit external to the extended application server 40. In addition, in step S904, the CPU 401 reads the default print settings and stores them as the current print settings associated with the JobID.

[0076] Next, in step S905, the CPU 401 sends a job reservation request to the cloud print server 50. At this time, the CPU 401 sends the converted print data and the current print settings together. If the communication is successful and a reserved job URL 605, etc., is returned from the cloud print server 50, the process proceeds to step S906. At the same time, if there is an error notification from the cloud print server 50 or no response is received within a predetermined period, it is determined that the operation has failed, and the process proceeds to step S911.

[0077] In step S906, the CPU 401 stores the reserved job URL 605 associated with the JobID. In step S907, the CPU 401 returns the current print settings, the reserved job URL 605, and the preview image 606 to the generative AI server 30 as a response. In step S908, the CPU 401 determines whether a print setting change request is received from the generative AI server 30. If a print setting change request has been received, the process proceeds to step S909. If no request is received, the processing of the flowchart is terminated.

[0078] In step S909, the CPU 401 reads the current print settings associated with the JobID and reflects and stores the requested setting changes by overwriting. In step S910, the CPU 401 reads the reserved job URL 605 associated with the JobID and sends a reserved job setting change request to the cloud print server 50. At this time, the CPU 401 sends the converted print data and the print settings with the reflected changes together. If the communication is successful and the reserved job URL 605 etc. are returned from the cloud print server 50, the process proceeds to step S907. Meanwhile, if the communication fails as described above, the process proceeds to step S911. In step S911, the CPU 401 returns a failure message to the generative AI server 30 and terminates the flowchart process.

[0079] As described above, the computer program (plugin) according to the present embodiment is a computer program that extends the functions of the generative AI service. That is, when the computer program receives a print request through the generative AI service, it causes the computer of the information processing device to run to generate a print job based on the print request and register the reservation of the generated print job in the print server. In addition, the computer program causes the information processing device to run to obtain information related to the connection destination for executing the reserved print job from the print server, and presents the print job generated via the generative AI service and the information related to the connection destination to the user. Thereby, the time and effort required to print the text generated by the generative AI on the printing device can be reduced.

[0080] <Second Embodiment>

[0081] The second embodiment of the present invention will be described below. In the above first embodiment, it has been described that in step S719, the user terminal 20 accesses the reserved job URL 605 through the browser according to the user operation. However, since the cloud print server 50 is used by an unspecified number of users, considering the effective use of memory resources, it is not desirable to save the data of the print job including the reserved job indefinitely. Therefore, it is desirable to set an expiration date for the reserved job, and the reserved job URL 605 inevitably follows this expiration date. In this embodiment, the reprint method when the user accesses the reserved job URL 605 after the expiration date is described.

[0082] <Derivative Sequence>

[0083] Reference will be made to Figure 10 Describe the sequence derived from the Figures 8A to 8B sequence diagram when the expiration date of the reserved job URL 605 has passed. The processing until step S718 is similar to the Figures 8A to 8B processing, so its illustration and description will be omitted.

[0084] In step S1001, the user accesses the reserved job URL 605 in the browser. Different from step S719, the user opens the reserved job URL 605 on a new tab in the browser. In addition, in order to guide the user to perform the operation of opening a new tab, the wording of the print request response 604 and the print setting change response 608 is partially changed, as Figure 11 the guiding response 1101.

[0085] In step S1002, the cloud printing server 50 returns a screen notifying the user terminal 20 that the reserved job URL 605 has expired. At this time, the display of the browser on the user terminal 20 is as Figure 12 shown. The generative AI tab 1201 is a tab on which, until step S718, the screen displayed in the browser Figure 7 is shown. In step S1002, the screen is not displayed, but all interactions up to step S718 are stored, and these interactions will be displayed again when the user moves to the generative AI tab 1201. The reserved job tab 1202 is a newly opened tab when the user accesses the reserved job URL 605. In step S1002, the expiration text 1203 described later is displayed. The expiration text 1203 is the text returned by the cloud printing server 50 to the user terminal 20 notifying that the reserved job URL 605 has expired. It also includes text prompting the user to move to the generative AI tab 1201 to issue a print instruction again.

[0086] In step S1003, the user terminal 20 moves to the generative AI tab 1201 according to the user input, receives the input of the reprint prompt, and sends it to the generative AI server 30. In step S1004, the generative AI server 30 sends a reprint request to the extended application server 40. The reprint request includes the text generated in step S702 and the print settings indicated in the print setting change response 608.

[0087] In step S1005, the extended application server 40 receives the reprint request. The processing content is basically the same as that in step S704, but instead of the default print settings, the print settings included in the reprint request are stored as the current print settings. That is, here, the text previously generated in step S702 will be read from the storage destination and used. Since the subsequent processing is the same as that in step S705, its description will be omitted.

[0088] As described above, the reservation of the print job in the cloud print server according to the present embodiment is stored in the cloud print server, and the expiration date is set. In addition, the computer program of the present invention also causes the information processing device to operate to store the generated print job. In addition, when the expiration date of the reservation of the print job has expired, if a reprint request is received via the generative AI service, the re-reservation of the print job is registered in the print server using the stored text and print settings. Thus, according to the present embodiment, even if the reservation job URL 605 has expired, reprinting can be appropriately performed without reprinting from the beginning.

[0089] Other embodiments

[0090] Embodiments of the present invention can also be implemented by a computer of a system or apparatus that reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more fully referred to as a "non-transitory computer-readable storage medium") to perform one or more of the functions of the above-described embodiments and / or includes one or more circuits (e.g., an application specific integrated circuit (ASIC)) for performing one or more of the functions of the above-described embodiments, and the embodiments of the present invention can be implemented by a method of, for example, reading and executing the computer-executable instructions from the storage medium by the computer of the system or apparatus to perform one or more of the functions of the above-described embodiments and / or controlling the one or more circuits to perform one or more of the functions of the above-described embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessing unit (MPU)), and may include a network of separate computers or separate processors to read and execute the computer-executable instructions. The computer-executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, a hard disk, a random access memory (RAM), a read-only memory (ROM), the memory of a distributed computing system, an optical disc (such as a compact disc (CD), a digital versatile disc (DVD), or a Blu-ray disc (BD) TM ), a flash device, and a memory card, etc.

[0091] Embodiments of the present invention can also be implemented by a method in which software (a program) that performs the functions of the above-described embodiments is provided to a system or apparatus via a network or various storage media, and the computer or the central processing unit (CPU), the microprocessing unit (MPU) of the system or apparatus reads and executes the program.

[0092] Although the present invention has been described with reference to exemplary embodiments, it should be understood that the present invention is not limited to the disclosed exemplary embodiments. The scope of the appended claims should be given the broadest interpretation so as to cover all such variations and equivalent structures and functions.

Claims

1. A non-transitory computer-readable storage medium storing a computer program for extending the functionality of a generative AI service, wherein: The computer program is used to cause a computer of an information processing device to run to perform the following operations: Upon accepting a print request via the generative AI service, generating a print job based on the print request; registering a reservation of the generated print job in a print server; acquiring, from the print server, information related to a connection destination for executing the reserved print job; and The generated print job and information related to the connection destination are presented to a user via the generative AI service.

2. The storage medium according to claim 1, wherein: The computer program is also used to cause the computer of the information processing device to run to perform the following operations: When a request to change the setting of the print job presented to the user is accepted via the generative AI service, the print job and the reservation of the print job are updated according to the changed content.

3. The storage medium according to claim 2, wherein: The reservation of the print job to the print server is stored in the print server, and a valid period is set.

4. The storage medium according to claim 3, wherein: The computer program is also used to cause the computer of the information processing device to run to perform the following operations: storing the generated print job; and In a case where the validity period of the reservation of the print job has expired, when a reprint request is accepted via the generative AI service, re-reservation of the print job is registered in the print server using the stored print job.

5. The storage medium according to claim 1, wherein: The computer program is also used to cause the computer of the information processing device to run to perform the following operations: Print setting contents and a print preview image generated by the print server are presented to a user as information of the print job.

6. The storage medium according to claim 5, wherein: The computer program is also used to cause the computer of the information processing device to run to perform the following operations: When the print job is generated, unique identification information is assigned.

7. The storage medium according to claim 6, wherein: The computer program is also used to cause the computer of the information processing device to run to perform the following operations: The text data included in the print request accepted via the generative AI service is converted into a format acceptable to the print server, and print data is generated.

8. The storage medium according to claim 7, wherein: The computer program is also used to cause the computer of the information processing device to run to perform the following operations: Sets the preset print settings for the generated print job.

9. The storage medium according to claim 5, wherein: In a case where the user accesses the information related to the connection destination presented to the user, the print job is input from the print server to the image forming apparatus, and the print job is executed.

10. The storage medium according to claim 5, wherein: The computer program is implemented in the information processing device as a plug-in for the generative AI service.

11. A printing control method, comprising: When a print request is accepted via a generative AI service provided by an information processing device, generating a print job based on the print request; registering a reservation of the generated print job in a print server; acquiring, from the print server, information related to a connection destination for executing the reserved print job; as well as The generated print job and information related to the connection destination are presented to a user via the generative AI service.

12. A printing system comprising an information processing device that provides a generative AI service to a user terminal, a print server, and an image forming device, The information processing device comprises: one or more first memory devices storing a set of instructions; as well as One or more first processors, which execute the instruction set to perform the following operations: Upon accepting a print request via the generative AI service, generating a print job based on the print request; registering a reservation of the generated print job in the print server; acquiring, from the print server, information related to a connection destination for executing the reserved print job; as well as presenting the generated print job and information related to the connection destination to a user via the generative AI service, and The print server comprises: one or more second memory devices storing a set of instructions; as well as One or more second processors, which execute the instruction set to perform the following operations: When the print job is reserved, providing information related to the connection destination; and When the user accesses the information related to the connection destination, the print job is input to the image forming apparatus.

13. The printing system according to claim 12, wherein: The one or more second processors execute instructions in the one or more second memory devices to perform the following operations: When the user accesses the information related to the connection destination presented to the user, a login screen is provided to the user terminal, and based on the user information input via the login screen, an image forming apparatus to which the print job is to be input is specified.

14. The printing system according to claim 13, wherein: The one or more second processors execute instructions in the one or more second memory devices to perform the following operations: When a plurality of image forming apparatuses are associated with the user information, the user is inquired in advance via the user terminal about the image forming apparatus to be used.

15. The printing system according to claim 12, wherein: The print server is a cloud print server.

16. A computer program product storing a computer program for extending the functionality of a generative AI service, wherein: The computer program is used to cause a computer of an information processing device to run to perform the following operations: Upon accepting a print request via the generative AI service, generating a print job based on the print request; registering a reservation of the generated print job in a print server; acquiring, from the print server, information related to a connection destination for executing the reserved print job; and The generated print job and information related to the connection destination are presented to a user via the generative AI service.

Images