Computer program, control method for information processing device, and printing system

Abstract

To provide, for example, a mechanism to cause an image forming apparatus to suitably print output from a generative AI.SOLUTION: The present invention relates to a computer program that expands the features of a generative AI service. The computer program causes a computer of an information processing apparatus to, upon receiving a print request via the generative AI service, function to create a print job on the basis of the print request, and register a reservation for the created print job in a print server. The computer program causes the information processing apparatus to function to acquire, from the print server, information related to a connection destination for executing the reserved print job, and present the created print job and the information related to the connection destination to a user via the generative AI service.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to a computer program for expanding the functions of an artificial intelligence system, Information processing device a control method, and printing a system.

Background Art

[0002] There is known an artificial intelligence system called generative AI that can generate text, images, or other media in response to a prompt. In generative AI such as ChatGPT (registered trademark), function expansion by plugins is possible. For example, when a sentence containing the keyword "print" is input as an instruction to the generative AI, a plugin related to printing is selected, and the plugin can perform processing that the generative AI cannot respond to, enabling function expansion. [[ID=1⑧]]

[0003] On the other hand, in an image forming apparatus, printing can be performed by inputting print data from a cloud server. For example, Patent Document 1 proposes a technique that enables printing of a document managed by a cloud server in a chat conversation format.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when printing an output such as text generated by generative AI on an image forming apparatus, a user or the like needs to copy it to a file or the like and execute printing from a print driver or the like. That is, the user has to copy the output generated by generative AI to execute printing, which has been troublesome.

[0006] The present invention has been made in view of at least one of the above-mentioned problems, and provides a mechanism for suitably printing the output from a generated AI using an image forming apparatus. [Means for solving the problem]

[0007] The present invention relates to, for example, a computer program that enhances the functionality of a generation AI service, wherein the computer of an information processing device provides the generation AI service Based on the prompt entered Print request From the aforementioned AI generation service Upon receiving the print request, the system includes a generation means for generating a print job based on the print request, a reservation means for registering the reservation of the generated print job with the print server, an acquisition means for obtaining information about the connection destination for executing the reserved print job from the print server, and the generation AI service Before Information regarding the connection destination Report It is characterized by functioning as a means of presentation to the user.

[0008] Furthermore, the present invention relates to a printing system including, for example, an information processing device, a print server, and an image forming apparatus that provides a generation AI service to a user terminal, wherein the information processing device implements a computer program that extends the functionality of the generation AI service, thereby enabling the generation AI service Based on the prompt entered Print request The aforementioned generation AI service Upon receiving the request, the system includes a generation means for generating a print job based on the print request, a reservation means for registering the reservation of the generated print job with the print server, an acquisition means for obtaining information about the connection destination for executing the reserved print job from the print server, and the generation AI service. Before Information regarding the connection destination Report The means of presentation to the user and Equipped with The print server, when a print job is reserved, provides a means for providing information about the connection destination, and when a user accesses the information about the connection destination, it provides the print job to the image forming apparatus. send It is characterized by comprising means for performing the action. [Effects of the Invention]

[0009] According to the present invention, the output from the generative AI can be suitably printed by an image forming apparatus. Further, according to the present invention, it is possible to reduce the user's effort when printing the text generated by the generative AI by the image forming apparatus.

Brief Description of the Drawings

[0010] [Figure 1] A diagram showing a system configuration according to an embodiment. [Figure 2] A diagram showing the configuration of an MFP according to an embodiment. [Figure 3] A diagram showing the configuration of a user terminal according to an embodiment. [Figure 4] A diagram showing the configuration of a generative AI server according to an embodiment. [Figure 5] A diagram showing the configuration of an extended application server according to an embodiment. [Figure 6] A diagram showing the configuration of a cloud print server according to an embodiment. [Figure 7] A diagram showing an example of a screen for interaction with a generative AI server displayed on a user terminal according to an embodiment. [Figure 8] A sequence diagram of document printing according to an embodiment. [Figure 9] A flowchart related to an extended application server according to an embodiment. [Figure 10] A sequence diagram of reprinting according to an embodiment. [Figure 11] A diagram showing an example of a response of a generative AI server according to an embodiment. [Figure 12] A diagram showing an example of a browser screen when the reservation job URL expires according to an embodiment.

Modes for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential for the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0012] <First Embodiment> <System Configuration> Hereinafter, a first embodiment of the present invention will be described. In this embodiment, as an image processing apparatus, a multifunction peripheral (MFP) having printing, scanning, and FAX functions will be described as an example. FIG. 1 shows an example of an overall configuration diagram of a printing system that provides a printing service via a generative AI service according to the present invention. This printing system includes an image forming apparatus 10 such as a printing apparatus, a user terminal 20, a generative AI server 30, an extended application server 40, and a cloud print server 50. Each is communicably connected to each other via a network 70. The network 70 is a wireless or wired network composed of a WAN or a LAN.

[0013] The image forming apparatus 10 represents a printing apparatus having a function of printing an image notified from the cloud print server 50. The user terminal 20 represents an information terminal such as a smartphone, a tablet terminal, or a personal computer when a user uses a generative AI service such as ChatGPT. The user operates the user terminal 20 to access the generative AI server 30 on the cloud and execute the generative AI application. The user terminal 20 and the generative AI server 30 are connected to a wired or wireless communication network, and data can be transmitted and received between them. In this embodiment, a public line on the Internet is assumed as an example of the communication network, but a dedicated line may be used.

[0014] The generation AI server 30 is a cloud server (information processing device) located on the cloud 60 that provides generation AI such as ChatGPT, a text generation AI. The generation AI server 30 provides services in cooperation with the extended application server 40. The generation AI server 30 interprets messages sent from the user terminal 20, generates appropriate responses, and displays them as responses on the screen of the user terminal 20. Furthermore, the generation AI server 30 can have its functionality expanded by communicating with the extended application server 40.

[0015] The extended application server 40 is a cloud server (processing device) located on the cloud 60 and has the function of providing additional functions (plugins) to the generation AI server 30. The generation AI server 30 works in cooperation with the extended application server 40 and, by implementing predetermined plugins, becomes capable of processing that it could not do alone. The cloud print server 50 receives a print request from the user terminal 20 and notifies the image forming apparatus 10 that a print job has arrived. The image forming apparatus 10 receives the print job from the cloud print server 50 in accordance with the notification from the cloud print server 50 and executes printing. Here, an example is described in which various servers are provided individually, but they may also be provided as an integrated unit with other servers. For example, the generation AI server 30 and the extended application server 40 may be provided as an integrated unit.

[0016] <Hardware configuration of image forming apparatus> Referring to Figure 2, an example of the hardware configuration of the image forming apparatus 10 according to this embodiment will be described. The image forming apparatus 10 includes a control unit 110, an operation unit 116, a reading unit 118, a printing unit 120, a wireless communication unit 122, a fax communication unit 124, and a communication unit 126. The control unit 110 includes a CPU 111, a ROM 112, a RAM 113, an HDD 114, an operation unit I / F 115, a reading unit I / F 117, a printing unit I / F 119, a wireless communication unit I / F 121, a fax unit I / F 123, and a communication unit I / F 125.

[0017] The control unit 110, including the CPU 111, controls the operation of the entire image forming apparatus 10. The CPU 111 reads control programs stored in the ROM 112 or HDD 114 into the RAM 113 and performs various controls such as read control and print control. The ROM 112 stores control programs that can be executed by the CPU 111. The ROM 112 also stores boot programs and font data. The RAM 113 is the main memory and is used as a temporary storage area for loading the various control programs stored in the work area, ROM 112, and HDD 114. The HDD 114 stores image data, print data, various programs, various addresses, and various setting information. The HDD 114 is a storage medium and may be an SSD (Solid State Drive), eMMC (embedded Multi Media Card), etc., instead of an HDD.

[0018] In this embodiment, the image forming apparatus 10 uses one CPU 111 and one memory (RAM 113) to execute each process shown in the flowchart described later, but it is not limited to this. For example, multiple CPUs, RAMs, ROMs, and HDDs can work together to execute each process. Alternatively, some processes may be executed using hardware circuits such as ASICs or FPGAs.

[0019] The operation unit I / F 115 connects the control unit 110 to the operation unit 116, which includes a display unit such as a touch panel and hard keys. The operation unit 116 displays information to the user and detects user input. The reading unit I / F 117 connects the control unit 110 to the reading unit 118, such as a scanner. The reading unit 118 reads an image of a document, and the CPU 111 converts that image into image data such as binary data. The image data generated based on the image read by the reading unit 118 is transmitted to an external device or printed on recording paper. The printing unit I / F 119 connects the control unit 110 to the printing unit 120, such as a printer. The CPU 111 transfers image data (print data) stored in RAM 113 to the printing unit 120 via the printing unit I / F 119. The printing unit 120 prints an image based on the transferred image data onto recording paper fed from the paper cassette.

[0020] The wireless communication interface 121 is an interface for controlling the wireless communication unit 122 and connects to the control unit 110 and external wireless devices wirelessly. The fax unit interface 123 connects to the public telephone network 80 by controlling the fax communication unit 124. The fax unit interface 123 is an interface for controlling the fax communication unit 124 and enables connection to the public telephone network and control of the fax communication protocol by controlling the modem and NCU for facsimile communication.

[0021] The communication interface 125 connects the control unit 110 and the network 70. The communication interface 125 allows the communication unit 126 to transmit image data and various internal information of the device to external devices on the network 70, and to receive print data and information on the network 70 from external devices on the network 70. Transmission and reception via the network 70 can be done using email or other protocols (e.g., FTP, SMB, WebDAV, etc.). Image data and message data can also be transmitted and received over the network 70 via HTTP communication from the user terminal 20 and the generation AI server 30. Furthermore, it is possible to access the image forming apparatus 10 via the network from the web browser of the user terminal 20 and perform various settings on the image forming apparatus 10 (remote UI function).

[0022] <User terminal hardware configuration> Referring to Figure 3, an example of the hardware configuration of the user terminal 20 according to this embodiment will be described. Although the user terminal 20 in this embodiment is assumed to be a device such as a smartphone or tablet PC, it may be any other device as long as it is an information processing device that can connect to the network 70 using Wi-Fi communication or the like. The user terminal 20 includes an operation panel 201, a camera 204, an NFC communication unit 205, a Bluetooth® communication unit 206, a CPU 207, a ROM 208, a RAM 209, an HDD 210, and a wireless LAN communication unit.

[0023] The CPU 207 reads the control program stored in the ROM 208 and executes various processes to control the operation of the user terminal 20. The ROM 208 stores the above control program. The RAM 209 is used as the main memory and temporary storage area for the CPU 207, such as the work area. The HDD 210 stores various data such as photographs and electronic documents.

[0024] The control panel 201 has a touch panel function that can detect user touch operations and displays various screens provided by the OS and email sending applications. The control panel 201 is also used to check information stored in the generation AI server 30. The user can input desired operation instructions to the user terminal 20 by inputting touch operations on the control panel 201. The user terminal 20 is equipped with hardware keys (not shown), and the user can also input operation instructions to the user terminal 20 using these hardware keys.

[0025] Camera 204 takes images according to the user's imaging instructions. The images taken by camera 204 are stored in a designated area of ​​HDD 210. It is also possible to obtain information from QR codes read by camera 204 using a program capable of QR code analysis.

[0026] The user terminal 20 can exchange data with various peripheral devices via the NFC communication unit 205, the Bluetooth communication unit 206, and the wireless LAN communication unit 211. The Bluetooth communication unit 206 of the user terminal 20 may also support Bluetooth Low Energy (BLE).

[0027] <Hardware configuration of the AI ​​generation server> Referring to Figure 4, an example of the hardware configuration of the generation AI server 30 according to this embodiment will be described. The generation AI server 30 includes a CPU 301, ROM 302, RAM 303, communication unit 304, and HDD 305.

[0028] The CPU 301 executes processing to control the operation of generating appropriate responses using the control program stored in the ROM 302 and the learning model stored in the HDD 305. The ROM 302 stores the above control program. The RAM 303 is used as the main memory and temporary storage area for the CPU 301, such as the work area. The HDD 305 stores various data such as the learning model and the generation AI application.

[0029] The communication unit 304 can exchange data with various devices such as the user terminal 20, the image forming apparatus 10, and the extended application server 40. The communication unit 304 may use wired communication using Ethernet® or wireless communication such as Wi-Fi.

[0030] <Hardware configuration of the extended application server> Refer to Figure 5, which shows an example of the hardware configuration of the extended application server 40. The extended application server 40 comprises a CPU 401, ROM 402, RAM 403, communication unit 404, and HDD 405.

[0031] The CPU 401 reads the control program stored in the ROM 402 and executes processing according to the message received from the generation AI server 30. The ROM 402 stores the above control program. The RAM 403 is used as the CPU 401's main memory, work area, and other temporary storage areas. The HDD 405 stores the message content and parts thereof received from the generation AI server 30. Data can be sent and received with the generation AI server 30 and other devices via the communication unit 404.

[0032] <Hardware configuration of the cloud print server> Figure 6 shows an example of the hardware configuration of the cloud print server 50. The cloud print server 50 includes a CPU 501, ROM 502, RAM 503, communication unit 504, and HDD 505.

[0033] The CPU 501 reads the control program stored in the ROM 502, enabling it to receive print jobs from the user terminal 20 and retrieve saved print jobs. The ROM 502 stores the above-mentioned control program. The RAM 503 is used as the main memory and temporary storage area for the CPU 501, such as the work area. The HDD 505 stores print jobs received from the user terminal 20. Data can be sent and received with various devices, such as the generation AI server 30, via the communication unit 504.

[0034] <Print instructions> Referring to Figure 7, the interaction between the user and the generation AI server 30 when instructing the generation AI server 30 to print according to this embodiment will be explained. By accessing the generation AI server 30 from a browser running on the user terminal 20, screen 600 is displayed on the operation panel 201.

[0035] The prompt input field 601 is an input field for the user to input instructions (prompts) to the generation AI server 30. The user inputs in natural language text format from the operation panel 201 of the user terminal 20. The user can input instructions by operating the touch panel of the user terminal 20. Input of instructions may also be achieved by voice input. The send button 602 is a button that acts as a trigger to send the prompt entered in the prompt input field 601 to the generation AI server 30.

[0036] The print request prompt 603 is an example of a prompt for instructing the generation AI server 30 to print. It must include guidelines for the text to be generated by the generation AI server 30 and a statement indicating that it should be printed.

[0037] The print request response 604 is a response to the print request prompt 603 generated by the generation AI server 30 in cooperation with the extended application server 40. From here on, the interactive exchange between the user and the generation AI server 30 is arranged chronologically in combinations of prompts and responses. The print request response 604 includes the settings for the print to be performed, as well as the reserved job URL 605 and preview image 606, which will be described later.

[0038] The reserved job URL 605 is a URL that points to a print job stored on the cloud print server 50, and is an example of information regarding the connection destination. The information regarding the connection destination is not limited to a URL; it can be any information indicating the location where the print job is stored or any information that identifies the print job. Users can perform cloud printing (submitting a print job from the cloud print server 50 to the image forming apparatus 10) by accessing this URL. Furthermore, changes to the print settings of a reserved job are also made by sending an HTTP request to the reserved job URL. The preview image 606 is a preview image that shows what the output will look like when printed with the current print settings. This image allows users to get a rough idea of ​​the final output before printing.

[0039] The print setting change prompt 607 is an example of a prompt used when a user wants to change the print settings confirmed in the print request response 604 and instructs the generation AI server 30 to change the settings. For this instruction as well, the user enters the instruction in the prompt input field 601 and sends the instruction to the generation AI server 30 by pressing the send button 602. In this embodiment, the instruction is to change the number of copies to 2, but it may also be an instruction to change other settings (for example, changing the paper size or making the layout 2-in-1). Furthermore, it may include instructions to change multiple settings.

[0040] The print settings change response 608 is a response to the print settings change prompt 607, which was generated by the generating AI server 30 in cooperation with the extended application server 40. The basic content is the same as the print request response 604, but the print settings reflect the instructed changes. In addition, if settings that change the preview image, such as color mode or layout, are changed, the preview image 606 is also replaced accordingly.

[0041] <Sequence> Referring to Figure 8, the interactions between system components from the time the user instructs the generation AI server 30 to print until the print job is actually submitted to the image forming apparatus 10 according to this embodiment will be explained. In the sequence described below, if the generation AI server 30 and the extended application server 40 are integrated into a single unit, the control of the two devices will be integrated.

[0042] In S701, the user terminal 20 sends the contents of the print request prompt 603 to the generation AI server 30 according to the user operation via the browser. Subsequently, in S702, the generation AI server 30 generates the document to be printed (text data) and sends a print request to the extended application server 40 in S703. In S703, the text data generated in S702 is also sent.

[0043] Next, in S704, the extended application server 40 generates and saves a JobID. The JobID is a unique identifier used to associate and manage various types of data that will be handled in the future. Furthermore, the extended application server 40 converts the text data received from the generation AI server 30 into a format that the cloud print server 50 can accept (e.g., PDF). This process can be skipped if the cloud print server 50 can accept text data. After that, the extended application server 40 saves the default print settings as the current print settings. Subsequently, in S705, the extended application server 40 sends a job reservation request to the cloud print server 50. At this time, the converted data generated in S704 and the current print settings are sent together.

[0044] In S706, the cloud print server 50 generates a reserved job based on the converted data received from the extended application server 40 and the current print settings. Furthermore, the cloud print server 50 generates a reserved job URL 605 that points to the reserved job and a preview image 606 which is an image of the output of the reserved job, and saves them together with the generated reserved job. Subsequently, in S707, the cloud print server 50 returns the reserved job URL 605 and the preview image 606 to the extended application server 40 as a response to the job reservation request.

[0045] Next, at S708, the extended application server 40 saves the reserved job URL 605 in association with the JobID. Subsequently, at S709, the extended application server 40 returns the current print settings, the reserved job URL 605, and the preview image 606 to the generating AI server 30 as information to be presented to the user as a response to the print request. At S710, the generating AI server 30 returns the current print settings, the reserved job URL 605, and the preview image 606 to the user terminal 20 as a response to the print request prompt 603. The user terminal 20 presents the information to the user via a browser according to the information received.

[0046] In S711, the user terminal 20 sends the contents of the print setting change prompt 607 to the generation AI server 30 according to user input via the browser. Note that if a print setting change is not required, steps S711 to S718 may be skipped. In S712, the generation AI server 30 sends a print setting change request to the extended application server 40. In S713, the extended application server 40 reads the current print settings associated with the JobID, and updates them by overwriting them with the changed settings according to the print setting change request (change content) as the current print settings. In S714, the extended application server 40 reads the reserved job URL associated with the JobID, sends a reserved job setting change request to the cloud print server 50, and makes a re-reservation. At this time, the extended application server 40 sends the converted data generated in S704 and the current print settings overwritten in S713 together.

[0047] In S715, the cloud print server 50 regenerates and updates the reserved job and preview image 606 with the new print settings. It is desirable to keep the reserved job URL 605 unchanged. This allows it to appear as the same reserved job externally. In S716, the cloud print server 50 returns the reserved job URL 605 and the regenerated preview image 606 to the extended application server 40 as a response to the reserved job setting change request.

[0048] In S717, the extended application server 40 returns the print settings reflecting the changes, the reserved job URL 605, and the regenerated preview image 606 to the generation AI server 30 as a response to the print settings change request. In S718, the generation AI server 30 returns the current print settings reflecting the changes, the reserved job URL 605, and the regenerated preview image 606 to the user terminal 20 as a response to the print request prompt 603.

[0049] Subsequently, at S719, the user terminal 20 accesses the reserved job URL 605 according to user operations via a browser. At S720, the cloud print server 50 returns the cloud print service login screen (not shown) to the user terminal 20. The user terminal 20 displays the login screen on the operation panel 201. At S721, the user terminal 20 accepts login information according to user operations and logs in to the cloud print service. Note that if the user does not have a cloud print service account, an account creation procedure (not shown) will be required.

[0050] In S722, the cloud print server 50 identifies the MFP being used by the user based on the logged-in user information. If the user has not registered an MFP, an MFP registration procedure (not shown) is required. If multiple MFPs are registered and linked to the user's information, the user may be allowed to select an MFP before printing through an interactive process (not shown). In S723, the cloud print server 50 submits the reserved job to the identified image forming apparatus 10.

[0051] In S724, the image forming apparatus 10 executes printing according to the reserved job submitted from the cloud print server 50. In S725, the image forming apparatus 10 notifies the cloud print server 50 that printing of the reserved job is complete. In S726, the cloud print server 50 returns a print completion screen (not shown) to the user terminal 20 for display on the user terminal 20, and this sequence ends.

[0052] <Processing procedure for the extended application server> Referring to Figure 9, the processing procedure of the extended application server 40 according to this embodiment will be described. The processing described below is realized, for example, by the CPU 401 reading a program stored in ROM 402 into RAM 403 and executing it. Furthermore, the following processing is realized by executing a plugin that extends the functionality of the generation AI server 30. In this embodiment, the plugin (program) is described as being managed and executed by the extended application server 40, but this is not intended to limit the present invention. For example, the plugin managed by the extended application server 40 may be installed on the generation AI server 30 and executed on the generation AI server 30. Alternatively, the generation AI server 30 and the extended application server 40 may be provided as an integrated unit, in which case the integrated server will control the management, installation, and execution of the plugin.

[0053] In S901, CPU401 receives a print request and the text data to be printed from the generation AI server 30. In S902, CPU401 generates and saves a unique JobID. In S903, CPU401 converts the text data to be printed into a format that the cloud print server 50 can accept to generate print data, and saves it to memory such as RAM403 or HDD405, associated with the JobID. Similarly, the various saving processes described below are also performed on memory such as RAM403 or HDD405. This memory may also be connected to an external location of the extended application server 40. Furthermore, in S904, CPU401 reads the default print settings and saves them as the current print settings, associated with the JobID.

[0054] Next, in S905, CPU401 sends a job reservation request to the cloud print server 50. At this time, CPU401 sends the converted print data and the current print settings together. If the communication is successful and the cloud print server 50 returns the reserved job URL 605, etc., the process proceeds to S906. On the other hand, if the cloud print server 50 sends an error notification or does not receive a response within the specified time, it is determined that the process has failed and the process proceeds to S911.

[0055] In S906, CPU401 saves the reserved job URL605 associated with the JobID. In S907, CPU401 returns the current print settings, reserved job URL605, and preview image606 as a response to the generation AI server30. In S908, CPU401 determines whether or not it has received a request to change the print settings from the generation AI server30. If a request to change the print settings has been received, the process proceeds to S909; otherwise, the process of this flowchart ends.

[0056] In S909, CPU401 reads the current print settings associated with the JobID and overwrites and saves them, reflecting the requested setting changes. In S910, CPU401 reads the reserved job URL605 associated with the JobID and sends a request to the cloud print server 50 to change the settings of the reserved job. At this time, CPU401 sends the converted print data and the print settings reflecting the changes together. If the communication is successful and the reserved job URL605 etc. are returned from the cloud print server 50, the process proceeds to S907. On the other hand, if the communication fails as described above, the process proceeds to S911. In S911, CPU401 returns a failure message to the generation AI server 30 and terminates the processing of this flowchart.

[0057] As described above, the computer program (plugin) according to this embodiment is a computer program that extends the functionality of the generation AI service. Specifically, this computer program causes the computer of the information processing device to generate a print job based on a print request received via the generation AI service, and to register the reservation of the generated print job with the print server. Furthermore, this computer program causes the information processing device to obtain information about the connection destination for executing the reserved print job from the print server, and to present the user with the information about the print job generated via the generation AI service and the connection destination. This reduces the effort required when printing text generated by the generation AI on a printing device.

[0058] <Second Embodiment> The following describes a second embodiment of the present invention. In the first embodiment described above, it was explained that in S719, the user terminal 20 accesses the reserved job URL 605 according to user operations via a browser. However, since the cloud print server 50 is used by an unspecified number of users, it is undesirable from the standpoint of effectively using memory resources to retain print job data, including reserved jobs, indefinitely. Therefore, it is desirable to set an expiration date for reserved jobs, and the reserved job URL 605 will inevitably also be subject to that expiration date. In this embodiment, a method for reprinting when a user accesses the reserved job URL 605 after its expiration date will be described.

[0059] <Derived Sequence> Referring to Figure 10, the derived sequence when the reserved job URL 605 expires will be explained based on the sequence diagram in Figure 8. Since the process up to S718 is the same as in Figure 8, the illustration and explanation will be omitted.

[0060] In S1001, the user accesses the reserved job URL 605 in their browser. Unlike S719, the user opens the reserved job URL 605 in a new browser tab. In addition, to guide the user to open it in a new tab, the wording of the print request response 604 and the print setting change response 608 is partially modified, as shown in the guidance response 1101 in Figure 11.

[0061] In S1002, the cloud print server 50 returns a screen to the user terminal 20 informing it that the reserved job URL 605 has expired. At this time, the browser display on the user terminal 20 will look like Figure 12. The generated AI tab 1201 is the tab that displayed the screen shown in Figure 7 in the browser up to S718. Although the screen is not displayed at S1002, all interactions up to S718 are saved and will be redisplayed when the user moves to the generated AI tab 1201. The reserved job tab 1202 is the tab that the user newly opened when accessing the reserved job URL 605. At S1002, it displays the expired message 1203, which will be described later. The expired message 1203 is the message that the cloud print server 50 returned to the user terminal 20 informing it that the reserved job URL 605 has expired. It also includes a message prompting the user to move to the generated AI tab 1201 to issue another print command.

[0062] In S1003, the user terminal 20 moves to the generated AI tab 1201 according to user input, accepts input for the reprint prompt, and sends it to the generated AI server 30. In S1004, the generated AI server 30 sends a reprint request to the extended application server 40. The reprint request includes the document generated in S702 and the print settings indicated in the print setting change response 608.

[0063] In S1005, the extended application server 40 accepts a reprint request. The processing is basically the same as in S704, but instead of using the default print settings, the print settings included in the reprint request are saved as the current print settings. In other words, the document already generated in S702 is read from its storage location and used here. The subsequent processing is the same as in S705 and is therefore omitted.

[0064] As described above, the print job reservation to the cloud print server according to this embodiment is stored on the cloud print server and has an expiration date. Furthermore, the computer program of the present invention further causes the information processing device to function to save the generated print job. If the expiration date of the print job reservation has passed, when a request for reprinting is received via the generation AI service, the saved print job is used to register a re-reservation of the print job to the print server. Thus, according to this embodiment, even if the reserved job URL 605 has expired, reprinting can be performed smoothly without having to start over from the beginning.

[0065] The disclosures herein include the following computer programs, printing control methods, and systems. (Item 1) A computer program that extends the functionality of a generation AI service, wherein the computer of the information processing device When a print request is received via the aforementioned generation AI service, the generation means generates a print job based on the print request, A reservation means for registering the reservation of the generated print job with the print server, An acquisition means for obtaining information about the connection destination for executing the reserved print job from the print server, A presentation means for presenting to the user the print job generated via the generation AI service and information regarding the connection destination. A computer program characterized by being designed to function as such. (Item 2) The computer of the aforementioned information processing device is further, When the generation AI service receives a request from the user to change the settings of the print job presented, the update means updates the print job and the print job reservation according to the changes. A computer program as described in item 1, characterized by being configured to function as such. (Item 3) The computer program according to item 1 or 2, characterized in that the reservation of the print job to the print server is stored on the print server and has an expiration date. (Item 4) The computer of the aforementioned information processing device is further, The generated print job is to function as a storage means for saving the job. The computer program according to item 3, characterized in that, when the reservation means receives a request for reprinting via the generation AI service when the reservation of the print job has expired, it uses the stored print job to register the re-reservation of the print job with the print server. (Item 5) The computer program according to any one of items 1 to 4, further characterized in that the presentation means presents to the user the contents of the print settings and a print preview image generated by the print server as information of the print job. (Item 6) The computer program according to any one of items 1 to 5, characterized in that the generation means assigns unique identification information when generating the print job. (Item 7) The computer program according to any one of items 1 to 6, characterized in that the generation means converts the text data included in the print request received via the generation AI service into a format that can be accepted by the print server to generate print data. (Item 8) The computer program according to any one of items 1 to 7, characterized in that the generation means sets predetermined print settings for the generated print job. (Item 9) A computer program according to any one of items 1 to 8, characterized in that when the user accesses the information regarding the connection destination presented to the user, the print job is submitted from the print server to the image forming apparatus and the print job is executed. (Item 10) The computer program according to any one of items 1 to 9, characterized in that the computer program is implemented in the information processing device as a plug-in for the AI ​​generation service. (Item 11) A printing control method, When the generation means receives a print request via the generation AI service provided by the information processing device, the generation process involves generating a print job based on the print request, The reservation means includes a reservation step of registering the reservation of the generated print job to the print server, The acquisition means includes an acquisition step of acquiring information from the print server regarding the connection destination for executing the reserved print job, The presentation means includes a presentation step in which it presents to the user the print job generated via the generation AI service and information regarding the connection destination. A printing control method characterized by including the following. (Item 12) A printing system including an information processing device, a print server, and an image forming apparatus that provides AI generation services to a user terminal, The information processing device implements a computer program that extends the functionality of the generation AI service, When a print request is received via the aforementioned generation AI service, the generation means generates a print job based on the print request, A reservation means for registering the reservation of the generated print job with the print server, An acquisition means for obtaining information about the connection destination for executing the reserved print job from the print server, A presentation means for presenting to the user the print job generated via the generation AI service and information regarding the connection destination. It functions as, The aforementioned print server, When the print job is reserved, the providing means provides information about the connection destination, When a user accesses the information regarding the connection destination, an execution means submits the print job to the image forming apparatus. A printing system characterized by comprising the following features. (Item 13) The printing system according to item 12, characterized in that when the user accesses the information regarding the connection destination presented to the user, the execution means provides a login screen to the user terminal and identifies an image forming apparatus that submits the print job based on the user information entered via the login screen. (Item 14) The printing system according to item 13, characterized in that, if the user information is associated with multiple image forming apparatuses, the execution means prompts the user via the user terminal to inquire in advance about which image forming apparatus to use. (Item 15) The printing system according to any one of items 12 to 14, characterized in that the printing server is a cloud print server.

[0066] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0067] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0068] 10: MFP, 20: User terminal, 30: Generation AI server, 40: Extended application server, 50: Cloud print server, 60: Cloud, 70: Network

Claims

1. A computer program that enhances the functionality of a generation AI service, wherein the computer of the information processing device When the generation AI service receives a print request based on a prompt input to the generation AI service, the generation means generates a print job based on the print request, A reservation means for registering the reservation of the generated print job with the print server, An acquisition means for obtaining information about the connection destination for executing the reserved print job from the print server, A presentation means that presents information regarding the connection destination to the user via the AI ​​generation service. A computer program characterized by being designed to function as such.

2. The presenting means further presents the settings for the print job to the user, The computer of the aforementioned information processing device is further, When the generation AI service receives a request from the user to change the settings of the print job presented, the update means updates the print job and the print job reservation according to the changes. The computer program according to claim 1, characterized in that it functions as such.

3. The computer program according to claim 2, characterized in that the reservation of the print job to the print server is stored on the print server and has an expiration date.

4. The computer of the aforementioned information processing device is further, The generated print job is to function as a storage means for saving the job. The computer program according to claim 3, characterized in that when the reservation means receives a request for reprinting via the generation AI service when the reservation of the print job has expired, it uses the stored print job to register the re-reservation of the print job with the print server.

5. The computer program according to any one of claims 1 to 4, further characterized in that the presentation means presents a preview image generated by the print server to the user.

6. The computer program according to claim 5, characterized in that the generation means assigns unique identification information when generating the print job.

7. The computer program according to claim 6, characterized in that the generation means converts the text data included in the print request received via the generation AI service into a format that can be accepted by the print server to generate print data.

8. The computer program according to claim 7, characterized in that the generation means sets predetermined print settings for the generated print job.

9. The computer program according to claim 5, characterized in that when the user accesses the information regarding the connection destination presented to the user, the print server sends the print job to the image forming apparatus and the print job is executed.

10. The computer program according to claim 5, characterized in that it is implemented in the information processing device as a plug-in for the AI ​​generation service.

11. A control method for an information processing device, When a print request is received from the generation AI service based on a prompt input to the generation AI service, a generation step is performed to generate a print job based on the print request, The reservation process involves registering the reservation of the generated print job with the print server, A step of obtaining information about the connection destination for executing the reserved print job from the print server, A presentation step of presenting information regarding the connection destination to the user via the AI ​​generation service. A control method for an information processing device, characterized by including the following:

12. A printing system including an information processing device that provides AI generation services to a user terminal, a print server, and an image forming apparatus, The information processing device implements a computer program that extends the functionality of the AI ​​generation service, When the generation AI service receives a print request based on a prompt input to the generation AI service, the generation means generates a print job based on the print request, A reservation means for registering the reservation of the generated print job with the print server, An acquisition means for obtaining information about the connection destination for executing the reserved print job from the print server, A presentation means that presents information regarding the connection destination to the user via the AI ​​generation service. Equipped with, The aforementioned print server, When the print job is reserved, the providing means provides information about the connection destination, When a user accesses the information regarding the connection destination, an execution means transmits the print job to the image forming apparatus. A printing system characterized by comprising the following features.

13. The printing system according to claim 12, characterized in that the execution means identifies an image forming apparatus that, when the user accesses the information regarding the connection destination presented to the user, provides a login screen to the user terminal and transmits the print job based on the user information entered via the login screen.

14. The printing system according to claim 13, characterized in that, if multiple image forming apparatuses are associated with the user information, the execution means inquires with the user via the user terminal in advance about which image forming apparatus to use.

15. The printing system according to any one of claims 12 to 14, characterized in that the printing server is a cloud print server.

Images