Computer program, print control method, and system

Abstract

To provide, for example, a mechanism to cause an image forming apparatus to suitably print output from a generative AI.SOLUTION: The present invention relates to a computer program that expands the features of a generative AI service. The computer program causes a computer of an information processing apparatus to function to acquire authentication information related to a user upon receiving a print request via the generative AI service. The computer program causes the computer to function to acquire apparatus information related to an available image forming apparatus from a print server by using the acquired authentication information related to the user, and identify an image forming apparatus that executes printing on the basis of the apparatus information.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to a computer program, a printing control method, and a system for expanding the functions of an artificial intelligence system.

Background Art

[0002] An artificial intelligence system called generative AI is known, which can generate text, images, or other media in response to a prompt. In generative AI such as ChatGPT (registered trademark), function expansion by plugins is possible. For example, when a sentence including the keyword "print" is input as an instruction to the generative AI, a plugin related to printing is selected, and the plugin can perform processing that the generative AI cannot respond to, thereby enabling function expansion.

[0003] On the other hand, in an image forming apparatus, printing can be performed by inputting print data from a cloud server. For example, Patent Document 1 proposes a technique for making it possible to print a document managed by a cloud server in a chat conversation format.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when printing an output such as text generated by generative AI on an image forming apparatus, a user or the like needs to copy it to a file or the like and execute printing from a print driver or the like. That is, the user has to copy the output generated by generative AI to execute printing, which is troublesome.

[0006] The present invention has been made in view of at least one of the above-described problems, and provides a mechanism for suitably printing the output from a generative AI by an image forming apparatus.

Means for Solving the Problems

[0007] The present invention is, for example, a computer program that extends the functions of a generative AI service, and causes a computer of an information processing apparatus to function as a first acquisition means for acquiring authentication information related to a user when receiving a print request via the generative AI service, a second acquisition means for acquiring apparatus information related to an available image forming apparatus from a print server using the acquired authentication information related to the user, and a specifying means for specifying an image forming apparatus that executes printing based on the apparatus information.

[0008] Further, the present invention is, for example, a printing system including an information processing apparatus that provides a generative AI service to a user terminal, a print server, and an image forming apparatus. The information processing apparatus functions as a first acquisition means for acquiring authentication information related to a user when receiving a print request via the generative AI service, a second acquisition means for acquiring apparatus information related to an available image forming apparatus from a print server using the acquired authentication information related to the user, and a specifying means for specifying an image forming apparatus that executes printing based on the apparatus information. The print server includes a providing means for providing the apparatus information associated with the authentication information related to the user, and an execution means for inputting a print job based on the print request to the specified image forming apparatus when printing is instructed via the generative AI service.

Effects of the Invention

[0009] According to the present invention, the output from the generative AI can be suitably printed by the image forming apparatus. Further, according to the present invention, a user can print using an image forming apparatus only by inputting to the generative AI service.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0012] <First Embodiment> <System Configuration> Hereinafter, a first embodiment of the present invention will be described. In this embodiment, as an image processing apparatus, a multi-function peripheral (MFP) having printing, scanning, and FAX functions will be described as an example. FIG. 1 shows an example of an overall configuration diagram of a printing system that provides a printing service via a generative AI service according to the present invention. This printing system includes an MFP 10 such as a printing apparatus, a user terminal 20, a generative AI server 30, an extended application server 40, and a cloud printing server 50. Each is connected to be communicable with each other via a network 70. The network 70 is a wireless or wired network composed of a WAN or a LAN.

[0013] The MFP 10 represents a printing apparatus having a function of printing an image notified from the cloud printing server 50. The user terminal 20 represents an information terminal such as a smartphone, a tablet terminal, or a personal computer when a user uses a generative AI service such as ChatGPT. The user operates the user terminal 20 to access the generative AI server 30 on the cloud and execute the generative AI application. The user terminal 20 and the generative AI server 30 are connected to a wired or wireless communication network, and data can be transmitted and received between them. In this embodiment, a public line on the Internet is assumed as an example of the communication network, but a dedicated line may be used.

[0014] The generative AI server 30 is a cloud server (information processing apparatus) disposed on a cloud 60 that provides a generative AI such as ChatGPT, which is a text generative AI. The generative AI server 30 provides a service in cooperation with the extended application server 40. The generative AI server 30 interprets a message transmitted from the user terminal 20, generates an appropriate response, and displays it on the screen of the user terminal 20 as a response. Furthermore, the generative AI server 30 can expand its functions by communicating with the extended application server 40.

[0015] The extended application server 40 is a cloud server (information processing device) arranged on the cloud 60 and has a function of providing an additional function (plugin) to the generation AI server 30. The generation AI server 30 cooperates with the extended application server 40 to enable processing that could not be done alone by implementing a predetermined plugin, which is a computer program. The cloud print server 50 is a print server that receives a print request from the user terminal 20 and notifies the MFP 10 that a print job has arrived. The MFP 10 receives the print job from the cloud print server 50 and executes printing according to the notification from the cloud print server 50. Here, an example where various servers are provided individually is described, but they may be provided integrally with other servers. For example, the generation AI server 30 and the extended application server 40 may be provided integrally.

[0016] <Hardware Configuration of the Image Forming Apparatus> Referring to FIG. 2, a hardware configuration example of the MFP 10 according to the present embodiment will be described. The MFP 10 includes a control unit 110, an operation unit 116, a reading unit 118, a printing unit 120, a wireless communication unit 122, a FAX communication unit 124, and a communication unit 126. The control unit 110 includes a CPU 111, a ROM 112, a RAM 113, an HDD 114, an operation unit I / F 115, a reading unit I / F 117, a printing unit I / F 119, a wireless communication unit I / F 121, a FAX unit I / F 123, and a communication unit I / F 125.

[0017] The control unit 110 including the CPU 111 controls the operation of the entire MFP 10. The CPU 111 reads the control program stored in the ROM 112 or the HDD 114 into the RAM 113 and performs various controls such as reading control and printing control. The ROM 112 stores the control program executable by the CPU 111. The ROM 112 also stores a boot program, font data, and the like. The RAM 113 is a main memory and is used as a temporary storage area for expanding various control programs stored in the work area, the ROM 112, and the HDD 114. The HDD 114 stores image data, print data, various programs, various addresses, and various setting information. The HDD 114 is a storage medium, and it may be an SSD (Solid State Drive), an eMMC (embedded Multi Media Card), etc. instead of an HDD.

[0018] Note that in the MFP 10 of this embodiment, it is assumed that one CPU 111 executes each process shown in the flowchart described later using one memory (RAM 113), but it is not limited to this. For example, a plurality of CPUs, RAMs, ROMs, and HDDs can cooperate to execute each process. Also, some processes may be executed using a hardware circuit such as an ASIC or an FPGA.

[0019] The operation unit I / F 115 connects an operation unit 116 including a display unit such as a touch panel and hard keys and a control unit 110. The operation unit 116 displays information to the user and detects input from the user. The reading unit I / F 117 connects a reading unit 118 such as a scanner and a control unit 110. The reading unit 118 reads an image of a document, and the CPU 111 converts the image into image data such as binary data. The image data generated based on the image read by the reading unit 118 is transmitted to an external device or printed on a recording paper. The printing unit I / F 119 connects a printing unit 120 such as a printer and a control unit 110. The CPU 111 transfers the image data (printing data) stored in the RAM 113 to the printing unit 120 via the printing unit I / F 119. The printing unit 120 prints an image based on the transferred image data on the recording paper fed from a paper feed cassette.

[0020] The wireless communication unit I / F 121 is an I / F for controlling the wireless communication unit 122, and connects to an external wireless device via wireless with the control unit 110. The FAX unit I / F 123 is connected to the public switched telephone network 80 by controlling the FAX communication unit 124. The FAX unit I / F 123 is an I / F for controlling the FAX communication unit 124, and can perform connection to the public switched telephone network, control of the facsimile communication protocol, etc. by controlling a modem and an NCU for facsimile communication.

[0021] The communication unit I / F 125 connects the control unit 110 and the network 70. The communication unit I / F 125 enables the communication unit 126 to transmit image data and various internal device information to external devices on the network 70, or to receive print data and information on the network 70 from external devices on the network 70. As methods of transmission and reception via the network 70, transmission and reception using electronic mail (E-mail) or file transmission using other protocols (e.g., FTP, SMB, WEBDAV, etc.) can be performed. Also, image data and message data can be transmitted and received via the network 70 by access through HTTP communication from the user terminal 20 and the generation AI server 30. Furthermore, it is possible to access the MFP 10 via the network from the web browser of the user terminal 20 and perform various settings of the MFP 10 (remote UI function).

[0022] <Hardware Configuration of User Terminal> Referring to FIG. 3, a hardware configuration example of the user terminal 20 according to the present embodiment will be described. Although the user terminal 20 of the present embodiment assumes a device such as a smartphone or a tablet PC, other devices may be used as long as they are information processing devices capable of connecting to the network 70 using Wi-Fi communication or the like. The user terminal 20 includes an operation panel 201, a camera 204, an NFC communication unit 205, a Bluetooth (registered trademark) communication unit 206, a CPU 207, a ROM 208, a RAM 209, an HDD 210, and a wireless LAN communication unit.

[0023] The CPU 207 reads out the control program stored in the ROM 208 and executes various processes for controlling the operation of the user terminal 20. The ROM 208 stores the above control program. The RAM 209 is used as a temporary storage area such as the main memory and work area of the CPU 207. The HDD 210 stores various data such as photos and electronic documents.

[0024] The operation panel 201 has a touch panel function capable of detecting a user's touch operation, and displays various screens provided by the OS and the email sending application. Also, the operation panel 201 is used to check information stored in the generation AI server 30. The user can input a desired operation instruction to the user terminal 20 by inputting a touch operation to the operation panel 201. Note that the user terminal 20 is provided with a hardware key (not shown), and the user can also input an operation instruction to the user terminal 20 using this hardware key.

[0025] The camera 204 captures an image in response to a user's imaging instruction. The photo captured by the camera 204 is stored in a predetermined area of the HDD 210. It is also possible to obtain information from the QR code read by the camera 204 using a program capable of QR code (registered trademark) analysis.

[0026] The user terminal 20 can exchange data with various peripheral devices via the NFC communication unit 205, the Bluetooth communication unit 206, and the wireless LAN communication unit 211. The Bluetooth communication unit 206 of the user terminal 20 may support Bluetooth Low Energy (BLE).

[0027] <Hardware Configuration of Generation AI Server> With reference to FIG. 4, an example of the hardware configuration of the generation AI server 30 according to the present embodiment will be described. The generation AI server 30 includes a CPU 301, a ROM 302, a RAM 303, a communication unit 304, and an HDD 305.

[0028] The CPU 301 executes processing for controlling an operation of generating an appropriate response using a control program stored in the ROM 302 and a learning model stored in the HDD 305. The ROM 302 stores the above control program. The RAM 303 is used as a temporary storage area such as the main memory and work area of the CPU 301. The HDD 305 stores various data such as a learning model and a generation AI application.

[0029] Data can be exchanged with various devices such as the user terminal 20, the MFP 10, and the extended application server 40 via the communication unit 304. Note that the communication unit 304 may perform wired communication using Ethernet (registered trademark), or may perform wireless communication such as Wi-Fi.

[0030] <Hardware Configuration of Extended Application Server> FIG. 5 is a diagram showing an example of the hardware configuration of the extended application server 40. The extended application server 40 includes a CPU 401, a ROM 402, a RAM 403, a communication unit 404, and an HDD 405.

[0031] The CPU 401 reads out the control program stored in the ROM 402 and executes processing according to the message received from the generation AI server 30. The ROM 402 stores the above control program. The RAM 403 is used as a temporary storage area such as the main memory and work area of the CPU 401. The HDD 405 stores the message content received from the generation AI server 30 and a part thereof. Data can be transmitted and received to and from various models such as the generation AI server 30 via the communication unit 404.

[0032] <Hardware Configuration of Cloud Print Server> FIG. 6 is a diagram showing an example of the hardware configuration of the cloud print server 50. The cloud print server 50 includes a CPU 501, a ROM 502, a RAM 503, a communication unit 504, and an HDD 505.

[0033] The CPU 501 reads out the control program stored in the ROM 502 to enable reception of a print job from the user terminal 20 and acquisition of the stored print job. The ROM 502 stores the above control program. The RAM 503 is used as a temporary storage area such as the main memory and work area of the CPU 501. The HDD 505 stores print jobs received from the user terminal 20 and the like. Data can be transmitted and received to and from various models such as the generation AI server 30 via the communication unit 504.

[0034] <Printing Instruction> Referring to FIG. 7, the interaction between the user terminal 20 and the generative AI server 30 when instructing the generative AI server 30 according to this embodiment to perform printing will be described. FIG. 7 shows an example of a screen for the interaction when performing a printing instruction. The screen 600 is displayed on the operation panel 201 by accessing the generative AI server 30 from a browser operating on the user terminal 20.

[0035] The prompt input field 601 is an input field for the user to input an instruction text (prompt) for the generative AI server 30. The user inputs in the form of natural language text from the operation panel 201 of the user terminal 20. The voice recognition result by voice input may be treated as text input. The send button 602 is a button that serves as a trigger for sending the prompt input in the prompt input field 601 to the generative AI server 30.

[0036] The print request prompt 603 is an example of a prompt for instructing the generative AI server 30 to perform printing. It is necessary to include the guidelines for the text to be generated by the generative AI server 30 and the instruction to print it. The response 604 is a response to the print request prompt 603 for the generative AI server 30 to inquire the user about the cloud print ID generated in cooperation with the extended application server 40. In the example of FIG. 7, it shows a state where a cloud print ID of "4567" is returned as a response from the user.

[0037] The Cloud Print ID indicates the authentication information related to the user when using a printer managed on the cloud. Here, an example of querying the Cloud Print ID has been described, but it is not intended to limit the present invention. Any information that can identify the user and is managed by the Cloud Print Server 50 is acceptable. That is, any information may be used as long as it is effective for identifying the MFP that the user uses via the Cloud Print Server 50. Also, information such as the Cloud Print ID may be assigned to each user or to a group.

[0038] In the Cloud Print Server 50, for each Cloud Print ID, for example, the authority for the scope of receiving cloud services, usage history, etc. are managed. Subsequently, the interactive exchanges between the user and the Generative AI Server 30 will be arranged in chronological order as a combination of prompts and responses.

[0039] The Generative AI Server 30 analyzes the message content from the User Terminal 20 and returns an appropriate response. If the message content can be used to create a response only by the Generative AI Server 30, a response is created and displayed in the Response 604. If it is determined from the message content that the message should be processed by the Extended Application Server 40, a processing request is executed to the Extended Application Server 40. Further, a response to the User Terminal 20 is created from the response content from the Extended Application Server 40.

[0040] For example, if the keyword "print" is included in the message from the User Terminal 20, the extended application server related to printing is selected and the processing request is executed. By doing so, printing processing on the MFP 10 that cannot be achieved by the Generative AI Server 30 alone becomes possible. Note that the Generative AI Server 30 and the Extended Application Server 40 may be provided integrally, and in that case, the processing of the Extended Application Server 40 may be configured to operate as one module.

[0041] In this embodiment, an example is shown from when a message for printing is input in the prompt input field 601 of the user terminal 20 until printing is executed by the MFP 10 after an interaction with the generation AI server 30 is performed. Details of the processing will be described later with reference to FIG. 8. The response 605 indicates a response to a print request including the settings for the upcoming printing and the preview image 606. The user can check the print settings and the preview image 606 and, if they wish to change the settings, can do so by instructing the prompt input field 601.

[0042] <Sequence> Referring to FIG. 8, the sequence between each device in the printing system from when the user according to this embodiment instructs the generation AI server 30 to print until the print job is actually input to the MFP 10 will be described. In the sequence described below, when the generation AI server 30 and the extended application server 40 are integrally provided, the control of the two devices is integrated.

[0043] In S701, the user terminal 20 transmits the content of the print request prompt 603 to the generation AI server 30 according to a user operation via the browser. Subsequently, in S702, the generation AI server 30 generates the text (text data) to be printed, and in S703, it transmits a request to acquire the MFP to the extended application server 40. At this time, the generation AI server 30 also transmits the text data generated in S702 and the login ID to the generation AI server 30.

[0044] Next, at S704, the extended application server 40 generates and saves a JobID. The JobID is unique identification information for managing various data to be handled in the future by associating them. Further, the extended application server 40 converts the text data received from the generation AI server 30 into a format (e.g., PDF) that can be accepted by the cloud print server 50. This process may be skipped if the cloud print server 50 can accept the text data. Thereafter, the extended application server 40 saves the default print settings as the current print settings. Subsequently, the extended application server 40 checks whether the cloud print ID saved in association with the login ID to the generation AI server 30 is saved. If it is saved, the processes from S705 to S708 may be skipped.

[0045] At S705, the extended application server 40 makes a request to the generation AI server 30 to obtain a cloud print ID. Thereafter, the message exchange between the generation AI server 30 and the extended application server 40 includes the JobID to clarify the exchange for which job. At S706, the generation AI server 30 returns a request for input of the cloud print ID to the user terminal 20 as a response to S701.

[0046] At S707, the user terminal 20 accepts the input of the cloud print ID (in the example of FIG. 7, "4567") to the prompt input field 601 according to a user operation via the browser and transmits it to the generation AI server 30. At S708, the generation AI server 30 transmits the cloud print ID received at S707 to the extended application server 40. At S709, the extended application server 40 associates and saves the login ID to the generation AI server 30 received at S703 and the cloud print ID received at S708. At S710, the extended application server 40 transmits an MFP acquisition request to the cloud print server 50 together with the cloud print ID.

[0047] In S711, the cloud print server 50 transmits MFP information with a usage history of the cloud print ID received in S710 to the extended application server 40. Here, the MFP information is device information related to available image forming apparatuses including the name of the MFP, usage history, and the like. Note that the present invention is not intended to be limited, and the MFP information may include information for identifying a predetermined MFP. Further, the MFP information transmitted here includes information corresponding to one or more MFPs. That is, in S711, the cloud print server 50 operates to provide device information (MFP information) associated with authentication information (cloud print ID) related to the user.

[0048] In S712, the extended application server 40 selects an MFP for printing from the MFP information received in S711. The processing in the case where there are a plurality of selection candidates will be described later with reference to FIG. 10. In S713, the extended application server 40 transmits the MFP information selected in S712 to the generation AI server 30.

[0049] In S714, the generation AI server 30 creates a response message from the MFP information received in S713. In S715, the generation AI server 30 returns, as a response to S707, a message prompting a selection response of the MFP for executing printing created in S714 to the user terminal 20. The message corresponds to "Is it okay with MFPA?" in the example of FIG. 7, and asks the user whether there is any problem with executing printing with the name "MFPA" of the selected MFP.

[0050] In S716, the user terminal 20 receives an input indicating that there is no problem with the MFP in S715 in the prompt input field 601 according to a user operation via the browser, and transmits it to the generation AI server 30. In S717, the generation AI server 30 transmits a message indicating that there is no problem with the response in S716 to the extended application server 40. In S718, the extended application server 40 transmits a print preview image creation request to the cloud print server 50. At this time, the extended application server 40 transmits the converted data generated in S704 and the current print settings.

[0051] At S719, the cloud print server 50 creates a preview image 606 that is an image of the output. At S720, the cloud print server 50 transmits the preview image 606 created at S719 to the extended application server 40. At S721, the extended application server 40 transmits the preview image received at S720 and the print settings to the generation AI server 30. At S722, the generation AI server 30 creates a response message from the preview image and the print settings received at S721. At S723, the generation AI server 30 returns, as a response to S716, a response (message) 605 that checks whether there is any problem with the printed matter created at S722 to the user terminal 20 as information to be presented to the user. As described above, the response 605 includes the preview image 606 created at S719. The user terminal 20 presents the information to the user via a browser according to the received information.

[0052] At S724, the user terminal 20 accepts an input indicating that there is no problem in the content of S723 in the prompt input field 601 according to a user operation via the browser and transmits it to the generation AI server 30. The processing when changing the print settings will be described later with reference to FIGS. 9 and 10. At S725, the generation AI server 30 transmits a message indicating that there is no problem in response to S724 to the extended application server 40. At S726, the extended application server 40 makes a print request to the cloud print server 50. At this time, the extended application server 40 transmits the converted data generated at S704, the current print settings, and information on the MFP that executes printing to the cloud print server 50.

[0053] At S727, the cloud print server 50 creates a print job for executing printing on the MFP from the print settings and the print document received at S726. At S728, the cloud print server 50 inputs the print job created at S727 to the MFP that executes the printing received at S726. The input of the print job may be to transmit print data from the cloud print server 50 to the target MFP for printing on the MFP, or the configuration may be such that the MFP is notified that the print job has been input and the MFP goes to retrieve the print data from the cloud print server 50.

[0054] At S729, the cloud print server 50 transmits to the extended application server 40 that the input of the print job to the MFP has been completed. At S730, the extended application server 40 transmits to the generation AI server 30 that the input of the print job to the MFP has been completed. At S731, the generation AI server 30 returns to the user terminal 20 that the input of the print job to the MFP has been completed as a response to S724. On the user terminal 20, a message "Printing has been executed." is displayed as a response. At S732, the MFP 10 executes the printing of the print job received at S728. In this embodiment, the MFP automatically executes the job based on receiving the print job, but the print job may also be executed based on receiving an execution instruction from the user after receiving the print job.

[0055] <Change of Print Settings> Referring to FIG. 9, an example of the interaction between the user and the generation AI server 30 when instructing the generation AI server 30 to print when changing the print settings according to this embodiment will be described. Here, the description of the same parts as in FIG. 7 is omitted. The screen 900 is displayed on the operation panel 201 by accessing the generation AI server 30 from a browser operating on the user terminal 20.

[0056] The MFP selection response 801 is a response when, in response to the prompt "usual MFP" of 603, the generative AI server 30 cooperates with the extended application server 40 to search for MFPs and multiple candidates are found. When multiple candidates are found, a response is generated to prompt the user terminal 20 to make a selection. The response 801 shows the response when two candidates, "MFPA" and "MFPB", are found. The MFP selection prompt 802 is a prompt for the user to select an MFP.

[0057] The print setting change prompt 803 is an example of a prompt for the user to instruct the generative AI server 30 to make a setting change when the user wants to change the print settings confirmed in the print request response 605. In this embodiment, the instruction is to change the number of copies to 2, but instructions for changing other settings (such as changing the paper size or changing the layout to 2in1) may also be used. Also, instructions for changing multiple settings may be included.

[0058] The print setting change response 804 is a response to the print setting change prompt 803 generated by the generative AI server 30 in cooperation with the extended application server 40. The basic content is the same as the print request response 605, but the changed content instructed in the print settings is reflected and the print job is updated. Also, when settings such as the color mode or layout that change the preview image are changed, the preview image 606 is also replaced accordingly.

[0059] <Processing procedure of the extended application server> Referring to FIG. 10, the processing procedure of the extended application server 40 according to the present embodiment will be described. The processing described below is realized, for example, by the CPU 401 reading the program stored in the ROM 402 into the RAM 403 and executing it. Further, the following processing is realized by executing a plugin that expands the function of the generation AI server 30. In the present embodiment, the plugin (program) is described as being managed and executed by the extended application server 40, but there is no intention of limiting the present invention. For example, the plugin managed by the extended application server 40 may be installed in the generation AI server 30 and executed by the generation AI server 30. Alternatively, the generation AI server 30 and the extended application server 40 may be integrally provided. In that case, the integrated server will control the management, installation, and execution of the plugin.

[0060] In S901, the CPU 401 determines whether it has received an MFP acquisition request from the generation AI server 30. Here, the MFP acquisition request includes, for example, text data and login ID data for the generation AI server 30. If the MFP acquisition request is received, the process proceeds to S902; otherwise, the determination in S901 is repeated.

[0061] In S902, the CPU 401 generates a JobID. In S903, the CPU 401 converts the text data received in S901 into a data format for a print document acceptable by the cloud print server 50. In S904, the CPU 401 determines whether the cloud print ID associated with the login ID for the generation AI server 30 received in S901 is stored in the HDD 405. If it is stored, the process proceeds to S908; if not, the process proceeds to S905.

[0062] At S905, the CPU 401 sends a cloud print ID request to the generative AI server 30. At S906, the CPU 401 determines whether there is a response of the cloud print ID from the generative AI server 30. If there is a response, it proceeds to S907; otherwise, the determination at S907 is repeated. At S907, the CPU 401 associates the login ID to the generative AI server 30 received from the generative AI server 30 with the cloud print ID and stores it in the HDD 405, and proceeds to S908.

[0063] At S908, the CPU 401 sends an MFP acquisition request to the cloud print server 50. The MFP acquisition request includes at least the cloud print ID. At S909, the CPU 401 determines whether there is a response of MFP information (device information related to available image forming apparatuses) from the cloud print server 50. If there is a response, it proceeds to S910; otherwise, the determination at S909 is repeated.

[0064] At S910, the CPU 401 selects the MFP to send to the generative AI server 30. Here, when there is a plurality of MFP information, it is determined which MFP to use from the usage history. For example, the one with the most usage times or the one used most recently is selected. At S911, the CPU 401 determines whether there is one candidate for the MFP. For example, when there are a plurality of MFPs with the same usage history, it is determined that there are a plurality of candidates. If it is determined that there is one, it proceeds to S912; if it is determined that there are a plurality, it proceeds to S913.

[0065] At S912, the CPU 401 sends the MFP information corresponding to the MFP to be used to the generative AI server 30 and proceeds to S914. On the other hand, at S913, the CPU 401 makes a request to send the response 801 of the MFP selection to the generative AI server 30 and proceeds to S914. At S914, the CPU 401 determines whether it has received a response to the MFP selection from the generative AI server 30. If it has received it, it proceeds to S915; otherwise, the determination at S914 is repeated.

[0066] At S915, the CPU 401 sends a preview image creation request (including the print document and print settings) to the cloud print server 50. At S916, the CPU 401 determines whether it has received a preview image from the cloud print server 50. If it determines that it has received it, it proceeds to S917; otherwise, it repeats the determination at S916.

[0067] At S917, the CPU 401 sends the preview image received at S916 and the print settings to the generation AI server 30. At S918, the CPU 401 determines whether a setting change has been made by the print setting change prompt 803 from the generation AI server 30. If it determines that a setting change has been made, it proceeds to S919; if it determines that there is no setting change, it proceeds to S920.

[0068] At S919, the CPU 401 changes the settings according to the content of the setting change request received at S918, saves them to the HDD 405, and returns the process to S915. On the other hand, at S920, the CPU 401 determines whether it has received a response from the generation AI server 30 indicating that there is no problem with the print settings. If it determines that there is no problem, it proceeds to S921; otherwise, it repeats the determination at S918. At S921, the CPU 401 sends a print request (including the print document, print settings, and MFP information) to the cloud print server 50 and ends the processing of this flowchart.

[0069] As described above, the computer program (plugin) according to the present embodiment is a computer program that extends the functions of the generative AI service. When this computer program causes the computer of the information processing apparatus to receive a print request via the generative AI service, it functions to acquire authentication information related to the user. Further, this computer program causes the computer to acquire device information related to an available image forming apparatus from a print server using the acquired authentication information related to the user, and to identify an image forming apparatus that executes printing based on the device information. According to the present embodiment, the output from the generative AI can be preferably printed by the image forming apparatus. Further, the user can perform printing on the image forming apparatus only by inputting to the generative AI service.

[0070] The disclosure of this specification includes the following computer program, print control method, and system. (Item 1) A computer program that extends the functions of the generative AI service, the computer of the information processing apparatus When receiving a print request via the generative AI service, a first acquisition means for acquiring authentication information related to the user; A second acquisition means for acquiring device information related to an available image forming apparatus from a print server using the acquired authentication information related to the user; A specifying means for specifying an image forming apparatus that executes printing based on the device information A computer program, characterized in that it functions as such. (Item 2) The specifying means is a computer program according to Item 1, characterized in that, via the generative AI service, an inquiry based on the device information is made to the user to specify an image forming apparatus that executes printing. (Item 3) When the specific means includes information related to a plurality of image forming apparatuses in the apparatus information, the computer program according to item 1 or 2 is characterized in that an inquiry is made to cause the user to select, via the generation AI service, an image forming apparatus that executes printing from among the plurality of image forming apparatuses. (Item 4) The computer of the information processing apparatus is further generation means for generating a print job based on the print request, and presentation means for presenting, to the user, information about the generated print job via the generation AI service and causing it to function, and is the computer program according to any one of items 1 to 3. (Item 5) When the generation means acquires a preview image when the print job is executed from the print server, the presentation means presents, as information about the print job, print settings when the print job is executed and the preview image, and is the computer program according to item 4. (Item 6) The computer of the information processing apparatus is further update means for updating the print job according to the content of the change when a request to change the settings of the print job presented to the user is received via the generation AI service and causing it to function, and is the computer program according to item 4 or 5. (Item 7) The generation means assigns unique identification information when generating the print job, and is the computer program according to any one of items 4 to 6. (Item 8) The generation means converts text data included in the print request received via the generation AI service into a format acceptable by the print server to generate print data, and is the computer program according to any one of items 4 to 7. (Item 9) The generation means sets printing settings determined in advance for the generated print job, and is the computer program according to any one of Items 4 to 8. (Item 10) The generation means sets printing settings for the generated print job based on the text data included in the print request, and is the computer program according to any one of Items 4 to 8. (Item 11) When receiving a print instruction from the user for the information about the print job presented to the user via the generation AI service, the print job is input from the print server to the image forming apparatus, and the print job is executed, and is the computer program according to any one of Items 4 to 10. (Item 12) The computer program is implemented in the information processing apparatus as a plug-in of the generation AI service, and is the computer program according to any one of Items 4 to 11. (Item 13) A print control method, when a first acquisition means receives a print request via a generation AI service provided by an information processing apparatus, a first acquisition step of acquiring authentication information related to a user; a second acquisition means acquires apparatus information related to an available image forming apparatus from a print server using the acquired authentication information related to the user, a second acquisition step; a specifying means specifies an image forming apparatus that executes printing based on the apparatus information, a specifying step and includes the above, and is a print control method. (Item 14) A print system including an information processing apparatus that provides a generation AI service to a user terminal, a print server, and an image forming apparatus, the information processing apparatus, by implementing a computer program that expands the functions of the generation AI service, when receiving a print request via the generation AI service, a first acquisition means for acquiring authentication information related to a user; Second acquisition means for acquiring device information related to an available image forming apparatus from a print server using the acquired authentication information related to the user; Specification means for specifying an image forming apparatus that executes printing based on the device information; Functioning as; The print server; Providing means for providing the device information associated with the authentication information related to the user; Execution means for inputting a print job based on the print request to the specified image forming apparatus when printing is instructed via the generation AI service; A printing system, characterized by comprising: (Item 15) The printing system according to item 14, characterized in that the print server is a cloud print server.

[0071] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and causing one or more processors in a computer of the system or apparatus to read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0072] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Therefore, claims are attached to disclose the scope of the invention.

Explanation of reference numerals

[0073] 10: MFP, 20: User terminal, 30: Generation AI server, 40: Extended application server, 50: Cloud print server, 60: Cloud, 70: Network

Claims

1. A computer program for expanding the functions of a generation AI service, which causes a computer of an information processing apparatus to, when receiving a print request via the generation AI service, a first acquisition means for acquiring authentication information related to a user; a second acquisition means for acquiring device information related to an available image forming apparatus from a print server using the acquired authentication information related to the user; a specifying means for specifying an image forming apparatus that executes printing based on the device information and characterized in that it functions as.

2. The specifying means according to claim 1, wherein, via the generation AI service, an inquiry based on the device information is made to the user to specify an image forming apparatus that executes printing.

3. The specifying means according to claim 2, wherein, when the device information includes information related to a plurality of image forming apparatuses, an inquiry is made to the user via the generation AI service to select an image forming apparatus that executes printing from among the plurality of image forming apparatuses.

4. The computer of the information processing apparatus further a generation means for generating a print job based on the print request; a presenting means for presenting information related to the generated print job to the user via the generation AI service and characterized in that it functions as.

5. The generation means acquires a preview image when the print job is executed from the print server, The presenting means according to claim 4, wherein, as information related to the print job, the print settings when the print job is executed and the preview image are presented.

6. The computer of the information processing apparatus further an update means for updating the print job according to the change content when receiving a request to change the settings of the print job presented to the user via the generation AI service and characterized in that it functions as.

7. The generation means according to claim 4, wherein unique identification information is assigned when generating the print job.

8. The computer program according to claim 7, wherein the generation means generates print data by converting the text data included in the print request received via the generation AI service into a format acceptable by the print server.

9. The computer program according to claim 8, wherein the generation means sets predetermined print settings in the generated print job.

10. The computer program according to claim 8, wherein the generation means sets print settings in the generated print job based on the text data included in the print request.

11. When receiving a print instruction from the user for the information on the print job presented to the user via the generation AI service, the computer program according to claim 4 causes the print server to submit the print job to an image forming apparatus, and the print job is executed.

12. The computer program according to claim 4, wherein the computer program is installed in the information processing apparatus as a plug-in of the generation AI service.

13. A print control method, comprising: a first acquisition step of acquiring authentication information related to a user when a first acquisition means receives a print request via a generation AI service provided by an information processing apparatus; a second acquisition step of acquiring apparatus information related to an available image forming apparatus from a print server using the acquired authentication information related to the user by a second acquisition means; and a specifying step of specifying an image forming apparatus for executing printing based on the apparatus information by a specifying means characterized by including the above steps.

14. A print system including an information processing apparatus that provides a generation AI service to a user terminal, a print server, and an image forming apparatus, wherein the information processing apparatus functions as a first acquisition means for acquiring authentication information related to a user when receiving a print request via the generation AI service by implementing a computer program for expanding the function of the generation AI service; a second acquisition means for acquiring apparatus information related to an available image forming apparatus from a print server using the acquired authentication information related to the user; and a specifying means for specifying an image forming apparatus for executing printing based on the apparatus information and the print server is Providing means for providing the device information associated with the authentication information related to the user; Execution means for, when printing is instructed via the generation AI service, inputting a print job based on the print request to a specified image forming apparatus; A printing system, characterized by comprising the above.

15. The printing system according to claim 14, characterized in that the print server is a cloud print server.

Images