Program, control method of information processing device and information processing device

Abstract

To provide a program for reducing the time and effort required for print settings when issuing print instructions in a chat format.SOLUTION: Provided is a program for controlling an information processing device, and the program causes a computer of the information processing device to execute: a receiving step of receiving print instructions using a chat function; an acquisition step of acquiring print settings registered by a printer driver provided in the information processing device; and a printing step of causing a printing device to print using the print settings according to the print instructions.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present invention relates to a program, a control method for an information processing device, and an information processing device. [Background technology]

[0002] Patent Document 1 discloses an information processing system that uses a software robot (bot) to print documents stored on a cloud server in response to a print instruction from a user in chat format. Furthermore, a technology is disclosed in which the bot inquires about print settings from the user via chat, and the print settings are determined based on the user's responses. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2018-128843 Summary of the Invention [Problem to be solved by the invention]

[0004] One use case being considered is one in which software (or applications) that creates or modifies documents works in conjunction with AI (Artificial Intelligence) to print documents based on print instructions given by users via chat.

[0005] Typically, users can set and register frequently used print settings in a printer driver. However, the technology described in Patent Document 1 does not use the print settings set in the printer driver, so the user cannot use the pre-registered print settings when issuing a print instruction in chat format. In other words, even though the user has registered print settings in the printer driver, they cannot use them and must set the print settings in chat format when issuing a print instruction, which is time-consuming.

[0006] The present invention has been made in consideration of the above-mentioned problems, and aims to reduce the effort required for print settings when issuing print instructions in chat format. [Means for solving the problem]

[0007] The program of the present invention is a program for controlling an information processing device, and is characterized in that it causes a computer of the information processing device to execute an acceptance procedure for accepting a print instruction using a chat function, an acquisition procedure for acquiring print settings registered in a printer driver possessed by the information processing device, and a print procedure for causing a printing device to print using the print settings in accordance with the print instruction. [Effects of the Invention]

[0008] This reduces the time and effort required for print settings when giving print instructions in chat format. [Brief explanation of the drawings]

[0009] [Figure 1] System configuration diagram [Figure 2] FIG. 1 is a diagram illustrating a hardware configuration of an image forming apparatus. [Figure 3] A diagram showing the hardware configuration of an information processing terminal. [Figure 4] Diagram showing the hardware configuration of the AI ​​server [Figure 5] Hardware configuration of the extended application server [Figure 6] Cloud Print Server Hardware Configuration [Figure 7] A diagram showing the software configuration of the information processing terminal. [Figure 8] Figure showing the screen when instructing printing from a business application [Figure 9] Figure showing the screen when selecting the printer to use for printing in a business application [Figure 10] Figure showing the screen for setting up print settings in a business application [Figure 11] Sequence diagram in the first embodiment [Figure 12] Flowchart for the extended application server in the first embodiment [Figure 13] Sequence diagram in the second embodiment [Figure 14] Hardware configuration of the job creation server [Figure 15] Sequence diagram in the third embodiment [Figure 16] FIG. 10 is a diagram showing an example of processing performed by the AI ​​server business application plug-in 703 in the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0011] Note that the following embodiments do not limit the invention according to the claims, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0012] First Embodiment A first embodiment of the present invention will be described.

[0013] FIG. 1 is a diagram showing an example of the overall configuration of an AI printing service according to the present invention. AI is an abbreviation for Artificial Intelligence. The AI ​​printing service includes an image forming device 10, which is an example of an image processing device, an information processing terminal 20, which is an example of an information processing device, an AI server 30, an extended application server 40, and a cloud print server 50. Each of these is connected via a network 70 and can communicate with each other. The network 70 is a wireless or wired network configured as a WAN (Wide Area Network) or LAN (Local Area Network).

[0014] The image forming apparatus 10 refers to an image forming apparatus that has a function of printing data such as an image on a print medium, the data being notified by the cloud print server 50. The image forming apparatus 10 is an example of a printing apparatus.

[0015] The information processing terminal 20 refers to an information processing device or information terminal, such as a smartphone, tablet, or personal computer, used by a user of the AI ​​printing service. The user operates the information processing terminal 20 to use a business application, which will be described later. The information processing terminal 20 and the AI ​​server 30 are connected to a wired or wireless communication network, and are capable of sending and receiving data between them. In this embodiment, a public line on the Internet is assumed as an example of a communication network, but a dedicated line may also be used.

[0016] The AI ​​server 30 is a cloud server located on the cloud 60, and provides services in cooperation with the extended application server. The AI ​​server 30 interprets messages sent from the AI ​​server business application plug-in 703 (described later) on the information processing terminal 20, and responds with appropriate answers or instructs the AI ​​server communication business application plug-in to perform business support processing. Furthermore, the AI ​​server 30's functions can be expanded by communicating with the extended application server. Note that messages received by the AI ​​server 30 may be messages entered as characters in a natural language used by humans, and the AI ​​server 30 interprets these messages. The messages received by the AI ​​server 30 are called prompts.

[0017] The extended application server 40 is a cloud server located on the cloud 60, and is a service that provides additional functions to the AI ​​server 30. By working in conjunction with the extended application server 40, the AI ​​server 30 becomes able to perform processes that it could not perform on its own. In this embodiment, this is an extension that enables printing using an image forming device.

[0018] The cloud print server 50 can receive print requests from other information processing devices, generate print jobs, and submit the print jobs to registered image forming devices via the Internet. The cloud print server 50, the AI ​​server 30, and the business application 702 and business application plug-in 703 for the AI ​​server (described later) can cooperate with each other using user account information.

[0019] FIG. 2 is a diagram illustrating an example of the hardware configuration of the image forming apparatus 10. As shown in FIG.

[0020] A control unit 110 including a CPU (Central Processing Unit) 111 controls the overall operation of the image forming apparatus 10. The CPU 111 reads a control program stored in a ROM 112 or an HDD 114 into a RAM (Random Access Memory) 113 and performs various controls such as reading control and printing control.

[0021] The ROM (Read Only Memory) 112 stores control programs executable by the CPU 111. The ROM 112 also stores a boot program, font data, and the like. The RAM 113 is a main memory, and is used as a work area and a temporary storage area for expanding the various control programs stored in the ROM 112 and the HDD 114. The HDD (Hard Disk Drive) 114 stores image data, print data, various programs, various addresses, and various setting information. The HDD 114 is a storage medium, and may not be an HDD, but may be an SSD (Solid State Drive), eMMC (Embedded Multi Media Card), or the like.

[0022] In the image forming apparatus 10 of this embodiment, one CPU 111 executes each process shown in the flowcharts described below using one memory (RAM 113), but this is not limited to this. For example, each process can be executed by multiple CPUs, RAMs, ROMs, and HDDs working together. Also, some processes can be executed using hardware circuits such as ASICs and FPGAs.

[0023] The operation unit I / F 115 connects the control unit 110 to an operation unit 116 including a display unit such as a touch panel and hard keys. The operation unit 116 displays information to the user and detects inputs from the user.

[0024] The reading unit I / F 117 connects the reading unit 118 and the control unit 110. The reading unit 118 reads an image of a document, and the CPU 111 converts the image into image data such as binary data. The image data generated based on the image read by the reading unit 118 is transmitted to an external device or printed on a printing medium.

[0025] The printing unit I / F 119 connects the printing unit 120 and the control unit 110. The CPU 111 transfers image data (print data) stored in the RAM 113 to the printing unit 120 via the printing unit I / F 119. The printing unit 120 prints an image based on the transferred image data on a print medium fed from a paper feed cassette.

[0026] The wireless communication unit I / F 121 is an I / F for controlling the wireless communication unit 122, and connects the control unit 110 to external wireless devices via wireless communication.

[0027] The FAX unit I / F 123 is connected to the public line network 80 by controlling the FAX communication unit 124. The FAX unit I / F is an I / F for controlling the FAX communication unit 124, and by controlling the modem and NCU for facsimile communication, it is possible to connect to the public line network, control the facsimile communication protocol, and the like.

[0028] The communication unit I / F 125 connects the control unit 110 to the network 70. The communication unit I / F 125 allows the communication unit 126 to send image data and various internal device information to external devices on the network 70, and to receive print data, print instructions, information on the network 70, and the like from external devices on the network 70. Methods for sending and receiving data via the network 70 include sending and receiving using electronic mail (E-mail) and sending files using other protocols (e.g., FTP, SMB, WEBDAV, etc.). In addition, image data and message data can be sent and received over the network 70 by accessing via HTTP communication from the information processing terminal 20 or a cloud server on the cloud 60.

[0029] Furthermore, it is possible to access the image forming apparatus 10 from a web browser on the information processing terminal 20 via a network and perform various settings of the image forming apparatus 10 (remote UI function).

[0030] 3 is a diagram showing an example of the hardware configuration of the information processing terminal 20. Note that although the information processing terminal 20 of this embodiment is assumed to be a device such as a PC, it may be any other device as long as it is an information processing device on which the business application 702 can be installed and which can be connected to the network 70.

[0031] The CPU 207 reads out a control program stored in the ROM 208 and executes various processes for controlling the operation of the information processing terminal 20 .

[0032] The ROM 208 stores a control program.

[0033] The RAM 209 is used as a temporary storage area such as a main memory or work area for the CPU 207 .

[0034] The HDD 210 stores various data such as photographs, electronic documents, etc. The data referred to here includes data edited by the business application 702, data saved by the business application 702 (print data), and the like.

[0035] The operation panel 201 has a touch panel function that can detect touch operations by the user, and displays various screens provided by the OS and email sending applications. The operation panel 201 is also used to check information stored in the AI ​​server 30. The user can input desired operation instructions to the information processing terminal 20 by inputting touch operations on the operation panel 201. The information processing terminal 20 is equipped with hardware keys (not shown), and the user can input operation instructions to the information processing terminal 20 using these hardware keys.

[0036] Camera 204 takes an image in response to an image capture instruction from the user. The photograph taken by camera 204 is stored in a predetermined area of ​​HDD 210. It is also possible to obtain information from a QR code read by camera 204 using a program capable of analyzing QR codes (registered trademark).

[0037] The information processing terminal 20 can exchange data with various peripheral devices via the NFC communication unit 205, the Bluetooth (registered trademark) communication unit 206, and the network communication unit 211. The Bluetooth communication unit 206 of the information processing terminal 20 may be compatible with Bluetooth Low Energy.

[0038] FIG. 4 illustrates an example of the hardware configuration of the AI ​​server 30. The CPU 301 executes processing to control operations for generating appropriate responses using a control program stored in the ROM 302 and a learning model stored in the HDD 305. The ROM 302 stores the control program. The RAM 303 is used as a temporary storage area such as the CPU 301's main memory and work area. The HDD 305 stores various data such as learning models and AI applications. Data can be exchanged with various devices such as the information processing terminal 20, the image forming apparatus 10, and the extended application server 40 via the communication unit 304. The communication unit 304 may perform wired communication using Ethernet (registered trademark) or wireless communication such as Wi-Fi.

[0039] Figure 5 shows an example of the hardware configuration of the extended application server 40. The CPU 401 reads out the control program stored in the ROM 402 and executes processing according to messages received from the AI ​​server 30. The ROM 402 stores the control program. The RAM 403 is used as a temporary storage area such as the main memory and work area of ​​the CPU 401. The HDD 405 stores the contents of messages received from the AI ​​server 30 or parts of them. Data can be sent and received with various models such as the AI ​​server 30 via the communication unit 404.

[0040] FIG. 6 is a diagram showing an example of the hardware configuration of the cloud print server 50. The CPU 501 reads out a control program stored in the ROM 502, enabling it to receive print jobs from the information processing terminal 20 and acquire saved print jobs. The ROM 502 stores the control program. The RAM 503 is used as a temporary storage area such as the main memory and work area of ​​the CPU 501. The HDD 505 stores print jobs received from the information processing terminal 20, etc. Data can be sent and received to and from various models such as the AI ​​server 30 via the communication unit 504.

[0041] 7 is a diagram showing an example of the software configuration of the information processing terminal 20. An OS 701 is an operating system (OS) of the information processing terminal 20. It provides an interface for other applications to use the hardware and network of the information processing terminal 20.

[0042] The business application 702 is software for creating documents used in business, etc. The AI ​​server business application plug-in 703 is attached to the business application 702 and provides an interface with the AI ​​server 30 so that the user can efficiently operate the business application 702 using the AI ​​server 30. In addition, the business application 702 and the AI ​​server business application plug-in 703 can cooperate with the cloud print server 50 by logging in with the user's account information.

[0043] The printer driver 704 is software for controlling the printer from the information processing terminal 20. The printer driver 704 enables other applications on the information processing terminal 20 to use the image forming apparatus 10. For example, the business application 702 can use the printer driver 704 when printing a document it is creating. The printer driver 704 accepts settings such as the number of copies, layout, and single-sided / double-sided printing from the user. The printer driver 704 can accept frequently used values ​​from the user and register them in the HDD 210 as default settings when called up from the business application 702 (at startup). The user can also use the printer driver 704 to register frequently used settings as favorites in the HDD 210, separate from the default settings. Settings registered as favorites can be specified and called up by the user later and used as print setting values ​​for print data.

[0044] 8 shows a screen displayed when a business application 702 instructs the image forming apparatus 10 to print a document opened in the business application 702 using a business application plug-in 703 for the AI ​​server, the AI ​​server 30, and the extended application server 40. Examples of business applications include presentation software for creating presentation materials, a document creation application for creating documents, and an image editing application for editing image data. In this embodiment, presentation software is used as an example of a business application. The business application 702 has a chat function, and a chat area 803 is displayed when the application program for the business application 702 is executed.

[0045] The business application window 800 is the entire window that the business application 702 displays on the operation panel 201 of the information processing terminal 20 .

[0046] The slide editing area 801 is an area for displaying and editing any slide in the document currently open in the business application 702 .

[0047] The slide selection area 802 displays thumbnails of multiple slides included in the document currently open in the business application 702, and by selecting the thumbnail of any slide, the slide displayed in the slide editing area 801 can be switched.

[0048] The chat area 803 is an area for interactive communication between the user and the AI ​​server 30. An AI server business application prompt input section 804 and a prompt send button 805 (described later) are always displayed, and prompts entered by the user and the AI ​​server 30's responses to them are displayed sequentially. The chat area 803 may be displayed from the time the business application 702 is launched, or may be displayed when a specific instruction is entered. The chat area 803 may be displayed alongside the business application 702 in the same window, or may be displayed in a window separate from the business application 702, such as a pop-up window.

[0049] The AI ​​server business application prompt input unit 804 allows the user to input instructions to the AI ​​server 30 by inputting characters in a natural language.

[0050] By pressing the prompt transmission button 805, the instruction entered in the AI ​​server business application prompt input section 804 is sent to the AI ​​server 30.

[0051] The print start prompt 806 is a chat-style message sent to the AI ​​server 30. Specifically, the print start prompt 806 is a prompt (message) displayed when the user inputs "Print this file" into the AI ​​server business application prompt input section 804 and then presses the prompt send button 805. The text displayed as the prompt in the chat area 803 is the exact text entered by the user. The text entered by the user into the AI ​​server business application prompt input section 804 is displayed in the chat area 803 and sent to the AI ​​server 30 in response to pressing the prompt send button 805. Note that the prompt entered by the user is not limited to a print instruction in the form of natural language character input, such as "Print this file," but may also be, for example, a command or keyword instructing printing. Furthermore, the prompt entered by the user may include information on print settings and information specifying a printing device.

[0052] Figure 9 shows a screen in which the display has been changed in accordance with the response returned from the AI ​​server 30 after Figure 8. Explanation of the same parts as in Figure 8 will be omitted.

[0053] The printer selection list box 901 is a list displayed by the AI ​​server business application plug-in 703 as a user-selectable list, based on the results of the business application 702 searching the network 70 for printers that the information processing terminal 20 can use via the OS 701. The printer selection list box 901 is a list box generated when the AI ​​server 30 and the extended application server 40 interpret a user-entered text as an instruction to start printing. The user can select a printer to use for printing from the displayed list box. Furthermore, when any option on the screen is pressed, the selection result is automatically sent to the AI ​​server 30. A confirmation button (not shown) may be provided, and after the user selects a printer, the selection may be confirmed and the selection result sent to the AI ​​server 30 by pressing the confirmation button. Alternatively, after viewing the list, the user may directly enter the printer to use for printing from the printers displayed in the list box into the AI ​​server business application prompt input section 804, and the response may be sent to the AI ​​server 30.

[0054] Fig. 10 shows a screen that has been changed by the user pressing "Printer1 (assumed to be the image forming device 10)" in Fig. 9. Explanations of the same items as in Figs. 8 and 9 will be omitted.

[0055] A printer selection prompt 1001 indicates that the selection result has been sent to the AI ​​server 30 when the user presses "Printer1" from the printer selection list box 901 in FIG.

[0056] The print setting box 1002 is displayed by the AI ​​server business application plug-in 703 to allow the user to specify print settings. This display occurs when the AI ​​server 30 and extended application server 40, having received the printer selection results, return a response requesting print settings. The print setting box 1002 displays the same settings as the printer driver 704 by default. The AI ​​server business application plug-in 703 obtains the print setting values ​​set by the printer driver 704 and registered in the HDD 210, and displays them in the chat area 803.

[0057] A copy number setting box 1003 is a box for setting the number of copies to be printed, and the user can set any number of copies by operating the up and down triangle buttons.

[0058] A layout box 1004 is a box for setting the layout of the printed matter. When the user presses the triangle button, a drop-down list (not shown) is displayed, and the layout can be set by selecting from the displayed list.

[0059] The single-sided / double-sided box 1005 is a box for setting whether the printed material should be printed on one side or both sides. When the user presses the triangle button, a drop-down list (not shown) is displayed, and the user can select from the displayed list to set single-sided or double-sided printing.

[0060] The print button 1006 is a button that is pressed after completing the print settings to instruct printing to the image forming apparatus 10. When the print button 1006 is pressed, the contents of each setting item that is set at the time of pressing the button are sent to the AI ​​server 30.

[0061] Note that these are not the only items that can be displayed and set in the print setting box 1002. Not all of these setting items are required, and there may be other setting items, such as color / monochrome settings and paper size settings.

[0062] Alternatively, the printer selection list box 901 and the print setting box 1002 may be displayed simultaneously. In this case, since the settings of the printer driver 704 differ for each printer, the default values ​​displayed may change each time the printer selected by the user changes.

[0063] FIG. 11 is a sequence diagram showing interactions between system components from when a user issues a print instruction to the AI ​​server business application plug-in 703 until a print job is actually submitted to the image forming apparatus 10.

[0064] In S1101, the CPU 207 of the information processing terminal 20 runs the AI ​​server business application plug-in 703, causing it to send a print start prompt 806 to the AI ​​server 30. This is triggered by the user pressing the prompt send button 805 described above.

[0065] In S1102, the CPU 301 of the AI ​​server 30 interprets the natural language contained in the received print start prompt 806. As a result, the AI ​​server 30 understands that the process requested by the user is printing.

[0066] In S1103, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to send a print request to the extended application server 40. This is because, by pre-registering in the AI ​​server 30 that the role of the extended application server 40 is related to printing, the AI ​​server 30 can mediate the request to the appropriate extended application server 40 in response to the user's request.

[0067] In S1104, the CPU 401 of the extended application server 40 generates a unique ID (hereinafter, "context ID") for identifying the context in subsequent communications and stores it in the HDD 405. This is because other information processing terminals on the network 70 may also make similar print requests. From then on, the unique ID generated here is always added to communications between the AI ​​server business application plug-in 703 and the AI ​​server 30, and between the AI ​​server 30 and the extended application server 40, unless otherwise specified. In this embodiment, the context ID expires after 10 minutes (a longer estimate of the time it will take for a print job to be submitted in the following steps), but this may be changed depending on the situation. The expiration date is not limited to this, and may be any length of time, or may expire when a condition, such as the number of uses, is met.

[0068] In S1105, the CPU 401 of the extended application server 40 causes the communication unit 404 to return a printer search request to the AI ​​server 30 in order to identify the printer used by the user.

[0069] In S1106, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to return a printer search instruction to the AI ​​server business application plug-in 703.

[0070] In S1107, the CPU 207 activates the AI ​​server business application plug-in 703 and instructs the business application 702 to search for a printer.

[0071] In step S1108, the business application 702 operated by the CPU 207 searches the network 70 via the OS 701 for printers that can be used by the information processing terminal 20.

[0072] In S1109, the business application 702 operated by the CPU 207 returns the printer list of the search results to the business application plug-in 703 for the AI ​​server.

[0073] In S1110, the AI ​​server business application plug-in 703 operated by the CPU 207 transmits the printer list to the AI ​​server 30.

[0074] In S1111, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to send the printer list to the extended application server 40.

[0075] In S1112, the extended application server 40 operated by the CPU 401 returns a printer selection request to the AI ​​server 30. The printer selection request includes a printer selection list generated based on the received printer list.

[0076] In S1113, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to return a printer selection instruction to the AI ​​server business application plug-in 703. The printer selection instruction includes a printer selection list.

[0077] In S1114, the AI ​​server business application plug-in 703, operated by the CPU 207, displays the printer selection list box 901 and accepts the user's selection (pressing an option). In other words, by displaying multiple printing devices in the chat area, candidate printing devices for printing are presented.

[0078] In S1115, the AI ​​server business application plug-in 703 operated by the CPU 207 transmits the printer information selected by the user to the AI ​​server 30.

[0079] In S1116, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to send the printer information to the extended application server 40.

[0080] In S1117, the CPU 401 of the extended application server 40 stores the received printer information in the HDD 405 in association with the context ID.

[0081] In S1118, the CPU 401 of the extended application server 40 causes the communication unit 404 to return a driver setting request to the AI ​​server 30.

[0082] In S1119, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to return a driver setting acquisition instruction to the AI ​​server business application plug-in 703.

[0083] In S1120, the AI ​​server business application plug-in 703 operated by the CPU 207 instructs the business application 702 to acquire driver settings.

[0084] In S1121, the business application 702 operated by the CPU 207 requests the printer driver 704 for current driver settings. The current driver setting values ​​are print setting values ​​registered to be displayed as defaults when the printer driver 704 is started. These default values ​​can be any print settings set by the user on a setting screen (not shown). Note that print setting values ​​registered by the user as favorites may be used as the current driver settings instead of the defaults. If the user has registered multiple print setting values ​​as favorites, the print setting value selected by the user in advance from among these multiple print setting values ​​can be used as the default value.

[0085] In step S1122, the printer driver 704 operated by the CPU 207 returns the current driver settings to the business application 702.

[0086] In S1123, the business application 702 operated by the CPU 207 returns the driver settings to the business application plug-in 703 for the AI ​​server.

[0087] In S1124, the AI ​​server business application plug-in 703 operated by the CPU 207 transmits the driver settings to the AI ​​server 30.

[0088] In S1125, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to transmit the driver settings to the extended application server 40.

[0089] In S1126, the extended application server 40 operated by the CPU 207 associates the received driver setting with a context ID and stores it in the HDD 405.

[0090] In S1127, the CPU 401 of the extended application server 40 causes the communication unit 404 to return the file to be printed and a print setting request to the AI ​​server 30. This includes default print settings based on the saved driver settings.

[0091] In S1128, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to return a file and print setting acquisition instruction to the AI ​​server business application plug-in 703. This includes the default print settings.

[0092] In S1129, the AI ​​server business application plug-in 703 operated by the CPU 207 displays the print setting box 1002 described above and accepts the user's print setting operation and print instruction (pressing the print button 1006).

[0093] In S1130, the AI ​​server business application plug-in 703 operated by the CPU 207 transmits the file to be printed (the document currently opened by the business application 702) and print settings to the AI ​​server 30.

[0094] In S1131, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to transmit the file to be printed and the print settings to the extended application server 40.

[0095] In S1132, the CPU 401 of the extended application server 40 generates a print job from the received print target file and print settings.

[0096] In S1133, the CPU 401 of the extended application server 40 causes the communication unit 404 to return a print job submission instruction to the AI ​​server 30. This includes the printer information saved in S1117 and the generated print job.

[0097] In S1134, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to return a print job submission instruction to the AI ​​server business application plug-in 703. The print job submission instruction includes printer information and the print job.

[0098] In S1135, the AI ​​server business application plug-in 703 operated by the CPU 207 identifies the printer (here, the image forming device 10) to which the print job is to be submitted from the printer information received in S1134, and submits the print job.

[0099] 12 is a flowchart of the extended application server 40 in this embodiment. The CPU 401 reads a program stored in the ROM 402 into the RAM 403 and executes it, thereby executing the processing of the flowchart in FIG.

[0100] In S1201, the CPU 401 receives a print request from the AI ​​server 30 (S1103).

[0101] In S1202, the CPU 401 generates a unique context ID and stores it in the HDD 405 (S1104).

[0102] In S1203, the CPU 401 causes the communication unit 404 to send a printer search request to the AI ​​server 30 (S1105).

[0103] In S1204, the CPU 401 receives the printer list from the AI ​​server 30 (S1111).

[0104] In S1205, the CPU 401 determines whether a valid printer is included in the received printer list. If it is included, the process proceeds to S1206. If it is not included, the process proceeds to S1219.

[0105] In S1206, the CPU 401 causes the communication unit 404 to transmit a printer selection request to the AI ​​server 30 (S1112).

[0106] In S1207, the CPU 401 receives printer information from the AI ​​server 30 (S1116).

[0107] In S1208, the CPU 401 determines whether the received printer information is valid. An example of invalid printer information is a printer that is not targeted by the extended application server 40. If the information is valid, the process proceeds to S1209. If the information is invalid, the process proceeds to S1219.

[0108] In S1209, the CPU 401 associates the received printer information with a context ID and stores it in the HDD 405 (S1117).

[0109] In S1210, the CPU 401 causes the communication unit 404 to send a driver setting request to the AI ​​server 30 (S1118).

[0110] In S1211, the CPU 401 receives the driver settings from the AI ​​server 30 (S1125).

[0111] In S1212, the CPU 401 determines whether the received driver settings are valid. An example of an invalid setting is a setting for a driver that is not targeted by the extended application server 40. If the setting is valid, the process proceeds to S1213. If the setting is invalid, the process proceeds to S1214.

[0112] In S1213, the CPU 401 associates the received driver settings with a context ID and stores them in the HDD 405 (S1126).

[0113] In S1214, the CPU 401 associates the general-purpose default settings with a context ID and stores them in the HDD 405 (S1126).

[0114] In S1215, the CPU 401 causes the communication unit 404 to transmit the file to be printed and a print setting request to the AI ​​server 30 (S1127). The data transmitted by the CPU 401 in S1215 includes default print settings based on the saved settings.

[0115] In S1216, the CPU 401 receives the file to be printed and the print settings from the AI ​​server 30 (S1131).

[0116] In S1217, the CPU 401 generates a print job from the received file to be printed and the print settings (S1132). If the print job generation is successful, the process proceeds to S1218. If it is unsuccessful, the process proceeds to S1219.

[0117] In S1218, the CPU 401 causes the communication unit 404 to send a print job submission instruction to the AI ​​server 30 (S1133). The print job submission instruction includes the printer information saved in S1209 and the generated print job. After the transmission is complete, the CPU 401 deletes the context ID and all information saved in association with it.

[0118] Step S1219 is an error message transmission process performed by the CPU 401 when a failure occurs anywhere in a series of processes using the same context ID. After the transmission is complete, the CPU 401 deletes the context ID and all information stored in association with it.

[0119] As described above, this embodiment makes it possible to print a file that is open in the business application 702 by issuing a command in natural language and performing a few operations. In addition, in this case, the previous print settings can be automatically carried over.

[0120] 16 is a diagram showing an example of processing performed by the AI ​​server business application plug-in 703 in this embodiment. The CPU 207 reads a program stored in the ROM 208 into the RAM 209 and executes it, thereby executing the processing of the flowchart in FIG.

[0121] In S1601, the CPU 207 detects that the user has pressed the prompt send button 805. The CPU 207 causes the network communication unit 211 to send to the AI ​​server 30 the prompt that was input in the AI ​​server business application prompt input unit 804 at the time the prompt send button 805 was pressed (S1101). In other words, if the prompt input by the user is the print start prompt 806, the user's print instruction is sent to the AI ​​server 30.

[0122] In S1602, the CPU 207 receives a printer search instruction from the AI ​​server 30 (S1106).

[0123] In S1603, the CPU 207 transmits the printer search instruction received in S1602 from the AI ​​server business application plug-in 703 to the business application 702 (S1107).

[0124] In S1604, the business application plug-in 703 for the AI ​​server, which is operated by the CPU 207, receives the printer list from the business application 702 (S1109).

[0125] In S1605, the CPU 207 causes the network communication unit 211 to transmit the printer list received in S1604 to the AI ​​server 30 (S1110).

[0126] In S1606, the CPU 207 receives a printer selection instruction from the AI ​​server 30 (S1113).

[0127] In S1607, the CPU 207 displays the printer selection list box 901 on the operation panel 201 of the information processing terminal 20 and detects the user's selection (pressing an option) (S1114). In other words, by detecting the user's selection, the CPU 207 can accept the printer that the user wants to use for printing. In S1608, the CPU 207 causes the network communication unit 211 to transmit the printer information accepted in S1607 to the AI ​​server 30 (S1115).

[0128] In S1609, the CPU 207 receives a driver setting acquisition instruction from the AI ​​server 30 (S1119).

[0129] In S1610, the CPU 207 transmits the driver setting acquisition instruction received in S1609 from the AI ​​server business application plug-in 703 to the business application 702 (S1120).

[0130] In S1611, the business application plug-in 703 for the AI ​​server, which is operated by the CPU 207, receives the driver settings from the business application 702 (S1123).

[0131] In S1612, the CPU 207 causes the network communication unit 211 to transmit the driver settings received in S1611 to the AI ​​server 30 (S1124).

[0132] In S1613, the CPU 207 receives the file and a print setting acquisition instruction from the AI ​​server 30 (S1128).

[0133] In S1614, the CPU 207 displays the print setting box 1002 on the operation panel 201 of the information processing terminal 20. The CPU 207 detects the user's operation of the print setting box 1002 and the depression of the print button 1006 (S1129). In other words, by detecting the user's operation of the print setting box 1002 and the depression of the print button 1006, the CPU 207 can accept print settings and print instructions from the user.

[0134] In S1615, the CPU 207 causes the network communication unit 211 to transmit the file to be printed (the document currently opened by the business application 702) and the print settings accepted in S1614 to the AI ​​server 30 (S1130).

[0135] In S1616, the CPU 207 receives a print job submission instruction including printer information and a print job from the AI ​​server 30 (S1134).

[0136] In S1617, CPU 207 causes network communication unit 211 to transmit the print job received in S1616 to image forming apparatus 10 (S1135). At this time, CPU 207 transmits the print job to the printer (image forming apparatus 10) corresponding to the printer information received in S1616. When this step is completed, CPU 207 ends this process.

[0137] According to the first embodiment as described above, it is possible to reduce the time and effort required for print settings when issuing print instructions in a chat format.

[0138] <Second embodiment> In recent years, a method of printing using a cloud print server without installing a printer driver on an information processing terminal has become widespread. In the second embodiment, a case where a cloud print server is added to the system configuration of the first embodiment will be described.

[0139] Figure 13 is a sequence diagram based on Figure 11, and is a derived sequence diagram for a configuration including the cloud print server 50. Hereinafter, explanations of parts that are the same as in Figure 11 will be omitted, and only exchanges specific to this embodiment will be explained. Furthermore, unless otherwise specified, secure information that can identify the user based on the user's account information is always added to communications between the AI ​​server business application plug-in 703 and the AI ​​server 30, and communications between the AI ​​server 30 and the cloud print server 50. This allows each information processing device to obtain information linked to the user.

[0140] In S1301, the CPU 301 of the AI ​​server 30 causes the communication unit 304 to send a printer search instruction to the cloud print server 50.

[0141] In S1302, the CPU 501 of the cloud print server 50 causes the communication unit 504 to return a printer list linked to the user to the AI ​​server 30. At this time, the information on each printer includes default print settings.

[0142] In step S1303, the CPU 401 of the extended application server 40 associates the received printer list with a context ID and stores it in the HDD 405.

[0143] In S1304, the CPU 401 of the extended application server 40 saves the default print settings of the printer selected by the user in S1114 in the HDD 405. The default print settings of the printer are acquired from the information in the printer list saved in S1303.

[0144] In S1305, the CPU 401 of the extended application server 40 causes the communication unit 404 to return a cloud print request to the AI ​​server 30. The cloud print request includes printer information, but unlike S1134, does not include a print job; instead, it includes information about the file to be printed and print settings. This is because in the second embodiment, which uses the cloud print server 50, the role of generating the print job is assumed by the cloud print server 50.

[0145] In S1306, the CPU 30 of the AI ​​server 30 causes the communication unit 304 to send a cloud print instruction to the cloud print server 50. The cloud print instruction includes printer information, the file to be printed, and print setting information.

[0146] In S1307, the CPU 501 of the cloud print server 50 generates a print job from the received file to be printed and the print settings.

[0147] In S1308, the CPU 501 of the cloud print server 50 identifies the printer (here, the image forming apparatus 10) to which the print job is to be submitted from the printer information received in S1306, and submits the cloud print job.

[0148] As described above, according to the second embodiment, even when using a cloud print server without installing a printer driver, it is possible to print a file opened in a business application with a natural language instruction and a few operations. In addition, in this case, the default print settings of the printer registered on the cloud print server can be automatically inherited.

[0149] <Third embodiment> In the third embodiment, a case will be described in which the role of print job generation that was played by the extended application server 40 in the first embodiment is played by a job generation server 140 instead of the extended application server 40. In this embodiment, in addition to the overall configuration of the AI ​​print service (FIG. 1), a job generation server 140 (not shown) is included as a component. The job generation server 140 is a server in which the printer-related roles of the extended application server 40 are separated.

[0150] FIG. 14 is a diagram illustrating an example of the hardware configuration of the job generation server 140. The CPU 1401 executes processing for controlling the operation of generating an appropriate response using a control program stored in the ROM 1402 and a learning model stored in the HDD 1405. The ROM 1402 stores the control program. The RAM 1403 is used as a temporary storage area such as the main memory and work area of ​​the CPU 1401. The HDD 1405 stores various data such as the learning model and AI applications. Data can be transmitted and received via a communication unit 1404 to and from various devices such as the information processing terminal 20, the image forming apparatus 10, and the extended application server 40. The communication unit 1404 may perform wired communication using Ethernet or wireless communication such as Wi-Fi.

[0151] Fig. 15 is a sequence diagram based on Fig. 11, and is a derived sequence diagram when the role of print job generation, which was previously performed by the extended application server 40, is separated into a dedicated job generation server 140. Hereinafter, explanations of parts that are the same as in Fig. 11 will be omitted, and only exchanges specific to this embodiment will be explained.

[0152] In step S1501 , the CPU 401 of the extended application server 40 causes the communication unit 404 to send printer information to the job generating server 140 .

[0153] In S1502, the CPU 1401 of the job creation server 140 determines whether the received printer information is valid and causes the communication unit 1404 to return the determination result to the extended application server 40. This is equivalent to transferring the processing that was performed by the extended application server 40 in S1208 to the job creation server 140.

[0154] In S1503, if the received determination result indicates validity, the CPU 401 of the extended application server 40 associates the received printer information with the context ID in S1116 and stores it in the HDD 405. If the received determination result indicates invalidity, the CPU 401 performs the process of S1219 and ends the flow.

[0155] In S1504 , the CPU 401 of the extended application server 40 causes the communication unit 404 to transmit the driver settings to the job generating server 140 .

[0156] In S1505, the CPU 1401 of the job generating server 140 causes the communication unit 1404 to return the result of determining whether the received driver settings are valid to the extended application server 40. This is equivalent to transferring the processing that the extended application server 40 performed in S1212 to the job generating server 140.

[0157] In S1506, if the received determination result indicates validity, the CPU 401 of the extended application server 40 associates the driver settings received in S1125 with the context ID and stores them in the HDD 405. If the received determination result indicates invalidity, the CPU 401 associates general-purpose default settings with the context ID and stores them.

[0158] In S1507 , the CPU 401 of the extended application server 40 causes the communication unit 404 to transmit the file to be printed and the print settings to the job generating server 140 .

[0159] In S1508, the CPU 1401 of the job generating server 140 generates a print job from the received file to be printed and the print settings.

[0160] In S1509, the CPU 1401 of the job generating server 140 causes the communication unit 1404 to return the print job generated in S1508 to the extended application server 40.

[0161] As described above, according to the third embodiment, the extended application server 40 plays an intermediary role between the AI ​​server 30 and the job generating server 140, and specialized printer-related processing can be separated into the job generating server.

[0162] The printer driver described in this specification may also be, for example, a scanner driver, etc. The scanner driver may register scan settings, and when scanning, the CPU may call and display the registered settings for single-sided / double-sided reading and reading resolution, allowing the user to select from the displayed settings to set the scan.

[0163] Note that the combinations of software and servers described in this specification are not limited to these. For example, the business application 702 and the AI ​​server business application plug-in 703 of the information processing terminal 20 do not need to be separate, and the same software may be configured to implement the present invention. Also, for example, the present invention may be implemented in a configuration in which the role performed by the AI ​​server business application plug-in 703 is shared among multiple pieces of software. Similarly, the AI ​​server 30, extended application server 40, and cloud print server 50, which are described separately in this specification, do not need to be separate, and may be configured to implement the present invention on the same server. Furthermore, the combination and number of these servers are arbitrary.

[0164] <Other Examples> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0165] 800 Business Application Window 801 Slide Editing Area 802 Slide Selection Area 803 Chat Area 804 AI server business application prompt input section 805 Prompt Submit Button 901 Printer selection list box 1001 Printer selection prompt 1002 Print Settings Box 1003 Number of copies setting box 1004 Layout Box 1005 Single / Double Sided Box 1006 Print button

Claims

[Claim 1] A program for controlling an information processing device, The computer of the information processing device A procedure for accepting print instructions using a chat function; An acquisition procedure for acquiring print settings registered in a printer driver included in the information processing device; a printing procedure for causing a printing device to perform printing using the print settings in accordance with the print instruction; A program characterized by causing a computer to execute the above.

Images