Computer programs, information processing devices, and systems

Abstract

The present invention provides, for example, a novel mechanism for easily configuring print settings via a generating AI. [Solution] This information processing device accepts natural language regarding print settings, inputs the accepted natural language and the print target into a generating AI to obtain print settings, makes print setting suggestions based on the obtained print settings, and reflects the print settings according to the response to the suggestions.

Description

Technical Field

[0001] [$ The present invention relates to a computer program, an information processing apparatus, and a system for printing a document via a generative AI.

Background Art

[0002] When printing a document, it is also possible to specify and print the part to be printed in the document. For example, for a document that is described in order for a specific theme such as a manual or a thesis, it is also possible to specify and print the procedure to be referred to or the part to be proofread. Also, for a document in which various information is aggregated and published, such as a catalog or various declaration documents, it is also possible to print the page on which the desired information is published. At that time, the user scrolls the page and performs a search within the document on the print preview screen to find the part to be printed and specify it as the print target. Then, settings related to the print format such as paper size and layout are made, and printing is executed. As a result, the part to be printed in the document can be printed with the desired output.

[0003] Recently, generative AIs such as Stable Diffusion (https: / / stability.ai / ), ChatGPT (https: / / chat.openai.com / ), and GAN (adversarial generative algorithm) have attracted attention. In generative AI technology, by setting an image or text as an input image or input prompt and using a generative model, it is possible to obtain products such as characters, images, and videos with a high probability of matching the "context" represented by the set input image or input prompt. The relationship between the input value and the "context" is acquired when the model learns using a large amount of images and texts. Also, it is possible to change the product by changing the initial value that is mainly generated from random numbers during generation.

[0004] Patent Document 1 proposes a technology that eliminates the hassle of printing documents by listing candidate deliverables based on the document to be printed and presenting the user with setting items that are identified by the selection of a deliverable. Here, setting items refer to settings related to the printing format, such as paper size and layout, which are displayed on the print preview screen. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2021-64061 [Overview of the Initiative] [Problems that the invention aims to solve]

[0006] However, the above-mentioned conventional technology has the following drawbacks. For example, with the above-mentioned conventional technology, the deliverable information must be prepared in advance, and the system selects the appropriate deliverable from the prepared list that matches the document to be printed. Also, although the effort involved in setting the print format is eliminated, it was still necessary to manually find and set the parts of the document that one wanted to print.

[0007] The present invention has been made in view of at least one of the above-mentioned problems, and provides, for example, a novel mechanism for easily performing print settings via a generating AI. [Means for solving the problem]

[0008] The present invention is characterized in that, for example, a computer program causes the computer of an information processing device to function as: a receiving means for receiving natural language relating to print settings; an acquiring means for inputting the received natural language and the print target into a generating AI to obtain print settings; a suggesting means for suggesting print settings based on the acquired print settings; and an updating means for updating the print settings in response to the suggestion. [Effects of the Invention]

[0009] According to the present invention, a novel mechanism can be provided that facilitates print settings via a generating AI. [Brief explanation of the drawing]

[0010] [Figure 1] A diagram showing an example configuration of a printing system for document printing according to one embodiment. [Figure 2] A diagram showing an example of the hardware configuration of an image forming apparatus 100 according to one embodiment. [Figure 3] A diagram showing an example of the hardware configuration of a client PC 102 and a server PC 104 according to one embodiment. [Figure 4] A diagram showing an example of a functional block of a printing system according to one embodiment. [Figure 5] A diagram illustrating an example of the generation process. [Figure 6] This figure shows an example of a document printing screen on a client PC 102 according to one embodiment. [Figure 7] A figure showing an example of prompt candidate display in a document printing screen according to one embodiment. [Figure 8] This figure shows an example of a process that reflects the print settings generated by the AI ​​in the document printing screen according to one embodiment. [Figure 9] This figure shows an example of the process for generating prompt candidates in a document printing screen according to one embodiment. [Figure 10] This figure shows an example of a generation AI service that takes device information into account in a document printing screen according to one embodiment. [Figure 11] This figure shows an example of the process for generating print settings that take device information into account in a document printing screen according to one embodiment. [Figure 12] This figure shows an example of a generation AI service that takes conversational style into account in a document printing screen according to one embodiment. [Figure 13] This figure shows an example of the process for generating print settings that take into account the conversation style in a document printing screen according to one embodiment. [Figure 14] A diagram showing an example of a document to be printed according to one embodiment. [Figure 15] A diagram showing an example of a generated printed image according to an embodiment.

Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential for the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0012] <First Embodiment> <System Configuration> Hereinafter, the first embodiment of the present invention will be described. First, the configuration of the printing system according to the present embodiment will be described. The printing system according to the present embodiment is a printing system for an image forming apparatus. In the printing system, a print job is transmitted from an externally connected PC to the image forming apparatus. When generating a print job, an editing operation of print settings is performed on the screen of the PC as necessary.

[0013] FIG. 1 shows an example of the system configuration in the network environment of the printing system according to the present embodiment. This printing system includes image forming apparatuses 100 and 101, a client PC 102, and a server PC 104, and each apparatus is connected so as to be able to communicate with each other via a network 103. The client PC 102 and the server PC 104 are information processing apparatuses having the same computer configuration. The detailed configuration of the information processing apparatus will be described later using FIG. 3.

[0014] The client PC 102 performs rendering processing on the print document to be printed and acquires a print image. Further, the client PC 102 generates, as a print job, the print image with print settings applied thereto, and inputs the print job to the image forming apparatuses 100 and 101. Furthermore, when the client PC 102 performs content analysis of the print document or generates print settings suitable for the print document, the client PC 102 requests the server PC 104 to perform the processing. The server PC 104 is a generation AI server and provides a generation AI service. In the printing system according to the present embodiment, the system includes two image forming apparatuses, but is not limited thereto, and may be one or three or more. The number of client PCs and server PCs is also one, but may be two or more.

[0015] As an example of executing printing, in the present embodiment, a form in which a print job is transmitted from a printing application installed on a PC to the image forming apparatus 100 via a printer driver will be described. For example, a printing application and a printer driver are installed on the client PC 102. The printing application can acquire device information of the image forming apparatus 100 associated from the printer driver, and print parameters such as paper type, paper size, and print quality, and can edit print settings from the acquired parameters. A print job is generated based on the print settings and the print image for which the rendering processing has been completed on the client PC 102, and the print job is input to the image forming apparatus via the spool of the printer driver to execute the printing process.

[0016] In the image forming apparatus, printing is executed based on the print settings of the received print job. Further, the image forming apparatus holds, as device information, configuration information regarding consumables to be handled, status information such as an idle state and a print error. Furthermore, when printing cannot be normally executed due to insufficient remaining amount of consumables, a problem with the image forming apparatus, or an error in the print settings, a warning message is displayed on the main body panel to notify the user of the reason why normal printing cannot be performed.

[0017] <Hardware Configuration of Image Forming Apparatus> Referring to Figure 2, an example of the hardware configuration of the image forming apparatus 100 according to this embodiment will be described. Note that the image forming apparatus 101 has a similar configuration, so its description will be omitted. The image forming apparatus 100 includes a CPU 200, ROM 201, RAM 202, input unit 204, printing unit I / F 205, memory controller 206, printing unit 207, external memory 208, and operation unit 209. Each unit can exchange data with each other via a system bus.

[0018] The image forming apparatus 100 is controlled by the CPU 200. The CPU 200 operates based on control programs stored in the program ROM 201 or in the external memory 208. The CPU 200 outputs image signals as output information to the printing unit (printer engine) 207, which is connected to the printing unit I / F 205 via the system bus 203. The CPU 200 can communicate with the client PC 102 via the input unit 204 and can notify the client PC 102 of information within the image forming apparatus 100. The CPU 200 can also receive output data to be output to the printing unit 207 via the input unit 204.

[0019] RAM 202 functions as the main memory of the CPU 200 and as a work area, and its memory capacity can be expanded by optional RAM connected to an expansion port (not shown). RAM 202 is used for output information expansion area, environmental data storage area, non-volatile memory, etc. External memory 208, such as a hard disk drive (HDD) and IC card, is accessed by the memory controller 206. External memory 208 can be connected as an option and stores information such as font data, emulation programs, form data, consumable levels, output paper type and size information, and main unit status information. The operation unit 209 is equipped with a panel that can display various information.

[0020] <Configuration of the information processing device> Referring to Figure 3, an example of the computer configuration of the client PC 102, which is an information processing device according to this embodiment, will be described. Note that the computer of the server PC 104 has the same configuration as the computer of the client PC 102, so its description will be omitted. The client PC 102 comprises a computer internal 307, a keyboard 308, a display 309, and external memory 310. The computer internal 307 consists of a CPU 300, ROM 301, RAM 302, a keyboard controller 304, a display controller 305, and a disk controller 306. Each part can exchange data with each other via the main bus 303.

[0021] The CPU 300 reads various programs, such as control programs, system programs, and application programs, from the external memory 310 via the disk controller 306 into the RAM 302. The CPU 300 executes the various programs read into the RAM 302 to perform various data processing and control the display of the display 309. The CPU 300 may also read control programs, etc., from the ROM 301. The CPU 300 may also be a dedicated circuit such as an ASIC. The CPU 300 and the dedicated circuit are examples of hardware circuits and hardware processors. The disk controller 306 controls access to the external memory 310, such as an HD, CD-ROM, DVD-ROM, or USB.

[0022] RAM 302 is configured to allow expansion of its capacity with optional RAM (not shown), and is primarily used as the work area for CPU 300. Keyboard controller 304 controls key input from keyboard 308 and pointing device (not shown). Display controller 305 controls the display of display 309. In the embodiments of the present invention, unless otherwise specified, CPU 300 controls each part connected to the main bus 303 via the main bus 303. Server PC 104 may also be equipped with the same configuration as described above. Of course, in server PC 104, components that are not necessarily essential, such as the display 309, do not need to be included in the configuration.

[0023] <Function Block> Referring to Figure 4, an example of the functional blocks of the printing system according to this embodiment will be described. First, the functional blocks in the client PC 102 and server PC 104 will be described.

[0024] The client PC 102 comprises a print document submission unit 401, a print settings unit 402, a prompt input unit 403, a candidate prompt selection unit 404, and a print job transmission unit 405 as functional blocks. The server PC 104 comprises a print document analysis unit 411, a print settings generation unit 412, a generation AI plugin 413, a device information acquisition unit 414, a print settings generation model 415, and a generation AI 416. The print document submission unit 401 accepts print documents. For example, when the print document submission unit 401 receives a print request for a file being edited from an application such as a document editor running on the client PC 102, it accepts the file as a print document. The print settings unit 402 specifies the prompt, which is natural language, and the print document entered into the prompt input unit 403, and requests processing from the print settings generation unit 412 on the server PC 104.

[0025] The print setting generation unit 412 generates print settings using the generation AI plugin 413. The generation AI plugin 413 determines the print setting items related to the input prompt using the print setting generation model 415. The generation AI 416 generates the optimal value for each determined print setting item from the document file. Then, the generated optimal value is interpreted by the print setting generation model 415 and converted into the corresponding value as the print setting value. The device information acquisition unit 414 acquires and stores device information from the image forming apparatus 100. The stored device information is used by the generation AI plugin 413 when proposing print settings that take the device information into consideration. The device information includes, for example, configuration information regarding consumables handled by the corresponding image forming apparatus, and status information such as idle status and print errors.

[0026] Furthermore, the candidate prompt selection unit 404 on the client PC 102 specifies a print document and requests processing from the print document analysis unit 411 on the server PC 104, thereby generating and presenting candidate prompts to be entered into the prompt input unit 403. The print document analysis unit 411 also utilizes the generation AI plugin 413, similar to the print setting generation unit 412, to generate print-related prompts (natural language) from the specified print document.

[0027] The print job transmission unit 405 of the client PC 102 creates a print job and sends the created print job to the image forming apparatus 100. When creating a print job, the print settings obtained from the print setting generation unit 412 of the server PC 104 and the print image after rendering on the client PC 102 are combined.

[0028] Next, the functional blocks within the image forming apparatus 100 will be described. The ROM 201 stores programs and the like that realize the functional blocks, and these programs and the like include a device information holding unit 406, a print job receiving unit 407, and a print execution unit 408 as functional blocks. The print job receiving unit 407 receives print jobs sent from the client PC 102. The print execution unit 408 executes the printing process for the print jobs. The device information holding unit 406 stores information such as the configuration and remaining amount of consumables installed in the image forming apparatus 100, the type and size of output paper, the main unit status information of the image forming apparatus 100, and the status information of print jobs. As described above, this device information is acquired by the device information acquisition unit 414 of the server PC 104.

[0029] <Processing of generated AI> Here, with reference to Figure 5, an example of generative AI processing will be explained. In generative AI technology, as shown in Figure 5, images and text (natural language) are input to the generative model 501 as input images and input prompts 500. The generative model 501 outputs generated products 502 such as characters, images, and videos that have a high probability of fitting the "context" represented by the set input image and input prompt 500. The relationship between the input values ​​and the "context" is acquired when the model learns using a large amount of images and text. Furthermore, it is possible to change the generated products 502 by changing the initial values ​​which are mainly generated from random numbers during generation. In the printing system according to this embodiment, a mechanism is provided to easily perform print settings via such generative AI. This will be explained in detail below.

[0030] <Document Print Screen> Referring to Figure 6, an example of a document printing screen 600 for an image forming apparatus 100, displayed on the display screen 309 of the client PC 102 according to this embodiment, will be described. The document printing screen 600 is an example of a settings screen and consists of a print preview area 601, a print settings area 602, and a generation AI service area 603.

[0031] The print preview area 601 displays the print image resulting from the rendering process of the print document received by the print document submission unit 401. The print settings area 602 corresponds to the first area and displays the settings items that can be set for the print settings unit 402 in an operable manner. For example, in the example in Figure 6, a manual document has been received as a print document, and if the user wants to print only the description of OS A in the manual document, they can find the relevant section and set the corresponding page in the page settings item in the print settings area 602, for example. Also, if they want to print in color, they select color as the color mode.

[0032] The generation AI service area 603 corresponds to a second area for interaction between the user and the generation AI, receiving natural language input information into the prompt input area 604 and inputting it into the prompt input unit 403. The prompt input area 604 is an example of a reception means. Natural language input to the prompt input area 604 may be text input from a keyboard (not shown) or voice input via a microphone (not shown). It is also possible to view the exchange of previously entered prompts and information generated by the print setting generation unit 412 and select whether to reflect the generated information. If the settings are reflected in the generation AI service area 603, the print preview and print setting values ​​displayed in the print preview area 601 and print setting area 602 will be updated. For example, in the example in Figure 6, the natural language input "I want to print the part about OS A" is entered into the prompt input area 604. In response to the input, "Pages 1, 3, and 5 are relevant" is displayed, and a display object is presented that allows the user to select whether or not to reflect (update) the print settings, and the user's response is accepted. If the user selects "Yes," the print preview area 601 will only display pages 1, 3, and 5, and the page setting values ​​in the print settings area 602 will be set to "1, 3, 5." Of course, it is also possible to skip the confirmation step and have the settings automatically reflect the changes.

[0033] In the example in Figure 6, the relevant page is suggested by the generation AI service. However, as in the generation process in Figure 5, an image containing only the OS A-related parts may be generated, and the generated image may be displayed in the print preview area 601. In this case, it is desirable to inform the user that the file name displayed at the bottom of the print preview area 601 is an excerpt from a manual document, such as "manual.pdf (excerpt of only the OS A-related area)". Also, it is assumed that the value of the page setting item in the print settings area 602 is set to "All".

[0034] Specifically, for the document to be printed shown in Figure 14, a print image like the one shown in Figure 15 is generated, and the value of the page setting item is expected to be checked as "All". Figure 14 shows a 4-page manual document. If only the area related to OS A is extracted from such a document, the print image shown in Figure 15 is obtained. Note that the print image of the extracted portion in Figure 15 shows an example of merging portions extracted from multiple pages into one page, but this is not intended to limit the present invention, and portions extracted from different pages may be generated as separate pages.

[0035] Furthermore, even if geometric information that is not a keyword written in the document, such as "I want to extract and print only the graph portion from the page," is entered, the system may extract or generate only the graph from each page and generate a merged print image. The generated print image may be displayed in the print preview area 601.

[0036] To perform printing, the user operates the print execution button 605, which requests the print job transmission unit 405 to create and send a print job for the document displayed in the print preview area 601 and the print settings area 602. The print job transmission unit 405 then creates the print job and sends it to the target image forming apparatus.

[0037] Figure 7 shows a document printing screen 700 displaying an AI service area 710, including a prompt candidate presentation area 701. Prompt candidate presentation, for example, in the document printing screen 600, instead of accepting message input from the user in the generating AI service area 603, is performed by the generating AI predicting and presenting candidate prompts. In the document printing screen 700, display areas similar to those in the document printing screen 600 are given the same reference numerals.

[0038] The prompt candidate display area 701 displays one or more prompts that can be selected. In Figure 7, the prompts "Print only the parts related to OS A" and "Print only the parts related to OS B" are displayed as selectable options. The user can complete prompt input by selecting the desired prompt from the prompt candidates, thus reducing effort. The prompt candidates correspond to the prompt candidates generated by the print document analysis unit 411, which are held in the candidate prompt selection unit 404. In addition, prompts can also be entered in the prompt candidate display area 701, just as in the prompt input area 604. Therefore, the user may select from the presented prompt candidates or enter a prompt themselves.

[0039] <Print Settings Flow> Referring to Figure 8, the processing procedure for reflecting (updating) the print settings generated by the AI ​​generation on the document printing screen 600 according to this embodiment will be explained. The processing described below is realized, for example, by the CPU 300 of the client PC 102 and the server PC 104 reading the program stored in the ROM 301 into the RAM 302 and executing it. On the client PC 102, for example, when input is made to the prompt input area 604 on the document printing screen 600, the processing of this flowchart is started by the print settings unit 402.

[0040] First, in S201, the print settings unit 402 retrieves the print document received by the print document submission unit 401. Next, in S202, the print settings unit 402 determines whether it was able to retrieve the prompt entered in the prompt input unit 403. If the prompt was retrieved (Yes in S202), the process proceeds to S203, where the print settings unit 402 requests the print settings generation unit 412 on the server PC 104 to generate print settings. Here, when requesting the generation of print settings, the print settings unit 402 sends information about the print document and the prompt to the print settings generation unit 412 (server PC 104). On the other hand, if the prompt entered in the prompt input unit 403 could not be retrieved (No in S202), the process of this flowchart ends.

[0041] In S204, the print setting generation unit 412 specifies the received print document and prompt to the generation AI plugin 413. The generation AI plugin 413 determines the print setting items to be generated by the print setting generation model 415. Then, in S205, the generation AI plugin 413 causes the generation AI 416 to generate setting values ​​based on the print document for each determined print setting item, and converts the setting values ​​generated by the print setting generation model 415 into values ​​that can be set for the corresponding print setting item. For example, even if "Color Printing / Booklet Printing" is generated in S204 for a monochrome-only printer, it will be switched to "Monochrome / Stapled" in S205. In another example, even if "Please add a print mode with high print quality and durability" is generated in S204, it will be switched to "Quality = High Quality, Paper Feed = Matte Paper" in S205.

[0042] Subsequently, in S205, the print settings unit 402 of the client PC 102 retrieves the setting values ​​for each print setting item determined in S204 from the print setting generation unit 412 of the server PC 104 and reflects them on the document print screen 600. After that, the processing of this flowchart ends. Of course, the generated print setting values ​​may include not only text but also a group of images containing specified information extracted from the document.

[0043] <Suggestion prompts> Referring to Figure 9, the procedure for generating prompt candidates when displaying the prompt candidate presentation area 701 in Figure 7 within the prompt input area 604 will be explained. The process described below is realized, for example, by the CPU 300 of the client PC 102 and the server PC 104 reading the program stored in ROM 301 into RAM 302 and executing it. The process in this flowchart starts, for example, after the process of S201 described above.

[0044] In S301, the print settings unit 402 requests the candidate prompt selection unit 404 to analyze the print document. The candidate prompt selection unit 404 requests the print document analysis unit 411 of the server PC 104 to analyze the print document using the generated AI plugin 413.

[0045] In S302, the generation AI plugin 413 uses the generation AI 416 to extract candidate prompts for each print setting item. Then, in S303, the generation AI plugin 413 uses the print setting generation model 415 to determine whether the extracted prompts are related to print settings.

[0046] Subsequently, in S304, the candidate prompt selection unit 404 obtains candidate prompts from the print document analysis unit 411 of the server PC 104 and determines whether or not there are candidate prompts related to print settings. If there are candidate prompts related to print settings (Yes in S304), the process proceeds to S305, where the print setting unit 402 displays them in the prompt candidate display area 701, terminates this flowchart, and proceeds to the process in S202. On the other hand, if there are no candidates (No in S304), the process terminates this flowchart without doing anything and proceeds to S202.

[0047] It is conceivable that a user may directly instruct a generation AI service such as Microsoft Copilot (registered trademark) to print without going through the document printing screen 600. In such cases, the generation AI 416 may call the generation AI plugin 413 to generate optimal print settings, and then display the document printing screen 600. The generated print settings are reflected in the print preview and print settings displayed in the print preview area 601 and print settings area 602 when the screen is generated and displayed.

[0048] As described above, the computer program according to this embodiment causes the computer of the information processing device to function as follows. That is, the information processing device receives natural language regarding print settings, inputs the received natural language and the print target to the generating AI to obtain print settings, makes print setting suggestions based on the obtained print settings, and reflects the print settings according to the response to the suggestion. According to this embodiment, even without preparing output information in advance, when a document file is received for printing, print settings corresponding to the document are dynamically generated in response to the natural language regarding print settings, so that the parts to be printed can be set in addition to the print format without any effort. Thus, according to this embodiment, a novel mechanism for easily performing print settings via the generating AI can be provided.

[0049] <Second Embodiment> A second embodiment of the present invention will be described below. In the first embodiment described above, the image forming apparatus 100 generated print setting values ​​for each print setting item it supports based on the document to be printed and the information entered in the prompt input area 604. However, depending on the configuration and remaining amount information of the consumables installed in the image forming apparatus 100, and the type and size information of the output paper, there may be constraints on the setting values ​​for each supported print setting item. For example, although the image forming apparatus supports color printing, if the remaining amount of yellow ink is low, there is a risk that the yellow ink will run out and the printing will fail if all pages are printed in color. In such cases, it becomes necessary to suggest printing in color for parts where color printing is recommended, and in monochrome for parts where it is not recommended.

[0050] <Document Print Screen> Referring to Figure 10, an example of a generation AI service that takes device information into account in the document printing screen 1000 according to this embodiment will be described. In the document printing screen 1000, the same reference numerals are used for display areas that are the same as those in the document printing screen 600.

[0051] The document printing screen 1000 displays the generated AI service area 1010, where the suggestion 1001 is presented. The suggestion 1001, which takes device information into consideration, presents the user with recommended settings based on the information acquired by the device information acquisition unit 414. In the example in Figure 10, because the amount of color ink remaining is low, the suggestion is to print only page 3 in color. This is because page 3 contains display objects, such as graphs and charts, for which color printing is recommended only. The suggestion 1001 also displays selectable display objects for selecting the suggestion and display objects for rejecting the suggestion. Note that if only page 3 is to be printed in color, the print job is divided into three jobs: page 1, page 3, and page 5, as the print settings change for each of the three pages.

[0052] <Print settings that take device information into consideration> Referring to Figure 11, the processing procedure for generating print settings that take device information into account in the document printing screen according to this embodiment will be explained. The process described below is realized, for example, by the CPU 300 of the server PC 104 reading the program stored in ROM 301 into RAM 302 and executing it. This flowchart is executed, for example, after the server PC 104 has processed S204.

[0053] In S401, the device information acquisition unit 414 acquires information held in the device information holding unit 406 from the image forming apparatus 100. Next, in S402, the generation AI plugin 413 determines whether or not there are setting items that affect device information among the print setting items determined in S204. If there are setting items that affect device information (Yes in S402), the process proceeds to S403, where the generation AI plugin 413 adds the device information to the input prompt, terminates the processing of this flowchart, and proceeds to S205. On the other hand, if there are no setting items that affect device information (No in S402), the process of this flowchart is terminated without doing anything, and the process proceeds to S205.

[0054] In the example in Figure 11, a suggestion is made by a generation AI service that takes ink levels into consideration, but this is not intended to limit the present invention. For example, if the user intends to print in color, the suggestion could be, "Please replace the yellow ink to print all pages in color." In this case, if the user replaces the yellow ink, the user is presented with, "The yellow ink has been replaced. Do you want to reflect this in the print settings? Yes. No." Of course, the generation AI service area 1010 could also prompt the user to replace the ink while printing is in progress. Furthermore, if there are many setting items that affect device information in S402, the generation AI service area 1010 could prompt the user to select a different image forming apparatus (an alternative image forming apparatus). In this case, if a different image forming apparatus is actually selected, the flowchart in Figure 8 is executed again.

[0055] <Third Embodiment> The following describes a third embodiment of the present invention. Some generation AI services can produce different results by specifying a conversation style when reading prompts. For example, Microsoft Copilot provides a function to specify prompts to the generation AI service after selecting one of three conversation styles: "more creative," "more balanced," or "more precise." When you want to print only the parts of a document you want to print, use "more precise." On the other hand, when you want to generate and print an analysis of the document to be printed, or when you want to print text converted into graphs or other diagrams, use "more creative." Also, when printing only the main points of a document, use "more balanced." If it is possible to determine which conversation style should be applied to each item of the print settings for the prompt specified in the prompt input unit 403, it will be possible to make more accurate suggestions to the user. Therefore, in this embodiment, print settings that take conversation style into consideration will be described.

[0056] <Document Print Screen> Figure 12 illustrates an example of a generation AI service that takes conversational style into account in the document printing screen 1200. In the document printing screen 1200, the same reference numerals are used for display areas that are the same as those in the document printing screen 600.

[0057] The document printing screen 1200 displays the generation AI service area 1210, where a proposal 1201 that takes conversational style into consideration is presented. In the proposal according to this embodiment, if input such as "I want to print only the part related to OS A" is entered in the prompt input area of ​​the generation AI service area 1210, the conversational style "more precisely" is used to cause the generation AI service to generate a result of picking out the relevant part. On the other hand, as shown in Figure 12, there are cases where it is desired to print something created from the document rather than the document itself, such as "I want to print a summary of the OS A setup procedure." In such cases, the conversational style "more balanced" or "more creative" is used to cause the generation AI service to generate a result illustrating the created text or procedure.

[0058] <Print settings that take conversation style into consideration> Referring to Figure 13, the processing procedure for generating print settings that take conversation style into account in the document printing screen 1200 according to this embodiment will be explained. The process described below is realized, for example, by the CPU 300 of the server PC 104 reading the program stored in ROM 301 into RAM 302 and executing it. This flowchart starts after the process of S204 above has been executed by the server PC 104.

[0059] In S501, the AI ​​generation plugin 413 determines the conversation style corresponding to the input prompt. When determining the conversation style, for example, the print setting generation model 415 may be used, or it may be determined based on the keywords included in the prompt. Alternatively, the user may be asked to select a style. Subsequently, in S502, the AI ​​generation plugin 413 adds the conversation style determined in S501 to the input prompt, and the processing of this flowchart ends, proceeding to S205.

[0060] <Variation> The present invention is not limited to the embodiments described above and can be modified in various ways. For example, in the above embodiments, an application for creating layout data is used as an example of an application. However, the present invention is not limited to this, and can be implemented and is effective in any application that has similar image layout functionality.

[0061] Furthermore, in the above embodiments, a personal computer is assumed as the information processing device. However, there is no intention to limit the present invention, and it can be implemented for any information processing device (terminal) capable of similar usage. For example, the present invention is applicable to mobile phones, portable information terminals, digital still cameras, digital video cameras, portable music players, games, set-top boxes, internet-connected home appliances, etc. Also, in the above embodiments, an example using Ethernet is shown as an example of network configuration. However, this is not limited to the present invention, and other arbitrary network configurations such as wireless LAN, IEEE1394, Bluetooth, etc. may also be used.

[0062] The disclosures herein include the following computer programs, information processing devices, and systems. (Item 1) A computer program that controls the computer of an information processing device. A means of receiving information about print settings in natural language, An acquisition means that inputs the received natural language and the print target into a generating AI to obtain print settings, A suggestion means that suggests print settings based on the acquired print settings, In response to the aforementioned proposal, an update means for updating the print settings, A computer program characterized by being designed to function as such. (Item 2) The computer of the aforementioned information processing device is further, This function serves as a presentation means for generating and presenting one or more natural language candidates related to print settings based on the print target. The computer program according to claim 1, wherein the receiving means accepts natural language regarding the print settings according to the selection of one or more candidates. (Item 3) The computer program according to claim 2, characterized in that the presentation means inputs the print target to the generation AI to obtain one or more candidates and presents the obtained one or more candidates. (Item 4) The computer of the aforementioned information processing device is further, It functions as a means of acquiring device information for the image forming apparatus that receives print jobs. The proposed means is a computer program according to any one of claims 1 to 3, characterized in that it proposes print settings based on the acquired print settings and device information. (Item 5) The proposed means is a computer program according to claim 4, characterized in that it modifies the print settings obtained from the generating AI according to the device information and proposes the modified print settings. (Item 6) The proposed means is characterized by selecting and proposing an alternative image forming apparatus to perform printing according to the print settings and device information obtained from the generating AI, as described in the computer program according to claim 4. (Item 7) The computer program according to any one of claims 1 to 6, characterized in that the acquisition means selects the conversation style of the generating AI according to the content of the received natural language and acquires the print settings. (Item 8) The acquisition means is a computer program according to claim 7, characterized in that it selects the conversation style of the generating AI using the generating AI. (Item 9) The computer of the aforementioned information processing device is further, A computer program according to any one of claims 1 to 8, characterized in that it functions as a display control means for displaying a settings screen which includes at least a first area for setting print settings and a second area for inputting natural language and interacting with the generating AI. (Item 10) The computer program according to claim 9, characterized in that the receiving means receives natural language regarding the print settings via the second region. (Item 11) The computer program according to claim 9 or 10, characterized in that the suggestion means makes a suggestion of the print settings via the second area and displays a display object in the second area that allows the user to select whether or not to update the suggested print settings. (Item 12) The computer program according to any one of claims 9 to 11, wherein the updating means further updates the print settings displayed in the first area according to the print settings to be updated. (Item 13) The computer program according to any one of claims 9 to 12, characterized in that the display control means displays a third area on the settings screen that displays a print preview when printing is performed according to the print settings. (Item 14) The computer program according to claim 13, characterized in that when the print settings are updated by the update means, the display control means updates the display of the print preview according to the updated print settings. (Item 15) The computer of the aforementioned information processing device is further, The computer program according to any one of claims 9 to 14, characterized in that, when a print operation is instructed, it generates a print job according to the updated print settings and functions as an execution means for feeding the print job to the corresponding image forming apparatus. (Item 16) An information processing device, A means of receiving information about print settings in natural language, An acquisition means that inputs the received natural language and the print target into a generating AI to obtain print settings, A suggestion means that suggests print settings based on the acquired print settings, In response to the above proposal, an update means for updating the print settings and An information processing device characterized by comprising: (Item 17) A method for controlling an information processing device, The reception method includes a reception process that accepts natural language regarding print settings, The acquisition means includes an acquisition step of inputting the received natural language and the print target into a generating AI to acquire print settings, The proposal means includes a proposal step of proposing print settings based on the acquired print settings, The update means includes an update process in which the print settings are updated in response to the aforementioned proposal. A control method for an information processing device, characterized by including the following:

[0063] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0064] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0065] 100: Image forming apparatus, 102: Client PC, 103: Network, 104: Server PC, 203: System bus, 303: Main bus, 307: Computer internals, 401: Print document submission unit, 402: Print settings unit, 403: Prompt input unit, 404: Candidate prompt selection unit, 405: Print job transmission unit, 406: Device information retention unit, 407: Print job reception unit, 408: Print execution unit, 411: Print document analysis unit, 412: Print settings generation unit, 413: Generated AI program 414: Device information acquisition unit, 415: Print setting generation model, 416: Generation AI, 500: Input image and input prompt, 501: Generation model, 502: Product, 600: Document printing screen, 601: Print preview area, 602: Print settings area, 603: Generation AI service area, 604: Prompt input area, 605: Print execution button, 701: Prompt candidate presentation area, 1001: Suggestion considering device information, 1201: Suggestion considering conversation style

Claims

1. A computer program that controls the computer of an information processing device. A means of receiving information about print settings in natural language, An acquisition means that inputs the received natural language and the print target into a generating AI to obtain print settings, A suggestion means that suggests print settings based on the acquired print settings, In response to the aforementioned proposal, an update means for updating the print settings, A computer program characterized by being designed to function as such.

2. The computer of the aforementioned information processing device is further, This function serves as a presentation means for generating and presenting one or more natural language candidates related to print settings based on the print target. The computer program according to claim 1, wherein the receiving means accepts natural language regarding the print settings according to the selection of one or more candidates.

3. The computer program according to claim 2, characterized in that the presentation means inputs the print target to the generating AI to obtain one or more candidates and presents the obtained one or more candidates.

4. The computer of the aforementioned information processing device is further, It functions as a means of acquiring device information for the image forming apparatus that receives print jobs. The computer program according to claim 1, characterized in that the suggestion means suggests print settings based on the acquired print settings and device information.

5. The proposed means is a computer program according to claim 4, characterized in that it modifies the print settings obtained from the generated AI according to the device information and proposes the modified print settings.

6. The computer program according to claim 4, characterized in that the proposed means selects and proposes an alternative image forming apparatus to perform printing according to the print settings and device information obtained from the generated AI.

7. The computer program according to claim 1, characterized in that the acquisition means selects the conversation style of the generating AI according to the content of the received natural language and acquires the print settings.

8. The acquisition means is a computer program according to claim 7, characterized in that it selects the conversation style of the generating AI using the generating AI.

9. The computer of the aforementioned information processing device is further, A computer program according to any one of claims 1 to 8, characterized in that it functions as a display control means for displaying a settings screen which includes at least a first area for setting print settings and a second area for inputting natural language and interacting with the generating AI.

10. The computer program according to claim 9, characterized in that the receiving means receives natural language regarding the print settings via the second region.

11. The computer program according to claim 9, characterized in that the suggestion means makes a suggestion of the print settings via the second region and displays a display object in the second region that allows the user to select whether or not to update the suggested print settings.

12. The computer program according to claim 9, wherein the updating means further updates the print settings displayed in the first area according to the print settings to be updated.

13. The computer program according to claim 9, characterized in that the display control means displays a third area on the settings screen that displays a print preview when printing is performed according to the print settings.

14. The computer program according to claim 13, characterized in that when the print settings are updated by the update means, the display control means updates the display of the print preview according to the updated print settings.

15. The computer of the aforementioned information processing device is further, The computer program according to claim 9, characterized in that, when a print operation is instructed, it generates a print job according to the updated print settings and functions as an execution means for submitting the print job to the corresponding image forming apparatus.

16. An information processing device, A means of receiving information about print settings in natural language, An acquisition means that inputs the received natural language and the print target into a generating AI to obtain print settings, A suggestion means that suggests print settings based on the acquired print settings, In response to the above proposal, an update means for updating the print settings and An information processing device characterized by comprising:

17. A method for controlling an information processing device, The reception method includes a reception process that accepts natural language regarding print settings, The acquisition means includes an acquisition step of inputting the received natural language and the print target into a generating AI to acquire print settings, The proposal means includes a proposal step of proposing print settings based on the acquired print settings, The update means includes an update process in which the print settings are updated in response to the aforementioned proposal. A control method for an information processing device, characterized by including the following:

Images