Computer program, information processing apparatus, and system

Abstract

The present invention provides, for example, a novel mechanism for easily performing print settings via a generated AI.SOLUTION: The information processing apparatus receives a natural language related to a print setting, inputs the received natural language and a print target to a generation AI to acquire a print setting, makes a proposal of the print setting based on the acquired print setting, and reflects the print setting in accordance with a response to the proposal.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a computer program, an information processing device, and a system for printing a document via a generation AI. [Background technology]

[0002] When printing a document, it is possible to specify the section of the document you want to print. For example, for documents that explain a specific topic in a step-by-step manner, such as manuals or papers, you can specify the steps you want to refer to or the sections you want to correct and print them. Also, for documents that aggregate a variety of information, such as catalogs or various tax return forms, you can print the pages that contain the desired information. In this case, the user scrolls through the pages or searches within the document on the print preview screen to find the section they want to print and specify it as the print target. Then, they set the print format, such as paper size and layout, and execute the print operation. As a result, the desired section of the document can be printed in the desired output.

[0003] Recently, generative AI such as Stable Diffusion (https: / / stability.ai / ), ChatGPT (https: / / chat.openai.com / ), and GAN (Generative Adversarial Algorithm) has been attracting attention. With generative AI technology, images or text are set as input images or input prompts, and a generative model is used to generate characters, images, videos, and other output that are highly likely to match the "context" expressed by the set input images or input prompts. The relationship between the input values ​​and the "context" is acquired when the model learns using a large number of images and text. It is also possible to change the output by changing the initial values, which are mainly generated from random numbers during generation.

[0004] Patent Document 1 proposes a technology that eliminates the hassle of document printing by listing candidate deliverables based on the document to be printed and presenting the user with setting items specified by selecting the deliverable. Here, the setting items are, for example, settings related to the print format, such as paper size and layout, that are displayed on the print preview screen. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-64061 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the above-mentioned conventional technology has the following problems. For example, in the above-mentioned conventional technology, deliverable information must be prepared in advance, and the deliverable information that matches the document to be printed is selected from a prepared deliverable list. Furthermore, while the time and effort required for setting print formats is eliminated, the parts of the document that are to be printed must be manually found and set.

[0007] The present invention has been made in consideration of at least one of the above problems, and provides, for example, a novel mechanism for easily performing print settings via a generation AI. [Means for solving the problem]

[0008] The present invention is characterized in that, for example, a computer program causes a computer of an information processing device to function as an accepting means for accepting natural language relating to print settings, an acquiring means for inputting the accepted natural language and the print target into a generation AI to acquire print settings, a proposing means for proposing print settings based on the acquired print settings, and an updating means for updating the print settings in accordance with a response to the proposal. [Effects of the Invention]

[0009] According to the present invention, a new mechanism for easily setting print settings via a generation AI can be provided. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a printing system related to document printing according to an embodiment. [Figure 2] FIG. 1 is a diagram showing an example of the hardware configuration of an image forming apparatus 100 according to an embodiment. [Figure 3] FIG. 2 is a diagram showing an example of the hardware configuration of a client PC 102 and a server PC 104 according to an embodiment. [Figure 4] FIG. 2 is a diagram showing an example of functional blocks of a printing system according to an embodiment. [Figure 5] FIG. 10 is a diagram showing an example of a generation process. [Figure 6] FIG. 2 is a view showing an example of a document print screen on a client PC 102 according to an embodiment. [Figure 7] FIG. 10 is a diagram showing an example of prompt candidate presentation on a document print screen according to an embodiment. [Figure 8] 10A and 10B are diagrams showing an example of a process for reflecting print settings generated by a generation AI on a document print screen according to an embodiment. [Figure 9] 10A and 10B are diagrams showing an example of a process for generating prompt candidates on a document print screen according to an embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a generation AI service that takes into account device information on a document printing screen according to an embodiment. [Figure 11] 10A and 10B are views showing an example of a process for generating print settings in consideration of device information on a document print screen according to an embodiment. [Figure 12] FIG. 10 is a diagram showing an example of a generation AI service that takes conversation style into consideration on a document print screen according to an embodiment. [Figure 13] 10A and 10B are diagrams showing an example of a process for generating print settings that take conversation style into consideration on a text print screen according to an embodiment. [Figure 14] FIG. 1 is a diagram showing an example of a document to be printed according to an embodiment. [Figure 15] FIG. 10 is a diagram showing an example of a generated print image according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0012] First Embodiment <System configuration> A first embodiment of the present invention will be described below. First, the configuration of a printing system according to this embodiment will be described. The printing system according to this embodiment is a printing system targeted at an image forming apparatus. In the printing system, a print job is sent from an externally connected PC to the image forming apparatus. When generating a print job, print settings can be edited on the PC screen as necessary.

[0013] 1 shows an example of a system configuration in a network environment of a printing system according to this embodiment. This printing system includes image forming apparatuses 100 and 101, a client PC 102, and a server PC 104, which are interconnected via a network 103 so as to be able to communicate with each other. The client PC 102 and the server PC 104 are information processing apparatuses having similar computer configurations. The detailed configuration of the information processing apparatus will be described later with reference to FIG. 3.

[0014] The client PC 102 performs rendering processing on the print document to be printed and obtains a print image. The client PC 102 also generates a print job by adding print settings to the print image and submits the print job to the image forming apparatuses 100 and 101. The client PC 102 also requests processing from the server PC 104 when analyzing the content of the print document or generating print settings suitable for the print document. The server PC 104 is a generation AI server and provides a generation AI service. The printing system according to this embodiment includes two image forming apparatuses, but is not limited to this and may include one, three, or more. Although there is one client PC and one server PC, there may be two or more.

[0015] As an example of printing, this embodiment describes a mode in which a print job is sent from a printing application installed on a PC to image forming apparatus 100 via a printer driver. For example, a printing application and a printer driver are installed on client PC 102. The printing application can obtain device information of the associated image forming apparatus 100 from the printer driver, as well as print parameters such as paper type, paper size, and print quality, and edit print settings from the obtained parameters. A print job is generated based on the print settings and a print image that has been rendered by client PC 102, and the print job is submitted to the image forming apparatus via the spool of the print driver, thereby executing print processing.

[0016] The image forming device executes printing based on the print settings of the received print job. The image forming device also stores device information, such as configuration information about the consumables it handles and status information about idle states and print errors. Furthermore, if printing cannot be performed normally due to a lack of consumables, a problem with the image forming device, or an error in the print settings, a warning message is displayed on the device panel to inform the user of the reason why printing cannot be performed normally.

[0017] <Hardware configuration of image forming device> An example of the hardware configuration of the image forming apparatus 100 according to this embodiment will be described with reference to Fig. 2. Note that the image forming apparatus 101 also has a similar configuration, and therefore a description thereof will be omitted. The image forming apparatus 100 includes a CPU 200, a ROM 201, a RAM 202, an input unit 204, a printing unit I / F 205, a memory controller 206, a printing unit 207, an external memory 208, and an operation unit 209. Each unit can exchange data with each other via a system bus.

[0018] The image forming apparatus 100 is controlled by a CPU 200. The CPU 200 operates based on a control program stored in a program ROM of a ROM 201 or a control program stored in an external memory 208. The CPU 200 outputs an image signal as output information to a printing unit (printer engine) 207 connected to a printing unit I / F 205 via a system bus 203. The CPU 200 is capable of communication processing with the client PC 102 via an input unit 204, and can notify the client PC 102 of information in the image forming apparatus 100. The CPU 200 can also receive output data to be output to the printing unit 207 via the input unit 204.

[0019] The RAM 202 functions as the main memory, work area, etc. of the CPU 200, and is configured so that its memory capacity can be expanded by an optional RAM connected to an expansion port (not shown). The RAM 202 is used as an output information development area, an environmental data storage area, a non-volatile memory, etc. Access to an external memory 208 such as a hard disk (HDD) or an IC card is controlled by a memory controller 206. The external memory 208 can be connected as an option and stores font data, emulation programs, form data, remaining amounts of consumables, information regarding the type and size of output paper, main unit status information, etc. The operation unit 209 is equipped with a panel that can display various information.

[0020] <Configuration of information processing device> An example of the computer configuration of the client PC 102, which is an information processing apparatus according to this embodiment, will be described with reference to Fig. 3. The computer of the server PC 104 has the same configuration as the computer of the client PC 102, and therefore description thereof will be omitted. The client PC 102 includes a computer interior 307, a keyboard 308, a display 309, and an external memory 310. The computer interior 307 includes a CPU 300, a ROM 301, a RAM 302, a keyboard controller 304, a display controller 305, and a disk controller 306. Each unit can exchange data with each other via a main bus 303.

[0021] The CPU 300 reads various programs such as control programs, system programs, and application programs from the external memory 310 into the RAM 302 via the disk controller 306. The CPU 300 executes the various programs read into the RAM 302 to perform various data processing and control the display of the display 309. The CPU 300 may read the control programs and the like from the ROM 301. The CPU 300 may be a dedicated circuit such as an ASIC. The CPU 300 and the dedicated circuit are examples of hardware circuits and hardware processors. The disk controller 306 controls access to the external memory 310, such as a HD, CD-ROM, DVD-ROM, or USB.

[0022] The RAM 302 is configured so that its capacity can be expanded using an optional RAM (not shown) or the like, and is mainly used as a work area for the CPU 300. The keyboard controller 304 controls key input from a keyboard 308 or a pointing device (not shown). The display controller 305 controls the display on the display 309. In the embodiment of the present invention, unless otherwise specified, the CPU 300 controls each unit connected to the main bus 303 via the main bus 303. The server PC 104 may also be equipped with the above-described configuration. Of course, components that are not necessarily required for the server PC 104, such as the display 309, may not be included in the configuration.

[0023] <Function block> An example of functional blocks of the printing system according to this embodiment will be described with reference to Fig. 4. First, functional blocks within the client PC 102 and the server PC 104 will be described.

[0024] The client PC 102 includes, as functional blocks, a print document submission unit 401, a print setting unit 402, a prompt input unit 403, a candidate prompt selection unit 404, and a print job transmission unit 405. The server PC 104 also includes a print document analysis unit 411, a print setting generation unit 412, a generation AI plug-in 413, a device information acquisition unit 414, a print setting generation model 415, and a generation AI 416. The print document submission unit 401 accepts a print document. For example, when the print document submission unit 401 accepts a print request for a file being edited from an application such as a document editing application running on the client PC 102, it accepts the file as a print document. The print setting unit 402 specifies a prompt in natural language input to the prompt input unit 403 and a print document, and requests processing from the print setting generation unit 412 of the server PC 104.

[0025] The print setting generation unit 412 generates print settings using a generation AI plug-in 413. The generation AI plug-in 413 determines print setting items related to the input prompt using a print setting generation model 415. The generation AI 416 generates optimal values ​​for each determined print setting item from the document file. The print setting generation model 415 then interprets the generated optimal values ​​and converts them into corresponding print setting values. The device information acquisition unit 414 acquires and stores device information from the image forming device 100. The stored device information is used by the generation AI plug-in 413 when proposing print settings that take the device information into consideration. The device information includes, for example, configuration information about consumables handled by the corresponding image forming device, and status information such as idle state and print errors.

[0026] Furthermore, a candidate prompt selection unit 404 of the client PC 102 specifies a print document and requests processing from a print document analysis unit 411 of the server PC 104, thereby generating and presenting candidate prompts to be input to the prompt input unit 403. The print document analysis unit 411, like the print setting generation unit 412, also utilizes a generation AI plug-in 413 to generate a prompt (natural language) related to printing from the specified print document.

[0027] A print job sending unit 405 of the client PC 102 creates a print job and sends the created print job to the image forming apparatus 100. When creating the print job, the print settings acquired from the print setting generation unit 412 of the server PC 104 and the print image for which rendering processing has been completed in the client PC 102 are combined.

[0028] Next, the functional blocks within the image forming apparatus 100 will be described. The ROM 201 stores programs and the like that realize the functional blocks, and the programs and the like cause the functional blocks to include a device information holding unit 406, a print job receiving unit 407, and a print execution unit 408. The print job receiving unit 407 receives a print job sent from the client PC 102. The print execution unit 408 executes print processing for the print job. Information on the configuration and remaining amount of consumables installed in the image forming apparatus 100, information on the type and size of output paper, main body status information of the image forming apparatus 100, and status information of print jobs are held in the device information holding unit 406. As described above, this device information is acquired by the device information acquisition unit 414 of the server PC 104.

[0029] <Generated AI processing> Here, with reference to FIG. 5, an example of the processing of generative AI (generative AI) will be described. In generative AI technology, as shown in FIG. 5, an image or text (natural language) is input to a generative model 501 as an input image or input prompt 500. The generative model 501 outputs a product 502, such as characters, images, or videos, that has a high probability of matching the "context" expressed by the set input image or input prompt 500. The relationship between the input value and the "context" is acquired when the model learns using a large amount of images and text. Furthermore, the product 502 can be changed by changing the initial value, which is mainly generated from random numbers during generation. The printing system according to this embodiment provides a mechanism for easily setting up print settings via such generative AI. This will be described in detail below.

[0030] <Document Print Screen> 6, an example of a document print screen 600 for the image forming apparatus 100, which is displayed on the display 309 of the client PC 102 according to this embodiment, will be described. The document print screen 600 is an example of a settings screen, and includes a print preview area 601, a print settings area 602, and a generated AI service area 603.

[0031] The print preview area 601 displays a print image resulting from rendering of the print document accepted by the print document submission unit 401. The print setting area 602 corresponds to the first area, and displays configurable setting items for the print setting unit 402 in an operable manner. For example, in the example of FIG. 6, if a manual document is accepted as the print document and the user wishes to print only the description of OS A in the manual document, the user finds the relevant portion and sets the relevant page, for example, using the page setting items in the print setting area 602. Furthermore, if the user wishes to print in color, the color mode is selected as color.

[0032] The generation AI service area 603 corresponds to a second area for dialogue between the user and the generation AI. It accepts natural language input information in the prompt input area 604 and inputs it to the prompt input unit 403. The prompt input area 604 is an example of a receiving means. The natural language input to the prompt input area 604 may be text input from a keyboard (not shown) or voice input via a microphone (not shown). The user can also view previously entered prompts and information generated by the print setting generation unit 412 and select whether to reflect the generated information. When the settings are reflected in the generation AI service area 603, the print preview and print setting values ​​displayed in the print preview area 601 and print setting area 602 are updated. For example, in the example of FIG. 6, the natural language input "I would like to print the part related to OS A" is input in the prompt input area 604. In response to the input, "Pages 1, 3, and 5 are applicable" is displayed, and a display object is presented that allows the user to select whether to reflect (update) the information in the print settings and accept the user's response. If the user selects "Yes," only pages 1, 3, and 5 are displayed as print images in the print preview area 601, and the values ​​of the page setting items in the print setting area 602 become "1, 3, 5." Of course, it is also possible to omit the confirmation of whether or not to reflect the settings in the print settings, and have the settings automatically reflected in the print settings.

[0033] In the example of Figure 6, the relevant page is proposed by the generation AI service, but it is also possible to generate an image that summarizes only the part related to OS A, as in the generation process of Figure 5, and display the generated image in the print preview area 601. In this case, it is desirable to inform the user that the file name displayed at the bottom of the print preview area 601 indicates that it is an excerpt from a manual document, such as "manual.pdf (excerpt only of the area related to OS A)." Also, it is assumed that the value of the page setting item in the print setting area 602 is set to "All" with a check mark.

[0034] Specifically, it is assumed that a print image such as that shown in FIG. 15 is generated for the document to be printed shown in FIG. 14, with the value of the page setting item being checked as "All." FIG. 14 shows a four-page manual document. If only the area relating to the OS A portion is excerpted from such a document, the print image shown in FIG. 15 will result. Note that the print image excerpting the relevant portions in FIG. 15 shows an example in which portions excerpted from multiple pages are merged into one page, but this is not intended to limit the present invention, and portions excerpted from different pages may each be generated as different pages.

[0035] Furthermore, even when geometric information other than keywords written in a document is entered, such as "I want to extract and print only the graph portion from each page," only the graph may be extracted or generated from each page and a merged print image may be generated. The generated print image may be displayed in the print preview area 601.

[0036] When printing is to be performed, a print execution button 605 is operated to request the print job sending unit 405 to create and send a print job for the print document displayed in the print preview area 601 and print setting area 602. The print job sending unit 405 creates a print job and sends the created print job to the target image forming device.

[0037] 7 shows a document print screen 700 that displays an AI service area 710 that includes a prompt candidate presentation area 701. Prompt candidates are presented by having the generation AI predict and present candidate prompts instead of, for example, accepting a message input by the user in the generation AI service area 603 on the document print screen 600. Display areas on the document print screen 700 that are similar to those on the document print screen 600 are designated by the same reference numerals.

[0038] The prompt candidate presentation area 701 displays one or more prompts as selection candidates. In FIG. 7, the prompt "Print only the part related to OS A" and the prompt "Print only the part related to OS B" are displayed as selectable prompts. The user can complete the prompt input by selecting the desired prompt from the prompt candidates, thereby reducing the amount of work required. The prompt candidates correspond to the prompt candidates generated by the print document analysis unit 411 and stored in the candidate prompt selection unit 404. Note that a prompt can also be input into the prompt candidate presentation area 701, just as in the prompt input area 604. Therefore, the user may select a presented prompt candidate or input the prompt themselves.

[0039] <Print setting flow> 8, a process procedure for reflecting (updating) print settings generated by a generation AI on the document print screen 600 according to this embodiment will be described. The process described below is realized, for example, by the CPU 300 of each of the client PC 102 and the server PC 104 reading a program stored in ROM 301 into RAM 302 and executing it. In the client PC 102, for example, when an input is made to the prompt input area 604 on the document print screen 600, the print setting unit 402 starts the process of this flowchart.

[0040] First, in S201, the print setting unit 402 acquires the print document accepted by the print document submission unit 401. Subsequently, in S202, the print setting unit 402 determines whether or not the prompt input to the prompt input unit 403 has been acquired. If the prompt has been acquired (Yes in S202), the process proceeds to S203, where the print setting unit 402 requests the print setting generation unit 412 of the server PC 104 to generate print setting values. Here, when requesting the generation of print settings, the print setting unit 402 transmits information about the print document and the prompt to the print setting generation unit 412 (server PC 104). On the other hand, if the prompt input to the prompt input unit 403 has not been acquired (No in S202), the process of this flowchart ends.

[0041] In S204, the print setting generation unit 412 specifies the received print document and prompt to the generation AI plug-in 413. The generation AI plug-in 413 determines the print setting items to be generated using the print setting generation model 415. Then, in S205, the generation AI plug-in 413 causes the generation AI 416 to generate setting values ​​based on the print document for each determined print setting item, and converts the setting values ​​generated by the print setting generation model 415 into values ​​that can be set for the corresponding print setting items. For example, even if "color printing / booklet printing" is generated in S204 for a monochrome-only printer, it is switched to "monochrome / stapled" in S205. In another example, even if "Please add a print mode with high print quality and durability" is generated in S204, it is switched to "quality = high quality, paper feed = matte paper" in S205.

[0042] Thereafter, in S205, the print setting unit 402 of the client PC 102 acquires the setting values ​​entered in S205 for each print setting item determined in S204 from the print setting generation unit 412 of the server PC 104 and reflects them on the document print screen 600. The processing of this flowchart then ends. Of course, the generated print setting values ​​may include not only characters but also images extracted from specified information within the document.

[0043] <Prompt for candidates> 9, a process for generating prompt candidates when the prompt candidate presentation area 701 in FIG. 7 is displayed in the prompt input area 604 will be described. The process described below is realized, for example, by the CPU 300 of each of the client PC 102 and the server PC 104 reading a program stored in ROM 301 into RAM 302 and executing it. The process of this flowchart starts, for example, after the process of S201 above.

[0044] In S301, the print setting unit 402 requests the candidate prompt selection unit 404 to analyze the print document. The candidate prompt selection unit 404 requests the print document analysis unit 411 of the server PC 104 to analyze the print document using the generation AI plug-in 413.

[0045] In S302, the generation AI plug-in 413 extracts prompt candidates for each print setting item using the generation AI 416. Then, in S303, the generation AI plug-in 413 determines, using the print setting generation model 415, whether the extracted prompt is related to the print setting.

[0046] Thereafter, in S304, the candidate prompt selection unit 404 acquires candidate prompts from the print document analysis unit 411 of the server PC 104 and determines whether or not there are any candidate prompts related to the print settings. If there are candidate prompts related to the print settings (Yes in S304), the process proceeds to S305, where the print setting unit 402 displays them in the prompt candidate presentation area 701, ends this flowchart, and proceeds to the processing of S202 above. On the other hand, if there are no candidates (No in S304), the process ends this flowchart without doing anything and continues to S202.

[0047] It is also conceivable that the user may instruct a generation AI service such as Microsoft Copilot (registered trademark) directly that they wish to print, without going through the document print screen 600. In such a case, the generation AI plug-in 413 may be called from the generation AI 416 to generate optimal print setting values, and then the document print screen 600 may be displayed. Note that the generated print setting values ​​are reflected in the print preview and print setting values ​​displayed in the print preview area 601 and print setting area 602, and a screen is generated and displayed accordingly.

[0048] As described above, the computer program according to this embodiment causes a computer of an information processing device to function as follows. That is, the information processing device accepts natural language related to print settings, inputs the accepted natural language and the print target into a generation AI to acquire print settings, proposes print settings based on the acquired print settings, and reflects the print settings in response to the proposal. According to this embodiment, even without preparing deliverable information in advance, when a document file is requested to be printed, print settings corresponding to the document are dynamically generated according to the natural language related to the print settings, making it possible to easily set the print format and the parts to be printed. As a result, this embodiment provides a new mechanism for easily setting print settings via a generation AI.

[0049] <Second embodiment> A second embodiment of the present invention will be described below. In the first embodiment, print setting values ​​were generated for each print setting item supported by the image forming apparatus 100 based on the document to be printed and input information in the prompt input area 604. However, depending on the configuration and remaining amount information of consumables installed in the image forming apparatus 100, and the type and size information of output paper, restrictions may be placed on the setting values ​​for each supported print setting item. For example, even if an image forming apparatus supports color printing, there may be a risk that if there is only a small amount of yellow ink remaining and all pages are printed in color, there is a risk that the yellow ink will run out and printing will fail. In such a case, it may be necessary to suggest printing in color for areas where color printing is recommended and printing in monochrome for other areas.

[0050] <Document Print Screen> An example of an AI service generated taking device information into consideration on the document print screen 1000 according to this embodiment will be described with reference to Fig. 10. Display areas on the document print screen 1000 that are similar to those on the document print screen 600 will be assigned the same reference numerals.

[0051] The document print screen 1000 displays a generation AI service area 1010, in which a proposal 1001 is presented. The proposal 1001, which takes device information into consideration, presents recommended setting values ​​to the user based on information acquired by the device information acquisition unit 414. In the example of FIG. 10 , because the remaining amount of color ink is low, a proposal is made to print only page 3 in color. This is because page 3 includes display objects, such as graphs and charts, that are recommended for color printing only. The proposal 1001 also displays a display object for selecting the proposal and a display object for rejecting the proposal, which are selectable. Note that when printing only page 3 in color, the print job is split into three pages for which the print settings change, resulting in three jobs for page 1, page 3, and page 5.

[0052] <Print settings that take device information into account> The process steps for generating print settings that take device information into consideration on the document print screen according to this embodiment will be described with reference to Fig. 11. The process described below is realized, for example, by the CPU 300 of the server PC 104 reading a program stored in the ROM 301 into the RAM 302 and executing it. This flowchart is executed, for example, after the server PC 104 processes step S204.

[0053] In S401, the device information acquisition unit 414 acquires information stored in the device information storage unit 406 from the image forming apparatus 100. Subsequently, in S402, the generation AI plug-in 413 determines whether or not the print setting items determined in S204 include setting items that affect the device information. If there are setting items that affect the device information (Yes in S402), the process proceeds to S403, where the generation AI plug-in 413 adds the device information to the input prompt, terminates the processing of this flowchart, and continues to S205. On the other hand, if there are no setting items that affect the device information (No in S402), the process terminates the processing of this flowchart without doing anything, and continues to S205.

[0054] In the example of FIG. 11, the generation AI service makes a suggestion that takes remaining ink into consideration, but this is not intended to limit the present invention. For example, since the user intends to print in color, the suggestion may be, "Please replace the yellow ink to print all pages in color." In this case, if the user replaces the yellow ink, the user is prompted with, "The yellow ink has been replaced. Would you like to reflect this in the print settings? Yes or No." Of course, the generation AI service area 1010 may prompt the user to replace the ink while printing is in progress. Also, if there are many setting items that affect the device information in S402, the generation AI service area 1010 may prompt the user to select a different image forming device (alternate image forming device) in the first place. In this case, if a different image forming device is actually selected, the flowchart of FIG. 8 is executed again.

[0055] <Third embodiment> The following describes a third embodiment of the present invention. Some generation AI services allow you to obtain different results by specifying a conversation style when loading a prompt. For example, Microsoft Copilot provides a function that allows you to select three conversation styles—“more creative,” “more balanced,” and “more strict”—and then specify the prompt to the generation AI service. When you want to print an excerpt of the document you want to print, use “more strict.” On the other hand, when you want to generate and print a commentary on the document you want to print, or when you want to print a graph or other diagram containing the text, use “more creative.” When you want to print the main points of the text, use “more balanced.” If you can determine the appropriate conversation style for each print setting item for the prompt specified in the prompt input unit 403, more accurate suggestions can be made to the user. Therefore, in this embodiment, print settings that take conversation style into account are described.

[0056] <Document Print Screen> 12 illustrates an example of an AI service that takes conversation style into consideration on a document print screen 1200. On the document print screen 1200, display areas that are the same as those on the document print screen 600 are given the same reference numerals.

[0057] The document printing screen 1200 displays a generation AI service area 1210, which presents a proposal 1201 that takes conversational style into consideration. In the proposal according to this embodiment, if an input such as "I want to print only the part related to OS A" is made in the prompt input area of ​​the generation AI service area 1210, the "more strict" conversational style is used, and the generation AI service generates a result of picking out the relevant part. On the other hand, as shown in FIG. 12, there are also cases where the user wants to print something created from a document rather than the document itself, such as "I want to print a summary of the configuration procedure for OS A." In such cases, the "more balanced" or "more creative" conversational style is used, and the generation AI service generates a result illustrating the text or procedure to be created.

[0058] <Printing settings that take conversational style into consideration> 13, a process for generating print settings that take conversation style into consideration on the document print screen 1200 according to this embodiment will be described. The process described below is realized, for example, by the CPU 300 of the server PC 104 reading a program stored in the ROM 301 into the RAM 302 and executing it. This flowchart starts after the process of S204 described above is executed by the server PC 104.

[0059] In S501, the generation AI plug-in 413 determines a conversation style corresponding to the input prompt. When determining the conversation style, for example, the print setting generation model 415 may be used, or the conversation style may be determined based on keywords included in the prompt. Alternatively, the user may be asked to select a style. Next, in S502, the generation AI plug-in 413 adds the conversation style determined in S501 to the input prompt, terminates the processing of this flowchart, and continues to S205.

[0060] <Modification> The present invention is not limited to the above-described embodiment and can be modified in various ways. For example, in the above-described embodiment, an application that creates layout data is used as an example of an application. However, this does not limit the present invention, and any application having a similar image layout function can be realized and is effective.

[0061] Furthermore, in the above-described embodiment, a personal computer is assumed as the information processing device. However, this is not intended to limit the present invention, and the present invention can be implemented in any information processing device (terminal) that can be used in a similar manner. For example, the present invention is applicable to mobile phones, personal digital assistants, digital still cameras, digital video cameras, portable music players, games, set-top boxes, Internet appliances, and the like. Furthermore, in the above-described embodiment, an example is shown in which Ethernet is used as an example of a network configuration. However, this is not intended to limit the present invention, and any other network configuration may be used, such as wireless LAN, IEEE1394, Bluetooth, and the like.

[0062] The disclosure of this specification includes the following computer program, information processing device, and system. (Item 1) A computer program for executing an information processing device on a computer, a receiving means for receiving natural language regarding print settings; an acquisition means for inputting the received natural language and the print target into a generation AI to acquire print settings; a suggestion means for suggesting print settings based on the acquired print settings; an update means for updating print settings in response to the suggestions; A computer program characterized by causing the computer to function as follows. (Item 2) The computer of the information processing device further a presentation unit that generates and presents one or more candidates for natural language regarding print settings based on the print target; 2. The computer program according to claim 1, wherein the accepting unit accepts a natural language input regarding the print settings in accordance with the selection of the one or more candidates. (Item 3) 3. The computer program according to claim 2, wherein the presentation means inputs the printing target into the generation AI to obtain the one or more candidates, and presents the obtained one or more candidates. (Item 4) The computer of the information processing device further functioning as a means for acquiring device information of an image forming apparatus to which a print job is input; 4. The computer program according to claim 1, wherein the suggesting unit suggests print settings based on the acquired print settings and device information. (Item 5) 5. The computer program according to claim 4, wherein the suggestion means changes the print settings acquired from the generation AI in accordance with the device information and proposes the changed print settings. (Item 6) 5. The computer program according to claim 4, wherein the suggesting means selects and suggests an alternative image forming device to perform printing in accordance with the print settings and the device information acquired from the generating AI. (Item 7) 7. The computer program according to claim 1, wherein the acquisition means selects a conversation style of the generation AI according to the content of the received natural language and acquires the print settings. (Item 8) 8. The computer program according to claim 7, wherein the acquisition means selects the conversation style of the generation AI using the generation AI. (Item 9) The computer of the information processing device further The computer program according to any one of claims 1 to 8, characterized in that it functions as a display control means for displaying a setting screen including at least a first area for making print settings and a second area for inputting natural language and interacting with the generation AI. (Item 10) 10. The computer program product according to claim 9, wherein the accepting unit accepts the print setting in natural language via the second area. (Item 11) 11. The computer program according to claim 9, wherein the suggestion means proposes the print settings via the second area and displays a display object in the second area that allows the user to select whether to update the proposed print settings. (Item 12) 12. The computer program according to claim 9, wherein the update unit further updates the print settings displayed in the first area in accordance with the print settings to be updated. (Item 13) 13. The computer program according to claim 9, wherein the display control means displays a third area on the setting screen that displays a print preview of what will happen if printing is performed according to the print settings. (Item 14) 14. The computer program according to claim 13, wherein when the print settings are updated by the updater, the display control means updates the display of the print preview in accordance with the updated print settings. (Item 15) The computer of the information processing device further 15. The computer program according to claim 9, wherein when an instruction to execute printing is given, the computer program functions as an execution means that generates a print job according to the updated print settings and submits the print job to a corresponding image forming device. (Item 16) An information processing device, a receiving means for receiving natural language regarding print settings; an acquisition means for inputting the received natural language and the print target into a generation AI to acquire print settings; a suggestion means for suggesting print settings based on the acquired print settings; updating means for updating print settings in response to the suggestions; An information processing device comprising: (Item 17) A control method for an information processing device, comprising: a receiving step in which a receiving unit receives natural language regarding print settings; an acquisition step in which an acquisition means inputs the received natural language and the print target into a generation AI to acquire print settings; a proposing step in which a proposing unit proposes print settings based on the acquired print settings; an updating step in which an updating means updates the print settings in accordance with the response to the proposal; 10. A method for controlling an information processing device, comprising:

[0063] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0064] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0065] 100: Image forming apparatus, 102: Client PC, 103: Network, 104: Server PC, 203: System bus, 303: Main bus, 307: Inside of computer, 401: Print document input unit, 402: Print setting unit, 403: Prompt input unit, 404: Candidate prompt selection unit, 405: Print job transmission unit, 406: Device information storage unit, 407: Print job reception unit, 408: Print execution unit, 411: Print document analysis unit, 412: Print setting generation unit, 413: Generated AI program Plug-in, 414: Device information acquisition unit, 415: Print setting generation model, 416: Generation AI, 500: Input image and input prompt, 501: Generation model, 502: Product, 600: Document print screen, 601: Print preview area, 602: Print setting area, 603: Generation AI service area, 604: Prompt input area, 605: Print execution button, 701: Prompt candidate presentation area, 1001: Suggestion taking device information into account, 1201: Suggestion taking conversation style into account

Claims

1. A computer program for executing an information processing device on a computer, a receiving means for receiving natural language regarding print settings; an acquisition means for inputting the received natural language and the print target into a generation AI to acquire print settings; a suggestion means for suggesting print settings based on the acquired print settings; an update means for updating print settings in response to the suggestions; A computer program characterized by causing the computer to function as follows.

2. The computer of the information processing device further a display unit that generates and displays one or more natural language candidates related to print settings based on the print target; 2. The computer program product according to claim 1, wherein the accepting unit accepts natural language input regarding the print settings in accordance with the selection of the one or more candidates.

3. 3. The computer program according to claim 2, wherein the presentation means inputs the printing target into the generation AI to obtain the one or more candidates, and presents the obtained one or more candidates.

4. The computer of the information processing device further functioning as a means for acquiring device information of an image forming apparatus to which a print job is input; 2. The computer program according to claim 1, wherein the suggesting unit suggests print settings based on the acquired print settings and device information.

5. 5. The computer program according to claim 4, wherein the suggestion means changes the print settings acquired from the generation AI in accordance with the device information and proposes the changed print settings.

6. 5. The computer program according to claim 4, wherein the suggesting unit selects and suggests an alternative image forming device to perform printing in accordance with the print settings and the device information acquired from the generating AI.

7. 2. The computer program according to claim 1, wherein the acquisition means acquires the print settings by selecting a conversation style of the generation AI according to the content of the received natural language.

8. 8. The computer program according to claim 7, wherein the acquisition means selects the conversation style of the generation AI using the generation AI.

9. The computer of the information processing device further A computer program as claimed in any one of claims 1 to 8, characterized in that it functions as a display control means for displaying a setting screen including at least a first area for making print settings and a second area for inputting natural language and interacting with the generation AI.

10. 10. The computer program product according to claim 9, wherein the accepting unit accepts the print setting in natural language via the second area.

11. 10. The computer program product according to claim 9, wherein the suggestion unit proposes the print settings via the second area and displays a display object in the second area that allows the user to select whether or not to update the proposed print settings.

12. 10. The computer program according to claim 9, wherein the update unit further updates the print settings displayed in the first area in accordance with the print settings to be updated.

13. 10. The computer program according to claim 9, wherein the display control means displays a third area on the setting screen that displays a print preview of a print performed in accordance with the print settings.

14. 14. The computer program according to claim 13, wherein when the print settings are updated by the updater, the display control means updates the display of the print preview in accordance with the updated print settings.

15. The computer of the information processing device further 10. The computer program according to claim 9, wherein when an instruction to execute printing is issued, the computer program functions as an execution unit that generates a print job in accordance with the updated print settings and submits the print job to a corresponding image forming device.

16. An information processing device, a receiving means for receiving natural language regarding print settings; an acquisition means for inputting the received natural language and the print target into a generation AI to acquire print settings; a suggestion means for suggesting print settings based on the acquired print settings; updating means for updating print settings in response to the suggestions; An information processing device comprising:

17. A control method for an information processing device, comprising: a receiving step in which a receiving unit receives natural language regarding print settings; an acquisition step in which an acquisition means inputs the received natural language and the print target into a generation AI to acquire print settings; a proposing step in which a proposing unit proposes print settings based on the acquired print settings; an updating step in which an updating means updates the print settings in accordance with the response to the proposal; 10. A method for controlling an information processing device, comprising:

Images