Information processing system and program

Abstract

To facilitate prediction of the details of processing, compared with a case where an icon to be associated with the processing is selected from icons prepared in advance.SOLUTION: An information processing system has one or more processors, and the one or more processors extract one or more features that regulate processing designated by a user, generate character strings of a content instructing output of icons representing the extracted one or more features, and provide the generated character strings to a learned model to acquire one or more icons.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an information processing system and a program. [Background technology]

[0002] In the field of information devices, interfaces that allow processes to be executed by manipulating icons are used, and the icons associated with the processes can be set by the user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-132291 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the number of icons that can be prepared in advance is limited, so it can be difficult to predict the processing content from the icon.

[0005] The present invention aims to make it easier to predict the content of a process compared to when an icon to be associated with the process is selected from icons prepared in advance. [Means for solving the problem]

[0006] The invention described in claim 1 is an information processing system having one or more processors, which extract one or more features that define processing specified by a user, generate a string of characters whose content instructs the output of an icon that represents the extracted one or more features, and provide the generated string of characters to a trained model to obtain one or more icons. The invention described in claim 2 is an information processing system described in claim 1, wherein the one or more processors extract the one or more features from each of the multiple sub-processes when the process is composed of multiple sub-processes that are executed in sequence. A third aspect of the present invention is the information processing system according to the second aspect, wherein the one or more processors describe the execution order of the plurality of sub-processes using the character string. The invention described in claim 4 is an information processing system described in claim 2, in which the one or more processors generate multiple character strings by swapping the expression priority relationships between the multiple sub-processes, and obtain one or more icons for each of the multiple character strings generated. The invention described in claim 5 is an information processing system described in claim 4, in which the one or more processors display one or more icons obtained for each of the multiple character strings, with the corresponding character string as a unit. The invention described in claim 6 is an information processing system described in claim 1, wherein the one or more processors, when multiple icons are obtained from the trained model, display a screen for selecting one icon from the multiple icons. The invention described in claim 7 is the information processing system described in claim 6, wherein the one or more processors additionally display one or more other icons that have been prepared in advance on the screen. The invention described in claim 8 is the information processing system described in claim 1, wherein the one or more processors generate multiple character strings by swapping the priority relationships between the one or more features that define the processing, and obtain one or more icons for each of the multiple character strings generated. The invention described in claim 9 is the information processing system described in claim 8, wherein the one or more processors generate the plurality of character strings based on a priority relationship between predefined features. The invention described in claim 10 is an information processing system described in claim 1, in which the one or more processors, when at least one of the one or more features defining the processing differs from a feature defining another processing to be compared, generate another character string that instructs the output of an icon that emphasizes the different feature. An eleventh aspect of the present invention is the information processing system according to the tenth aspect, wherein the other processing is processing that overlaps with part of the one or more features. The invention described in claim 12 is an information processing system described in claim 10, in which the one or more processors use the process as a comparison target and generate an icon for the other process that emphasizes the differences in characteristics from the process in question. The invention described in claim 13 is a program for enabling a computer to realize the following functions: extracting one or more features that define processing specified by a user; generating a string of characters whose content instructs the output of an icon that represents the extracted one or more features; and providing the generated string of characters to a trained model to obtain one or more icons. [Effects of the Invention]

[0007] According to the invention of claim 1, it is easier to predict the content of the process compared to when an icon to be associated with the process is selected from icons prepared in advance. According to the invention of claim 2, an icon can be generated that represents the content of a process that is made up of multiple sub-processes. According to the invention of claim 3, an icon can be generated that represents the execution order of a plurality of sub-processes that make up one process. According to the invention of claim 4, it is possible to generate an icon that expresses each sub-process that constitutes one process in a manner that gives priority to the other sub-processes. According to the invention of claim 5, it is possible to easily check the icon corresponding to each character string. According to the invention of claim 6, an icon to be associated with a specified process can be selected from a plurality of icons. According to the seventh aspect of the present invention, an icon to be associated with a specified process can be selected, including icons prepared in advance. According to the invention of claim 8, an icon can be generated in which each feature that defines one process is given priority over other features. According to the invention of claim 9, the priority relationship between features can be set in advance. According to the invention of claim 10, it is possible to generate an icon that can be differentiated from icons for other processes that have similar characteristics. According to the invention of claim 11, an icon can be generated that can be distinguished from other processes with similar characteristics. According to the invention of claim 12, icons for other processes having similar characteristics can also be regenerated. According to the invention of claim 13, it is easier to predict the content of the process compared to when an icon to be associated with the process is selected from icons prepared in advance. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a schematic configuration of an image processing system assumed in a first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an image processing apparatus. [Figure 3] 3 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by the image processing device assumed in the first embodiment. FIG. [Figure 4] 10 is a flowchart illustrating an example of a job flow registration process according to the first embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of an operation screen displayed in relation to job flow registration. [Figure 6] FIG. 2 is a diagram illustrating an image of generating a prompt character string in the first embodiment. [Figure 7] 10 is a flowchart illustrating an example of a job flow display process. [Figure 8] FIG. 10 is a diagram illustrating a display example of a job flow screen. [Figure 9] 10 is a flowchart illustrating an example of a job flow execution process. [Figure 10] 10 is a flowchart illustrating an example of a job flow registration process according to the second embodiment. [Figure 11] FIG. 10 is a diagram illustrating an image of generating a prompt character string in the second embodiment. [Figure 12] FIG. 10 is a diagram illustrating a display example of an icon selection screen in the second embodiment. [Figure 13] FIG. 10 is a diagram illustrating another example of the icon selection screen. [Figure 14] FIG. 11 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by an image processing device assumed in a third embodiment. [Figure 15] 11 is a flowchart illustrating an example of a job flow registration process according to the third embodiment. [Figure 16] 10A and 10B are diagrams illustrating the relationship between characteristics that define a job flow and default values ​​for each type of job. [Figure 17] FIG. 11 is a diagram illustrating an image of generating a prompt character string in the third embodiment. [Figure 18] 10 is a diagram illustrating the difference between an icon generated in the third embodiment and an icon generated in the first embodiment. FIG. [Figure 19] 13 is a flowchart illustrating an example of a job flow registration process according to the fourth embodiment. [Figure 20] FIG. 13 is a diagram illustrating an image of generating a prompt character string in the fourth embodiment. [Figure 21] 10 is a diagram illustrating the difference between an icon generated in the fourth embodiment and an icon generated in the first embodiment. FIG. [Figure 22] FIG. 10 is a diagram illustrating an example of a display screen for setting the position where emphasis syntax is to be applied. [Figure 23] FIG. 13 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by an image processing device assumed in a fifth embodiment. [Figure 24]FIG. 10 is a diagram illustrating an example of a set character priority value table. [Figure 25] 13 is a flowchart illustrating an example of a job flow registration process according to the fifth embodiment. [Figure 26] FIG. 13 is a diagram illustrating an image of generating a prompt character string in the fifth embodiment. [Figure 27] FIG. 10 is a diagram illustrating the difference between the icon generated in the fifth embodiment and the icon generated in the first embodiment. [Figure 28] FIG. 13 is a diagram illustrating another prompt character string generated in the fifth embodiment. [Figure 29] 20 is a flowchart illustrating an example of a job flow registration process according to the sixth embodiment. [Figure 30] FIG. 20 is a diagram illustrating an image of generating a prompt character string in the sixth embodiment. [Figure 31] FIG. 20 is a diagram illustrating a display example of an icon selection screen in the sixth embodiment. [Figure 32] 13 is a flowchart illustrating an example of a job flow registration process according to the seventh embodiment. [Figure 33] FIG. 10 is a diagram illustrating differences between an existing job flow and a newly created job flow. [Figure 34] FIG. 20 is a diagram illustrating an image of generating a prompt character string in the seventh embodiment. [Figure 35] FIG. 13 is a diagram illustrating the difference between the icon generated in the seventh embodiment and the icon generated in the first embodiment. [Figure 36] FIG. 20 is a diagram illustrating another example of generating a prompt character string in the seventh embodiment. [Figure 37] 13 is a flowchart illustrating an example of a job flow registration process according to the eighth embodiment. [Figure 38] FIG. 20 is a diagram illustrating an image of generating a prompt character string in the eighth embodiment. [Figure 39] FIG. 10 is a diagram illustrating the difference between the icon generated in the eighth embodiment and the icon generated in the seventh embodiment. [Figure 40] FIG. 20 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by an image processing device assumed in a ninth embodiment. [Figure 41] 13 is a flowchart illustrating an example of a job flow registration process according to the ninth embodiment. [Figure 42] FIG. 20 is a diagram illustrating an image of generating a prompt character string in the ninth embodiment. [Figure 43] 10A and 10B are diagrams illustrating examples of application of other replacement character strings. [Figure 44] FIG. 20 is a diagram illustrating another example of generating a prompt character string in the ninth embodiment. [Figure 45] FIG. 23 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by an image processing device assumed in a tenth embodiment. [Figure 46] FIG. 10 is a diagram illustrating an example of data in a special term conversion table. [Figure 47] FIG. 22 is a diagram illustrating an image of generating a prompt character string in the tenth embodiment. [Figure 48] FIG. 10 is a diagram illustrating an example of another hardware configuration of the image processing apparatus. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <First Embodiment> <System configuration> FIG. 1 is a diagram illustrating a schematic configuration of an image processing system 1 assumed in the first embodiment. 1 includes an image generation AI (=Artificial Intelligence) service 10 and an image processing device 20. The image processing device 20 is an example of an information processing system.

[0010] The image generation AI service 10 is one form of a generation AI service. The image generation AI service 10 is a generation AI service that specializes in image generation, and is provided as a cloud service. The image generation AI service 10 in this embodiment provides the image generation AI with a prompt string received from the image processing device 20, and generates an image corresponding to the prompt string. The image generation AI here is an example of a trained model.

[0011] A prompt string is a string that describes instructions or questions to be given to the image generation AI. Prompt strings are classified into positive strings and negative strings. Positive strings are written with features that are desired to be included in the generated image. On the other hand, negative strings are written with features that are desired to be excluded from the generated image. In this embodiment, positive strings are mainly assumed. Prompt strings are written in natural language, for example.

[0012] Prompt strings also have a highlighting syntax, which is a predefined set of rules for highlighting specific words, sentences, or other features of the string. One of the highlighting constructs is context within the prompt string. When a highlighting construct is contextual, features that appear earlier take precedence over features that appear later. Precedence of earlier features implies ignoring later features.

[0013] Emphasis syntax allows you to use parentheses or numbers to indicate the parts to be emphasized and the degree of emphasis. There are two types of emphasis: positive emphasis and negative emphasis. In the following, negative emphasis will be referred to as "downplay." The degree of emphasis will also be referred to as "importance." The degree of emphasis is determined relative to the target part and other parts. For example, syntax highlighting rules include those that emphasize features enclosed in single parentheses over features without parentheses, and those that emphasize features enclosed in double parentheses over features enclosed in single parentheses. Note that a string can be enclosed in more than two parentheses. In this case, features with more parentheses are given more weight than features with fewer parentheses.

[0014] Conversely, there are rules that give less weight to features enclosed in single brackets than to features not enclosed in single brackets, and rules that give less weight to features enclosed in double brackets than to features enclosed in single brackets. Incidentally, a string can be enclosed in three or more parentheses. In this case, features with more parentheses are given less weight than features with fewer parentheses. In addition, emphasis syntax has a rule that specifies the degree of emphasis by adding a colon and a number after the feature enclosed in single parentheses or single square brackets. For example, writing (Feature A: 1.4) indicates that "Feature A" is emphasized 1.4 times more than other features.

[0015] The image processing device 20 is a device that processes images. In Fig. 1, a printing device is shown as an example of the image processing device 20. The printing device is a device that has a function of printing a document onto paper (so-called printing function). The printing device shown in Figure 1 has a printing function as well as a scanning function, an email function, and a fax function. The scanning function is a function for reading an image of a document. The email function is a function for sending the scanned image by email. The fax function is a function for sending the scanned image by fax.

[0016] A printing device, which is a device that prints documents on paper, is also called an "image forming device" in the sense that it is a device that forms an image on paper. A printing device that has multiple functions is also called a "multifunction device" or "printer-combined device." A job is a unit of processing executed by the image processing device 20. A job corresponds to, for example, a printing function, a scanning function, an email function, or a fax function. One job is defined by a plurality of characteristics.

[0017] A job flow is a combination of multiple jobs that are executed in sequence. In other words, a job flow is a combination of functions such as printing, scanning, email, and fax. For example, a copy function that combines a scanning function and a printing function is one form of job flow. However, it is also possible to define a job flow for a single job. When a "job flow" is referred to as an example of a "process," a "job" is referred to as a "sub-process."

[0018] When a job flow is made up of multiple jobs, the unit of execution is also called a step. A step consists of information about the job type and one or more corresponding setting information. Here, the "job type information" and "settings information" are both examples of "features" that define the job flow. For example, a scan function that indicates the type of job is also an example of a feature, and scan resolution (e.g., 400 bpi) is also an example of a feature. Therefore, a job flow is defined by one or more features.

[0019] <Hardware configuration of image processing device 20> FIG. 2 is a diagram illustrating an example of the hardware configuration of the image processing device 20. As shown in FIG. The image processing device 20 has a processor 21, a ROM (Read Only Memory) 22, and a RAM (Random Access Memory) 23. The ROM 22 stores, for example, a BIOS (Basic Input Output System), firmware, etc. The RAM 23 is used as a work area for the processor 21. In addition, the image processing device 20 has an auxiliary storage device 24, an operation panel 25, a scanner unit 26, an image processing unit 27, a printing unit 28, and a communication interface 29. These units are connected by a bus or other signal lines.

[0020] The processor 21 is a device that realizes various functions through the execution of firmware. The processor 21, the ROM 22, and the RAM 23 function as a computer. The auxiliary storage device 24 is configured, for example, by a hard disk drive or semiconductor storage. The auxiliary storage device 24 stores, for example, a job flow. The auxiliary storage device 24 also stores, for example, firmware, print job data, and scanned images of original documents. Hereinafter, the BIOS, firmware, and application programs are collectively referred to as programs.

[0021] The operation panel 25 is configured, for example, as a touch panel. The touch panel is configured with a display and a capacitive touch sensor that has transparency that does not obstruct the visibility of the image displayed on the display. The scanner unit 26 has, for example, a light source that irradiates illumination light onto the document, an image sensor that captures an image of the document, a mechanism that moves the light source and image sensor relative to the document, and a mechanism that transports the document relative to the light source and image. The image processing unit 27 is a processing unit that performs image processing such as color correction, tone correction, and the like on the image of a print job or an original document.

[0022] The printing unit 28 is a mechanism for forming an image on paper using, for example, an electrophotographic method or an inkjet method. The communication interface 29 is an interface that realizes communication with the image generation AI service 10 (see FIG. 1).

[0023] <Prompt string generation function> 3 is a diagram illustrating the relationship between the functional units and data related to the generation of a prompt string by the image processing device 20 (see FIG. 1) assumed in embodiment 1. The prompt string here is used to obtain an icon representing the contents of the job flow from the image generation AI service 10. In FIG. 3, the program functions are shown in relation to the processor 21, and the data are shown in relation to the secondary storage device 24.

[0024] The processor 21 functions as a UI (User Interface) control unit 211, a job flow display unit 212, a job flow execution unit 213, and a job flow setting unit 214 through the execution of firmware and other programs. The UI control unit 211 is a functional unit that displays information on the operation panel 25 and accepts user operations via the operation panel 25. Specifically, the UI control unit 211 controls the display of menu screens and other operation screens. The UI control unit 211 controls the display of the operation screens in cooperation with, for example, a job flow display unit 212, a job flow execution unit 213, and a job flow setting unit 214.

[0025] The job flow display unit 212 is a functional unit that reads the job flow 241 from the auxiliary storage device 24 and provides it to the UI control unit 211. The job flow display unit 212 provides, for example, an icon and operation details for the job flow 241 to the UI control unit 211. The operation details include, for example, the registered name of the job flow, the execution order of the jobs, and setting information for each job. The job flow 241 is displayed by receiving a display instruction via the operation panel 25.

[0026] The job flow execution unit 213 is a functional unit that reads out from the auxiliary storage device 24 a job flow 241 specified via the operation panel 25 and executes it. In FIG. 3, the execution units corresponding to each job are represented as "job execution unit #1" 213A, "job execution unit #2" 213B, etc. As mentioned above, each job corresponds to, for example, a print function, a scan function, an email function, or a fax function. The job flow execution unit 213 sequentially provides the setting information for each job specified in the job flow to the corresponding job execution unit, and executes the job flow. The job flow execution unit 213 references a job type and execution unit association table 242 to determine the job execution unit to which the setting information for each job is to be given.

[0027] The job flow setting unit 214 is a functional unit that registers the operation contents set via the operation panel 25 as a job flow 241 in the auxiliary storage device 24 . The job flow setting unit 214 communicates with the image generation AI service 10 via the image generation AI communication unit 214A. The job flow setting unit 214 also generates a prompt string to be given to the image generation AI communication unit 214A via the prompt string generation unit 214B. The prompt string generation unit 214B generates a prompt string by applying the operation content of the job flow 241 to a prompt string template 243. The generated prompt string is passed from the prompt string generation unit 214B to the image generation AI communication unit 214A. The job flow setting unit 214 registers the icon received from the image generation AI service 10 in association with the job flow 241 to be processed.

[0028] <Processing operation> The processing operations executed by the image processing device 20 will be explained below by processing content.

[0029] <Job flow registration process> 4 is a flowchart illustrating an example of a job flow registration process according to Embodiment 1. Note that the symbol S in the figure represents a step. The processing operations of the image processing device 20 shown in FIG. 4 are executed as functions of, for example, the UI control unit 211 and the job flow setting unit 214 (see FIG. 3).

[0030] First, the image processing device 20 determines whether the user's operation is a job flow registration operation (step 101). If it is any other operation, a negative result is obtained in step 101. In this case, the image processing device 20 repeats the determination in step 1. On the other hand, if it is a job flow registration operation, a positive result is obtained in step 101. In this case, the image processing apparatus 20 reads out the prompt character string template 243 (see FIG. 3) (step 102).

[0031] 5 is a diagram illustrating an example of an operation screen displayed in relation to job flow registration. The operation screen is displayed on operation panel 25. FIG. 5 shows, as operation screens, a home screen 250, a job flow screen 260, and a new job flow creation screen 270. 5 displays a "Copy" button 251, a "Scan" button 252, a "Fax" button 253, a "Send Email" button 254, a "Box Operation" button 255, and a "Job Flow" button 256. Note that other buttons may also be displayed on the home screen 250.

[0032] When the “Job Flow” button 256 is operated, the screen transitions to a job flow screen 260 . The title "Job Flow" is displayed at the top of the job flow screen 260 shown in FIG. 5, a job flow selection field 261 is displayed in the second row, and a "Create New" button 262 is displayed at the bottom row. The job flow selection column 261 displays a title column 261A, a cancel button 261B, an "OK" button 261C, and a list display column 261D of registered job flows.

[0033] 5, there are no registered job flows, so job flow list display column 261D is blank. When cancel button 261B is operated, the screen returns to home screen 250. When "OK" button 261C is operated, the selection of the job flow selected in job flow list display field 261D is confirmed. The "Create New" button 262 is a button for creating a new job flow.

[0034] When the "Create new" button 262 is operated, a new job flow creation screen 270 is displayed. The title "Create New" is displayed at the top of the new job flow creation screen 270 shown in Figure 5. In addition, the new job flow creation screen 270 has an operation content registration field 271, a "Next" button 272, and a "Register" button 273. In the case of FIG. 5, the operation content registration field 271 displays that the setting name of the job flow to be registered is "Job Flow A: Scan & Email." The operation content registration field 271 also displays that the job type of "Step #1" is "Scan." The operation content registration field 271 also displays that the color mode is "Black and White." The operation content registration field 271 also displays that the double-sided setting is "Double-sided."

[0035] When the "Next" button 272 is operated, the display content of the operation content registration field 271 switches to the next page. On the next page and thereafter, additional settings related to the scan function can be made, and settings for the second and subsequent jobs can also be made. A "Back" button will be added to the next page and onwards. When the "Back" button is pressed, the user will return to the previous page. When "Register" button 273 is operated, the operational details that define the newly registered job flow are confirmed. In the present embodiment, the confirmed operational details are stored as a new job flow in auxiliary storage device 24 (see FIG. 3). At this stage, the icon for the new job flow is not yet confirmed.

[0036] Returning to the explanation of Figure 4. Next, the image processing device 20 reads the operation content of the set job flow (step 103) and generates a prompt character string (step 104). FIG. 6 is a diagram illustrating an image of generating a prompt character string in the first embodiment. The job flow shown in Figure 6 consists of two steps. The job type of the first step (i.e., step #1) is "scan," and the job type of the second step (i.e., step #2) is "send email."

[0037] The template shown in Fig. 6 is an example of the prompt character string template 243 (see Fig. 3). The template is given as, for example, a fill-in-the-blank fixed phrase. The template shown in Figure 6 states, "A simplified diagram showing the process flow. The process is to perform <Step #1 job type> with <Step #1 setting value> on the printer / multifunction device, and then perform <Step #2 job type> with <Step #2 setting value>."

[0038] Here, the "simplified picture" refers to an icon. Therefore, the "simplified picture showing the flow of a process" refers to an icon that expresses the content specified by "The process is to..." In the template shown in Figure 6, each step has an embedding hole for "job type" and an embedding hole for "setting value." If one step has multiple features, content containing multiple features is inserted into the embedding hole for "setting value."

[0039] In the case of Figure 6, "Black and white and double-sided" is inserted into "Step #1 setting value", "Scan" is inserted into "Step #1 job type", "user1@ABC.com" is inserted into "Step #2 setting value", and "Send email" is inserted into "Step #2 job type". As a result, the prompt string becomes "A simplified illustration showing the process flow. The process is to scan in black and white and on both sides with a multifunction printer, and then send an email to user1@ABC.com."

[0040] Returning to the explanation of Figure 4. Once the prompt string is generated, the image processing device 20 transmits the generated prompt string to the image generation AI service 10 (step 105). The prompt string here is an example of a string whose content instructs the output of an icon representing one or more features that define the job flow.

[0041] When the image generation AI service 10 receives the prompt string (step 106), it provides the received prompt string to the image generation AI and generates an icon (step 107). After this, the image generation AI service 10 sends the icon to the image processing device 20 (step 108). This icon expresses the characteristics specified in the prompt string. On the other hand, when the image processing device 20 receives the icon from the image generation AI service 10 (step 109), it associates the operation content with the received icon and stores them (step 110). After that, the image processing device 20 ends the job flow registration process (step 111).

[0042] <Job flow display process> FIG. 7 is a flowchart illustrating an example of a job flow display process. The processing operations of image processing apparatus 20 shown in FIG. 7 are also executed as functions of UI control unit 211 (see FIG. 3) and job flow display unit 212 (see FIG. 3), for example. First, the image processing device 20 determines whether the user's operation is a job flow display operation (step 201). If it is any other operation, a negative result is obtained in step 201. In this case, the image processing device 20 repeats the determination in step 201.

[0043] On the other hand, if the operation is to display a job flow, a positive result is obtained in step 201. In this case, the image processing device 20 starts displaying a list of job flows (step 202). Specifically, the job flow display unit 212 reads out registered job flows from the auxiliary storage device 24 (see FIG. 3) and displays them in a list format. Next, the image processing device 20 displays the job flow in order in response to the user's operation (step 203). 8 is a diagram illustrating a display example of job flow screen 260. In Fig. 8, parts corresponding to those in Fig. 5 are assigned the same reference numerals.

[0044] In job flow screen 260 shown in FIG. 8, one registered job flow is displayed in job flow list display field 261D. In the case of FIG. 8, the registered name of the job flow is "Job Flow A: Scan & Email." An icon is displayed at the beginning of each line displaying a job flow. This icon consists of an image of a document being scanned, an image of an email, an arrow pointing from the image of the document being scanned to the image of the email, and an email address. This icon reflects the characteristics of the job flow. This allows the user to understand the processing details that will be executed when a job flow is selected, even from the icon display.

[0045] Returning to the explanation of Figure 7. Next, the image processing device 20 determines whether or not the display has ended (step 204). If the display has not ended, a negative result is obtained in step 204. In this case, the image processing device 20 returns to step 203. On the other hand, if the display is to be ended, a positive result is obtained in step 204. In this case, the image processing device 20 ends the display processing of the job flow (step 205).

[0046] <Job flow execution process> FIG. 9 is a flowchart illustrating an example of a job flow execution process. The processing operations of the image processing device 20 shown in FIG. 9 are executed as functions of, for example, the UI control unit 211 (see FIG. 3) and the job flow execution unit 213 (see FIG. 3). First, the image processing apparatus 20 determines whether the user's operation is an operation to execute a job flow (step 301). If the operation is other than the above, a negative result is obtained in step 301. In this case, the image processing device 20 repeats the determination in step 301.

[0047] On the other hand, if the operation is to execute a job flow, a positive result is obtained in step 301. In this case, the image processing device 20 reads out the job flow to be executed (step 302). Specifically, the job flow execution unit 213 reads out the job flow designated as the job flow to be executed from the auxiliary storage device 24 (see FIG. 3). Next, the image processing device 20 reads the first step of the read job flow (step 303). Next, the image processing device 20 determines the job execution unit associated with the read step (step 304), and instructs the corresponding job execution unit to execute the job based on the registered setting values ​​(step 305).

[0048] Next, the image processing device 20 determines whether or not it is the last step (step 306). If it is not the last step, a negative result is obtained in step 306. In this case, the image processing device 20 reads the next step (step 307) and returns to step 304. On the other hand, if it is the last step, a positive result is obtained in step 306. In this case, the image processing device 20 ends the execution processing of the job flow (step 308).

[0049] <Summary> In this embodiment, the image processing device 20 generates a prompt string whose content corresponds to the characteristics that define the job flow, and requests the image generation AI service 10 to generate an icon. The image processing device 20 then stores the icon obtained from the image generation AI service 10 in association with the job flow to be registered. Therefore, in job flow list display field 261D (see FIG. 8), icons reflecting the operation content of the job flow are displayed along with the registered name of the job flow.

[0050] This allows the user to easily predict the operation contents to be executed in the job flow from the icon, making it easier to select a job flow. Incidentally, if a job flow is associated with an icon that is prepared regardless of the content of the job flow or an icon that corresponds to only one job that defines the job flow, it is difficult for a user to guess the content of the job flow just by looking at the icon.

[0051] <Embodiment 2> In this embodiment, a case will be described in which an image generation AI service 10 (see FIG. 1) generates a plurality of icons and provides them to an image processing device 20 (see FIG. 1). The generation of multiple icons by the image generation AI service 10 may be based on a function inherent to the image generation AI service 10 or on instructions from the image processing device 20. The inherent function here refers to the ability to generate multiple icons without explicit instructions using a prompt string.

[0052] Fig. 10 is a flowchart illustrating an example of a job flow registration process according to Embodiment 2. In Fig. 10, parts corresponding to those in Fig. 4 are assigned the same reference numerals. In the case of Fig. 10, the processing operations of steps 101 to 103 are the same as those in Fig. 4. Therefore, the description of the processing operations for these steps will be omitted. When the operation content of the job flow is read, the image processing device 20 generates a prompt character string (step 104A). However, the generation of the prompt character string uses a template of text instructing the generation of a plurality of icons.

[0053] FIG. 11 is a diagram illustrating an image of generating a prompt character string in the second embodiment. The operation content of the job flow shown in FIG. 11 is the same as the operation content of the job flow exemplified in FIG. However, the template text is different. That is, the template shown in Figure 11 is "Simplified multiple pictures that show the flow of processing. The processing is to perform <Step #1 job type> with <Step #1 setting value> on the printer / multifunction device, and then perform <Step #2 job type> with <Step #2 setting value>," and the text instructs the generation of "multiple pictures."

[0054] For this reason, a prompt string is generated that reads, "Several simplified pictures that represent the process flow. The process is to scan in black and white and on both sides with a multifunction printer, and then send it by email to user1@ABC.com." Although the template used in FIG. 11 does not specify the number of icons to be generated as "multiple pictures," it is also possible to specify the number, for example, "three pictures." Returning to the explanation of Figure 10. After that, the image processing device 20 transmits the generated prompt character string to the image generation AI service 10 (step 105).

[0055] On the other hand, when the image generation AI service 10 receives the prompt string (step 106), it provides the received prompt string to the image generation AI and generates multiple icons (step 107A).Then, the image generation AI service 10 transmits the multiple icons to the image processing device 20 (step 108A). When the image processing device 20 receives a plurality of icons (step 109A), it displays the icon selection screen 280 (see FIG. 12) (step 121).

[0056] 12 is a diagram illustrating a display example of the icon selection screen 280 in Embodiment 2. The icon selection screen 280, which is one of the operation screens, is displayed on the operation panel 25. In addition to the title "Icon Selection," an icon list display field 281 and an "OK" button 282 are displayed on the icon selection screen 280 shown in FIG. In the case of Figure 12, the icon list display field 281 displays the instruction "Please select an icon" and three icons. All of these icons are generated by the image generation AI service 10 (see Figure 1). Each icon has an image of scanning a document and an image of an email placed before and after the arrow. Unlike the first embodiment, multiple icons are displayed, allowing the user to select the icon of their choice. When any icon is selected, the selection is confirmed by operating the "OK" button 282.

[0057] Fig. 13 is a diagram illustrating another display example of the icon selection screen 280. In Fig. 13, parts corresponding to those in Fig. 12 are assigned the same reference numerals. 13, icons prepared in advance in the image processing device 20 are added. In the case of FIG. 13, the three icons displayed in the lower row of the icon selection screen 280 correspond to the icons prepared in advance in the image processing device 20. Incidentally, the icon on the far left of the bottom row is an image of scanning a document, the icon in the middle of the bottom row is an image of an email, and the icon on the far right of the bottom row is a double circle icon. The double circle icon is even unrelated to the two jobs that define the job flow.

[0058] Note that due to differences in compatibility between the prompt string and the image generation AI service 10, user preferences, etc., the user may not want to select an icon candidate provided by the image generation AI service 10. However, as shown in Figure 13, icons pre-installed in the image processing device 20 are also displayed as selection candidates, making it possible to set an icon that is closest to the user's image. Returning to the explanation of Figure 10. When the user selects one of the icons, the image processing device 20 associates the operation content with the selected icon and saves them (step 110A), and ends the job flow registration process (step 111).

[0059] <Summary> In the case of image processing device 20 according to the present embodiment, it is possible to select an icon to be registered in association with a job flow from among a plurality of candidates. As a result, the user can register an icon that best suits his or her preferences in association with the job flow. Furthermore, by displaying not only candidate icons generated by the image generation AI service 10 but also icons built into the image processing device 20 as candidates, it becomes possible for the user to select an icon that is easy to use. Examples of easy-to-use icons also include those that are highly distinctive from existing icons. In this embodiment, it is assumed that multiple icons are provided from the image generation AI service 10. However, even if only one icon is provided from the image generation AI service 10, multiple icons, including an icon built into the image processing device 20, may be displayed as selectable icons.

[0060] <Third Embodiment> In this embodiment, a function for supporting the generation of icons that emphasize specific features that define a job flow will be described. The characteristics that define the job flow are given as the user's selection results for the items that can be set for each job. Therefore, if all the characteristics are reflected in the icons, it would be difficult to understand the differences between the icons. Therefore, in this embodiment, an icon that emphasizes the difference from the default setting is generated, thereby realizing the generation of an icon with enhanced identifiability and distinguishability.

[0061] Fig. 14 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by the image processing device 20 (see Fig. 1) assumed in embodiment 3. In Fig. 14, parts corresponding to those in Fig. 3 are assigned the same reference numerals. 14, a job type-specific default value 244 is added to the auxiliary storage device 24 of the image processing apparatus 20. The other functional units and data are the same as those in FIG. The default values ​​by job type 244 stores default values ​​of setting values ​​associated with each job type.

[0062] The default values ​​are basic or general-purpose settings. For example, in the case of "scan," the default value for the color mode is "black and white," and the default value for the double-sided setting is "single-sided." 14 refers to the job type-specific default values ​​244 to narrow down the features that define the job flow and apply the narrowed-down features to a prompt string template. In other words, a preprocessing step is added to the prompt string generation unit 214B to extract features to be applied to the prompt string template.

[0063] 15 is a flowchart illustrating an example of a job flow registration process according to Embodiment 3. In FIG. 15, parts corresponding to those in FIG. 4 are denoted by the same reference numerals. In the case of Fig. 15, the processing operations of steps 101 to 103 are the same as those in Fig. 4. Therefore, the description of the processing operations for these steps will be omitted. When the operation content of the job flow is read, the image processing device 20 extracts the part of the setting content of each job that defines the operation content that differs from the default value set for each type of job (step 131). Next, the image processing device 20 generates a prompt character string using the extracted setting value (step 104B). Note that the subsequent processing operations are the same as those in FIG. 4, and therefore a description thereof will be omitted.

[0064] 16 is a diagram illustrating the relationship between the characteristics that define the job flow and the default values ​​for each job type. The content of the job flow shown in FIG. 16 is the same as the content of the job flow shown in FIG. In the case of Figure 16, the default values ​​for each job type are specified as "Black and White" for the color mode of "Scan" and "Single-sided" for the double-sided setting. Also, the destination for "Email Sending" is specified as "Empty string." An empty string means that no setting has been made. In the case of the job flow shown in Fig. 16, the differences from the default values ​​are the double-sided setting "Double-sided" in "Step #1" and the destination "user1@ABC.com" in "Step #2." In Fig. 16, the differences are indicated by dashed lines.

[0065] 17 is a diagram illustrating an image of generating a prompt character string in embodiment 3. The image of generation shown in FIG. 17 corresponds to FIG. In FIG. 17, an "extracted job flow" is inserted between a "job flow" and a "template." The contents of the extraction job flow correspond to the differences in FIG. For this reason, the job type of the first step (i.e., step #1) in the extraction job flow is described as "scan" and the double-sided setting is described as "double-sided," while the job type of the second step (i.e., step #2) is described as "email sending" and the destination is described as "user1@ABC.com."

[0066] The difference from FIG. 6 is that the color mode setting has been removed from the setting values ​​of the first step #1. Therefore, "double-sided" is inserted into the "setting value for step #1" of the prompt character string template 243 (see FIG. 3), and "user1@ABC.com" is inserted into the "setting value for step #2". As a result, the prompt string becomes "A simplified illustration showing the process flow. The process is to scan both sides with a printer / multifunction device and then send an email to user1@ABC.com."

[0067] FIG. 18 is a diagram illustrating the difference between the icon 320 generated in the third embodiment and the icon 310 generated in the first embodiment. Icon 310 shown in the upper part of FIG. 18 is the same as the job flow icon in job flow list display column 261D (see FIG. 8). An icon 320 shown in the lower part of FIG. 18 is an icon obtained by providing the image generation AI service 10 with a prompt character string generated from the extraction job flow. In the icon 320, only the part representing "double-sided" scanning, which is a difference from the default settings for "scan," remains, and the part representing "black and white" scanning, which is the default setting, is gone.

[0068] <Summary> In the case of image processing device 20 of this embodiment, it is possible to register an icon representing a difference from the default value for each job that defines the job flow, in association with the job flow. In other words, even if the number of features defining the job flow is large, it is possible to generate an icon that highlights the difference from the default value and associate it with the job flow. The emphasis in this embodiment is to remove parts related to default values, which makes the icon designs simpler and is expected to improve identifiability.

[0069] As a result, even when selecting a job flow in job flow list display field 261D, the user can easily find the desired job flow because of the icon with its highlighted features. In this embodiment, it is assumed that only one icon is provided from the image generation AI service 10 (see Figure 1), and the provided icon is associated with the job flow to be registered without user confirmation. However, icon candidates to be associated with the job flow may be presented to the user so that the user can select from them. The multiple icons presented as selection candidates may be multiple icons provided from the image generation AI service 10, or may be multiple icons including icons built into the image processing device 20.

[0070] <Fourth Embodiment> In this embodiment, a case where emphasis syntax is applied to a prompt character string will be described. In the image generation AI service 10, the content of the first step may be given more importance than subsequent steps. In this case, an icon that emphasizes the first step in the job flow is generated. However, depending on the job flow, the final step is often more important.

[0071] 19 is a flowchart illustrating an example of a job flow registration process according to Embodiment 4. In FIG. 19, parts corresponding to those in FIG. 4 are denoted by the same reference numerals. In the case of Fig. 19, the processing operations of steps 101 to 103 are the same as those in Fig. 4. Therefore, the description of the processing operations for these steps will be omitted. After reading the job flow operation content, the image processing device 20 generates a prompt string (step 104C). However, in this generation process, syntax highlighting is applied only to the final step.

[0072] 20 is a diagram illustrating an image of how a prompt character string is generated in embodiment 4. The image of how a prompt character string is generated shown in FIG. 20 corresponds to FIG. In the case of FIG. 20, the contents of the job flow to be registered and the contents of the template to be applied are the same as those in FIG. However, a process has been added to highlight the setting value of the final step when applying the job flow operation content to a template.

[0073] Therefore, the following prompt string is generated: "A simplified illustration showing the process flow. The process is to scan in black and white and on both sides with a multifunction printer, and then send an email to (user1@ABC.com)." Specifically, the sentence "send email to user1@ABC.com" is enclosed in single parentheses.

[0074] Returning to the description of FIG. The processing operations after step 104C, that is, steps 105 to 111, are the same as those in FIG. The image generation AI service 10 generates an icon that highlights "Send email to user1@ABC.com" according to the prompt character string that includes the emphasis syntax (step 107). FIG. 21 is a diagram illustrating the difference between the icon 330 generated in the fourth embodiment and the icon 310 generated in the first embodiment.

[0075] Icon 310 shown in the upper part of FIG. 21 is the same as the job flow icon in job flow list display column 261D (see FIG. 8). The icon 330 shown in the lower part of FIG. 21 is an icon obtained by providing a prompt character string including an emphasis syntax to the image generation AI service 10. In the icon 330 shown in the lower row, the size of the image corresponding to "send email" is larger than the size of the image corresponding to "scan." The content of the image corresponding to "send email" has also been changed to show an envelope that has been opened and half of the message removed. The image corresponding to "scan" is also simpler than the image in icon 310. This makes the image corresponding to "send email" more noticeable.

[0076] <Summary> In the case of image processing device 20 of this embodiment, a prompt string is generated in which the setting value of the final step that defines the job flow is written in emphasis syntax, making it possible to register an icon with a prominent design corresponding to the final step in association with the job flow. In the image processing device 20 of this embodiment, the setting value of the final step is always written in an emphasis syntax, but some users may want an icon in which the setting value of the first step is emphasized. For this reason, the step to be emphasized may be specified by the user.

[0077] For example, when the "Register" button 273 (see FIG. 5) is operated on the new job flow creation screen 270 (see FIG. 5), the image processing device 20 may display a setting screen 290, 300 (see FIG. 22) for setting the position to apply the emphasis syntax on the operation panel 25 (see FIG. 5). FIG. 22 is a diagram illustrating an example of display of setting screens 290 and 300 for setting the position to which emphasis syntax is applied.

[0078] First, a setting screen 290 is displayed. In addition to the title "Setting the position where emphasis syntax is applied," the setting screen 290 displays an explanation 291 of the operation required of the user, a selection button 292, and an "OK" button 293. In the case of FIG. 22, the explanatory text 291 reads, "Do you want to apply syntax highlighting?" The selection button 292 is a radio button, and either the "No" button or the "Yes" button can be selected. In Fig. 22, the "Yes" button is selected. If the "OK" button 293 is operated with the "No" button selected, generation of a prompt character string begins.

[0079] Here, a case will be considered in which the "OK" button 293 is operated with the "Yes" button selected. In this case, a setting screen 300 is displayed. In addition to the title "Setting the position where emphasis syntax is applied," the setting screen 300 displays an explanation 301 of the operation required of the user, a job flow step display field 302, and an "OK" button 303. In the case of FIG. 22, the explanatory text 301 reads, "Please specify the position where the emphasis syntax should be applied."

[0080] In job flow step display field 302, buttons labeled with the job type of each step of the job flow set on new job flow creation screen 270 (see FIG. 5) are displayed in the order of execution. In the case of Fig. 22, the first step is the "Scan" button, and the last step is the "Send Email" button. In Fig. 22, the "Send Email" button is in a selected state. Therefore, when the "OK" button 303 is operated, syntax highlighting is applied to the setting value of the last step, just like in this embodiment.

[0081] In this embodiment, it is assumed that only one icon is provided from the image generation AI service 10 (see Figure 1), and the provided icon is associated with the job flow to be registered without user confirmation. However, icon candidates to be associated with the job flow may be presented to the user so that the user can select from them. The multiple icons presented as selection candidates may be multiple icons provided from the image generation AI service 10, or may be multiple icons including icons built into the image processing device 20.

[0082] <Fifth Embodiment> In the fourth embodiment described above, an example of emphasizing the final step of a job flow and an example of specifying the step to be emphasized on the operation screen have been described. In this embodiment, we will explain another application example of the emphasis syntax. In this embodiment, we will explain a case where the relationship between a setting value and an emphasis level (hereinafter referred to as a "priority value") is registered in advance, and the emphasis syntax is applied to a prompt character string based on the predetermined relationship.

[0083] Fig. 23 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by the image processing device 20 (see Fig. 1) assumed in embodiment 5. In Fig. 23, parts corresponding to those in Fig. 3 are assigned the same reference numerals. A set character priority value table 245 is added to the auxiliary storage device 24 of the image processing device 20 shown in Fig. 23. Other functional units and data are the same as those in Fig. 3. The set character priority value table 245 is an example of a priority relationship between predefined features. Fig. 24 is a diagram illustrating an example of the set character priority value table 245. The set character priority value table 245 shown in Fig. 24 is made up of set characters 245A and priority values ​​245B.

[0084] The setting characters 245A indicate the type of job (i.e., job type) and setting value to be executed by the image processing device 20. In Fig. 24, "scan" and "email send" are shown as examples of job types. Also, "double-sided" and "color" are shown as examples of setting values. Needless to say, these are just examples. The priority value 245B is a numerical value that indicates the degree of emphasis for the set value. In this embodiment, the priority value 245B is set at the time of shipping the image processing device 20.

[0085] The numerical value of the priority value 245B indicates the degree of emphasis. For example, a character set with a priority value of "2" is emphasized more than a character set with a priority value of "1." However, in this embodiment, the prompt string generation unit 214B controls the application of emphasis syntax based on a comparison with a threshold value that is provided separately from the priority value. Specifically, emphasis syntax is not applied to characters set with a priority value smaller than 245B.

[0086] 25 is a flowchart illustrating an example of a job flow registration process according to Embodiment 5. In FIG. 25, parts corresponding to those in FIG. 4 are denoted by the same reference numerals. In the case of Fig. 25, the processing operations of steps 101 to 103 are the same as those in Fig. 4. Therefore, the description of the processing operations for these steps will be omitted. After reading the job flow operation content, the image processing device 20 generates a prompt character string (step 104D). However, in this generation process, the operation content is checked against the set character priority value table 245 (see FIG. 23), and emphasis syntax is applied only to set characters whose priority value is greater than the threshold value.

[0087] 26 is a diagram illustrating an image of how a prompt character string is generated in embodiment 5. The image of how a prompt character string is generated shown in FIG. 26 corresponds to FIG. In the case of FIG. 26, the contents of the job flow to be registered and the contents of the template to be applied are the same as those in FIG. However, a process for emphasizing set characters with a priority value 245B (see FIG. 24) greater than 1 in the prompt character string generated by applying the template has been added. In this embodiment, of the setting characters included in the prompt character string, the setting characters with priority values ​​245B greater than 1 are "double-sided" and "email transmission."

[0088] For this reason, the following prompt string is generated: "A simplified illustration showing the process flow. The process is to scan in black and white (double-sided) using a multifunction printer, and then (send an email) to user1@ABC.com." Specifically, "Double-Sided" and "Email Sending" are enclosed in single parentheses. In the case of Figure 26, the difference in size between the priority value 245B of "Double-Sided" and the priority value 245B of "Email Sending" is not reflected in the prompt character string.

[0089] Returning to the explanation of FIG. The processing operations after step 104D, that is, steps 105 to 111, are the same as those in FIG. The image generation AI service 10 generates icons that highlight "double-sided" and "email sending" according to the prompt string that includes the emphasis syntax (step 107). FIG. 27 is a diagram illustrating the difference between the icon 340 generated in the fifth embodiment and the icon 310 generated in the first embodiment.

[0090] Icon 310 shown in the upper part of FIG. 27 is the same as the job flow icon in job flow list display column 261D (see FIG. 8). The icon 340 shown in the lower part of FIG. 27 is an icon obtained by providing a prompt character string including an emphasis syntax to the image generation AI service 10. In icon 340, the folded portion of the image representing "scan" is larger than in icon 310. Note that the part representing "black and white" scanning that was present in icon 310 is no longer present in icon 340. In addition, the display size of the image representing "send email" in icon 340 is larger than that of icon 310. Note that the destination address that was present in icon 310 is no longer present in icon 340. Incidentally, it can be said that in the icon 340 shown in FIG. 27, set characters other than the set characters to which the emphasis syntax is applied are not taken into consideration.

[0091] <Summary> In the case of the image processing device 20 of this embodiment, it is possible to apply the applicable syntax to the prompt string for each set character of each job that defines the job flow. Therefore, it is possible to obtain from the image generation AI service 10 an icon 340 that highlights only the set characters whose priority value is greater than the threshold, rather than for each step at a specific execution position. As a result, the image of the generated icon 340 becomes simpler, and improved identifiability is expected.

[0092] In the description of this embodiment, it is assumed that the threshold value used for comparison with the priority value 245B (see FIG. 24) is set in advance, but the threshold value may be variable by the user. For example, if the threshold value is reduced, it is possible to increase the number of set characters to be emphasized. On the other hand, if the threshold value is increased, it is possible to decrease the number of set characters to be emphasized. As a result, it is possible to obtain icons 340 with different combinations of emphasized parts. It is also possible to make the impression of the generated icon 340 closer to the user's preferences.

[0093] Furthermore, in the description of this embodiment, the set character priority value table 245 (see FIG. 23) is set at the time of shipping the image processing device 20, but the user may also be able to individually change the priority value 245B (see FIG. 24). For example, the priority value 245B for set characters corresponding to parts that the user wants to emphasize can be made larger than a threshold value, and the priority value 245B for set characters corresponding to parts that the user wants to minimize can be made smaller than the threshold value. As a result, the impression of the generated icon 340 can be made closer to the user's preferences.

[0094] In this embodiment, it is assumed that only one icon is provided from the image generation AI service 10 (see FIG. 1), and the provided icon is associated with the job flow to be registered without user confirmation. However, icon candidates to be associated with the job flow may be presented to the user so that the user can select from them. The multiple icons presented as selection candidates may be multiple icons provided from the image generation AI service 10, or may be multiple icons including icons built into the image processing device 20.

[0095] In the description of this embodiment, the same emphasis syntax is applied to set characters having priority values ​​245B greater than the threshold value, but the icon 330 may reflect the difference in the size of the priority values ​​245B. Fig. 28 is a diagram illustrating other prompt character strings generated in the fifth embodiment. Fig. 28 shows two prompt character strings as examples.

[0096] Prompt string A in the upper row of Figure 28 corresponds to a case where the emphasis syntax to be applied is switched by comparing it with two thresholds. Specifically, this is an example where set characters with a priority value 245B greater than 1 and less than 2 are enclosed in single parentheses, and set characters with a priority value of 2 or greater are enclosed in double parentheses. In this case, it is possible to generate an icon 330 that emphasizes "double-sided" scanning over "email sending." The two threshold values ​​may be variable by the user. By varying the threshold values, it becomes possible to fine-tune the degree of emphasis for each character. Of course, there may be three or more threshold values.

[0097] The prompt character string B in the lower part of Figure 28 corresponds to a case where the emphasis syntax to be applied is switched by comparing it with two thresholds. Specifically, this is an example in which the priority value 245B is associated with the set character and displayed. In this case, it is possible to generate an icon 330 that is emphasized or deemphasized according to the priority value 245B set in the set character priority value table 245. As described above, if the user can change the magnitude of the priority value 245B, it becomes possible to finely adjust the degree of emphasis for each set character.

[0098] <Sixth Embodiment> In the fourth embodiment described above, an example of emphasizing the final step of a job flow and an example of specifying the step to be emphasized on the operation screen have been described. In this embodiment, we will describe an embodiment in which multiple prompt strings with different emphasized steps can be provided to the image generation AI service 10, allowing the user to select an icon to register from multiple icons with different emphasized steps.

[0099] Fig. 29 is a flowchart illustrating an example of a job flow registration process according to Embodiment 6. In Fig. 26, parts corresponding to those in Fig. 4 are assigned the same reference numerals. In the case of Fig. 29, the processing operations of steps 101 to 103 are the same as those in Fig. 4. Therefore, the description of the processing operations for these steps will be omitted. After reading the job flow operation content, the image processing device 20 generates prompt strings with different highlighted steps for each step in the job flow (step 104E). In this embodiment, the job flow consists of two steps. Therefore, two prompt strings are generated.

[0100] The two prompt strings here are an example of multiple strings that swap the priority relationships in expression between multiple sub-processes. Incidentally, "step" is an example of a sub-process, "prompt string" is an example of a string, and "step to emphasize" is an example of a priority relationship in expression. 30 is a diagram illustrating an image of generating a prompt character string in embodiment 6. The image of generation shown in FIG. 30 corresponds to FIG. In the case of FIG. 30, the contents of the job flow to be registered and the contents of the template to be applied are the same as those in FIG.

[0101] However, a process for generating two prompt character strings #1 and #2 in which the job types to be highlighted are swapped has been added. In the case of FIG. 30, a prompt character string #1 that emphasizes the "scan" step and a prompt character string #2 that emphasizes the "send mail" step are generated.

[0102] For example, prompt string #1 is "A simplified illustration showing the process flow. The process is to scan in black and white and on both sides using a multifunction printer (scan: 2.0), and then send it by email to user1@ABC.com." For example, prompt string #2 is "A simplified illustration showing the process flow. The process is to scan in black and white and double-sided on a printer / multifunction device, and then (send email: 2.0) to user1@ABC.com." Numerical emphasis syntax is applied in Fig. 30. Note that in this embodiment, since the purpose is to change the steps to be emphasized, the numerical values ​​used for emphasis may remain the same.

[0103] Returning to the explanation of Figure 29. Next, the image processing device 20 transmits the generated prompt string #1 to the image generation AI service 10 (step 105E1). The prompt string #1 is one of the two prompt strings generated in step 104E. When the image generation AI service 10 receives prompt string #1 (step 106E1), it provides the received prompt string #1 to the image generation AI and generates icon #1 (step 107E1). After this, the image generation AI service 10 transmits icon #1 to the image processing device 20 (step 108E1). Icon #1 highlights the step specified by prompt string #1. On the other hand, when the image processing device 20 receives the icon #1 from the image generation AI service 10 (step 109E1), it associates the job type of step #1 with the received icon #1 and stores them (step 141).

[0104] Next, the image processing device 20 transmits the generated prompt string #2 (step 105E2), which is the remaining one of the two prompt strings generated in step 104E. When the image generation AI service 10 receives prompt string #2 (step 106E2), it provides the received prompt string #2 to the image generation AI and generates icon #2 (step 107E2). After this, the image generation AI service 10 sends icon #2 to the image processing device 20 (step 108E2). Icon #2 highlights the step specified in prompt string #2. On the other hand, when the image processing device 20 receives the icon #2 from the image generation AI service 10 (step 109E2), it associates the job type of step #2 with the received icon #2 and stores them (step 142).

[0105] When the icons corresponding to the two prompt character strings #1 and #2 are acquired, the image processing device 20 displays the icon selection screen 280 (see FIG. 31) (step 143). 31 is a diagram illustrating a display example of the icon selection screen 280 in Embodiment 6. The icon selection screen 280, which is one of the operation screens, is displayed on the operation panel 25. In addition to the title "Icon Selection," an icon list display field 281 and an "OK" button 282 are displayed on the icon selection screen 280 shown in FIG. In the case of Figure 31, the icon list display field 281 displays the instruction "Please select an icon," an icon display area 281A that emphasizes scanning, and an icon display area 281B that emphasizes sending an email.

[0106] 31, three icons emphasizing scanning are displayed in display area 281A, and three icons emphasizing sending email are displayed in display area 281B. However, as in the first embodiment, only one icon may be displayed in each of display area 281A and display area 281B. Returning to the explanation of Figure 29. When the user selects one of the icons, the image processing device 20 associates the operation content with the selected icon and saves them (step 110E), and ends the job flow registration process (step 111).

[0107] <Summary> In the case of the image processing device 20 in this embodiment, the user can obtain from the image generation AI service 10 multiple types of icons that highlight at least one of the multiple steps specified in the job flow. Therefore, a user operating image processing device 20 described in this embodiment can select an icon to associate with a job flow from among icons that have different emphasized parts depending on the emphasized step. In other words, it becomes easier to register an icon that is closer to one's preference in association with a job flow than if one icon were to be selected from multiple icons that emphasize the same step.

[0108] <Seventh Embodiment> In the above-described embodiment, each time a new job flow is registered, an icon is generated independently according to the operation details that define the job flow to be registered. Therefore, if the operation details of the new job flow are similar to those of an existing job flow, a similar icon may be provided by the image generation AI service 10. In this case, the job flow's identifiability by the icon may be reduced.

[0109] Therefore, in this embodiment, a technology is described for generating a prompt string so that, when a job flow with similar operation content already exists, an icon with low similarity to the icon registered for the existing job flow is generated. 32 is a flowchart illustrating an example of a job flow registration process according to Embodiment 7. In Fig. 32, parts corresponding to those in Fig. 4 are assigned the same reference numerals. In the case of Fig. 32, the processing operations of steps 101 to 103 are the same as those in Fig. 4. Therefore, the description of the processing operations for these steps will be omitted.

[0110] When the operation content of the job flow is read, the image processing device 20 extracts existing job flows with similar operation content (step 151). The existing job flows are read from the auxiliary storage device 24 (see FIG. 3). In this embodiment, job flows that satisfy predetermined conditions are considered to be similar. The predetermined conditions may include, for example, similar operational content. Similar operational content means, for example, that the combination of job types and execution order that define the job flow are the same. Similar operational content also means, for example, that some of the job characteristics that define the job flow overlap.

[0111] When similar job flows are extracted, the image processing device 20 extracts the differences between the extracted job flows and the other job flows from the setting contents of each job that define the operation contents (step 152). FIG. 33 is a diagram illustrating the differences between an existing job flow and a newly created job flow. In the case of FIG. 33, the first step #1 of both the existing job flow and the newly created job flow is set to "scan" and the last step #2 is set to "send email."

[0112] Additionally, both the existing job flow and the newly created job flow have the same double-sided scanning and destination. However, the color mode settings are different. Specifically, the "scan" in the existing job flow is performed in black and white, while the "scan" in the newly created job flow is performed in color.

[0113] Returning to the explanation of Figure 32. Next, the image processing device 20 generates a prompt string (step 104F), except that the image processing device 20 applies syntax highlighting only to the extracted differences. 34 is a diagram illustrating an image of how a prompt character string is generated in embodiment 7. The image of how a prompt character string is generated shown in FIG. 34 corresponds to FIG. In the case of FIG. 34, the contents of the job flow to be registered and the contents of the template to be applied are the same as those in FIG.

[0114] However, in the case of FIG. 34, processing has been added to emphasize the differences from other similar job flows. In the case of Figure 34, a prompt string is generated that emphasizes "color" in the "scan" step. Specifically, the following prompt string is generated: "A simplified illustration showing the process flow. The process is to scan (color) and double-sided with a multifunction printer, and then send an email to user1@ABC.com."

[0115] Returning to the explanation of Figure 32. When the prompt character string is generated, the image processing device 20 executes the same processing operations as those in FIG. 6, that is, steps 105 to 111. FIG. 35 is a diagram illustrating the difference between the icon 350 generated in the seventh embodiment and the icon 310 generated in the first embodiment. Icon 310 shown in the upper part of FIG. 35 is the same as the job flow icon in job flow list display column 261D (see FIG. 8).

[0116] The icon 350 shown in the lower part of FIG. 35 is an icon obtained by providing the image generation AI service 10 with a prompt character string in which emphasis syntax is applied to the character portion of "color." In icon 350, the image representing "scan" has been changed to a color display. In other words, the parts that were displayed in black and white in icon 310 have been changed to a color display. The operation panel 25 (see FIG. 2) assumed in this embodiment is capable of color display. Therefore, even when icon 310 and icon 350 are displayed side by side, it is easy to guess the job flow settings from the difference in the display colors of the corresponding parts.

[0117] <Summary> In the image processing device 20 of this embodiment, when another job flow similar in operation content to the job flow to be newly created is found, it is possible to instruct the image generation AI service 10 to generate an icon 350 that emphasizes the differences from the other job flow. Therefore, even when icons for multiple job flows with similar operation content are displayed on the job flow screen 260 (see FIG. 8), the icons with different emphasized parts can be displayed. As a result, the identifiability of the job flow by the icons is improved.

[0118] However, the prompt string for highlighting the differences can also be generated by other methods, such as applying a template specifically prepared for highlighting the differences. 36 is a diagram illustrating another image of how a prompt character string is generated in accordance with Embodiment 7. The image of how a prompt character string is generated shown in FIG. 36 corresponds to FIG. In the template #2 used in FIG. 36, the setting values ​​and job type corresponding to the differences are written at the beginning. The template shown in Figure 36 states, "A simplified diagram showing a processing flow that includes <job type with different setting values> with <setting values ​​different from other similar job flows>. The processing involves performing <job type for step #1> with <setting values ​​for step #1> on a multifunction printer, and then performing <job type for step #2> with <setting values ​​for step #2>."

[0119] Incidentally, the "setting value different from other similar job flows" is "color" and the "job type of different setting value" is "scan." As a result, the prompt string becomes, "A simplified illustration showing the process flow including color scanning. The process is to scan in color and on both sides with a printer / multifunction device, and then send the result by email to user1@ABC.com." In the image generation AI service 10, the first statement in the prompt string is given more importance than subsequent statements, so an icon that highlights the differences is generated, similar to icon 340 in FIG.

[0120] In this embodiment, it is assumed that only one icon is provided from the image generation AI service 10 (see Figure 1), and the provided icon is associated with the job flow to be registered without user confirmation. However, icon candidates to be associated with the job flow may be presented to the user so that the user can select from them. The multiple icons presented as selection candidates may be multiple icons provided from the image generation AI service 10, or may be multiple icons including icons built into the image processing device 20.

[0121] <Embodiment 8> In this embodiment, a modification of the seventh embodiment will be described. In the seventh embodiment, the image generation AI service 10 is instructed to generate an icon that emphasizes the differences from the operation content in the existing job flow, thereby improving the identifiability of the icon associated with the job flow. However, since there was no similar job flow when the existing job flow was registered, there is a possibility that the visual impression of the newly created icon will be similar.

[0122] Therefore, in this embodiment, a technique is proposed in which, after generating an icon corresponding to a newly registered job flow, icons for other job flows that have been compared are recreated. Fig. 37 is a flowchart illustrating an example of a job flow registration process according to Embodiment 8. In Fig. 37, parts corresponding to those in Figs. 4 and 32 are assigned the same reference numerals. The processing operations shown in Fig. 37 are executed after steps 101 to 110 in Fig. 32 are executed. For this reason, "S101 to S110 in Fig. 32" is written at the beginning of Fig. 37.

[0123] That is, after executing step 110 in FIG. 32, the image processing device 20 extracts the parts of the operation contents of the job flow extracted in step 151 (see FIG. 32) that differ from the newly registered job flow (step 161). Next, the image processing device 20 generates a prompt string (step 104G), except that the image processing device 20 applies syntax highlighting only to the extracted differences. 38 is a diagram illustrating an image of generating a prompt character string in embodiment 8. The image of generation shown in FIG. 38 corresponds to FIG.

[0124] In the case of FIG. 38, the contents of the job flow to be registered and the contents of the template to be applied are the same as those in FIG. However, in the case of FIG. 38, a process has been added to emphasize the differences from the newly registered job flow. In the case of Figure 38, a prompt string is generated that emphasizes "black and white" in the "scan" step. Specifically, the following prompt string is generated: "A simplified illustration showing the process flow. The process is to scan (black and white) and double-sided with a multifunction printer, and then send an email to user1@ABC.com."

[0125] Returning to the explanation of Figure 37. When the prompt character string is generated, the image processing device 20 executes the same processing operations as those in FIG. 6, that is, steps 105 to 111. Fig. 39 is a diagram illustrating the difference between icon 310A generated in embodiment 8 and icon 350 generated in embodiment 7. In Fig. 39, parts corresponding to those in Fig. 35 are assigned the same reference numerals. Icons 310 shown in the upper part of FIG. 39 are icons associated with existing job flows that have similar operational content to the job flow to be newly created.

[0126] As described above, in the newly created job flow, an icon 350 is generated that emphasizes "color" scanning, which is a difference from the existing job flow. For the existing job flow that was the subject of comparison, icon 310A was generated, emphasizing black and white scanning. Note that in icon 310A, the plain grid pattern before the re-creation has been changed to a black and white checkerboard pattern.

[0127] <Summary> In the image processing device 20 of this embodiment, after a new job flow is registered, an icon 310A is recreated for other job flows with similar operational content. Moreover, the recreated icon 310A is created so as to emphasize differences in the operational content from the newly created job flow. As a result, the icon for the newly created job flow and the icon for an existing job flow with similar operational content have different emphasized parts. As a result, the distinguishability between icons assigned to job flows with similar operational content is improved.

[0128] In this embodiment, it is assumed that only one icon is provided from the image generation AI service 10 (see Figure 1), and the provided icon is associated with the job flow to be registered without user confirmation. However, icon candidates to be associated with the job flow may be presented to the user so that the user can select from them. The multiple icons presented as selection candidates may be multiple icons provided from the image generation AI service 10, or may be multiple icons including icons built into the image processing device 20.

[0129] <Ninth Embodiment> If a job flow contains information that can identify an individual (hereinafter referred to as "personal information"), an icon containing the personal information may be generated. In this case, measures may be required to prevent the leakage of personal information through the icon. For example, this may occur when job flows registered in image processing device 20 are presented to users other than the registered user. Therefore, in this embodiment, a technique for controlling so that personal information or information considered to be personal information is not included in an icon will be described.

[0130] Fig. 40 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by the image processing device 20 (see Fig. 1) assumed in the ninth embodiment. In Fig. 40, parts corresponding to those in Fig. 3 are assigned the same reference numerals. 40 includes an additional personal information protection rule 246 in the auxiliary storage device 24 of the image processing device 20. The other functional units and data are the same as those in FIG. The personal information protection rules 246 include, for example, rules for extracting personal information and rules for generating prompt character strings.

[0131] The rules for extracting personal information include, for example, a dictionary of character strings and character string patterns that are considered to be personal information. In this case, the prompt character string generation unit 214B compares, for example, the operation content of the job flow with the dictionary and extracts personal information included in the operation content. The personal information extraction rule also includes an input field (such as a destination) into which personal information is entered. In this case, the prompt string generation unit 214B extracts a string entered into a specific input field as personal information. The rules for generating prompt strings include, for example, replacing them with alternative strings or deleting them. Alternative strings include, for example, user names, account names, domain names, surnames, and given names, which are part of personal information. Alternative strings also include, for example, dummy strings, affiliations, initials, and attributes.

[0132] 41 is a flowchart illustrating an example of a job flow registration process according to Embodiment 9. In FIG. 41, parts corresponding to those in FIG. 4 are denoted by the same reference numerals. In the case of Fig. 41, the processing operations of steps 101 to 103 are the same as those in Fig. 4. Therefore, the description of the processing operations for these steps will be omitted. When the operation content of the job flow is read, the image processing device 20 extracts the personal information portion based on the personal information extraction rule (step 171). As described above, the personal information extraction rule is registered as the personal information protection rule 246 (see FIG. 40).

[0133] Next, the image processing device 20 generates a prompt string (step 104H). However, the personal information portion is replaced or deleted based on the prompt string generation rules. As described above, the prompt string generation rules are registered as the personal information protection rules 246 (see FIG. 40). 42 is a diagram illustrating an image of generating a prompt character string in Embodiment 9. The image of generation shown in FIG. 42 corresponds to FIG.

[0134] In the case of FIG. 42, the contents of the job flow to be registered and the contents of the template to be applied are the same as those in FIG. However, in the case of FIG. 42, a process for replacing personal information has been added. In the case of Figure 42, the destination "user1@ABC.com" is the personal information part, so a substitute string is applied to the personal information part to generate a prompt string. In the case of Figure 42, the replacement string is the dummy string "test@example.com." Therefore, the prompt string generated is "A simplified illustration showing the process flow. The process is to scan in black and white on both sides with a multifunction printer, and then send an email to test@example.com."

[0135] FIG. 43 is a diagram for explaining an application example of another replacement character string. In prompt string A, "user1@ABC.com" is replaced with "To ABC," which indicates the organization. In this case, even if the generated icon contains the characters "To ABC," the individual cannot be identified. In prompt string B, "user1@ABC.com" is replaced with "Home" which indicates the recipient's affiliation. In this case, even if the generated icon contains the characters "Home," the individual cannot be identified.

[0136] In the prompt string C, "user1@ABC.com" is replaced with the initial "U." In this case, even if the generated icon contains the initial "U," the individual cannot be identified. In prompt string D, "user1@ABC.com" is replaced with "To Suzuki," which represents the surname of "User1." The surname is identified from the personal information associated with the email address recorded in the address book. In this case, even if the generated icon contains the surname "Suzuki," the individual cannot be identified. In the prompt string E, "user1@ABC.com" is replaced with "To Taro," which represents the name of "User1." The name is identified from the personal information associated with the email address recorded in the address book. In this case, even if the generated icon contains the name "Taro," the individual cannot be identified.

[0137] 44 is a diagram illustrating another image of how a prompt character string is generated in accordance with Embodiment 9. The image of how a prompt character string is generated shown in FIG. In the case of FIG. 44, the contents of the job flow to be registered and the contents of the template to be applied are the same as those in FIG. However, in the case of FIG. 44, a process for deleting personal information has been added. In the case of Figure 44, the destination "user1@ABC.com" is the personal information part, so a prompt string is generated with the personal information "user1@ABC.com" deleted. In the case of Figure 44, the following prompt string is generated: "A simplified picture showing the process flow. The process is to scan in black and white on both sides with a multifunction printer and then send it by email." In this case, no personally identifiable information is included in the icon.

[0138] <Summary> In the image processing device 20 of this embodiment, even if personal information is included in the operation content that defines the job flow, it becomes difficult to identify individuals through icons obtained from the image generation AI service 10, for example, by replacing the information with dummy strings or deleting the personal information. On the other hand, by replacing personal information in the operation content that defines the job flow with affiliation, initials, surname, and given name, it is possible to achieve both protection of personal information and convenience. For example, it is possible to create an icon that allows the user who registered the job flow to be identified as an individual, while making it difficult for other users to identify the individual.

[0139] In this embodiment, it is assumed that only one icon is provided from the image generation AI service 10 (see Figure 1), and the provided icon is associated with the job flow to be registered without user confirmation. However, icon candidates to be associated with the job flow may be presented to the user so that the user can select from them. The multiple icons presented as selection candidates may be multiple icons provided from the image generation AI service 10, or may be multiple icons including icons built into the image processing device 20.

[0140] <Tenth Embodiment> The set characters used to define the job flow may differ from general terminology. In other words, even if the same operation content is performed, different vendors of the image processing device 20 may use different terminology. In such cases, even if a prompt string is generated using set characters specific to a specific vendor, it may not be understood by the image generation AI service 10. In other words, the image generation AI service 10 may provide an icon with an unintended design. Therefore, in this embodiment, a function for converting a special expression into a general-purpose expression will be described.

[0141] Fig. 45 is a diagram illustrating the relationship between functional units and data related to the generation of a prompt character string by the image processing device 20 (see Fig. 1) assumed in embodiment 10. In Fig. 45, parts corresponding to those in Fig. 3 are assigned the same reference numerals. 45, the auxiliary storage device 24 of the image processing device 20 has a special term conversion table 247 added thereto. The other functional units and data are the same as those in FIG. Fig. 46 is a diagram for explaining an example of data in the special term conversion table 247. The special term conversion table 247 shown in Fig. 46 is made up of set values ​​247A as printing terms and general terms 247B. In the case of Figure 46, "2up" and "2in1" are converted to "combine two documents onto one page." Also, "4up" and "4in1" are converted to "combine four documents onto one page."

[0142] 47 is a diagram illustrating an image of generating a prompt character string in Embodiment 10. The image of generation shown in FIG. 47 corresponds to FIG. In the case of Figure 47, the content of the template is the same as that of Figure 6. However, some of the content of the job flow to be registered is different from that of Figure 6. Incidentally, in the case of Figure 47, the setting value for "1 sheet at a time" in "Step #1" is "2up." The other setting values ​​are the same as those in Figure 6. In addition, in the case of FIG. 47, conversion processing of special terms is added when applying the operation contents of the job flow to the template.

[0143] For this reason, the following prompt string is generated: "A simplified illustration showing the process flow. The process is to scan two documents onto one page using a multifunction printer, and then send it by email to user1@ABC.com." If the conversion process for special terms is not applied, the following is generated: "A simplified illustration showing the process flow. The process is to scan in 2up on a multifunction printer and then send an email to user1@ABC.com."

[0144] <Summary> In the image processing device 20 of this embodiment, even if the job flow settings in the image processing device 20 include vendor-specific expressions, it is possible to generate prompt strings converted into general terms. As a result, it is possible to reduce the discrepancy between the icons provided by the image generation AI service 10 and the operation content of the job flow.

[0145] <Other embodiments> (1) Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the scope of the above-described embodiments. It is clear from the claims that various modifications and improvements to the above-described embodiments are also included in the technical scope of the present invention.

[0146] (2) In the above description of the embodiment, a printing device was given as an example of the image processing device 20 (see FIG. 1), but the terminal that generates the prompt string may be an information processing terminal operated by a user or a server that cooperates with an information processing terminal operated by a user. Information processing terminals include, for example, desktop computers, notebook computers, tablet computers, smartphones, and wearable devices. These information processing terminals are also examples of information processing systems. Wearable devices include, for example, wristwatch-type, ring-type, and eyeglass-type devices. Eyeglass-type wearable devices include, for example, smart glasses and AR (Augmented Reality) glasses.

[0147] (3) In the above-described embodiment, the image generation AI service 10 (see FIG. 1) generates an icon corresponding to a job flow, but the icon generated by the image generation AI service 10 is not limited to an icon corresponding to a job flow. For example, the present invention can also be applied to the case of generating an icon corresponding to a processing flow (hereinafter referred to as a "workflow") defined by one or more business processes.

[0148] (4) In the above-described embodiment, an image processing system 1 (see FIG. 1) is described that is composed of an image generation AI service 10 (see FIG. 1) and an image processing device 20 (see FIG. 1). That is, the image processing device 20 requests the image generation AI service 10, which is a service on a cloud network, to generate an icon. However, the image processing device 20 may be a service provided on other networks, such as an intranet, a LAN (Local Area Network), or a mobile communication system such as 4G or 5G.

[0149] (5) In the above embodiment, an icon is acquired by providing a prompt character string to an external service. However, the icon may be generated within the image processing device 20 (see FIG. 1). Fig. 48 is a diagram illustrating another example of the hardware configuration of the image processing device 20. In Fig. 48, parts corresponding to those in Fig. 2 are assigned the same reference numerals. The image processing device 20 shown in Fig. 48 is also an example of an information processing system.

[0150] 48, an image generation AI model 248 is stored in the auxiliary storage device 24. The image generation AI model 248 here is an example of a trained model. The image generation AI model 248 is the same as the trained model used in, for example, the image generation AI service 10. Therefore, the processor 21 can obtain an icon corresponding to the job flow by providing the generated prompt character string to the image generation AI model 248.

[0151] (6) The processor in the above-described embodiments refers to a processor in a broad sense. Therefore, the processor also includes processors other than general-purpose processors (e.g., CPUs (Central Processing Units)). Other processors include dedicated processors (e.g., GPUs (Graphical Processing Units), ASICs (Application Specific Integrated Circuits), FPGAs (Field Programmable Gate Arrays), programmable logic devices, etc.). Furthermore, the operations of the processor in each of the above-described embodiments may be performed by a single processor alone, or may be performed by multiple processors located in physically separate locations in cooperation with each other. Furthermore, the order in which the operations of the processors are performed is not limited to the order described in each of the above-described embodiments, and may be changed individually.

[0152] <Additional Notes> (((1))) An information processing system having one or more processors, wherein the one or more processors extract one or more features that define processing specified by a user, generate a character string whose content instructs the output of an icon that represents the extracted one or more features, and provide the generated character string to a trained model to obtain one or more icons. (((2))) The information processing system described in (((1))), wherein, when the process is composed of multiple sub-processes that are executed in sequence, the one or more processors extract the one or more features from each of the multiple sub-processes. (((3))) The information processing system according to (((2))), wherein the one or more processors describe the execution order of the plurality of sub-processes by the character string. (((4))) The information processing system described in (((2))), wherein the one or more processors generate a plurality of character strings by swapping the priority of expression between the plurality of sub-processes, and obtain one or more icons for each of the generated character strings. (((5))) The information processing system according to (((4))), wherein the one or more processors display one or more icons obtained for each of the plurality of character strings, with the corresponding character string as a unit. (((6))) The information processing system described in any one of (((1))) to (((5))), wherein the one or more processors, when multiple icons are obtained from the trained model, display a screen for selecting one icon from the multiple icons. (((7))) The information processing system according to (((6))), wherein the one or more processors additionally display one or more other icons prepared in advance on the screen. (((8))) The information processing system described in any one of (((1))) to (((7))), wherein the one or more processors generate a plurality of character strings by changing the priority relationship between the one or more features that define the processing, and obtain one or more icons for each of the generated plurality of character strings. (((9))) The information processing system according to (((8))), wherein the one or more processors generate the plurality of character strings based on a priority relationship between predefined features. (((10))) The information processing system of any one of (((1))) to (((9))), wherein, if at least one of the one or more features defining the processing differs from a feature defining another processing to be compared, the one or more processors generate another character string that instructs the output of an icon that emphasizes the different feature. (((11))) The information processing system according to (((10))), wherein the other processing is processing that overlaps with part of the one or more features. (((12))) The information processing system described in (((10)))), wherein the one or more processors use the process as a comparison target and generate an icon for the other process that emphasizes the differences in characteristics between the process and the one or more processors. (((13))) A program for enabling a computer to perform the following functions: extract one or more features that define processing specified by a user; generate a string of characters that instructs the output of an icon that represents the extracted one or more features; and provide the generated string of characters to a trained model to obtain one or more icons.

[0153] According to the information processing system of (((1))), it is easier to predict the content of the process compared to when an icon to be associated with the process is selected from icons prepared in advance. According to the information processing system of (((2))), it is possible to generate an icon that represents the content of a process that is made up of multiple sub-processes. According to the information processing system of (((3))), it is possible to generate an icon that represents the execution order of a plurality of sub-processes that make up one process. According to the information processing system of (((4))), it is possible to generate an icon that expresses each sub-process that constitutes one process in a manner that prioritizes it over other sub-processes. According to the information processing system of (((5))), it is possible to easily check the icon corresponding to each character string. According to the information processing system of (((6))), an icon to be associated with a specified process can be selected from a plurality of icons. According to the information processing system of (((7))), an icon to be associated with a specified process can be selected, including icons prepared in advance. According to the information processing system of (((8))), it is possible to generate an icon in which each feature that defines one process is prioritized over other features. According to the information processing system of (((9))), the priority relationships between features can be set in advance. According to the information processing system of (((10))), it is possible to generate an icon that can be differentiated from icons for other processes that have similar characteristics. According to the information processing system of (((11))), it is possible to generate an icon that can be distinguished from other processes with similar characteristics. According to the information processing system of (((12))), it is possible to regenerate icons for other processes that have similar characteristics. According to the program (((13))), it is easier to predict the content of the process compared to when an icon to be associated with the process is selected from icons prepared in advance. [Explanation of symbols]

[0154] 1...image processing system, 10...image generation AI service, 20...image processing device, 21...processor, 22...ROM, 23...RAM, 24...auxiliary storage device, 25...operation panel, 26...scanner unit, 27...image processing unit, 28...printing unit, 29...communication interface, 211...UI control unit, 212...job flow display unit, 213...job flow execution unit, 214...job flow setting unit, 214A...image generation AI communication unit, 214B...prompt string generation unit

Claims

1. having one or more processors, the one or more processors: Extracting one or more features that define a process specified by a user; generating a character string instructing output of an icon representing the extracted one or more characteristics; providing the generated character string to a trained model to obtain one or more icons; Information processing system.

2. the one or more processors: If the process is comprised of multiple sub-processes that are executed in sequence, extracting the one or more features from each of the multiple sub-processes; The information processing system according to claim 1 .

3. the one or more processors: The execution order of the plurality of sub-processes is described by the character string. The information processing system according to claim 2 .

4. the one or more processors: generating a plurality of the character strings by changing the priority of expression among the plurality of sub-processes; obtaining one or more icons for each of the generated plurality of character strings; The information processing system according to claim 2 .

5. the one or more processors: displaying one or more icons acquired for each of the plurality of character strings, with the corresponding character string as a unit; The information processing system according to claim 4 .

6. the one or more processors: When multiple icons are acquired from the trained model, a screen is displayed for selecting one icon from the multiple icons. The information processing system according to claim 1 .

7. the one or more processors: additionally displaying one or more other icons prepared in advance on the screen; The information processing system according to claim 6.

8. the one or more processors: generating a plurality of said character strings by changing the priority relationship between said one or more features that define said processing; obtaining one or more icons for each of the generated plurality of character strings; The information processing system according to claim 1 .

9. the one or more processors: generating a plurality of said character strings based on a priority relationship between predefined features; The information processing system according to claim 8 .

10. the one or more processors: generating another character string instructing output of an icon expressing the difference when at least one of the one or more characteristics defining the process is different from a characteristic defining another process to be compared; The information processing system according to claim 1 .

11. The other processing is processing that overlaps with a part of the one or more features. The information processing system according to claim 10.

12. the one or more processors: Using the process as a comparison target, an icon for the other process is generated that emphasizes differences in characteristics between the process and the process in question. The information processing system according to claim 10.

13. On the computer, extracting one or more features that define a user-specified process; a function of generating a character string with content instructing output of an icon representing the extracted one or more characteristics; A function of providing the generated character string to a trained model to obtain one or more icons; A program to achieve this.

Images