Job execution system, voice operation support system, voice operation support program, electronic equipment, and job execution program

Abstract

This image-forming system comprises: an image-forming device 20 that executes a job; and a voice operation support system 40 that supports a user's voice operation of the image-forming device 20. The voice operation support system 40 generates a command for voice operation that corresponds to the set value of a job executed by the image-forming device 20 in S161 (S166), and the image-forming device 20 displays the command generated by the voice operation support system 40 (S168).

Description

Job Execution System, Voice Operation Support System, Voice Operation Support Program, Electronic Device, and Job Execution Program 【0001】 The present invention relates to a job execution system for executing a job, a voice operation support system, a voice operation support program, an electronic device, and a job execution program. 【0002】 As a conventional job execution system, there is known one that stores a user request instructed by voice in a server and reflects the same settings as in the past when used next time (see, for example, Patent Document 1). 【0003】 Japanese Patent Application Laid-Open No. 2020-087359 【0004】 However, in the conventional job execution system, there is a problem that setting values need to be saved. 【0005】 Therefore, an object of the present invention is to provide a job execution system, a voice operation support system, a voice operation support program, an electronic device, and a job execution program that can facilitate voice operation of an electronic device by a user without saving setting values. 【0006】 The job execution system of the present invention includes an electronic device that executes a job and a voice operation support system that supports voice operation of the electronic device by a user. The voice operation support system generates a command for the voice operation according to a setting value of a job executed by the electronic device, transmits the generated command to the electronic device, and the electronic device displays the command generated by the voice operation support system. 【0007】 With this configuration, in the job execution system according to an aspect of the present invention, the electronic device displays a command for voice operation according to a setting value of a job executed by the electronic device, so that voice operation of the electronic device by a user can be facilitated without saving setting values. 【0008】In a job execution system according to one aspect of the present invention, the voice operation support system may generate the command when the setting value of a job executed by the electronic device is different from the default setting value. 【0009】 With this configuration, the job execution system according to one aspect of the present invention generates commands corresponding to settings that differ from the default settings among the settings of a job executed by an electronic device. As a result, the commands displayed on the electronic device can be shortened, and consequently, voice operation of the electronic device by the user can be made easier. 【0010】 In a job execution system according to one aspect of the present invention, the electronic device, after executing the job, identifies a setting value among the setting values ​​for each setting item of the job that is different from the default value indicated by the default setting value information, based on the job type of the job, the setting value for each setting item of the job, and predetermined stored default setting value information, transmits the job type of the job, the setting value different from the default value, and the setting values ​​for each setting item other than the different setting value to the voice operation support system, and the voice operation support system generates the command using the job type of the job, the setting value different from the default value, and the setting values ​​for each setting item other than the different setting value received from the electronic device. 【0011】 A voice operation support system according to one aspect of the present invention is a voice operation support system that supports voice operation of an electronic device by a user, and generates a voice operation command according to the setting value of a job executed by the electronic device, and transmits the generated command to the electronic device. 【0012】 With this configuration, the voice operation support system according to one aspect of the present invention generates voice operation commands according to the settings of a job executed by an electronic device, thus facilitating voice operation of the electronic device by the user even if the settings are not saved. 【0013】A voice operation support program according to one aspect of the present invention is a voice operation support program for supporting voice operation of an electronic device by a user, which causes a computer to generate a voice operation command according to the setting value of a job executed by the electronic device, and to transmit the generated command to the electronic device. 【0014】 With this configuration, a computer executing a voice operation support program according to one aspect of the present invention generates voice operation commands according to the settings of a job executed by an electronic device, thus facilitating voice operation of the electronic device by the user even if the settings are not saved. 【0015】 An electronic device according to one aspect of the present invention is an electronic device that is voice-operated by a user to execute a job, wherein after the execution of the job, the electronic device identifies a setting value among the setting values ​​for each setting item of the job that is different from the default value indicated by the default setting value information, based on the job type of the job, the setting value for each setting item of the job, and predetermined stored default setting value information, transmits the job type of the job, the setting value different from the default value, and the setting values ​​for each setting item other than the different setting value to the voice operation support system, and the voice operation support system receives from the voice operation support system a command for voice operation generated using the job type of the job, the setting value different from the default value, and the setting values ​​for each setting item other than the different setting value received from the electronic device, and displays the received command. 【0016】 With this configuration, an electronic device according to one aspect of the present invention displays voice control commands corresponding to the settings of the executed job, thus facilitating voice operation of the electronic device by the user even if the settings are not saved. 【0017】A job execution program according to one aspect of the present invention is a job execution program executed by a computer in an electronic device that is voice-operated by a user, wherein the computer is instructed to execute a job, and after the execution of the job, based on the job type of the job, the setting value for each setting item of the job, and predetermined stored default setting value information, a setting value for each setting item of the job that is different from the default value indicated by the default setting value information is identified, the job type of the job, the setting value that is different from the default value, and the setting values ​​for each setting item other than the different setting value are transmitted to the voice operation support system, and the voice operation support system receives from the voice operation support system a command for voice operation generated using the job type of the job, the setting value that is different from the default value, and the setting values ​​for each setting item other than the different setting value received from the electronic device, and performs the process of displaying the received command. 【0018】 With this configuration, an electronic device that executes a job execution program according to one aspect of the present invention displays voice commands corresponding to the settings of the executed job, thus facilitating voice operation of the electronic device by the user even if the settings are not saved. 【0019】 A job execution system, voice operation support system, voice operation support program, electronic device, and job execution program according to one aspect of the present invention can facilitate voice operation of an electronic device by a user even if the settings are not saved. 【0020】This is a block diagram of an example of an image forming system according to one embodiment of the present invention. This is a block diagram of an example of an image forming apparatus shown in Figure 1 when it is configured with an MFP. This is a diagram showing an example of selectable setting value information shown in Figure 2. This is a diagram showing an example of default setting value information shown in Figure 2. This is a block diagram of an example of a voice input device shown in Figure 1. This is a block diagram of an example of a voice operation support system shown in Figure 1 when it is configured with a single computer. This is a diagram showing an example of job type command information shown in Figure 6. This is a diagram showing an example of setting value command information shown in Figure 6. This is a flowchart of the operation of the image forming apparatus shown in Figure 2 when a user performs the setting of a job to be executed by the image forming apparatus via the operation unit. This is a diagram showing an example of a copy setting screen displayed in the operation shown in Figure 9. This is a sequence diagram of the operation of the image forming system shown in Figure 1 when a user performs the setting of a job to be executed by the image forming apparatus by voice. This is a flowchart of the process shown in Figure 11. This is a sequence diagram of the operation of the image forming system shown in Figure 1 when a job is executed by the image forming apparatus. This is a diagram showing an example of a command notification screen displayed in the operation shown in Figure 13. 【0021】 Hereinafter, embodiments of the present invention will be described with reference to the drawings. 【0022】 First, the configuration of the image forming system as a job execution system according to one embodiment of the present invention will be described. 【0023】 Figure 1 is a block diagram of an example of an image forming system 10 according to this embodiment. 【0024】 As shown in Figure 1, the image forming system 10 includes an image forming apparatus 20, which is an electronic device for forming images. The image forming system 10 may also include at least one other image forming apparatus with a configuration similar to that of the image forming apparatus 20. The image forming apparatus may be, for example, a dedicated printer or an MFP (Multifunction Peripheral). 【0025】The image forming system 10 includes a voice input device 30 into which the voice of a user of the image forming apparatus is input. The image forming system 10 may also include at least one other voice input device having a similar configuration to the voice input device 30. The voice input device may be configured as, for example, a smart speaker or a computer such as a smartphone. 【0026】 The image forming system 10 includes a voice operation support system 40 that assists the user in operating the image forming apparatus by voice. The voice operation support system 40 may be composed of one computer, such as a PC (Personal Computer), or it may be composed of multiple computers. The voice operation support system 40 may be configured on the same LAN (Local Area Network) as the image forming apparatus, or it may be configured on the cloud. For example, the voice operation support system 40 may be composed of a server device located on the cloud. 【0027】 The image forming apparatus in the image forming system 10 and the voice operation support system 40 are connected to each other via a network 11 such as a LAN or the Internet, enabling them to communicate with one another. The voice input device in the image forming system 10 and the voice operation support system 40 are connected to each other via the network 11, enabling them to communicate with one another. 【0028】 Figure 2 is a block diagram of an example of an image forming apparatus 20 that is composed of MFPs. 【0029】As shown in Figure 2, the image forming apparatus 20 includes an operation unit 21, which is an operation device such as buttons into which various operations are input; a display unit 22, which is a display device such as an LCD (Liquid Crystal Display) that displays various information; a printer 23, which is a printing device that prints images onto a recording medium such as paper, and is equipped with an electrophotographic image forming mechanism; a scanner 24, which is a reading device that reads images from an original document; a communication unit 25, which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly via wired or wireless connection without a network; a fax communication unit 26, which is a fax device that performs fax communication with an external facsimile device (not shown) via a communication line such as a public telephone line; a storage unit 27, which is a non-volatile storage device such as a semiconductor memory or HDD (Hard Disk Drive) that stores various information; and a control unit 28 for controlling the entire image forming apparatus 20. 【0030】 The storage unit 27 stores a job execution program 27a for executing jobs. The job execution program 27a may be installed in the image forming apparatus 20 during the manufacturing stage, or it may be additionally installed in the image forming apparatus 20 from an external storage medium such as a USB (Universal Serial Bus) memory, or it may be additionally installed in the image forming apparatus 20 from a network. 【0031】 The memory unit 27 stores selectable setting value information 27b, which indicates setting values ​​that can be specified by the user for jobs executed by the image forming apparatus 20. 【0032】 Figure 3 shows an example of the selectable setting value information 27b. 【0033】 The selectable setting value information 27b shown in Figure 3 includes setting values ​​that can be specified by the user, for each combination of job type (hereinafter referred to as "job type") and setting item. Some information is omitted in the selectable setting value information 27b shown in Figure 3. 【0034】Examples of job types include copying, scanning, and faxing. 【0035】 The settings for a copy job include, for example, "Paper Size," which indicates the size of the recording medium to be printed on; "Color Selection," which indicates whether to print in black and white or color; "Number of Copies," which indicates the number of copies to print; "Single-sided / Double-sided," which indicates whether the printing on the recording medium is single-sided or double-sided; "Original," which indicates the orientation of the original document; and "Finished Print," which indicates whether the front and back sides should be facing the same direction when printing on both sides. 【0036】 As shown in Figure 2, the storage unit 27 stores default setting information 27c, which indicates the default setting values ​​for jobs executed by the image forming apparatus 20. 【0037】 Figure 4 shows an example of default setting information 27c. 【0038】 The default setting information 27c shown in Figure 4 contains the default settings for each combination of job type and setting item. Some information is omitted in the default setting information 27c shown in Figure 4. 【0039】 The control unit 28 shown in Figure 2 includes, for example, a processor consisting of a CPU (Central Processing Unit), a ROM (Read Only Memory) that stores programs and various data, and a RAM (Random Access Memory) used as a working area for the processor. The processor operates as a control unit 280 by executing a program stored in the ROM of the storage unit 27 or the control unit 28. The processor is an example of a computer included in the electronic device described in the claims. 【0040】 The processor in the control unit 28 operates as a setting execution unit 28a that executes job settings, a job execution unit 28b that executes jobs, and a command notification unit 28c that notifies voice commands by executing the job execution program 27a. 【0041】FIG. 5 is a block diagram of an example of the voice input device 30. 【0042】 As shown in FIG. 5, the voice input device 30 includes an operation unit 31 which is an operation device such as a keyboard or a mouse for inputting various operations, a display unit 32 which is a display device such as an LCD for displaying various information, a microphone 33 for inputting voice, a speaker 34 for outputting voice, a communication unit 35 which is a communication device for communicating directly with an external device by wire or wirelessly via a network such as a LAN or the Internet, or without going through a network, and a storage unit 36 which is a non-volatile storage device such as a semiconductor memory or an HDD for storing various information, and a control unit 37 for controlling the entire voice input device 30. 【0043】 The storage unit 36 stores a voice processing program 36a for processing voice. The voice processing program 36a may be installed in the voice input device 30 at the manufacturing stage of the voice input device 30, or may be additionally installed in the voice input device 30 from an external storage medium such as a USB memory, or may be additionally installed in the voice input device 30 from the network. 【0044】 The control unit 37 includes, for example, a CPU, a ROM for storing programs and various data, and a RAM as a memory used as a work area for the CPU of the control unit 37. The CPU of the control unit 37 executes the programs stored in the storage unit 36 or the ROM of the control unit 37. 【0045】 The control unit 37 operates as a voice processing unit 37a for processing voice by executing the voice processing program 36a. The voice processing unit 37a inputs the voice of the user via the microphone 33 and outputs the message to the user as voice via the speaker 34. For example, the voice processing unit 37a accepts the voice operation of the image forming apparatus 20 by the user through the dialogue with the user. 【0046】 FIG. 6 is a block diagram of an example of the voice operation support system 40 when it is configured by one computer. 【0047】 As shown in FIG. 6, the voice operation support system 40 includes an operation unit 41 which is an operation device such as a keyboard or a mouse for inputting various operations, a display unit 42 which is a display device such as an LCD for displaying various information, a communication unit 43 which is a communication device for communicating directly with an external device by wire or wirelessly via a network such as a LAN or the Internet, or without going through a network, and a storage unit 44 which is a non-volatile storage device such as a semiconductor memory or an HDD for storing various information, and a control unit 45 for controlling the entire voice operation support system 40. 【0048】 The storage unit 44 stores a voice operation support program 44a for supporting the voice operation of the image forming apparatus by the user. The voice operation support program 44a may be installed in the voice operation support system 40 at the manufacturing stage of the voice operation support system 40, or may be additionally installed in the voice operation support system 40 from an external storage medium such as a USB memory, or may be additionally installed in the voice operation support system 40 from the network. 【0049】 The storage unit 44 stores device correspondence information 44b indicating the correspondence relationship between the image forming apparatus and the voice input device. The device correspondence information 44b shows, for example, that the image forming apparatus 20 and the voice input device 30 are associated with each other. 【0050】 The storage unit 44 stores specifiable setting value information 44c indicating setting values that can be specified by the user for jobs executed by the image forming apparatus. The specifiable setting value information 44c is the same information as the specifiable setting value information 27b (see FIG. 3). 【0051】 The storage unit 44 stores job type command information 44d indicating commands for each job type. 【0052】 FIG. 7 is a diagram showing an example of the job type command information 44d. 【0053】The job type command information 44d shown in Figure 7 contains commands for each job type. Some information is omitted in the depiction of the job type command information 44d shown in Figure 7. 【0054】 As shown in Figure 6, the storage unit 44 stores setting value command information 44e, which indicates a command corresponding to the setting value. 【0055】 Figure 8 shows an example of the setting value command information 44e. 【0056】 The setting value command information 44e shown in Figure 8 includes a command for each combination of job type, setting item, and setting value. Some information is omitted in the setting value command information 44e shown in Figure 8. 【0057】 The control unit 45 shown in Figure 6 includes, for example, a processor equipped with a CPU, a ROM that stores programs and various data, and RAM as memory used as a working area for the CPU of the control unit 45. The processor of the control unit 45 executes programs stored in the storage unit 44 or the ROM of the control unit 45. By executing programs stored in the storage unit 44 or the ROM of the control unit 45, the processor operates as a control unit 450. The processor is an example of a computer within the scope of the claims. 【0058】 The processor in the control unit 45 operates as a receiving unit 45a that receives information from the image forming apparatus and the voice input device, a transmitting unit 45b that transmits information to the image forming apparatus, an interpreting unit 45c that interprets the information received from the voice input device, and a command search unit 45d that searches for commands corresponding to the settings received from the image forming apparatus, by executing the voice operation support program 44a. 【0059】 Next, the operation of the image forming system 10 will be described. 【0060】 In the following, the image forming apparatus 20 will be described as a representative example of the image forming apparatus. Similarly, the voice input device 30 will be described as a representative example of the voice input device. 【0061】First, we will explain the operation of the image forming apparatus 20 when a user inputs instructions via the operation unit 21 to set up a job to be executed by the image forming apparatus 20. 【0062】 Figure 9 is a flowchart showing the operation of the image forming apparatus 20 when a user configures a job to be performed by the image forming apparatus 20 via the operation unit 21. 【0063】 The user inputs the job type of the job to which the settings are to be applied to the image forming apparatus 20 via the operation unit 21. 【0064】 When a job type is entered into the operation unit 21, the setting execution unit 28a obtains the default setting values ​​for each setting item in the entered job type (hereinafter referred to as "target job type" in the description of the operation shown in Figure 9) from the default setting value information 27c, as shown in Figure 9 (S101). 【0065】 When the processing in S101 is completed, the setting execution unit 28a displays a setting screen for the target job type on the display unit 22, which reflects the default setting values ​​for each setting item acquired in S101 (S102). For example, if the target job type is copy, the setting execution unit 28a displays a setting screen for copy on the display unit 22. 【0066】 When the processing in S102 is completed, the setting execution unit 28a terminates the operation shown in Figure 9. 【0067】 The user refers to the settings screen displayed on the display unit 22 and inputs instructions to change the setting value via the operation unit 21. 【0068】 Figure 10 shows an example of the settings screen 50 for copying. 【0069】The settings screen 50 shown in Figure 10 includes a dropdown list 51 which is a widget for setting the "paper size", a dropdown list 52 which is a widget for setting the "color selection", a dropdown list 53 which is a widget for setting the "number of copies", a dropdown list 54 which is a widget for setting "single-sided / double-sided", a dropdown list 55 which is a widget for setting the "original", a dropdown list 56 which is a widget for setting the "finished product", and an execute button 57 which is a widget for executing the copy job. 【0070】 When the setting execution unit 28a displays the setting screen 50 on the display unit 22 in S102, it reflects the setting values ​​obtained in S101, corresponding to the setting values ​​for each setting item, into the drop-down lists 51 to 56. 【0071】 The user inputs instructions to change the setting values ​​specified in the drop-down lists 51 to 56 via the operation unit 21. 【0072】 Next, we will describe the operation of the image forming system 10 when the user performs the job settings to be executed by the image forming apparatus 20 using voice commands. 【0073】 Figure 11 is a sequence diagram of the operation of the image forming system 10 when a user performs the settings for a job to be executed by the image forming apparatus 20 using voice commands. 【0074】 The user inputs the settings for the job to be performed by the image forming apparatus 20 into the voice input device 30 via the microphone 33 of the voice input device 30. For example, the user can input the operation "Make three color copies on A5 paper" into the voice input device 30 by voice. 【0075】 When the above operation is input to the voice input device 30 by voice, the voice processing unit 37a of the voice input device 30 performs a known voice-to-text conversion process to convert the voice-input operation into text, as shown in Figure 11 (S121). 【0076】When the processing in S121 is completed, the voice processing unit 37a transmits the text generated in S121 from the communication unit 35 to the voice operation support system 40 (S122). 【0077】 When the receiving unit 45a of the voice operation support system 40 receives the text transmitted by the voice input device 30 via the communication unit 43 in S122, it passes the text received from the voice input device 30 to the interpretation unit 45c. 【0078】 When the interpretation unit 45c receives text from the receiving unit 45a, it interprets the text received from the receiving unit 45a and extracts the job type and the setting value for each setting item from this text (S123). The interpretation unit 45c uses the specified setting value information 44c in the interpretation performed in S123. The interpretation unit 45c is more accurate in interpreting text when the text indicated by the text received from the receiving unit 45a is in a specific format. The interpretation unit 45c interprets text even if the text indicated by the text received from the receiving unit 45a is not in a specific format. 【0079】 For example, if the interpretation unit 45c extracts "copy" as the job type from the text passed from the receiving unit 45a, and this text includes "long edge binding", it may extract the setting value "portrait orientation" for the setting item "original" and the setting value "front and back in the same direction" for the setting item "finished product" as the setting values ​​for each setting item. 【0080】 When the processing in S123 is completed, the interpretation unit 45c passes the job type and the setting value for each setting item extracted in S123 to the transmission unit 45b. When the transmission unit 45b receives the job type and the setting value for each setting item from the interpretation unit 45c, it transmits the job type and the setting value for each setting item received from the interpretation unit 45c to the image forming apparatus 20 which is associated with the voice input device 30 in the device correspondence information 44b via the communication unit 43 (S124). 【0081】In S124, the setting execution unit 28a of the image forming apparatus 20 receives the job type and the setting value for each setting item transmitted from the voice operation support system 40 via the communication unit 25, and displays a setting screen showing the job type and the setting value for each setting item received from the voice operation support system 40 on the display unit 22 (S125). 【0082】 Figure 12 is a flowchart of the process S125 shown in Figure 11. 【0083】 As shown in Figure 12, the setting execution unit 28a determines whether or not the setting screen for the job type (hereinafter referred to as "target job type" in the description of the operation shown in Figure 12) received from the voice operation support system 40 is displayed on the display unit 22 (S141). 【0084】 If the setting execution unit 28a determines in S141 that the setting screen for the target job type is not displayed on the display unit 22, it obtains the default setting values ​​for each setting item in the target job type from the default setting value information 27c (S142). 【0085】 When the processing in S142 is completed, the setting execution unit 28a updates the default setting values ​​for each setting item acquired in S142 with the setting values ​​for each setting item received from the voice operation support system 40 (S143). Specifically, the setting execution unit 28a changes the default setting values ​​for each setting item acquired in S142 that are the same as the setting values ​​received from the voice operation support system 40 to the setting values ​​for that setting item received from the voice operation support system 40. 【0086】 When the processing in S143 is completed, the setting execution unit 28a displays the setting screen for the target job type on the display unit 22, reflecting the setting values ​​for each setting item that were updated in S143 (S144). After this, the operation shown in Figure 12 is terminated. 【0087】 If the setting execution unit 28a determines in S141 that it is displaying the setting screen for the target job type on the display unit 22, it reflects the setting values ​​for each setting item received from the voice operation support system 40 on the setting screen displayed on the display unit 22 (S145), and then terminates the operation shown in Figure 12. 【0088】 Users can refer to the settings screen displayed on the display unit 22 and input instructions to change the setting values ​​via the operation unit 21. 【0089】 Next, we will describe the operation of the image forming system 10 when a job is executed by the image forming apparatus 20. 【0090】 Figure 13 is a sequence diagram of the operation of the image forming system 10 when a job is executed by the image forming apparatus 20. 【0091】 The user inputs a job execution instruction to the operation unit 21 by pressing the execute button via the operation unit 21 on the settings screen displayed on the display unit 22. 【0092】 When the job execution instruction is input to the operation unit 21 of the image forming apparatus 20, the job execution unit 28b executes the job of the target job type on the setting screen according to the setting values ​​for each setting item that were specified on the setting screen at the time the job execution instruction was input, as shown in Figure 13 (S161). 【0093】 When the processing in S161 is completed, the command notification unit 28c identifies the setting value for each setting item that is different from the default setting value for each setting item among the setting values ​​for each setting item that were specified on the setting screen when the execute button was pressed, based on the job type of the job executed in S161, the setting value for each setting item that was specified on the setting screen when the execute button was pressed, and the default setting value information 27c (S162). 【0094】When the processing in S162 is completed, the command notification unit 28c transmits the job type of the job executed in S161, the setting values ​​for each setting item that are different from the default setting values ​​identified in S162, and the setting values ​​for each setting item other than those different from the default setting values ​​to the voice operation support system 40 via the communication unit 25 (S163). If the command notification unit 28c was unable to identify setting values ​​for each setting item that are different from the default setting values ​​in S162, it transmits the job type and the setting values ​​for each setting item that were specified on the setting screen at the time the execution button was pressed to the voice operation support system 40 via the communication unit 25. 【0095】 When the receiving unit 45a of the voice operation support system 40 receives the settings transmitted by the image forming apparatus 20 in S163, namely the job type and the setting value for each setting item, it passes the following to the command search unit 45d: (i) the job type and the setting value for each setting item that is different from the default setting value, and the setting value for each setting item other than the different setting value, or (ii) the job type and the setting value for each setting item that was specified on the setting screen at the time the execution button was pressed. 【0096】 When the command search unit 45d receives (i) or (ii) from the receiving unit 45a, it identifies the command corresponding to the job type received from the receiving unit 45a based on the job type received from the receiving unit 45a and the job type command information 44d (S164). 【0097】 When the processing in S164 is completed, the command search unit 45d identifies the command corresponding to the setting value for each setting item that was passed from the receiving unit 45a, based on either (i) the job type, the setting value for each setting item that is different from the default setting value, and the setting value for each setting item other than the said different setting value, or (ii) the job type, the setting value for each setting item that was specified on the setting screen when the execution button was pressed, and the setting value command information 44e (S165). 【0098】Figure 8 shows that when the setting for "Original Document" is set to "Portrait" and the setting for "Finished Product" is set to "Front and Back are in the Same Direction", the command is "Long Edge Binding", when the setting for "Original Document" is set to "Portrait" and the setting for "Finished Product" is set to "Front and Back are in Opposite Directions", the command is "Short Edge Binding", when the setting for "Original Document" is set to "Landscape" and the setting for "Finished Product" is set to "Front and Back are in the Same Direction", the command is "Short Edge Binding", when the setting for "Original Document" is set to "Portrait", and when the setting for "Finished Product" is set to "Front and Back are in the Same Direction", the command is "Front and Back are in the Same Direction". When the command search unit 45d receives from the receiving unit 45a that the setting value for the setting item "original" is "portrait orientation" and the setting value for the setting item "finished product" is "front and back in the same direction", it identifies the command "long edge binding" based on the setting value for the setting item "original" being "portrait orientation" and the setting value for the setting item "finished product" being "front and back in the same direction". When the command search unit 45d receives from the receiving unit 45a that the setting value for the setting item "original" is "portrait orientation" and the setting value for the setting item "finished product" is "front and back in opposite directions", it identifies the command "short edge binding" based on the setting value for the setting item "original" being "portrait orientation" and the setting value for the setting item "finished product" being "front and back in opposite directions". If the receiving unit 45a provides both the setting value for the setting item "original" as "landscape" and the setting value for the setting item "finished product" as "front and back are in the same direction", the command search unit 45d identifies the command "short edge binding" based on the setting value for the setting item "original" as "landscape" and the setting value for the setting item "finished product" as "front and back are in the same direction". If the receiving unit 45a provides the setting value for the setting item "original" as "portrait", but neither the setting value for the setting item "finished product" as "front and back are in the same direction" nor the setting value for the setting item "finished product" as "front and back are in opposite directions", the command search unit 45d identifies the command "portrait" based on the setting value for the setting item "original".The command search unit 45d receives from the receiving unit 45a that the setting value for the setting item "Finished product" is "Front and back are in the same direction," but does not receive from the receiving unit 45a that the setting value for the setting item "Original" is "Portrait" or that the setting value for the setting item "Original" is "Landscape." In such cases, the command search unit 45d identifies the command "Front and back are in the same direction" based on the setting value for the setting item "Finished product" being "Front and back are in the same direction." 【0099】 When the processing in S165 is completed, the command search unit 45d generates a command to notify the user using the commands identified in S164 and S165 (S166). However, if the command search unit 45d has not been able to obtain setting values ​​for each setting item that are different from the default setting values, it may not identify a command in S165, or it may not generate a command in S166. 【0100】 When the processing in S166 is completed, the command search unit 45d passes the command generated in S166 to the transmission unit 45b. When the transmission unit 45b receives the command from the command search unit 45d, it transmits the command received from the command search unit 45d to the image forming apparatus 20 via the communication unit 44 (S167). 【0101】 When the command notification unit 28c of the image forming apparatus 20 receives a command transmitted from the voice operation support system 40 in S167, it displays a screen for notifying the command received from the voice operation support system 40 (hereinafter referred to as the "command notification screen") on the display unit 22 (S168). 【0102】 Figure 14 shows an example of the command notification screen 60 that is displayed during the operation shown in Figure 13. 【0103】 As shown in Figure 14, the command notification screen 60 includes text 61 indicating a message to the user and text 62 indicating the command sent from the voice operation support system 40 in S167. The command notification unit 28c changes the content of text 61 according to the job type of the job executed in S161. 【0104】When a user confirms the command notification screen 60 shown in Figure 14, they can input the same settings as the previous copy job by inputting the audio shown in text 62 into the audio input device 30 via the microphone 33 of the audio input device 30, in order to execute a copy job with the same settings as the copy job that triggered the display of the command notification screen 60 shown in Figure 14. 【0105】 As described above, the image forming system 10 allows the image forming apparatus 20 to display a voice command corresponding to the setting value of the previous job executed by the image forming apparatus 20 in S161 (S168). Therefore, even if the setting value is not saved, the user can easily operate the image forming apparatus 20 by voice. 【0106】 If the image forming apparatus 20 is installed in a public place such as a convenience store or library, there is a high possibility that an unspecified number of users will use the image forming apparatus 20 without user registration. Therefore, even if the settings are saved, there is a high possibility that these settings will not be reused. However, if the image forming apparatus 20 displays voice commands corresponding to the settings of the job executed by the image forming apparatus 20, users can input the same settings as the previous copy job simply by speaking the voice commands into the voice input device 30, thus increasing convenience for users. 【0107】 The image forming system 10 generates commands according to the settings of the job executed by the image forming apparatus 20 (S162-S166), so the commands necessary to operate with the same job as the one previously executed by the image forming apparatus 20 are displayed on the display unit 22. This improves operability when inputting the same job again using voice control. 【0108】Furthermore, in the voice operation support system 40, if the command search unit 45d has not been able to obtain setting values ​​for each setting item that are different from the default setting values, it will not identify a command in S165, or it will not generate a command in S166. In this case, the image forming system 10 will generate a command corresponding to the setting values ​​of the job executed by the image forming apparatus 20 that are different from the default setting values, only if the image forming apparatus 20 has been operated with settings different from the default (S162-S166). Therefore, only the above commands that can be effectively used when it is necessary to input job setting values ​​in order to operate the image forming apparatus 20 with settings different from the default will be displayed on the display unit 22. As a result, the operability of voice operation when operating the image forming apparatus 20 with settings different from the default is improved. When the image forming apparatus 20 executes a job with the same settings as the default, the user can operate the image forming apparatus 20 with the default settings with simple operations without voice input, so the above commands will not be displayed on the display unit 22. Furthermore, since the image forming system 10 generates commands corresponding to settings that differ from the default settings among the settings of a job executed by the image forming apparatus 20 (S162-S166), the commands displayed on the image forming apparatus 20 can be shortened, and as a result, voice operation of the image forming apparatus 20 by the user can be made easier. 【0109】 The image forming system 10 can shorten the commands displayed on the image forming apparatus 20, thereby reducing the possibility of misrecognition of voice commands by the user. 【0110】 The image forming system 10 converts the audio input to the audio input device 30 into text using the audio input device 30. However, the image forming system 10 may also convert the audio input to the audio input device 30 into text using the voice operation support system 40. 【0111】The image forming apparatus 20 may have at least some of the functions of the voice input device 30 in this embodiment. If the image forming apparatus 20 has all of the functions of the voice input device 30 in this embodiment, the image forming system 10 does not need to have the voice input device 30. 【0112】 The image forming apparatus 20 may include at least some of the functions of the voice operation support system 40 in this embodiment. If the image forming apparatus 20 includes all of the functions of the voice operation support system 40 in this embodiment, the image forming system 10 does not need to include the voice operation support system 40. 【0113】 In this embodiment, the electronic device of the present invention is an image forming apparatus. However, the electronic device of the present invention may be an electronic device other than an image forming apparatus.

Claims

1. A job execution system comprising: an electronic device for executing jobs; and a voice operation support system for assisting a user in voice operation of the electronic device, wherein the voice operation support system generates a command for voice operation according to the settings of the job executed by the electronic device, transmits the generated command to the electronic device, and the electronic device displays the command generated by the voice operation support system.

2. The job execution system according to claim 1, wherein the voice operation support system generates the command when the setting value of a job executed by the electronic device is different from the default setting value.

3. The job execution system according to claim 2, wherein, after the execution of the job, the electronic device identifies a setting value among the setting values ​​for each setting item of the job that is different from the default value indicated by the default setting value information, based on the job type of the job, the setting value for each setting item of the job, and predetermined stored default setting value information, transmits the job type of the job, the setting value different from the default value, and the setting values ​​for each setting item other than the different setting value to the voice operation support system, and the voice operation support system generates the command using the job type of the job, the setting value different from the default value, and the setting values ​​for each setting item other than the different setting value received from the electronic device.

4. A voice operation support system that assists a user in voice-operating an electronic device, comprising: generating a voice operation command according to the settings of a job executed by the electronic device; and transmitting the generated command to the electronic device.

5. A voice operation support program for assisting a user in voice operation of an electronic device, the program causing a computer to generate a voice operation command according to the settings of a job executed by the electronic device, and to transmit the generated command to the electronic device.

6. An electronic device that is voice-operated by a user to execute a job, wherein, after the execution of the job, the electronic device identifies a setting value among the setting values ​​for each setting item of the job that is different from the default value indicated by the default setting value information, based on the job type of the job, the setting value for each setting item of the job, and predetermined stored default setting value information, transmits the job type of the job, the setting value different from the default value, and the setting values ​​for each setting item other than the different setting value to the voice operation support system, the voice operation support system receives a voice operation command generated using the job type of the job, the setting value different from the default value, and the setting values ​​for each setting item other than the different setting value received from the electronic device, and displays the received command.

7. A job execution program executed by a computer in an electronic device that is voice-operated by a user, wherein the program causes the computer to execute a job, and after the execution of the job, based on the job type of the job, the setting value for each setting item of the job, and predetermined stored default setting value information, it identifies a setting value for each setting item of the job that is different from the default value indicated by the default setting value information, transmits the job type of the job, the setting value that is different from the default value, and the setting values ​​for each setting item other than the different setting value to the voice operation support system, and in the voice operation support system, receives a voice operation command generated using the job type of the job, the setting value that is different from the default value, and the setting values ​​for each setting item other than the different setting value received from the electronic device, and performs the process of displaying the received command.

Images