Image forming apparatus, image forming system, response notification method, and response notification program

Abstract

To provide an image formation device capable of avoiding a timeout of an external device in a case where it is voice-operated from the external device, and a response notification method and a responce notification program.SOLUTION: An image formation device comprises: a processing execution unit that executes processing in accordance with an instruction input via an external device; a first notification unit that performs a first notification in response to termination of the execution of the processing to the external device; and a second notification unit that performs a second notification different from the first notification to the external device when it is estimated that the execution of the processing will not end before a timeout time which is set for the external device in regard to the first notification.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image forming apparatus, Image forming system, The present invention relates to a response notification method and a response notification program. [Background technology]

[0002] There are known image forming devices such as MFPs (Multi-Function Peripherals) that allow a user to input voice commands to control multiple functions such as copying, scanning, printing, and faxing (see Patent Document 1).

[0003] In addition, many kinds of smart speakers are now in practical use. Smart speakers can receive the user's voice, output a response corresponding to the received voice, and instruct external devices to perform actions corresponding to the received voice via a cloud server.

[0004] When the above-mentioned image forming device and smart speaker are connected, the user's voice instructions can be sent to the image forming device via a cloud server, making it possible to operate the image forming device by voice. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2006-023636 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, in order to respond to a request from a user to an image forming device, the cloud server may be designed to time out if there is no response from the image forming device to the cloud server for a certain period of time (e.g., 5 to 7 seconds) after the image forming device sends the user's voice instruction to the image forming device.

[0007] With such specifications, when a user's voice instructions are sent to an image forming device, it takes time for the image forming device to process the voice instructions, and if the image forming device is unable to respond to the cloud server within a certain period of time, the cloud server will time out.

[0008] For example, when inputting image formation settings (such as paper selection) into an image forming device, the input processing is performed on the operation screen, whether the user inputs directly from the operation screen or by voice input from a smart speaker. Therefore, when inputting by voice from a smart speaker, the response from the image forming device to the cloud server is delayed until the input processing of the settings on the operation screen is completed. In particular, if an error occurs (such as selecting a paper that cannot be selected) or prohibition processing (checking whether the input value is unselectable) due to the input settings, the processing time is long, and the response from the image forming device to the cloud server is delayed.

[0009] In this way, when operating an image forming apparatus by voice from a smart speaker, the cloud server may time out depending on the settings entered by voice operation. In such a case, for example, the cloud server timeout may interrupt the voice operation, making it impossible to continue the voice operation. In addition, for example, the cloud server timeout may require the user to start the operation over from the beginning, which may worsen the operability of the voice operation.

[0010] The present invention provides an image forming apparatus capable of avoiding a timeout of an external device when an external device is operated by voice. Image forming system, The present invention provides a response notification method and a response notification program. [Means for solving the problem]

[0011] The image forming apparatus according to the present invention comprises: After receiving an instruction to set image forming conditions inputted via an external device, settinga process execution unit that executes a process; The above setting a first notification unit that issues a first notification to the external device in response to completion of execution of the process; Before a timeout period set in the external device regarding the first notification, setting a second notification unit that, when it is estimated that execution of the process will not be completed, issues a second notification to the external device that is different from the first notification; Equipped with. The image forming system according to the present invention comprises: In an image forming system including the image forming apparatus and the external device, The external device has a smart speaker for inputting voice instructions from a user. Image forming system. The image forming system according to the present invention comprises: In an image forming system including the image forming apparatus and the external device, The external device is A smart speaker that inputs voice instructions from the user, a server that outputs the voice instruction input to the smart speaker to the image forming device and transmits the first and second notifications notified from the image forming device to the smart speaker; having Image forming system.

[0012] The response notification method according to the present invention comprises the steps of: A response notification method in an image forming apparatus, comprising: After receiving an instruction to set image forming conditions inputted via an external device, setting When the process is executed, setting sending a first notification to the external device in response to completion of execution of the process; Before a timeout period set in the external device regarding the first notification, setting If it is estimated that the execution of the process will not end, a second notification different from the first notification is sent to the external device.

[0013] A response notification program according to the present invention includes: On the computer, After receiving an instruction to set image forming conditions inputted via an external device, setting When the process is executed, setting a first notification process for sending a first notification to the external device in response to completion of execution of the process; Before a timeout period set in the external device regarding the first notification, setting a second notification process for sending a second notification, which is different from the first notification, to the external device when it is estimated that the execution of the process will not be completed; Execute the command. Effect of the Invention

[0014] According to the present invention, when an external device is operated by voice, a timeout of the external device can be avoided. [Brief description of the drawings]

[0015] [Figure 1] 1 is a block diagram illustrating a schematic configuration of an image forming system according to an embodiment of the present invention. [Diagram 2] 2 is a sequence diagram illustrating a procedure for directly instructing from an operation panel in the image forming system shown in FIG. 1. FIG. [Diagram 3] 1. FIG. 4 is a sequence diagram illustrating a procedure when there is no response delay to a voice instruction but an error occurs in the image forming system shown in FIG. [Figure 4] 1. FIG. 4 is a sequence diagram illustrating a procedure when there is a delayed response to a voice instruction and an error occurs in the image forming system shown in FIG. [Diagram 5] 1. FIG. 4 is a sequence diagram illustrating a procedure when there is a response delay to a voice instruction and no error in the image forming system shown in FIG. [Figure 6] 4 is a flowchart illustrating a control procedure in the image forming apparatus. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0017] 1 is a block diagram illustrating a schematic configuration of an image forming system 1 according to the present embodiment. The image forming system 1 includes an image forming device 10, a network 20, an audio input / output device 30, and a server 40. The image forming device 10 is connected to the audio input / output device 30 and the server 40 via the network 20.

[0018] The image forming apparatus 10 is an MFP equipped with a plurality of processing functions such as copying, scanning, printing, and faxing, and includes a network unit 11, a scanner unit 12, a printer unit 13, and a fax unit .

[0019] The network unit 11 performs communication processing to transmit and receive various information between the audio input / output device 30 and the server 40 via a network 20 such as a LAN (Local Area Network) or a telephone line. The network 20 is not limited to a LAN or a telephone line, but may be a WAN (Wide Area Network) or the like, and may be either wireless or wired.

[0020] The scanner unit 12 optically reads an original document to create image data and performs scanning processing of the image. The scanner unit 12 may be equipped with an automatic document feeder called an ADF (Auto Document Feeder). In that case, when a user places a large number of original documents on the document tray of the ADF, the original documents are automatically transported one by one, and the images of the original documents can be scanned continuously all at once.

[0021] The printer unit 13 performs image printing processing by printing on a sheet material such as printing paper based on image data read by the scanner unit 12 or image data for printing from an external device. For example, when making a copy, an original is scanned using the scanner unit 12, and printing is performed on the sheet material using the printer unit 13. As a printing method, any known printing method such as a laser method or an inkjet method can be applied.

[0022] The FAX unit 14 transmits image data read by the scanner unit 12 and receives image data transmitted from an external source via a network 20 such as a telephone line, and performs FAX processing of the image.

[0023] The image forming apparatus 10 also includes a control unit 15 (computer), an operation panel 16 (display unit), and the like.

[0024] Although detailed illustration is omitted, the control unit 15 includes a processor such as a CPU (Central Processing Unit) and memories such as a RAM (Random Access Memory) and a ROM (Read Only Memory). The control unit 15 controls the network unit 11, scanner unit 12, printer unit 13, and FAX unit 14 based on input from an operation panel 16 and input from the voice input / output device 30 and server 40. The control unit 15 also controls the operation panel 16.

[0025] Although detailed illustration of the operation panel 16 is omitted, it is composed of, for example, a display device such as an LCD (Liquid Crystal Display) and an input device attached to the front of the display device and having a transparent touch pad, input buttons, etc. Operation instruction information (commands) input to the operation panel 16 using the touch pad or input buttons is input to the control unit 15.

[0026] The audio input / output device 30 is a device for inputting and outputting audio. Although detailed illustration is omitted, the audio input / output device 30 also includes a microphone, a speaker, a network unit, a control unit, and the like.

[0027] When audio is input from the outside, the microphone outputs the audio as an electrical signal to the control unit. The speaker outputs the electrical signal input from the control unit to the outside as audio. The network unit performs communication processing to transmit and receive various information between the image forming apparatus 10 and the server 40 via the network 20. The control unit encodes the electrical signal of the audio input from the microphone to generate audio data, and transmits the audio data to the server 40 via the network unit. The control unit also receives audio data transmitted from the server 40 via the network unit, converts the audio data to an electrical signal, and outputs it to the speaker.

[0028] Although detailed illustration is omitted, the server 40 includes a processor such as a CPU, and memories such as a RAM and a ROM, etc. The server 40 includes a network unit 41, a control unit 42, etc.

[0029] The network unit 41 performs communication processing for transmitting and receiving various types of information between the image forming device 10 and the audio input / output device 30 via the network 20 .

[0030] The control unit 42 performs a voice recognition process to convert the voice data transmitted from the voice input / output device 30 into operation instruction information (commands). Any known method can be applied to the voice recognition process in the control unit 42. The control unit 42 also performs a process corresponding to the command obtained by the voice recognition process, such as a response process to the voice input / output device 30 and transmission of a command to the image forming device 10. For example, when a voice instructing a process in the image forming device 10 is input to the voice input / output device 30, the control unit 42 converts the voice data of the voice into a command and transmits the command to the image forming device 10. Such a process in the control unit 42 is provided, for example, as an application on the server 40.

[0031] The above-mentioned voice input / output device 30 functions as a so-called smart speaker, and the server 40 functions as a cloud server that responds to voice input by a user from the voice input / output device 30 and issues instructions to the image forming device 10.

[0032] Therefore, when a user inputs an operation instruction by voice (voice instruction) from the voice input / output device 30, the server 40 converts the voice data of the voice instruction into a command and transmits it to the image forming device 10. Then, the image forming device 10 performs a process corresponding to the command transmitted from the server 40. That is, in the image forming system 1, the image forming device 10 can be operated by voice operation.

[0033] Incidentally, the server 40 may be designed to time out if, for its response operation, there is no response from the image forming device 10 to the server 40 for a certain period of time after the image forming device 10 transmits a user's voice instruction to the image forming device 10.

[0034] In the case of such specifications, when a user's voice instructions are sent to the image forming device 10, it takes time for the image forming device 10 to process the voice instructions, and if the image forming device 10 is unable to respond to the server 40 within a certain period of time, the server 40 will time out.

[0035] Therefore, in this embodiment, the image forming apparatus 10 is provided with a process execution unit that executes a process in response to an instruction (voice instruction) input via an external device, and a first notification unit that issues a first notification to the external device in response to completion of execution of the process. The image forming apparatus 10 is also provided with a second notification unit that issues a second notification, different from the first notification, to the external device when it is estimated that execution of the process will not be completed before a timeout period set in the external device for the first notification.

[0036] In the present embodiment, the external devices are the audio input / output device 30 and the server 40. If the audio input / output device 30 has the functions of the server 40, the external device may be the audio input / output device 30.

[0037] The process execution unit, the first notification unit, and the second notification unit are each provided as one function of the control unit 15. For example, the process execution unit, the first notification unit, and the second notification unit are provided as a program executed by the control unit 15.

[0038] The process execution unit executes processes in the image forming apparatus 10 in response to voice instructions input via the voice input / output device 30 and the server 40. For example, when image formation settings (e.g., paper selection, etc.) are input to the image forming apparatus 10 by voice instructions, the process execution unit executes input processing of the image formation settings on the operation screen of the operation panel 16.

[0039] Furthermore, the first notification unit sends a first notification to the voice input / output device 30 and the server 40 in response to the completion of execution of the process in the image forming device 10 (first notification process). For example, as described above, when the process execution unit executes the input process of the image formation settings and the input process ends without an error, the first notification to the effect that "settings have been completed" is sent to the voice input / output device 30 and the server 40 in response to the completion of the execution.

[0040] Furthermore, the second notification unit estimates whether the processing in the image forming apparatus 10 will end before the timeout time set in the audio input / output device 30 and the server 40 for the first notification. If the second notification unit estimates that the processing in the image forming apparatus 10 will not end before the timeout time, the second notification unit issues a second notification different from the first notification to the audio input / output device 30 and the server 40 (second notification process). For example, as described above, if the process execution unit executes input processing for image formation settings and it is estimated that the input processing will not end before the timeout time, the second notification stating "setting not possible" is issued to the audio input / output device 30 and the server 40.

[0041] Here, first, a procedure for responding when a user gives an instruction directly from operation panel 16 will be described with reference to Fig. 2. Fig. 2 is a sequence diagram for explaining the procedure when an instruction is given directly from operation panel 16 in image forming system 1. Then, a procedure for responding to a voice instruction (a response notification method and a response notification program) in image forming apparatus 10 having the above-mentioned configuration will be described with reference to Figs. 3 to 5.

[0042] (Step S1) The user selects the "color mode" as a setting for image formation by directly inputting from the operation screen of the operation panel 16.

[0043] (Step S2) Since the "color mode" has been selected on the operation panel 16 in step S1, the "color mode" command is input to the control unit 15.

[0044] (Step S3) The control unit 15 performs a process for setting the “color mode” in the image forming apparatus 10 .

[0045] (Step S4) When the "color mode" cannot be set in the image forming apparatus 10, the control unit 15 outputs an error to the operation panel 16. For example, when the image forming apparatus 10 is a device that does not support the "color mode" but supports the "monochrome mode", the control unit 15 determines that the "color mode" cannot be set in the image forming apparatus 10 and outputs an error to the operation panel 16.

[0046] (Step S5) The operation panel 16 displays the error input from the control unit 15 on the operation screen. For example, "Setting not possible" is displayed on the operation screen.

[0047] (Step S6) The operation panel 16 notifies the user of this by displaying "Setting not possible" on the operation screen.

[0048] As described above, when the user directly inputs image formation settings from the operation screen of operation panel 16, the processing is performed by image forming apparatus 10, so even if the setting processing takes time, the operation is not interrupted.

[0049] Next, a procedure for responding to a voice instruction when there is no response delay but there is an error will be described with reference to Fig. 3. Fig. 3 is a sequence diagram for explaining a procedure for responding to a voice instruction when there is no response delay but there is an error in the image forming system 1.

[0050] (Step S11) The user issues a voice instruction such as "color mode" to the voice input / output device 30. In this manner, the voice instruction issued by voice is, for example, an instruction to set conditions for performing image formation.

[0051] (Step S12) The audio input / output device 30 encodes the input audio into audio data and transmits it to the server 40 .

[0052] (Step S13) Server 40 (controller 42) performs voice recognition processing on the voice data transmitted from voice input / output device 30, and because "color mode" is specified by voice in step S11, transmits a command for "color mode" to controller 15 of image forming apparatus 10. Thereafter, server 40 performs response control between image forming apparatus 10 and voice input / output device 30.

[0053] (Step S14) The control unit 15 performs a process of setting the "color mode" in the image forming apparatus 10. At this time, as will be described in FIG. 6 (see step S64) described later, the control unit 15 starts measuring the timer T1 for the processing time. Also, before starting this measurement, as will be described in FIG. 6 (see step S62), the control unit 15 sets a response waiting time T0 according to the timeout time of the server 40. The response waiting time T0 is appropriately changed according to the timeout time of the server 40, but a time shorter than the timeout time is set.

[0054] (Step S15) When the process is completed and the "color mode" cannot be set in the image forming apparatus 10, the control unit 15 notifies the server 40 of an error (first notification). At this time, the timer T1 for the processing time < T0. That is, before the response waiting time T0, the control unit 15 notifies the server 40 of an error. Therefore, in this case, the server 40 does not time out. Also, here, before step S16 below, that is, immediately after the process ends, the server 40 is notified of an error, and the time from the start of the process to the notification of the error to the server 40 is shortened so as not to time out.

[0055] (Step S16) When the "color mode" cannot be set in the image forming apparatus 10, the control unit 15 outputs an error to the operation panel 16.

[0056] (Step S17) The operation panel 16 displays the error input from the control unit 15 on the operation screen. For example, it displays "Cannot be set" on the operation screen.

[0057] (Step S18) Upon receiving the error notification from the control unit 15, the server 40 transmits voice data of "Cannot be set" to the voice input / output device 30.

[0058] (Step S19) The voice input / output device 30 converts the voice data "Cannot set" sent from the server 40 into an electrical signal, outputs it to a speaker of the voice input / output device 30, and causes the speaker to output the voice "Cannot set."

[0059] 3, if the timeout period of the server 40 is longer than the processing time of the image forming device 10, no timeout problem occurs. However, since the timeout period may differ depending on the server 40, if the processing of the image forming device 10 does not finish within the timeout period, a dummy response is sent to extend the timeout, as shown in Figs. 4 and 5 described later.

[0060] Next, a procedure for responding to a voice instruction when there is a delayed response and an error will be described with reference to Fig. 4. Fig. 4 is a sequence diagram for explaining a procedure for responding to a voice instruction when there is a delayed response and an error in image forming system 1.

[0061] (Steps S21 to S24) Steps S21 to S24 are the same as steps S11 to S14 shown in FIG. 3, so a duplicated description will be omitted here.

[0062] (Step S25) If the process of setting the "color mode" in the image forming apparatus 10 takes a long time, the control unit 15 notifies the server 40 of a dummy (second notification). For example, the control unit 15 notifies the server 40 of "processing in progress" as a dummy notification. The control unit 15 may also estimate the time required for the process, or, as described in FIG. 6 (see step S67), may estimate that the process will take a long time if a timer T1 measuring the processing time exceeds a response waiting time T0. In other words, the control unit 15 notifies the server 40 of a dummy before the timeout time of the server 40, thereby avoiding the timeout of the server 40 and extending the timeout.

[0063] At this time, as will be described with reference to Fig. 6 (step S69), the control unit 15 resets the timer T1 for the processing time to T1 = 0. Then, the control unit 15 starts counting the timer T1 again.

[0064] In addition, the processing in the control unit 15 according to the setting instruction includes a process of displaying the contents of the setting instruction on the operation panel 16 of the image forming apparatus 10, a prohibition process of determining whether the contents of the setting instruction include any prohibited contents, etc. For example, when sending image data, prohibition process is necessary for destination specification, and when such a process is performed, the setting process may take time.

[0065] Also, instead of "Processing", a dummy phrase such as "Working on it" or "Please wait a moment" may be used, or the remaining time of processing may be used.

[0066] (Step S26) When the process of setting the "color mode" in the image forming apparatus 10 takes a long time, the control unit 15 outputs a dummy message to the operation panel 16. For example, the control unit 15 outputs a dummy message indicating that "processing" is in progress.

[0067] (Step S27) Operation panel 16 displays the dummy input from control unit 15 on the operation screen. For example, "Processing" is displayed on the operation screen.

[0068] (Step S28) Upon receiving the dummy notification from the control unit 15, the server 40 transmits voice data stating "Processing" to the voice input / output device 30.

[0069] (Step S29) The voice input / output device 30 converts the voice data "Processing" sent from the server 40 into an electrical signal, outputs it to the speaker of the voice input / output device 30, and causes the speaker to output the voice "Processing."

[0070] (Step S30) When the control unit 15 cannot set the "color mode" on the image forming apparatus 10, it notifies the server 40 of an error (first notification). In step S25, the timer T1 is reset, with T1 = 0, and the timer T1 is re-measured. At this time, the processing time of the timer T1 < T0. That is, before the response waiting time T0 after re-measurement, the control unit 15 has notified the server 40 of an error. Therefore, in this case, the server 40 will not time out. Also, here too, before step S31 below, that is, immediately after the process ends, the server 40 has been notified of an error, shortening the time from the start of re-measurement to the notification of an error to the server 40 so as not to time out.

[0071] (Steps S31 - S34) Steps S31 - S34 are the same as steps S16 - S19 shown in FIG. 3, so the overlapping explanations are omitted here.

[0072] Next, the procedure for the response to the voice instruction, specifically the procedure when there is a response delay and no error, will be described with reference to FIG. 5. FIG. 5 is a sequence diagram for explaining the procedure when there is a response delay to the voice instruction and no error in the image forming system 1.

[0073] (Steps S41 - S49) Steps S41 - S49 are the same as steps S21 - S29 shown in FIG. 4, so the overlapping explanations are omitted here.

[0074] (Step S50) After setting the "Color Mode" on the image forming apparatus 10, the control unit 15 notifies the server 40 of the completion of the setting (first notification). In step S45, the timer T1 is reset, set to T1 = 0, and the timer T1 is re-measured. At this time, the processing time of the timer T1 < T0. That is, before the response waiting time T0 after re-measurement, the control unit 15 has notified the server 40 of the completion of the setting. Therefore, in this case, the server 40 does not time out. Also, here too, before step S51 below, that is, immediately after the processing ends, the server 40 has been notified of the completion of the setting, shortening the time from the start of re-measurement to the notification of the completion of the setting to the server 40 so as not to time out.

[0075] (Step S51) After setting the "Color Mode" on the image forming apparatus 10, the control unit 15 outputs the completion of the setting to the operation panel 16.

[0076] (Step S52) The operation panel 16 displays the completion of the setting input from the control unit 15 on the operation screen. For example, "Setting completed" is displayed on the operation screen.

[0077] (Step S53) Upon receiving the notification of the completion of the setting from the control unit 15, the server 40 transmits voice data saying "Set" to the voice input / output device 30.

[0078] (Step S54) The voice input / output device 30 converts the voice data saying "Set" transmitted from the server 40 into an electrical signal, outputs it to the speaker of the voice input / output device 30, and outputs a voice saying "Set" from that speaker.

[0079] As described above, when the processing on the image forming apparatus 10 does not end within the timeout time of the server 40, a dummy response is made to extend the timeout. Thereby, it is possible to prevent interruption and re-operation of the voice operation, and it is possible to prevent deterioration of the operability of the voice operation.

[0080] Next, the control procedure in the control unit 15 of the image forming apparatus 10 in the sequences of Figures 3 to 5 described above will be described with reference to Figure 6. Figure 6 is a flowchart illustrating the control procedure in the image forming apparatus 10.

[0081] (Step S61) The control unit 15 judges whether or not a voice operation service has been selected. If a voice operation service has been selected (YES), the process proceeds to step S62, and if not (NO), the process proceeds to step S70. If a voice operation service has not been selected, for example, the sequence in FIG. 2 described above is executed. The selection of the voice operation service is set in advance by the user using the operation panel 16, for example.

[0082] (Step S62) The control unit 15 sets a response waiting time T0 according to the timeout time of the server 40. This response waiting time T0 is set to a predetermined time shorter than the timeout time. For example, if the timeout time is 7 seconds, the response waiting time T0 is set to 6 seconds.

[0083] (Step S63) The control unit 15 checks whether or not there is a voice instruction from the server 40. If there is a voice instruction (YES), the process proceeds to step S64, and if there is no voice instruction (NO), the process repeats step S63.

[0084] (Step S64) The control unit 15 starts measuring a processing time on a timer T1 when there is a voice instruction from the server 40. The timer T1 measures the time required for a process performed by the image forming apparatus 10 in response to the voice instruction, such as the setting process described above.

[0085] (Step S65) The control unit 15 starts the process to be performed by the image forming apparatus 10 in response to the voice instruction, for example, the above-mentioned setting process.

[0086] (Step S66) The control unit 15 determines whether the processing performed by the image forming apparatus 10 has been completed. If the processing has been completed (YES), the process proceeds to step S70, and if not (NO), the process proceeds to step S67. That is, the control unit 15 repeats steps S67 to S69, which will be described later, until the processing is completed. Note that, in order to prevent the processing from being prolonged, an upper limit may be set on the number of times the timeout can be extended, and steps S67 to S69, which will be described later, may be repeated up to the upper limit.

[0087] (Step S67) The control unit 15 compares the processing time timer T1 with the response waiting time T0, and if T1>T0 (YES), the process proceeds to step S68, and if T1>T0 is not satisfied (NO), the process returns to step S66.

[0088] (Step S68) When T1>T0, that is, when the processing time timer T1 exceeds the response waiting time T0, the control unit 15 notifies the server 40 of a dummy, and also displays it on the screen of the operation panel 16. For example, it notifies the server 40 of "Processing" as a dummy, and also displays "Processing" on the screen of the operation panel 16. This prevents the server 40 from timing out.

[0089] (Step S69) The control unit 15 resets the processing time timer T1 to T1 = 0. Then, the control unit 15 starts counting the timer T1 again, and the process returns to step S66.

[0090] When repeating steps S67 to S69, if T1>T0 in step S67, the control unit 15 notifies the server 40 of the dummy again and displays the dummy on the operation panel 16 again.

[0091] (Step S70) When the process is completed, the control unit 15 notifies the server 40 of the process result and also displays the result on the screen of the operation panel 16. For example, in the case of Fig. 5, the control unit 15 notifies the server 40 that "Setting is complete" and also displays the result on the screen of the operation panel 16.

[0092] In this way, in the image forming apparatus 10, the control unit 15 measures the timer T1, which is the processing time for processing in response to a voice instruction, and if the timer T1 exceeds the preset response waiting time T0, it notifies the server 40 of a dummy. Since the response waiting time T0 is set shorter than the timeout time of the server 40, by notifying the server 40 of a dummy when T1>T0, it is possible to reliably avoid a timeout of the server 40.

[0093] As described above in detail, in the image forming system 1 of the present embodiment, the image forming device 10 includes a process execution unit that executes a process in response to an instruction (voice instruction) input via an external device, and a first notification unit that issues a first notification to the external device in response to completion of execution of the process. The image forming device 10 also includes a second notification unit that issues a second notification, different from the first notification, to the external device when it is estimated that execution of the process will not be completed before a timeout period set in the external device for the first notification.

[0094] According to the present embodiment configured as above, when voice operations are performed from the voice input / output device 30 and the server 40, which are external devices, a timeout of the server 40 can be avoided.

[0095] Therefore, voice operation is prevented from being interrupted due to a timeout of the server 40, which makes it impossible to continue the voice operation thereafter, or requires the operation to be restarted from the beginning, and interruptions of voice operation and deterioration of the operability of voice operation can be prevented.

[0096] It should be noted that the above-mentioned embodiments are merely examples of the implementation of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these embodiments. In other words, the present invention can be implemented in various forms without departing from the gist or main characteristics of the present invention. [Explanation of symbols]

[0097] 1. Image forming system 10 Image forming device 11 Network Department 12 Scanner section 13 Printer section 14 FAX Department 15 Control section 16 Operation Panel 20 Network 30 Audio input / output device 40 Servers 41 Network Department 42 Control section

Claims

1. a processing execution unit that executes a setting process in response to an instruction for setting an image forming condition inputted via an external device; a first notification unit that issues a first notification to the external device in response to completion of the setting process; a second notification unit that, when it is estimated that the execution of the setting process will not be completed before a timeout time that is set in the external device with respect to the first notification, sends a second notification to the external device that is different from the first notification; An image forming apparatus comprising:

2. The process execution unit, when executing the setting process, executes a process of displaying contents of the setting instruction on a display unit of the image forming device. The image forming apparatus according to claim 1 .

3. The process execution unit, when executing the setting process, executes a prohibition process for determining whether or not the content of the setting instruction includes any prohibited content.

3. The image forming apparatus according to claim 1 or 2.

4. The second notification unit notifies the external device that processing is in progress as the second notification. The image forming apparatus according to claim 1 .

5. the second notification unit measures a processing time from the start of execution of the setting process, and when the processing time exceeds a waiting time that is set to be shorter than the timeout time by a predetermined time, performs the second notification to the external device. The image forming apparatus according to claim 1 .

6. the second notification unit resets the processing time to 0 after sending the second notification to the external device, measures a processing time of the setting process from the reset, and sends the second notification to the external device when the measured processing time exceeds the waiting time. The image forming apparatus according to claim 5 .

7. The first notification unit performs the first notification to the external device after the execution of the setting process is completed. The image forming apparatus according to claim 1 .

8. 8. An image forming system comprising the image forming apparatus according to claim 1 and the external device, The external device has a smart speaker for inputting voice instructions from a user. Image forming system.

9. 8. An image forming system comprising the image forming apparatus according to claim 1 and the external device, The external device is A smart speaker that inputs voice instructions from the user, a server that outputs the voice instruction input to the smart speaker to the image forming device and transmits the first and second notifications notified from the image forming device to the smart speaker; having Image forming system.

10. A response notification method in an image forming apparatus, comprising: when executing a setting process in response to an instruction for setting an image forming condition inputted via an external device after receiving the instruction, a first notification is sent to the external device in response to completion of the setting process; when it is estimated that the execution of the setting process will not be completed before a timeout period set in the external device with respect to the first notification, a second notification different from the first notification is sent to the external device. Response notification method.

11. On the computer, a first notification process for performing a setting process in response to an instruction for setting an image forming condition inputted via an external device, when the setting process is performed in response to the instruction for setting the image forming condition, to the external device, in response to completion of the setting process; a second notification process for sending a second notification, which is different from the first notification, to the external device when it is estimated that the execution of the setting process will not be completed before a timeout time set in the external device for the first notification; A response notification program that causes the execution of the following:

Images