Image formation device

Abstract

To enable avoidance of a situation where voice instruction is not correctly input by noise or the like.SOLUTION: An image formation device (1) includes: a reception part (103) that receives voice instruction via manual input operation via an operation part (47) and a microphone (22); and a control part (100) that performs a job on the basis of a setting received by the reception part (103). When the microphone (22) is in a state where voice is input, the control part (100) does not execute a predetermined job of the image formation device (1). When the microphone is not in the state where voice is input, the control part (100) performs control of executing the predetermined job.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an image forming apparatus capable of receiving voice instructions.

[0002] Some image forming devices, such as copiers and multifunction devices, are equipped with an operation panel that allows users to manually input operations. By operating the operation panel, users can select one function from multiple functions (e.g., copy function, scanner function, facsimile function) or configure settings for a function.

[0003] Furthermore, various image forming apparatuses that allow voice instructions have been proposed and put into practical use. For example, Patent Document 1 below describes how the contents of voice instructions are reflected in job settings, and Patent Document 2 below describes how job history information intended by a user is narrowed down from multiple pieces of job history information based on keywords included in the user's voice. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-098383 [Patent Document 2] Japanese Patent Application Publication No. 2019-205052 Summary of the Invention

[0005] However, if noise is introduced during voice input, the user's speech may not be correctly recognized, and the operation based on the user's intended voice command may not be realized. In particular, when a finisher that generates a relatively loud driving noise is in operation, the user's speech may not be correctly recognized. However, the inventions described in the above Patent Documents 1 and 2 do not have the above-mentioned However, this method cannot solve the problem of speech recognition under such noisy conditions.

[0006] The present invention has been made in view of the above circumstances, and has as its object to make it possible to avoid situations in which voice instructions are not input correctly due to noise or the like.

[0007] An image forming apparatus according to one aspect of the present invention is an image forming apparatus having an image forming unit that forms an image on a recording medium, and is equipped with a voice input unit that inputs voice from a user, a reception unit that receives voice instructions based on the voice input to the voice input unit, and a control unit that executes a job in accordance with the content of the voice instructions received by the reception unit, wherein when the voice input unit is set to a state in which voice can be input, the control unit does not execute a predetermined job for at least a predetermined period of time, and when the voice input unit is not set to a state in which voice can be input, the control unit controls the execution of the predetermined job.

[0008] According to the present invention, when the voice input unit is in a state where it is ready to accept voice, a predetermined job is not executed. Therefore, for example, by setting the predetermined job to a job that generates a loud noise from the image forming device, it is possible to avoid a situation where voice instructions are not input accurately due to noise, etc. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a perspective view showing the appearance of an image forming apparatus according to an embodiment of the present invention; [Figure 2] FIG. 2 is a functional block diagram illustrating a main internal configuration of the image forming apparatus. [Figure 3] 10A and 10B are diagrams showing an example of an operation screen displayed on a display unit. [Figure 4] 10A and 10B are diagrams showing an example of an operation screen displayed on a display unit. [Figure 5] FIG. 4 is a diagram illustrating an example of an operation screen displayed on a display unit. [Figure 6] FIG. 4 is a diagram illustrating an example of an operation screen displayed on a display unit. [Figure 7] 10 is a flowchart illustrating an example of processing performed by a control unit of the image forming apparatus. [Figure 8] FIG. 4 is a diagram illustrating an example of an operation screen displayed on a display unit. [Figure 9] FIG. 4 is a diagram illustrating an example of an operation screen displayed on a display unit. DETAILED DESCRIPTION OF THE INVENTION

[0010] An image forming apparatus according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a perspective view showing the exterior of an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a functional block diagram showing a schematic diagram of the main internal configuration of the image forming apparatus. The image forming apparatus 1 according to the first embodiment is a multifunction peripheral having multiple functions, such as a copy function, a printer function, a scanner function, and a facsimile function, and is configured to include a document feeder 6, a document reader 5, an image forming unit 12, a fixing unit 13, a paper feeder 14, a memory unit 8, a motion sensor 21, an operation unit 47, a facsimile communication unit 71, a network interface unit 91, a microphone 22, and a speaker 23. The image forming apparatus 1 is also configured to be connectable to a post-processing device 31.

[0011] The post-processing device 31 is called a finisher and performs stapling, punching, etc. on recording paper on which an image has been printed. The post-processing device 31 can be switched between an auto-stapling mode in which stapling is performed automatically and a manual stapling mode in which stapling is performed manually. The post-processing device 31 operates under the control of the image forming apparatus 1.

[0012] The document feeder 6 is configured to be openable and closable by a hinge or the like (not shown) on the top surface of the document reading unit 5, and functions as a document pressing cover when reading a document placed on a platen glass (not shown). The document feeder 6 is also called an ADF (Auto Document Feeder) or DP (Document Processor), and is equipped with a document placement tray 61, and supplies documents placed on the document placement tray 61 to the document reading unit 5 one by one.

[0013] The following describes the case where a document is read by the image forming apparatus 1. The document reading unit 5 optically reads an image of a document supplied to the document reading unit 5 by the document feeding unit 6 or a document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory (not shown) or the like.

[0014] The following describes an image forming operation performed by the image forming apparatus 1. Based on image data generated by a document reading operation or image data received from a computer as an external device (e.g., a personal computer) connected to a network, the image forming unit 12 forms an image on recording paper as a recording medium fed from the paper feed unit 14.

[0015] The fixing unit 13 applies heat and pressure to the recording paper on which the toner image has been formed by the image forming unit 12, thereby fixing the toner image to the recording paper, and the recording paper that has undergone the fixing process is discharged onto a discharge tray 151. The paper supply unit 14 includes a plurality of paper supply cassettes 141.

[0016] The storage unit 8 is a large-capacity storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores various control programs and the like.

[0017] The human sensor 21 detects a person approaching the image forming apparatus 1. As the human sensor 21, for example, a sensor that detects infrared rays emitted by a human body is used.

[0018] The operation unit 47 receives instructions, such as an instruction to perform an image forming operation, from the operator regarding various operations and processes that can be performed by the image forming apparatus 1. The operation unit 47 includes a display unit 473 that displays operation guides and the like to the operator. The operation unit 47 also receives input of instructions from the user via a touch panel provided in the display unit 473, based on the user's operation (touch operation) on the operation screen displayed on the display unit 473 or the user's operation on the physical keys.

[0019] The display unit 473 is composed of an LCD (Liquid Crystal Display) or the like. The display unit 473 is equipped with a touch panel. When the operator touches a button or key displayed on the screen, the touch panel receives an instruction associated with the touched position.

[0020] The facsimile communication unit 71 includes an encoding / decoding unit, a modulation / demodulation unit, and an NCU (Network Control Unit), not shown, and transmits and receives facsimiles using a public telephone line network or the like.

[0021] The network interface unit 91 is a communication interface for transmitting and receiving various data to and from an external device (for example, a personal computer) within a local area or on the Internet.

[0022] Microphone 22 is an audio input unit that collects sounds around image forming apparatus 1 and converts them into an electrical signal (audio data). Microphone 22 is provided in an appropriate location where it is easy to collect the voice of the user, for example, in operation unit 47.

[0023] The speaker 23 outputs various sounds such as operation sounds and sound effects when operating the operation unit 47, guidance audio that explains the operation method, and warning sounds when a problem occurs in the image forming apparatus 1. For example, the speaker 23 is provided in a location that cannot be seen from the outside of the image forming apparatus 1, for example, inside the operation unit 47.

[0024] The control unit 10 includes a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and a dedicated hardware circuit. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 10 includes a control unit 100, a display control unit 101, an audio analysis unit 102, and a reception unit 103.

[0025] The control unit 10 functions as a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103 through the operation of the processor in accordance with a control program stored in the storage unit 8. However, the control unit 100 and the like can also be configured by hardware circuits, without relying on the operation in accordance with the control program by the control unit 10. Unless otherwise stated below, the same applies to each embodiment.

[0026] The control unit 100 is responsible for overall operational control of the image forming apparatus 1. The control unit 100 is connected to the document feed unit 6, document reading unit 5, image forming unit 12, fixing unit 13, paper feed unit 14, memory unit 8, motion sensor 21, operation unit 47, facsimile communication unit 71, network interface unit 91, microphone 22, speaker 23, and post-processing device 31, and controls the operation of each of these units. For example, the control unit 100 controls the operation of the image forming unit 12, etc., to form the document image obtained by reading by the document reading unit 5 on recording paper as a recording medium.

[0027] Furthermore, when an approaching person is detected by the motion sensor 21, the control unit 100 controls the microphone 22 to turn on to enable voice input to the microphone 22, and when a predetermined time (e.g., 30 seconds) has elapsed since the motion sensor 21 stopped detecting an approaching person, the control unit 100 controls the microphone 22 to turn off. Note that the control unit 100 can also switch the microphone 22 on and off according to instructions input to the operation unit 47.

[0028] Display control unit 101 controls the display operation of display unit 473. For example, display control unit 101 displays on display unit 473 a selection screen that allows the user to select a function to be executed from a plurality of functions that can be executed by image forming apparatus 1, and also displays on display unit 473 a setting screen that is at a lower level than the selection screen and that is used to receive input related to the setting of each function.

[0029] 3A and 3B are diagrams showing examples of screens displayed on display unit 473. Operation screen SC1 shown in FIG. 3A is a selection screen that allows the user to select a function to be executed from among multiple functions that can be executed by image forming apparatus 1. Operation screen SC1 displays a "Copy" button, a "Send (scanner function)" button, a "Fax (facsimile function)" button, and the like. Note that operation screen SC1 as the selection screen also serves as the home screen. When the user presses the "Copy" button, operation unit 47 receives an instruction to select the copy function, and control unit 100, in accordance with this instruction, causes display unit 473 to display operation screen SC2 shown in FIG. 3B.

[0030] The operation screen SC2 is displayed on the display unit 473 as a lower layer than the "Home" screen. The operation screen SC2 is a setting screen for receiving input related to the settings of the "Copy" function. In the center of the setting screen for the "Copy" function, six buttons are displayed, labeled "Paper Selection," "Color Selection," "Page Combination," "Reduce / Enlarge," "Duplex / Split," and "Staple / Punch." These buttons are images for receiving settings related to the "Copy" function.

[0031] A symbol G1 with a microphone design is displayed on the operation screen SC1 shown in Fig. 3(A) and the operation screen SC2 shown in Fig. 3(B) (upper left in Figs. 3(A) and 3(B)). The display of the symbol G1 indicates that voice input to the microphone 22 is possible. That is, the control unit 100 turns on the microphone 22 and displays the symbol G1 on the operation screen SC2 when the microphone 22 is in a state where voice input is possible.

[0032] On the other hand, when the control unit 100 turns off the microphone 22 and puts the microphone 22 in a state where voice input is not possible, as shown in the examples of Figures 4(A) and 4(B), a symbol G2 consisting of a symbol G1 with a microphone design and an image of an "X" superimposed on it is displayed on the operation screen SC1 and operation screen SC2 (upper left in Figures 3(A) and (B)).

[0033] The voice analysis unit 102 converts the electrical signal (voice data) converted by the microphone 22 into text data using existing voice recognition technology, and analyzes the text data using existing natural language processing technology to recognize voice instructions from the user.

[0034] The reception unit 103 receives, as instructions from the user, instructions input by manual input operation via the operation unit 47 (including a touch panel) on the screen currently displayed on the display unit 473, and voice instructions recognized by the voice analysis unit 102 via the microphone 22 (the analysis result by the voice analysis unit 102). The control unit 100 executes a job in accordance with the content of the instructions received by the reception unit 103.

[0035] The display control unit 101 displays a setting screen on the display unit 473, which displays instructions input by manual input operation or the contents indicated by the voice instruction. For example, when the operation screen SC2 serving as the setting screen shown in FIG. 3B is displayed on the display unit 473, the user inputs instructions via the operation unit 47 to set "Paper Selection" to "A4," "Color Selection" to "Black and White," and "Page Combination" to "2 in 1," and the reception unit 103 receives these instructions. At this time, the display control unit 101 displays on the display unit 473 the operation screen SC2 (setting screen) which switches the setting of "Paper Selection" from "Auto" to "A4," the setting of "Color Selection" from "Full Color" to "Black and White," and the setting of "Page Combination" from "Off" to "2 in 1," as shown in FIG. 5.

[0036] When the operation screen SC1 shown in Figure 3(A) is displayed on the display unit 473, the user utters the keyword "black and white copy" and the reception unit 103 receives these voice instructions via the speaker 23 and the voice analysis unit 102, and the display control unit 101 displays the operation screen SC2 as shown in Figure 6 on the display unit 473.

[0037] When the microphone 22 is turned on to allow voice input, the control unit 100 either waits a predetermined period (e.g., two minutes) without executing a predetermined job, and then executes the job, or prohibits the job from being executed. Hereinafter, when a job is referred to as "not executing" or "prohibiting" it, it means that the job is either waited for a predetermined period without being executed, or is prohibited from being executed. Note that the expression "waiting without executing a job" means exactly that. The "predetermined job" refers to (i) a job that the manufacturer or developer of the image forming apparatus 1 subjectively identifies as a job that generates a loud noise from the image forming apparatus 1 (i.e., a job that is predetermined as a job that generates a loud noise from the image forming apparatus 1), or (ii) a job that operates at a predetermined volume (e.g., 80 dB) or higher. The "predetermined job" is stored as part of the control program or is pre-stored in a non-volatile memory or the like built into the control unit 10.

[0038] For example, when the microphone 22 is turned on and voice input is enabled, the control unit 100 prohibits the post-processing device 31 from executing a job that includes stapling and punching. As a specific example, even when the timing to start execution of a print job that includes stapling arrives, the control unit 100 does not start the print job if the microphone 22 is turned off and voice input is disabled. The control unit 100 executes the predetermined job.

[0039] However, even if the microphone 22 is in a state where voice input is possible, the control unit 100 executes a job with a predetermined high level of importance. For example, if the requester of job execution is a predetermined specific person (such as a manager or higher), the control unit 100 determines that the job is of high importance. For example, if the image forming apparatus 1 is shared and a user inputs login information such as personal ID information by operating the operation unit 47, the control unit 100 approves the login if the personal ID information indicated by the input login information matches the personal ID information of a pre-stored authorized user. Furthermore, if the personal ID information of this approved user matches the stored personal ID information of a predetermined specific person, and the user inputs an instruction to execute a job by operating the operation unit 47, the control unit 100 executes the job as a job with a predetermined high level of importance, even if the microphone 22 is in a state where voice input is possible.

[0040] Next, an example of processing performed by the control unit 10 of the image forming apparatus 1 will be described with reference to the flowchart shown in Fig. 7. This processing is performed when it is time to start execution of a job.

[0041] The control unit 100 determines whether the microphone 22 is in a state where voice input is possible, that is, whether the microphone 22 is in an on state (S1). If the control unit 100 determines that the microphone 22 is not in a state where voice input is possible (NO in S1), it executes the job (S3).

[0042] On the other hand, if the control unit 100 determines that the microphone 22 is in a state where voice input is possible (YES in S1), it further determines whether the job is the predetermined job (S2). If the control unit 100 determines that the job is not a predetermined job (NO in S2), it executes the job (S3). Then, the process ends.

[0043] On the other hand, when the control unit 100 determines that the job is the predetermined job (YES in S2), it determines whether the job is a job with a predetermined high level of importance (S4).

[0044] If the control unit 100 determines that the job is of a predetermined high importance (YES in S4), it executes the job (S3), after which the process ends.

[0045] Furthermore, if the control unit 100 determines that the job is not of a predetermined high importance (NO in S4), it does not execute the job and causes the job to wait for a predetermined period (for example, 2 minutes) (S5). After the predetermined period has elapsed, the control unit 100 executes the job. After this, the processing ends. Note that if the control unit 100 determines that the job is not of a predetermined high importance (NO in S4), it may cancel the job without executing it (S5).

[0046] As described above, according to the embodiment, when the microphone 22 is in a state where voice input is possible, the control unit 100 does not execute the predetermined job, thereby making it possible to avoid a situation where voice instructions are not input correctly due to noise, etc. In other words, when voice input to the microphone 22 is possible, it is possible to prohibit the execution of stapling and punching processes, which produce relatively loud driving sounds, thereby reducing the possibility of noise, etc., entering the microphone 22 during voice input and making it possible to accurately accept voice instructions.

[0047] A further embodiment will be described. For example, in the case where image forming apparatus 1 operates selectively under the control of control unit 100 between a normal mode in which each operating mechanism such as image forming unit 12 operates normally and a silent mode in which each operating mechanism such as image forming unit 12 operates while suppressing the drive noise of image forming apparatus 1, when microphone 22 is in a state in which voice input is possible, control unit 100 may set image forming apparatus 1 to the silent mode and then control image forming apparatus 1 to immediately execute the predetermined job, instead of controlling not to execute the predetermined job.

[0048] This reduces the possibility of noise being introduced into microphone 22 while minimizing degradation in job execution performance by image forming apparatus 1. When control unit 100 has microphone 22 enabled for voice input and has set silent mode, display control unit 101 preferably displays a message on display unit 473 informing the user that silent mode has been set, as shown in the example of Fig. 8. As shown in the example of Fig. 8, a message M1 saying "Silent mode in operation" is displayed on operation screen SC2 (top right of operation screen SC2 in Fig. 8).

[0049] A further embodiment will be described. When the post-processing device 31 is capable of switching between an auto-stapling mode in which stapling is performed automatically under the control of the control unit 100 etc., and a manual stapling mode in which stapling is performed manually based on user operation and which produces a relatively loud operating sound, the control unit 100 controls the operation of the post-processing device 31 by selectively switching between the auto-stapling mode and the manual stapling mode. In this case, when the microphone 22 is in a state in which voice input is possible, the control unit 100 does not operate the post-processing device 31 in the manual stapling mode. In other words, the control unit 100 controls the post-processing device 31 by selectively switching between the auto-stapling mode and the manual stapling mode. Operation of the post-processing device 31 in the manual staple mode is prohibited as the predetermined job.

[0050] In this case, when the user inputs an instruction to switch to the manual stapling mode to the operation unit 47 while the microphone 22 is in a state where voice input is possible, the display control unit 101 displays a message on the display unit 473 indicating that switching to the manual stapling mode is prohibited and that, to cancel the prohibition, the microphone 22 must be set to a state where voice input is impossible. In this case, the display control unit 101 functions as a "control unit" in the claims. For example, the display control unit 101 displays a pop-up screen PU on the display unit 473, which displays a message M2 as shown in FIG. 9.

[0051] Furthermore, when the microphone 22 is set to a state where voice input is possible in this manner, and the user inputs an instruction to switch to manual staple mode into the operation unit 47, the control unit 100 may be configured to output the above message from the speaker 23.

[0052] In addition, the control unit 100 sets the microphone 22 to a state where voice input is disabled in accordance with an instruction to turn off the microphone 22 input by the user to the operation unit 47.

[0053] Furthermore, when a predetermined voice input start condition (for example, human presence sensor 21 detects the approach of a person) is met, control unit 100 turns on microphone 22 to enable voice input, but when post-processing device 41 is operating in manual staple mode, control unit 100 controls microphone 22 not to enable voice input even when the above voice input start condition is met. In other words, when post-processing device 41 is operating in manual staple mode, control unit 100 does not turn on microphone 22 but keeps it in the off state even if a person approaches image forming apparatus 1.

[0054] Up to this point, we have explained the case where the voice data collected by the microphone 22 and converted is analyzed by the voice analysis unit 102 in the image forming device 1. However, as a further embodiment, a speaker with a built-in microphone and an AI (artificial intelligence) assistant function called a smart speaker may be adopted, and the user's voice may be collected by the speaker. The image forming device 1 may use the speaker as a voice input unit, and the voice analysis results from the speaker may be received by the reception unit 103.

[0055] The present invention is not limited to the configuration of the above embodiment, and various modifications are possible. Furthermore, in the above embodiment, the configuration and processing shown in the above embodiment using Figures 1 to 9 are merely one embodiment of the present invention, and it is not intended that the present invention be limited to these configurations and processing.

Claims

1. An image forming apparatus including an image forming unit that forms an image on a recording medium, a voice input unit for inputting voice from a user; a reception unit that receives a voice instruction based on the voice input to the voice input unit; a control unit that executes a job in accordance with the content of the voice instruction received by the reception unit, The control unit of the image forming apparatus does not execute a predetermined job for at least a predetermined period of time when the voice input unit is set to a state in which voice can be input, and controls the execution of the predetermined job when the voice input unit is not set to a state in which voice can be input.

2. The image forming apparatus according to claim 1 , wherein the control unit immediately executes a job having a predetermined high level of importance even when the voice input unit is set to a state in which voice can be input.

3. 2. The image forming apparatus according to claim 1, wherein, when the voice input unit is set to a state in which voice can be input, the control unit controls the image forming apparatus to immediately execute the predetermined job after setting the image forming apparatus to a quiet mode that suppresses noise generated by the image forming apparatus, instead of controlling the image forming apparatus not to execute the predetermined job for at least a predetermined period of time.

4. a post-processing device for stapling the recording paper on which the image is printed; the control unit controls the operation of the post-processing device by switching between an auto stapling mode in which stapling is performed automatically and a manual stapling mode in which stapling is performed manually; 2. The image forming apparatus according to claim 1, wherein the control unit, when the voice input unit is in a state in which voice can be input, does not execute the operation of the post-processing device in the manual staple mode as the predetermined job for at least a predetermined period of time.

5. 5. The image forming apparatus according to claim 4, wherein the control unit does not set the voice input unit in a state in which voice can be input when the post-processing device is operated in the manual staple mode.

6. The notification department, an operation unit into which instructions are input by a user operation, 6. The image forming apparatus according to claim 4, wherein when an instruction to operate the post-processing device in the manual staple mode is input while the voice input unit is in a state where voice is input, the control unit causes the notification unit to notify a message indicating that, in order to operate the post-processing device in the manual staple mode, the voice input unit must be in a state where voice is not input.

Images