Image forming apparatus

Abstract

To enable avoidance of a situation where voice instruction is not correctly input by noise or the like.SOLUTION: An image formation device (1) includes: a reception part (103) that receives voice instruction via manual input operation via an operation part (47) and a microphone (22); and a control part (100) that performs a job on the basis of a setting received by the reception part (103). When the microphone (22) is in a state where voice is input, the control part (100) does not execute a predetermined job of the image formation device (1). When the microphone is not in the state where voice is input, the control part (100) performs control of executing the predetermined job.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an image forming apparatus capable of voice instructions.

[0002] Some image forming apparatuses such as copiers and multifunction printers have an operation panel for users to perform manual input operations. By operating through the operation panel, users can select one function from a plurality of functions (for example, copy function, scanner function, facsimile function), or perform settings for the functions.

[0003] In addition, various image forming apparatuses that enable voice instructions have been proposed and put into practical use. For example, Patent Document 1 below describes reflecting the content of voice instructions in job settings, and Patent Document 2 below describes narrowing down job history information intended by the user from a plurality of job history information based on keywords included in the user voice.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

[0005] However, if noise is introduced during voice input, the user's speech may not be correctly recognized, and there is a risk that the operation according to the voice instruction intended by the user may not be realized. In particular, when a finisher with a relatively large driving sound is operating, there is a risk that the user's speech may not be correctly recognized. However, the inventions described in Patent Documents 1 and 2 above cannot solve the problems of voice recognition under such noise. problems such as those described above regarding voice recognition under noise.

[0006] This invention has been made in view of the above circumstances, and aims to prevent situations in which voice commands are not accurately input due to noise or other factors.

[0007] An image forming apparatus according to one aspect of the present invention is an image forming apparatus comprising an image forming unit for forming an image on a recording medium, the apparatus comprising: an audio input unit for receiving audio input from a user; a reception unit for receiving audio instructions based on the audio input to the audio input unit; and a control unit for executing a job according to the content of the audio instructions received by the reception unit, wherein the control unit does not execute a predetermined job for at least a predetermined period of time when the audio input unit is set to receive audio input, and executes the predetermined job when the audio input unit is not set to receive audio input.

[0008] According to the present invention, when the system is in a state where it accepts audio input to the audio input unit, it does not execute a predetermined job. For example, by making the predetermined job a job that generates a loud noise in the image forming apparatus, it becomes possible to avoid situations where voice instructions are not accurately input due to noise or the like. [Brief explanation of the drawing]

[0009] [Figure 1] This is a perspective view showing the external appearance of an image forming apparatus according to one embodiment of the present invention. [Figure 2] This is a functional block diagram that schematically shows the main internal components of an image forming apparatus. [Figure 3] (A) and (B) are diagrams showing examples of operation screens displayed on the display unit. [Figure 4] (A) and (B) are diagrams showing examples of operation screens displayed on the display unit. [Figure 5] This figure shows an example of the operation screen displayed on the display unit. [Figure 6] This figure shows an example of the operation screen displayed on the display unit. [Figure 7] This flowchart shows an example of processing performed by the control unit of an image forming apparatus. [Figure 8] This figure shows an example of the operation screen displayed on the display unit. [Figure 9] This figure shows an example of the operation screen displayed on the display unit. [Modes for carrying out the invention]

[0010] Hereinafter, an image forming apparatus according to one embodiment of the present invention will be described with reference to the drawings. Figure 1 is a perspective view showing the external appearance of an image forming apparatus according to one embodiment of the present invention. Figure 2 is a functional block diagram schematically showing the main internal configuration of the image forming apparatus. The image forming apparatus 1 according to the first embodiment is a multifunction device that combines multiple functions such as a copy function, a printer function, a scanner function, and a facsimile function, and is composed of a document feeding unit 6, a document reading unit 5, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, a storage unit 8, a human presence sensor 21, an operation unit 47, a facsimile communication unit 71, a network interface unit 91, a microphone 22, and a speaker 23. The image forming apparatus 1 is also configured to be connectable to a post-processing device 31.

[0011] The post-processing device 31, also known as a finisher, performs stapling and punching operations on the printed image paper. The post-processing device 31 can switch between an automatic stapling mode and a manual stapling mode. The post-processing device 31 operates under the control of the image forming apparatus 1.

[0012] The document feeding unit 6 is configured to open and close on the upper surface of the document reading unit 5 by a hinge (not shown), and functions as a document holder cover when reading documents placed on a platen glass (not shown). The document feeding unit 6 is also known as an ADF (Auto Document Feeder) or DP (Document Processor), and is equipped with a document tray 61 that supplies documents placed on the document tray 61 to the document reading unit 5 one at a time.

[0013] The case where the original reading operation is performed by the image forming apparatus 1 will be described. The original reading unit 5 optically reads the original supplied to the original reading unit 5 by the original feeding unit 6 or the image of the original placed on the platen glass, and generates image data. The image data generated by the original reading unit 5 is stored in an image memory (not shown) or the like.

[0014] The case where the image forming operation is performed by the image forming apparatus 1 will be described. Based on the image data generated by the original reading operation and the image data received from a computer as an external device (for example, a personal computer) connected to the network, the image forming unit 12 forms an image on a recording sheet as a recording medium fed from the paper feeding unit 14.

[0015] The fixing unit 13 heats and presses the recording sheet on which the toner image is formed by the image forming unit 12 to fix the toner image on the recording sheet, and the recording sheet subjected to the fixing process is discharged to the discharge tray 151. The paper feeding unit 14 includes a plurality of paper feeding cassettes 141.

[0016] The storage unit 8 is a large-capacity storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various control programs and the like.

[0017] The human presence sensor 2 * 1 detects a person approaching the image forming apparatus 1. As the human presence sensor 2 * 1, for example, a sensor that detects infrared rays emitted by a human body is used.

[0018] The operation unit 47 receives instructions from an operator, such as an image forming operation execution instruction, regarding various operations and processes that the image forming apparatus 1 can execute. The operation unit 47 includes a display unit 473 that displays operation guidance and the like to the operator. Further, the operation unit 47 receives an input of an instruction from a user based on an operation (touch operation) by the user on an operation screen displayed on the display unit 473 via a touch panel included in the display unit 473 or an operation by the user on a physical key.

[0019] The display unit 473 consists of an LCD (Liquid Crystal Display) or the like. The display unit 473 has a touch panel. When the operator touches the buttons or keys displayed on the screen, the touch panel receives an instruction associated with the touched position.

[0020] The facsimile communication unit 71 includes an encoding / multiplexing, modulation / demodulation unit and an NCU (Network Control Unit) not shown in the figure, and performs facsimile transmission and reception using a public telephone line network or the like.

[0021] The network interface unit 91 is a communication interface that performs transmission and reception of various data with external devices (e.g., personal computers) within a local area or on the Internet.

[0022] The microphone 22 is a voice input unit that collects sounds around the image forming apparatus 1 and converts them into electrical signals (voice data). The microphone 22 is provided at an appropriate location, for example, on the operation unit 47, where it is easy to collect the voice of the user speaking.

[0023] The speaker 23 outputs various sounds such as operation sounds and effect sounds when operating the operation unit 47, guidance voices explaining the operation method, warning sounds when a trouble occurs in the image forming apparatus 1, and the like. For example, the speaker 23 is provided at a location not visible from the outside of the image forming apparatus 1, for example, inside the operation unit 47.

[0024] The control unit 10 comprises a processor, RAM (Random Access Memory), ROM (Read Only Memory), and dedicated hardware circuits. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 10 includes a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103.

[0025] The control unit 10 functions as a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103 through operation by the processor in accordance with the control program stored in the memory unit 8. However, these control units 100, etc., can also be configured by hardware circuits, rather than by operation in accordance with the control program by the control unit 10. The same applies to each embodiment below unless otherwise specified.

[0026] The control unit 100 is responsible for the overall operation control of the image forming apparatus 1. The control unit 100 is connected to the document feeding unit 6, document reading unit 5, image forming unit 12, fixing unit 13, paper feeding unit 14, storage unit 8, human presence sensor 21, operation unit 47, facsimile communication unit 71, network interface unit 91, microphone 22, speaker 23, and post-processing unit 31, and performs operation control of each of these units. For example, the control unit 100 controls the operation of the image forming unit 12, etc., to form the document image obtained by reading by the document reading unit 5 onto the recording paper which serves as the recording medium.

[0027] Furthermore, when the motion sensor 21 detects an approaching person, the control unit 100 controls the microphone 22 to turn it on, enabling voice input to the microphone 22. After a predetermined time (for example, 30 seconds) has elapsed since the motion sensor 21 stopped detecting an approaching person, the control unit 100 controls the microphone 22 to turn it off. Note that the control unit 100 can also switch the microphone 22 on and off according to instructions input to the operation unit 47.

[0028] The display control unit 101 controls the display operation of the display unit 473. For example, the display control unit 101 displays a selection screen on the display unit 473 for the user to select a function to be executed from among several functions that can be executed in the image forming apparatus 1, and also displays a setting screen on the display unit 473, which is a lower layer than the selection screen, for receiving input related to the settings of each function.

[0029] Figures 3(A) and 3(B) show examples of screens displayed on the display unit 473. The operation screen SC1 shown in Figure 3(A) is a selection screen that allows the user to select a function to be executed from among several functions that can be executed in the image forming apparatus 1. Operation screen SC1 displays buttons such as "Copy," "Send (Scanner function)," and "Fax (Facsimile function)." Operation screen SC1, which functions as a selection screen, also serves as the home screen. When the user presses the "Copy" button, the operation unit 47 receives a copy function selection instruction, and the control unit 100 displays the operation screen SC2 shown in Figure 3(B) on the display unit 473 according to this instruction.

[0030] The operation screen SC2 is displayed on the display unit 473 as a lower level than the "Home" screen. The operation screen SC2 is a settings screen for receiving input related to the "Copy" function settings. In the center of the "Copy" function settings screen, six buttons are displayed labeled "Paper Selection," "Color Selection," "Page Collation," "Reduce / Enlarge," "Duplex / Split," and "Staple / Punch." These buttons are images for receiving settings related to the "Copy" function.

[0031] The operation screen SC1 shown in Figure 3(A) and the operation screen SC2 shown in Figure 3(B) (top left in Figures 3(A) and (B)) display the symbol G1, which is a microphone. The display of symbol G1 indicates that audio input to the microphone 22 is possible. In other words, the control unit 100 displays the symbol G1 on the operation screen SC2 when the microphone 22 is turned on and in a state where audio input is possible.

[0032] On the other hand, when the control unit 100 turns off the microphone 22 and makes it impossible to input audio from the microphone 22, the operation screen SC1 and operation screen SC2 (upper left in Figures 3(A) and 3(B)) display a symbol G2 which is a symbol G1 which is a microphone, with an "×" image superimposed on it.

[0033] The voice analysis unit 102 converts the electrical signals (voice data) converted by the microphone 22 into text data using existing voice recognition technology, and then analyzes the text data using existing natural language processing technology to recognize voice instructions from the user.

[0034] The reception unit 103 receives instructions from the user via manual input through the operation unit 47 (including the touch panel) on the screen currently displayed on the display unit 473, and voice instructions (analysis results by the voice analysis unit 102) recognized by the voice analysis unit 102 via the microphone 22. The control unit 100 executes a job according to the content of the instructions received by the reception unit 103.

[0035] The display control unit 101 displays a settings screen on the display unit 473 that shows the content indicated by the instructions entered by manual input or the voice instructions. For example, when the operation screen SC2, which is a settings screen as shown in Figure 3(B), is displayed on the display unit 473, the user inputs instructions via the operation unit 47 to set "Paper Selection" to "A4", "Color Selection" to "Black and White", and "Page Consolidation" to "2in1", and the reception unit 103 receives these instructions. At this time, the display control unit 101 displays an operation screen SC2 (settings screen) on the display unit 473, as shown in Figure 5, which switches the "Paper Selection" setting from "Automatic" to "A4", the "Color Selection" setting from "Full Color" to "Black and White", and "Page Consolidation" from "Off" to "2in1".

[0036] When the operation screen SC1 shown in Figure 3(A) is displayed on the display unit 473, and the user speaks the keyword "black and white copy," and the reception unit 103 receives these voice commands via the speaker 23 and the voice analysis unit 102, the display control unit 101 displays the operation screen SC2 shown in Figure 6 on the display unit 473.

[0037] When the control unit 100 has the microphone 22 turned on and is in a state where voice input is possible, it will either wait for a predetermined period (for example, 2 minutes) before executing a predetermined job, or it will prohibit the job from being executed. Hereinafter, when a job is described as "not executed" or "prohibited," it means that the job will wait for a predetermined period before being executed, or it will be prohibited from being executed. When it is expressed as "waiting without executing the job," it means exactly what it says. The above-mentioned "predetermined jobs" are (i) jobs that the manufacturer or developer of the image forming apparatus 1 has subjectively identified as producing loud noises (i.e., jobs predetermined as producing loud noises from the image forming apparatus 1), or (ii) jobs that operate at a predetermined volume (for example, 80 dB) or higher. The above-mentioned "predetermined jobs" are stored as part of the control program, or are stored in advance in a non-volatile memory built into the control unit 10.

[0038] For example, when the microphone 22 is turned on and voice input is enabled, the control unit 100 prohibits the execution of jobs including stapling and punching in the post-processing device 31. Specifically, even when it is time to start execution of a print job including stapling, if the microphone 22 is in a state where voice input is enabled, the control unit 100 will not start the print job. The control unit 100 will execute the predetermined job when the microphone 22 is turned off and voice input is disabled.

[0039] However, even if the microphone 22 is in a state where voice input is possible, the control unit 100 will execute jobs that are predetermined to be of high importance. For example, if the person requesting the execution of a job is a predetermined specific person (such as a manager or higher), the control unit 100 will determine that the job is of high importance. For example, if the image forming apparatus 1 is shared, and login information such as personal ID information is entered by a user operating the operation unit 47, and the control unit 100 approves the login if the personal ID information indicated by the entered login information matches the personal ID information of a legitimate user that is stored in advance, and furthermore, if the personal ID information of this approved user matches the personal ID information of a predetermined specific person that is stored in advance, and the user enters a job execution instruction by operating the operation unit 47, the control unit 100 will execute the job as a predetermined high-priority job, even if the microphone 22 is in a state where voice input is possible.

[0040] Next, an example of the processing performed by the control unit 10 of the image forming apparatus 1 will be explained based on the flowchart shown in Figure 7. This processing is performed when the job execution start timing arrives.

[0041] The control unit 100 determines whether the microphone 22 is in a state where it can receive audio input, that is, whether the microphone 22 is turned on (S1). If the control unit 100 determines that the microphone 22 is not in a state where it can receive audio input (NO in S1), it executes the job (S3).

[0042] On the other hand, if the control unit 100 determines that the microphone 22 is in a state where it can receive audio input (YES in S1), it further determines whether the job is one of the predetermined jobs (S2). If the control unit 100 determines that the job is not one of the predetermined jobs (NO in S2), it executes the job (S3). After this, the process ends.

[0043] On the other hand, if the control unit 100 determines that the job is one of the predetermined jobs (YES in S2), it determines whether the job is a predetermined job of high importance (S4).

[0044] If the control unit 100 determines that the job is a job of high priority as predetermined (YES in S4), it executes the job (S3). After this, the process ends.

[0045] Furthermore, if the control unit 100 determines that the job is not a job of a predetermined high importance (NO in S4), it will not execute the job and will have it wait for a predetermined period (for example, 2 minutes) (S5). After the predetermined period has elapsed, the control unit 100 will execute the job. After this, the process will end. Alternatively, if the control unit 100 determines that the job is not a job of a predetermined high importance (NO in S4), it may cancel the job without executing it (S5).

[0046] Thus, according to the above embodiment, the control unit 100 does not execute the predetermined jobs when the microphone 22 is in a state where voice input is possible, making it possible to avoid situations where voice instructions are not accurately input due to noise, etc. In other words, when voice input to the microphone 22 is possible, it is possible to prohibit the execution of stapling and punching processes, which produce relatively loud drive noises, thereby reducing the possibility of noise entering the microphone 22 during voice input and ensuring that voice instructions are accurately received.

[0047] Further embodiments will be described. For example, if the image forming apparatus 1 operates selectively between a normal mode in which the operating mechanisms such as the image forming unit 12 operate normally under the control of the control unit 100, and a silent mode in which the operating mechanisms such as the image forming unit 12 operate while suppressing the driving noise of the image forming apparatus 1, the control unit 100 may, when the microphone 22 is in a state where it can receive audio input, instead of controlling the image forming apparatus 1 not to execute the predetermined job, set the image forming apparatus 1 to the silent mode and then immediately cause the image forming apparatus 1 to execute the predetermined job.

[0048] This reduces the possibility of noise entering the microphone 22 while minimizing any decrease in the job execution performance of the image forming apparatus 1. When the control unit 100 has enabled audio input from the microphone 22 and has set silent mode, it is preferable for the display control unit 101 to display a message on the display unit 473 informing the user that silent mode is set, as shown in the example in Figure 8. As shown in the example in Figure 8, the message M1 "Silent mode in operation" is displayed on the operation screen SC2 (upper right of the operation screen SC2 in Figure 8).

[0049] Further embodiments will be described. If the post-stapling device 31 can switch between an auto-stapling mode in which stapling is performed automatically by control of the control unit 100, etc., and a manual-stapling mode in which stapling is performed manually based on user operation and the operation noise is relatively loud, the control unit 100 will selectively switch the post-stapling device 31 between the auto-stapling mode and the manual-stapling mode to control its operation. In this case, when the microphone 22 is in a state where voice input is possible, the control unit 100 will not operate the post-stapling device 31 in the manual-stapling mode. That is, the control unit 100 will Operating the post-processing device 31 in manual stapling mode is prohibited as a predetermined job.

[0050] Furthermore, in this case, when the microphone 22 is in a state where voice input is possible, and the user inputs a command to switch to manual stapling mode to the operation unit 47, the display control unit 101 displays a message on the display unit 473 indicating that switching to manual stapling mode is prohibited and that in order to lift the prohibition, the microphone 22 must be set to a state where voice input is impossible. In this case, the display control unit 101 functions as the "control unit" in the claims. For example, the display control unit 101 displays a pop-up screen PU on the display unit 473 with a message M2, as shown in Figure 9.

[0051] Furthermore, when the microphone 22 is in a state where voice input is possible, and the user inputs a command to switch to manual stapling mode to the operation unit 47, the control unit 100 may output the above message from the speaker 23.

[0052] Furthermore, the control unit 100 disables the microphone 22 to a state where voice input is impossible, in accordance with the instruction to turn off the microphone 22 input by the user to the operation unit 47.

[0053] Furthermore, when a predetermined voice input start condition (for example, when the motion sensor 21 detects the approach of a person) is met, the control unit 100 turns on the microphone 22 to enable voice input. However, when the post-processing device 41 is operating in manual stapling mode, the control unit 100 controls the microphone 22 so as not to enable voice input even if the above voice input start condition is met. In other words, when the post-processing device 41 is switched to manual stapling mode and operating, the control unit 100 does not turn on the microphone 22, but keeps it off, even if a person approaches the image forming apparatus 1.

[0054] Up to this point, we have described the case in which the audio data collected and converted by the microphone 22 is analyzed by the audio analysis unit 102 in the image forming apparatus 1. However, as a further embodiment, a speaker with a built-in microphone and AI (artificial intelligence) assistant function, known as a smart speaker, may be used. The user's voice is collected by this speaker, and the image forming apparatus 1 uses this speaker as an audio input unit, with the receiving unit 103 receiving the audio analysis results from the speaker.

[0055] The present invention is not limited to the configuration of the above embodiments and various modifications are possible. Furthermore, the configuration and processing shown in the above embodiments using Figures 1 to 9 are merely one embodiment of the present invention and are not intended to limit the present invention to such configuration and processing.

Claims

1. An image forming apparatus comprising an image forming unit that forms an image on a recording medium, A voice input unit where the user's voice is input, A receiving unit that receives voice instructions based on the voice input to the voice input unit, The system comprises a control unit that executes a job according to the content of the voice instructions received by the reception unit, The control unit controls the audio input unit to not accept audio input when a job that operates at a predetermined volume or higher is being executed, and to accept audio input when a job that operates at a predetermined volume or higher is not being executed.

2. The image forming apparatus according to claim 1, wherein the control unit controls jobs that operate with an operating sound above a predetermined volume, treating them as jobs to be operated in manual stapling mode.

3. The image forming apparatus is further equipped with a human presence sensor for detecting people approaching it. The control unit, as the control, When the motion sensor detects a person approaching the image forming apparatus, and the apparatus is not running a job that operates at a predetermined volume or higher, the voice input unit is set to accept voice input. The image forming apparatus according to claim 1, wherein even when the motion sensor detects a person approaching the image forming apparatus, if a job that operates at a predetermined volume or higher is being executed, the voice input unit is controlled to not be in a state where voice is input.

4. The image forming apparatus according to claim 1, wherein the job that operates at a predetermined volume or higher is a job that includes stapling or punching.

Images