Image forming apparatus

Abstract

An image forming apparatus (1) comprises a reception part (103) that receives a manual input operation via an operating part (47) and a voice instruction via a microphone (22) and a control part (100) that executes a job on the basis of a setting received by the reception part (103). When the microphone (22) is brought into a state in which voice is input to the microphone (22), the control part (100) does not execute a job determined in advance for the image forming apparatus (1). When the microphone is not in the state in which the voice is input to the microphone (22), the control part (100) performs control for executing the job determined in advance.

Description

Technical Field

[0001] The present invention relates to an image forming apparatus capable of voice instructions.

[0002] Some image forming apparatuses such as copiers and multifunction peripherals are provided with an operation panel for a user to perform manual input operations. By operating via the operation panel, the user can select one function from a plurality of functions (for example, a copying function, a scanner function, a facsimile function), or can perform settings for the function.

[0003] In addition, various image forming apparatuses that enable voice instructions have been proposed and put into practical use. For example, Patent Document 1 below describes reflecting the content of voice instructions in job settings, and Patent Document 2 below describes narrowing down job history information intended by the user from a plurality of job history information based on keywords included in the user voice.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

[0005] However, if noise is introduced during voice input, the user's speech may not be correctly recognized, and there is a risk that the operation according to the voice instruction intended by the user may not be realized. In particular, when a finisher with a relatively large driving sound is operating, there is a risk that the user's speech may not be correctly recognized. However, the inventions described in Patent Documents 1 and 2 above cannot solve the problem of voice recognition under such noise.

[0006] The present invention has been made in view of the above circumstances, and an object thereof is to avoid a situation where a voice instruction is not accurately input due to noise or the like.

[0007] An image forming apparatus according to an aspect of the present invention is an image forming apparatus including an image forming unit that forms an image on a recording medium, and includes a voice input unit that receives voice from a user, a reception unit that receives a voice instruction based on the voice input to the voice input unit, and a control unit that executes a job according to the content of the voice instruction received by the reception unit. The control unit does not execute a predetermined job for at least a predetermined period when the voice input unit is in a state where voice is input, and performs control to execute the predetermined job when the voice input unit is not in a state where voice is input.

[0008] According to the present invention, when in a state of receiving the voice input to the voice input unit, since a predetermined job is not executed, for example, by setting the predetermined job as a job with a large generation sound of the image forming apparatus, it is possible to avoid a situation where a voice instruction is not accurately input due to noise or the like.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0010] Hereinafter, an image forming apparatus according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view showing the appearance of an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a functional block diagram schematically showing the main internal configuration of the image forming apparatus. The image forming apparatus 1 according to the first embodiment is, for example, a multifunction machine having a plurality of functions such as a copying function, a printer function, a scanner function, and a facsimile function, and includes a document feeder 6, a document reading unit 5, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, a storage unit 8, a human sensor 21, an operation unit 47, a facsimile communication unit 71, a network interface unit 91, a microphone 22, and a speaker 23. Further, the image forming apparatus 1 is configured such that a post-processing apparatus 31 can be connected.

[0011] The post-processing apparatus 31 is called a finisher, and performs staple processing, punching processing, etc. on the recording paper on which an image is printed. Further, the post-processing apparatus 31 can be switched between an auto staple mode in which staple processing is automatically performed and a manual staple mode in which staple processing is manually performed. Note that the post-processing apparatus 31 operates under the control of the image forming apparatus 1.

[0012] The document feeder 6 is configured to be openable and closable by hinges (not shown) on the upper surface of the document reading unit 5, and the document feeder 6 functions as a document pressing cover when reading a document placed on a platen glass (not shown). Further, the document feeder 6 is called an ADF (Auto Document Feeder) or a DP (Document Processor), includes a document placement tray 61, and supplies the documents placed on the document placement tray 61 to the document reading unit 5 one by one.

[0013] The case where the original reading operation is performed by the image forming apparatus 1 will be described. The original reading unit 5 optically reads the original supplied to the original reading unit 5 by the original feeding unit 6 or the image of the original placed on the platen glass, and generates image data. The image data generated by the original reading unit 5 is stored in an image memory (not shown) or the like.

[0014] The case where the image forming operation is performed by the image forming apparatus 1 will be described. Based on the image data generated by the original reading operation and the image data received from a computer as an external device (for example, a personal computer) connected to the network, the image forming unit 12 forms an image on a recording sheet as a recording medium fed from the paper feeding unit 14.

[0015] The fixing unit 13 heats and presses the recording sheet on which the toner image is formed by the image forming unit 12 to fix the toner image on the recording sheet, and the recording sheet subjected to the fixing process is discharged to the discharge tray 151. The paper feeding unit 14 includes a plurality of paper feeding cassettes 141.

[0016] The storage unit 8 is a large-capacity storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various control programs and the like.

[0017] The human presence sensor 21 detects a person approaching the image forming apparatus 1. As the human presence sensor 21, for example, a sensor that detects infrared rays emitted by the human body is used.

[0018] The operation unit 47 receives instructions such as an image forming operation execution instruction from the operator regarding various operations and processes that the image forming apparatus 1 can execute. The operation unit 47 includes a display unit 473 that displays operation guidance and the like to the operator. Further, the operation unit 47 receives an input of an instruction from the user based on an operation (touch operation) by the user on the operation screen displayed on the display unit 473 or an operation by the user on a physical key via the touch panel included in the display unit 473.

[0019] The display unit 473 is composed of an LCD (Liquid Crystal Display) or the like. The display unit 473 is provided with a touch panel. When the operator touches the buttons or keys displayed on the screen, the touch panel receives an instruction associated with the touched position.

[0020] The facsimile communication unit 71 includes an encoding / multiplexing, modulation / demodulation unit and an NCU (Network Control Unit), which are not shown in the figure, and performs facsimile transmission and reception using a public telephone line network or the like.

[0021] The network interface unit 91 is a communication interface that performs transmission and reception of various data with external devices (e.g., personal computers) within a local area or on the Internet.

[0022] The microphone 22 is a voice input unit that collects sounds around the image forming apparatus 1 and converts them into electrical signals (voice data). The microphone 22 is provided at an appropriate location, for example, on the operation unit 47, where it is easy to collect the voice of the user speaking.

[0023] The speaker 23 outputs various sounds such as operation sounds and effect sounds when operating the operation unit 47, and guidance voices for explaining the operation method, and warning sounds when a trouble occurs in the image forming apparatus 1. For example, the speaker 23 is provided at a location that cannot be seen from the outside of the image forming apparatus 1, for example, inside the operation unit 47. Ga

[0024] ​The control unit 10 is configured to include a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and a dedicated hardware circuit. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit), etc. The control unit 10 includes a control section 100, a display control section 101, an audio analysis section 102, and a reception section 103.

[0025] The control unit 10 functions as the control section 100, the display control section 101, the audio analysis section 102, and the reception section 103 by the operation of the processor according to the control program stored in the storage unit 8. However, these control sections 100, etc. can also be configured by hardware circuits respectively without depending on the operation according to the control program by the control unit 10. The same applies to each embodiment hereinafter unless otherwise specified.

[0026] The control section 100 is in charge of the overall operation control of the image forming apparatus 1. The control section 100 is connected to the original document feeding section 6, the original document reading section 5, the image forming section 12, the fixing section 13, the paper feeding section 14, the storage unit 8, the human presence sensor 21, the operation section 47, the facsimile communication section 71, the network interface section 91, the microphone 22, the speaker 23, and the post-processing apparatus 31, and performs operation control, etc. of these sections. For example, the control section 100 controls the operation of the image forming section 12, etc. to form the original document image obtained by reading by the original document reading section 5 on the recording paper as the recording medium.

[0027] Also, when the human presence sensor 21 detects an approaching person, the control unit 100 controls the microphone 22 to turn it on, enabling voice input to the microphone 22. When a predetermined time (e.g., 30 seconds) has elapsed after the human presence sensor 21 stops detecting an approaching person, the control unit 100 controls the microphone 22 to turn it off. Note that the control unit 100 can also switch the microphone 22 on and off according to an instruction input to the operation unit 47.

[0028] The display control unit 101 controls the display operation of the display unit 473. For example, the display control unit 101 displays on the display unit 473 a selection screen for allowing the user to select a function to be executed from among a plurality of functions executable by the image forming apparatus 1, and also displays on the display unit 473 a setting screen for receiving an input related to the setting of each function, which is a lower layer than the selection screen.

[0029] FIGS. 3(A) and (B) are diagrams showing an example of a screen displayed on the display unit 473. The operation screen SC1 shown in FIG. 3(A) is a selection screen for allowing the user to select a function to be executed from among a plurality of functions executable by the image forming apparatus 1. On the operation screen SC1, a "Copy" button, a "Transmit (Scanner Function)" button, a "Fax (Facsimile Function)" button, etc. are displayed. Note that the operation screen SC1 as the selection screen is also the home screen. When the "Copy" button is pressed by the user, a copy function selection instruction is received by the operation unit 47, and the control unit 100 causes the operation screen SC2 shown in FIG. 3(B) to be displayed on the display unit 473 according to this instruction.

[0030] The operation screen SC2 is displayed on the display unit 473 as a lower layer than the "Home" screen. The operation screen SC2 is a setting screen for receiving an input related to the setting of the "Copy" function. In the central part of the setting screen of the "Copy" function, six buttons marked "Paper Selection", "Color Selection", "Page Aggregation", "Reduce / Enlarge", "Double-Sided / Split", and "Staple / Punch" are displayed. These buttons are images for receiving settings related to the "Copy" function.

[0031] On the operation screen SC1 shown in FIG. 3(A) and the operation screen SC2 shown in FIG. 3(B) (in the upper left in FIGS. 3(A) and 3(B)), a symbol G1 with a design of a microphone is displayed. The display of the symbol G1 indicates that voice input to the microphone 22 is possible. That is, the control unit 100 turns on the microphone 22 and displays the symbol G1 on the operation screen SC2 when the microphone 22 is in a state where voice input is possible.

[0032] On the other hand, when the control unit 100 turns off the microphone 22 and makes the microphone 22 in a state where voice input is impossible, as shown in FIGS. 4(A) and 4(B) for example, on the operation screen SC1 and the operation screen SC2 (in the upper left in FIGS. 3(A) and 3(B)), a symbol G2 in which an image of "×" is superimposed on the symbol G1 with a design of a microphone is displayed.

[0033] The voice analysis unit 102 converts the electrical signal (voice data) converted by the microphone 22 into text data using an existing voice recognition technology, and analyzes the text data using an existing natural language processing technology to recognize a voice instruction by the user.

[0034] The reception unit 103 receives, as an instruction from the user, an instruction input by a manual input operation via the operation unit 47 (including a touch panel) for the currently displayed screen on the display unit 473, and a voice instruction (analysis result by the voice analysis unit 102) recognized by the voice analysis unit 102 via the microphone 22. The control unit 100 executes a job according to the content of the instruction received by the reception unit 103.

[0035] The display control unit 101 displays on the display unit 473 a setting screen that shows the content indicated by the instruction input by manual operation or the voice instruction. For example, when the operation screen SC2 as the setting screen shown in FIG. 3(B) is displayed on the display unit 473, the user inputs an instruction to set "paper selection" to "A4", "color selection" to "black and white", and "page collation" to "2in1" via the operation unit 47, and the reception unit 103 receives these instructions. At this time, the display control unit 101 displays on the display unit 473 an operation screen SC2 (setting screen) that switches the setting of "paper selection" from "automatic" to "A4", the setting of "color selection" from "full color" to "black and white", and "page collation" from "off" to "2in1" and is displayed as shown in FIG. 5.

[0036] When the operation screen SC1 shown in FIG. 3(A) is displayed on the display unit 473 and the user utters the keyword "black and white copy" and the reception unit 103 receives these voice instructions via the speaker 23 and the voice analysis unit 102, the display control unit 101 displays the operation screen SC2 as shown in FIG. 6 on the display unit 473.

[0037] When the control unit 100 turns on the microphone 22 to enable voice input, it either waits without executing a predetermined job for a predetermined period (e.g., 2 minutes) and then executes the job, or prohibits the execution of the job. Hereinafter, when it is stated that the job is "not executed" or "prohibited", it shall mean that the job is either waited without execution for a predetermined period and then executed, or prohibited from execution. Note that when it is expressed as waiting without executing the job, it has the same meaning. Also, the above-mentioned "predetermined job" is (i) a job specified subjectively by the manufacturer or developer of the image forming apparatus 1, etc., assuming that the generated sound generated by the image forming apparatus 1 is loud (i.e., a job predetermined assuming that the generated sound generated by the image forming apparatus 1 is loud), or (ii) a job that operates with an operating sound of a predetermined volume (e.g., 80 dB) or more. The above-mentioned "predetermined job" is stored as part of the above control program, or is prestored in a non-volatile memory built into the control unit 10 or the like.

[0038] For example, when the control unit 100 turns on the microphone 22 to enable voice input, it prohibits the execution of jobs including staple processing and punch processing in the post-processing device 31. As a specific example, even when it is time to start executing a print job including staple processing, if the microphone 22 is in a state where voice input is possible, the print job is not started. The control unit 100 executes the predetermined job when the microphone 22 is turned off and voice input is impossible.

[0039] However, even when the control unit 100 enables the microphone 22 for voice input, it causes a job with a predetermined high importance level to be executed. For example, when the requester for job execution is a predetermined specific person (such as a management position or higher), the control unit 100 determines that the importance level of that job is high. For example, when the image forming apparatus 1 is shared and login information such as personal ID information is input by an operation on the operation unit 47 by a user, and the control unit 100 approves the login when the personal ID information indicated by the input login information matches the personal ID information of a regular user stored in advance, and further, when the personal ID information of this approved user matches the personal ID information of a predetermined specific person stored, when an execution instruction for a job is input by an operation on the operation unit 47 by this user, the control unit 100 causes the job to be executed as a job with a predetermined high importance level even when the microphone 22 is enabled for voice input.

[0040] Next, an example of the processing performed by the control unit 10 of the image forming apparatus 1 will be described based on the flowchart shown in FIG. 7. Note that this processing is performed when the execution start timing of a job is reached.

[0041] The control unit 100 determines whether the microphone 22 is in a state where voice input is possible, that is, whether the microphone 22 is turned on (S1). Here, if the control unit 100 determines that the microphone 22 is not in a state where voice input is possible (NO in S1), it causes the job to be executed (S3).

[0042] On the other hand, if the control unit 100 determines that the microphone 22 is in a state where voice input is possible (YES in S1), it further determines whether the job is the above-mentioned predetermined job (S2). Here, if the control unit 100 determines that the job is not a predetermined job (NO in S2), it causes the job to be executed (S3). After this, the processing ends.

[0043] On the other hand, when the control unit 100 determines that the job is the predetermined job (YES in S2), it determines whether the job is a job with a predetermined high importance (S4).

[0044] When the control unit 100 determines that the job is a job with a predetermined high importance (YES in S4), it causes the job to be executed (S3). After that, the process ends.

[0045] Also, when the control unit 100 determines that the job is not a job with a predetermined high importance (NO in S4), it does not cause the job to be executed and waits for a predetermined period (for example, two minutes) (S5). After the elapse of the predetermined period, the control unit 100 causes the job to be executed. After that, the process ends. Note that when the control unit 100 determines that the job is not a job with a predetermined high importance (NO in S4), it may cancel the job without causing it to be executed (S5).

[0046] As described above, according to the above embodiment, when the control unit 100 has the microphone 22 in a state where voice input is possible, it does not execute the predetermined job, so that it is possible to avoid a situation where a voice instruction is not accurately input due to noise or the like. That is, when voice input to the microphone 22 is possible, it becomes possible to prohibit the execution of staple processing and punch processing with relatively large driving sounds, so that the possibility of noise or the like entering the microphone 22 during voice input can be reduced, and the voice instruction can be accurately received.

[0047] A further embodiment will be described. For example, when the image forming apparatus 1 selectively operates in a normal mode in which each operating mechanism such as the image forming unit 12 operates normally under the control of the control unit 100 and a silent mode in which each operating mechanism such as the image forming unit 12 operates while suppressing the driving sound of the image forming apparatus 1, when the control unit 100 has the microphone 22 in a state where voice input is possible, instead of the control of not executing the predetermined job, the control may be performed to set the image forming apparatus 1 to the silent mode and then immediately cause the image forming apparatus 1 to execute the predetermined job.

[0048] Thereby, it is possible to reduce the possibility of noise entering the microphone 22 while minimizing the reduction in the performance of job execution by the image forming apparatus 1. When the control unit 100 has the microphone 22 in a state where voice input is possible and the silent mode is set, as shown in the example of FIG. 8, the display control unit 101 preferably causes the display unit 473 to display a message notifying the user that the silent mode is set. As shown in the example of FIG. 8, a message M1 saying "During silent mode operation" is displayed on the operation screen SC2 (in the upper right of the operation screen SC2 in FIG. 8).

[0049] A further embodiment will be described. When the post-processing device 31 can be switched between an auto staple mode in which staple processing is automatically performed under the control of the control unit 100 or the like and a manual staple mode in which staple processing is manually performed based on an operation by the user and which has a relatively large operating sound, the control unit 100 controls the operation of the post-processing device 31 by selectively switching between the auto staple mode and the manual staple mode. In this case, when the control unit 100 has the microphone 22 in a state where voice input is possible, the post-processing device 31 is not operated in the manual staple mode. That is, the control unit 100 prohibits operating the post-processing device 31 in the manual staple mode as the predetermined job.

[0050] In this case, when the user inputs an instruction to switch to the manual stapling mode to the operation unit 47 while the microphone 22 is in a state where voice input is possible, the display control unit 101 displays a message on the display unit 473 indicating that switching to the manual stapling mode is prohibited and that in order to release the prohibition, the microphone 22 must be put into a state where voice input is not possible. In this case, the display control unit 101 functions as the "control unit" in the claims. For example, the display control unit 101 displays a pop-up screen PU on the display unit 473, which shows a message M2 as shown in FIG. 9.

[0051] In addition, when the microphone 22 is in a state capable of accepting voice input in this manner, when a user inputs an instruction to switch to the manual staple mode into the operation unit 47, the control unit 100 may cause the above message to be output from the speaker 23.

[0052] It should be noted that the control unit 100, in accordance with an instruction to turn off the microphone 22 input by the user via the operation unit 47, sets the microphone 22 to a state in which voice input is not possible.

[0053] Furthermore, when a predetermined voice input start condition (for example, the human presence sensor 21 detects the approach of a person) is met, the control unit 100 turns on the microphone 22 to enable voice input, but when the post-processing device 41 is operating in the manual staple mode, the control unit 100 controls the microphone 22 not to enable voice input even if the above-mentioned voice input start condition is met. In other words, when the post-processing device 41 is operating in the manual staple mode, the control unit 100 does not turn on the microphone 22 but keeps it in the off state even if a person approaches the image forming apparatus 1.

[0054] Note that the case where the voice data collected and converted by the microphone 22 is analyzed by the voice analysis unit 102 in the image forming apparatus 1 has been described so far. As a further embodiment, a speaker with an AI (artificial intelligence) assistant function incorporating a microphone, called a smart speaker, may be adopted to collect the user's voice with the speaker, and the image forming apparatus 1 may use the speaker as a voice input unit so that the reception unit 103 receives the voice analysis result from the speaker.

[0055] The present invention is not limited to the configuration of the above embodiment, and various modifications are possible. Further, in the above embodiment, the configuration and processing shown by the above embodiment using FIGS. 1 to 9 are merely one embodiment of the present invention, and the present invention is not intended to be limited to the configuration and processing.

Claims

1. An image forming apparatus including an image forming unit that forms an image on a recording medium, a voice input unit that receives voice input from a user, a reception unit that receives a voice instruction based on the voice input to the voice input unit, and a control unit that executes a job according to the content of the voice instruction received by the reception unit, wherein when the control unit sets the voice input unit to a state where voice is input, it does not execute a predetermined job for at least a predetermined period, and when the voice input unit is not in a state where voice is input, it performs control to execute the predetermined job. An image forming apparatus.

2. The image forming apparatus according to claim 1, wherein the control unit immediately executes a job with a predetermined high importance even when the voice input unit is in a state where voice is input.

3. When the control unit sets the voice input unit to a state where voice is input, instead of performing control not to execute the predetermined job for at least a predetermined period, it sets the image forming apparatus to a silent mode that suppresses the generated sound and then immediately executes the predetermined job. The image forming apparatus according to claim 1, which performs control.

4. a display unit, and a display control unit that controls the display operation of the display unit, wherein when the voice input unit is in a state where voice is input and the silent mode is set, the display control unit causes the display unit to display a message notifying the user that the silent mode is set. The image forming apparatus according to claim 3.

5. further including a post-processing device that performs staple processing on the recording paper on which the image is printed, wherein the control unit switches the post-processing device between an auto staple mode that automatically performs staple processing and a manual staple mode that manually performs staple processing, and controls the operation, When the control unit has the voice input unit in a state where voice is input, it does not execute the operation of the post-processing device in the manual staple mode as the predetermined job for at least a predetermined period, the image forming apparatus according to claim 1.

6. When the control unit operates the post-processing device in the manual staple mode, it does not put the voice input unit in a state where voice is input, the image forming apparatus according to claim 5.

7. A notification unit, An operation unit for inputting an instruction by an operation by a user, and When an instruction to operate the post-processing device in the manual staple mode is input while the control unit has the voice input unit in a state where voice is input, in order to operate the post-processing device in the manual staple mode, the control unit causes the notification unit to notify a message indicating that it is necessary to put the voice input unit in a state where voice is not input, the image forming apparatus according to claim 5 or claim 6.

Images