Image forming apparatus

Abstract

To ensure security and input accuracy in inputting a voice instruction by uttering voice.SOLUTION: An image forming apparatus (1) comprises: a receiving unit (103) that receives a manual input instruction through an operating unit (47) and a voice instruction through a microphone (22); and a control unit (100) that executes a job on the basis of settings received by the receiving unit (103). The control unit (100) switches between a manual input dedicated mode in which only the manual input instruction is received by the receiving unit and a voice input possible mode in which the voice input and the manual input instruction are received by the receiving unit. When an operating screen (SC3) for receiving input of information, the input of which by the voice instruction is prohibited in advance, is displayed on a display (101) by a display control unit (SC2), the control unit switches to the manual input dedicated mode.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an image forming apparatus capable of voice instructions.

Background Art

[0002] Some image forming apparatuses such as copiers and multifunction peripherals have an operation panel for users to perform manual input operations. By operating through the operation panel, a user can select one function from a plurality of functions (for example, a copying function, a scanner function, a facsimile function), or can perform settings for the functions.

[0003] In addition, various image forming apparatuses that enable voice instructions have been proposed and put into practical use. For example, Patent Document 1 below describes reflecting the content of voice instructions in job settings, and Patent Document 2 below describes narrowing down job history information intended by a user from a plurality of job history information based on keywords included in the user voice.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

[0005] However, when voice input is performed, the content uttered by the user is likely to be transmitted to the surroundings. If the operation content is merely function selection or setting, there is no problem even if it is transmitted to the surroundings, but it is not preferable in terms of security that personal information such as a user ID and a password is transmitted to the surroundings. In addition, in voice input, the accuracy of the input may not be maintained, and there may be cases where accurate instructions cannot be input. However, Patent Documents 1 and 2 above do not disclose any means for solving the problem at the time of voice input.

[0006] This invention has been made in view of the above circumstances, and aims to ensure security and input accuracy when inputting voice commands by uttering them.

[0007] An image forming apparatus according to one aspect of the present invention is an image forming apparatus comprising an image forming unit for forming an image on a recording medium, comprising: a display unit; a display control unit for displaying an operation screen on the display unit; an operation unit for receiving manual input instructions by a user; a voice input unit for receiving voice input from a user; a reception unit for receiving voice instructions based on the voice input to the voice input unit and the manual input instructions; and a control unit for controlling the operation of the image forming apparatus and executing a job based on the manual input instructions and voice instructions received by the reception unit, wherein the control unit switches between a manual input-only mode in which only the manual input instructions are received by the reception unit and a voice input-enabled mode in which both the voice instructions and the manual input instructions are received by the reception unit, and the voice input When the operation screen for accepting input of information for which input by voice is prohibited in advance is displayed on the display unit by the display control unit, the system switches to the manual input only mode. When the display control unit displays both input items that accept voice instructions and input items that accept only manual instructions on the operation screen, it adds an image or message indicating that voice input is not accepted to the input items that accept only manual instructions. The control unit then switches to the voice input enabled mode. The reception unit does not accept voice instructions indicating information for which input by voice is prohibited in advance, but accepts voice instructions indicating information other than that for which input by voice is prohibited in advance.

[0008] According to the present invention, it becomes possible to ensure security and input accuracy when inputting voice commands by uttering them. [Brief explanation of the drawing]

[0009] [Figure 1] This is a perspective view showing the external appearance of an image forming apparatus according to one embodiment of the present invention. [Figure 2] This is a functional block diagram that schematically shows the main internal components of an image forming apparatus. [Figure 3] (A) and (B) are diagrams showing examples of operation screens displayed on the display unit. [Figure 4] (A) and (B) are diagrams showing examples of operation screens displayed on the display unit. [Figure 5] This figure shows an example of the operation screen displayed on the display unit. [Figure 6] This figure shows an example of the operation screen displayed on the display unit. [Figure 7] This figure shows an example of the operation screen displayed on the display unit. [Figure 8] This flowchart shows an example of processing performed by the control unit of an image forming apparatus. [Figure 9] This figure shows an example of the operation screen displayed on the display unit. [Modes for carrying out the invention]

[0010] Hereinafter, an image forming apparatus according to one embodiment of the present invention will be described with reference to the drawings. Figure 1 is a perspective view showing the external appearance of an image forming apparatus according to one embodiment of the present invention. Figure 2 is a functional block diagram schematically showing the main internal configuration of the image forming apparatus. The image forming apparatus 1 according to the first embodiment is a multifunction device that combines multiple functions such as a copy function, a printer function, a scanner function, and a facsimile function, and is composed of a document feeding unit 6, a document reading unit 5, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, a storage unit 8, a human presence sensor 21, an operation unit 47, a facsimile communication unit 71, a network interface unit 91, a microphone 22, and a speaker 23.

[0011] The document feeding unit 6 is configured to open and close on the upper surface of the document reading unit 5 by a hinge (not shown), and functions as a document holder cover when reading documents placed on a platen glass (not shown). The document feeding unit 6 is also known as an ADF (Auto Document Feeder) or DP (Document Processor), and is equipped with a document tray 61 that supplies documents placed on the document tray 61 to the document reading unit 5 one at a time.

[0012] The process of reading a document in the image forming apparatus 1 will now be explained. The document reading unit 5 optically reads the image of the document supplied to the document reading unit 5 by the document feeding unit 6, or the document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory (not shown) or the like.

[0013] The image forming operation performed by the image forming apparatus 1 will now be described. Based on the image data generated by the document reading operation and the image data received from a network-connected external device (for example, a personal computer), the image forming unit 12 forms a toner image on the recording paper, which is fed from the paper feeding unit 14.

[0014] The fixing unit 13 heats and pressurizes the recording paper on which the toner image has been formed by the image forming unit 12 to fix the toner image to the recording paper, and the fixing process is discharged into the output tray 151. The paper feeding unit 14 is equipped with multiple paper feed cassettes 141.

[0015] The storage unit 8 is a high-capacity storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive), and stores various control programs and the like.

[0016] The motion sensor 21 detects a person approaching the image forming apparatus 1. For example, the motion sensor 21 may be a sensor that detects infrared radiation emitted by the human body.

[0017] The operation unit 47 receives instructions such as an instruction to execute an image forming operation from an operator regarding various operations and processes that the image forming apparatus 1 can execute. The operation unit 47 includes a display unit 473 that displays operation guidance and the like to the operator. Further, the operation unit 47 receives an input of an instruction from a user based on an operation (touch operation) by the user on an operation screen displayed on the display unit 473 or an operation by the user on a physical key via a touch panel included in the display unit 473.

[0018] The display unit 473 is composed of an LCD (Liquid Crystal Display) or the like. The display unit 473 includes a touch panel. When the operator performs an operation of touching a button or a key displayed on the screen, an instruction associated with the touched position is received by the touch panel.

[0019] The facsimile communication unit 71 includes an encoding / multiplexing, modulation / demodulation unit and an NCU (Network Control Unit), not shown in the figure, and performs facsimile transmission and reception using a public telephone line network or the like.

[0020] The network interface unit 91 is a communication interface that performs transmission and reception of various data with an external device (for example, a personal computer) within a local area or on the Internet.

[0021] The microphone 22 collects sounds around the image forming apparatus 1 and converts them into electrical signals (voice data). The microphone 22 is provided at an appropriate location, for example, on the operation unit 47, where it is easy to collect the voice of the user speaking.

[0022] The speaker 23 outputs various sounds such as an operation sound and an effect sound when operating the operation unit 47, a guidance voice explaining the operation method, and a warning sound when a trouble occurs in the image forming apparatus 1. For example, the speaker 23 is provided at a location where it cannot be seen from the outside of the image forming apparatus 1, for example, inside the operation unit 47.

[0023] The control unit 10 comprises a processor, RAM (Random Access Memory), ROM (Read Only Memory), and dedicated hardware circuits. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 10 includes a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103.

[0024] The control unit 10 functions as a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103 through operation by the processor in accordance with the control program stored in the memory unit 8. However, these control units 100, etc., can also be configured by hardware circuits, rather than by operation in accordance with the control program by the control unit 10. The same applies to each embodiment below unless otherwise specified.

[0025] The control unit 100 is responsible for the overall operation control of the image forming apparatus 1. The control unit 100 is connected to the document feeding unit 6, document reading unit 5, image forming unit 12, fixing unit 13, paper feeding unit 14, storage unit 8, human presence sensor 21, operation unit 47, facsimile communication unit 71, network interface unit 91, microphone 22, and speaker 23, and performs drive control of each of these units. For example, the control unit 100 controls the operation of the image forming unit 12, etc., to form the document image obtained by reading by the document reading unit 5 onto the recording paper used as a recording medium.

[0026] Furthermore, when the motion sensor 21 detects an approaching person, the control unit 100 controls the microphone 22 to turn it on, enabling voice input to the microphone 22. After a predetermined time (for example, 30 seconds) has elapsed since the motion sensor 21 stopped detecting an approaching person, the control unit 100 controls the microphone 22 to turn it off. Note that the control unit 100 can also switch the microphone 22 on and off according to instructions input to the operation unit 47.

[0027] The display control unit 101 controls the display on the display unit 473. For example, the display control unit 101 displays a selection screen on the display unit 473 for the user to select a function to be executed from among several functions that can be executed in the image forming apparatus 1, and also displays a setting screen on the display unit 473, which is at a lower level than the selection screen, for receiving input related to the settings of each function.

[0028] Figures 3(A) and 3(B) show examples of screens displayed on the display unit 473. The operation screen SC1 shown in Figure 3(A) is a selection screen that allows the user to select a function to be executed from among several functions that can be executed in the image forming apparatus 1. The operation screen SC1 displays buttons such as "Copy," "Send (Scanner function)," and "Fax (Facsimile function)." Note that the operation screen SC1, which functions as a selection screen, is also the "Home" screen. When the user presses the "Copy" button, the operation unit 47 receives a copy function selection instruction, and the control unit 100 displays the operation screen SC2 shown in Figure 3(B) on the display unit 473 according to this instruction.

[0029] The operation screen SC2 is displayed on the display unit 473 as a lower level than the "Home" screen. The operation screen SC2 is a settings screen for receiving input related to the "Copy" function settings. In the center of the "Copy" function settings screen, six buttons are displayed labeled "Paper Selection," "Color Selection," "Page Collation," "Reduce / Enlarge," "Duplex / Split," and "Staple / Punch." These buttons are images for receiving settings related to the "Copy" function.

[0030] The operation screen SC1 shown in Figure 3(A) and the operation screen SC2 shown in Figure 3(B) (top left in Figures 3(A) and (B)) display the symbol G1, which is a microphone. The display of symbol G1 indicates that audio input to the microphone 22 is possible. In other words, the control unit 100 displays the symbol G1 on the operation screen SC2 when the microphone 22 is turned on and in a state where audio input is possible.

[0031] On the other hand, when the control unit 100 turns off the microphone 22 and makes it impossible to input audio from the microphone 22, the operation screen SC1 and operation screen SC2 (upper left in Figures 3(A) and 3(B)) display a symbol G2 which is a symbol G1 which is a microphone, with an "×" image superimposed on it.

[0032] The voice analysis unit 102 converts the electrical signals (voice data) converted by the microphone 22 into text data using existing voice recognition technology, and then analyzes the text data using existing natural language processing technology to recognize voice instructions from the user.

[0033] The reception unit 103 receives instructions from the user via manual input through the operation unit 47 (including the touch panel) on the screen currently displayed on the display unit 473, and voice instructions (analysis results by the voice analysis unit 102) recognized by the voice analysis unit 102 via the microphone 22. The control unit 100 executes a job according to the content of the instructions received by the reception unit 103.

[0034] The display control unit 101 displays a settings screen on the display unit 473 that shows the content indicated by the instructions entered by manual input or the voice instructions. For example, when the operation screen SC2, which is a settings screen as shown in Figure 3(B), is displayed on the display unit 473, the user inputs instructions via the operation unit 47 to set "Paper Selection" to "A4", "Color Selection" to "Black and White", and "Page Consolidation" to "2in1", and the reception unit 103 receives these instructions. At this time, the display control unit 101 displays an operation screen SC2 (settings screen) on the display unit 473, as shown in Figure 5, which switches the "Paper Selection" setting from "Automatic" to "A4", the "Color Selection" setting from "Full Color" to "Black and White", and "Page Consolidation" from "Off" to "2in1".

[0035] When the operation screen SC1 shown in Figure 3(A) is displayed on the display unit 473, and the user speaks the keyword "black and white copy," and the reception unit 103 receives these voice commands via the speaker 23 and the voice analysis unit 102, the display control unit 101 displays the operation screen SC2 shown in Figure 6 on the display unit 473.

[0036] The control unit 100 switches between a manual input-only mode in which only manual input instructions entered by the operation unit 47 are accepted by the reception unit 103, and a voice input-enabled mode in which both voice instructions and manual input instructions are accepted by the reception unit 103. Here, the method by which the control unit 100 prevents the reception unit 103 from accepting voice instructions in the manual input-only mode may be either (i) turning off the microphone 22 so that only manual input instructions are accepted by the reception unit 103, or (ii) preventing the reception unit 103 from accepting voice instructions that are input to the microphone 22 while it is on and analyzed by the voice analysis unit 102. When an operation screen for accepting input of information for which input by voice instruction is prohibited in advance is displayed on the display unit 473 by the display control unit 101, the control unit 100 switches to the manual input-only mode. The information that is prohibited from being entered via voice commands as described above is, for example, forbidden words that should not be leaked (e.g., user ID or password), and / or instructions that cannot be accurately entered via voice input because accuracy cannot be maintained (e.g., email address to send emails to, IP address to send data to, etc.). This information that is prohibited from being entered via voice commands as described above will be referred to as voice input prohibited information below.

[0037] When the display control unit 101 is switched to voice input enabled mode, it displays an image or message on the operation screen displayed on the display unit 473 indicating that voice commands can be accepted. On the other hand, when the display control unit 101 is switched to manual input only mode, it displays an image or message on the operation screen displayed on the display unit 473 indicating that voice commands cannot be accepted.

[0038] As shown in Figure 7, when the authentication screen SC3, which prompts for the input of a user ID and password, is displayed on the display unit 473, the control unit 100 switches the operating mode of the image forming apparatus 1 to manual input only mode, and the reception unit 103 is set to accept only manual input operations and not voice commands for the user ID and password. In addition, the display control unit 101 displays the symbol G2, which is a microphone symbol with an "X" superimposed on it, on the authentication screen SC3 to indicate that these operations do not accept voice commands. The authentication screen SC3 is displayed in situations other than login, such as when performing system settings. Also, when performing private printing, the user is prompted to enter a password, and in this case, the same authentication screen SC3 is displayed.

[0039] Next, an example of the processing performed by the control unit 10 of the image forming apparatus 1 will be explained based on the flowchart shown in Figure 8. This processing is performed when a change occurs in the operation screen displayed on the display unit 473. As an initial setting, the control unit 100 switches the operating mode of the image forming apparatus 1 to the voice input enabled mode.

[0040] When the operation screen of the display unit 473 is switched by the display control unit 101, the control unit 100 determines whether the switched operation screen is an operation screen for accepting the input of the above-mentioned voice input prohibition information (S1).

[0041] Here, when the control unit 100 determines that the operation screen after the switch is an operation screen for accepting the input of the above voice input prohibition information (S1 "Yes"), it switches the operation mode of the image forming apparatus 1 to manual input only mode (S2), and the reception unit 103 is set to not accept voice instructions for the user ID and password, and to accept only manual input operations.

[0042] At this time, the display control unit 101 displays an image or message on the operation screen indicating that voice commands cannot be accepted, as shown in the example in Figure 7 (S3).

[0043] On the other hand, if the control unit 100 determines that the operation screen after the switch is not an operation screen for accepting the input of the above-mentioned voice input prohibition information (S1 "No"), it keeps the operating mode of the image forming apparatus 1 in the voice input enabled mode (S4). After this, the process ends.

[0044] Thus, according to the above embodiment, when an operation screen for accepting input of voice-input prohibited information, such as private information (confidential information) like a user ID or password, is displayed on the display unit 473, the reception unit 103 does not accept voice instructions and only accepts manual input instructions. As a result, the user does not utter personal information such as a user ID or password, thus preventing the leakage of confidential information and ensuring security. Furthermore, when an operation screen for accepting recipient information for data transmission, such as an email address to send an email to or an IP address to send data to, as voice-input prohibited information is displayed on the display unit 473, the reception unit 103 does not accept voice instructions and only accepts manual input instructions. As a result, the user manually operates the operation unit 47 to input the recipient information, ensuring accuracy in the input of the recipient information (instruction content) and enabling accurate information (instructions).

[0045] Further embodiments will be described. The display control unit 101 may display both input items that accept voice commands and input items that accept only manual commands on the operation screen of the display unit 473 (for example, the operation screen SC1 shown in Figure 3(A)). When the display control unit 101 displays such an operation screen on the display unit 473, it displays an image or message indicating that voice input is not accepted for input items that accept only manual commands.

[0046] For example, as shown in Figure 9 as an example of the operation screen SC4, the display control unit 101 displays the symbol G1, which is a microphone, for the buttons "Copy," "Send," "Fax," and "User Box" that accept voice commands on the operation screen SC4, while displaying the symbol G2, which is a microphone with an "X" superimposed on it, as an image to indicate that voice input is not accepted for the buttons "System Settings" and "Internet" that do not accept voice commands.

[0047] When the SC4 operation screen is displayed, the control unit 100 switches the operating mode of the image forming apparatus 1 to the voice input enabled mode. Based on the content of the voice information input from the voice analysis unit 102, the reception unit 103 processes voice instructions that indicate voice input prohibition information but does not accept voice instructions that indicate voice input prohibition information.

[0048] Next, a further embodiment will be described. The control unit 100 stores the total number of voice commands and manual input commands received by the reception unit 103. When the operation screen to be used as the initial screen is displayed on the display unit 473 by the display control unit 101, the control unit 100 switches the operating mode of the image forming apparatus 1 to the mode with the higher total number of received commands, either the manual input-only mode or the voice input-enabled mode. However, even in this case, the reception unit 103 does not accept voice commands for input of information that prohibits voice input, and only accepts manual input commands. This makes it possible to improve convenience for the user by switching to the mode that the user frequently uses when the initial screen is displayed, while ensuring the security and accuracy of the information to be input.

[0049] Up to this point, we have described the case in which the audio data collected and converted by the microphone 22 is analyzed by the audio analysis unit 102 in the image forming apparatus 1. However, as a further embodiment, a speaker with a built-in microphone and AI (artificial intelligence) assistant function, known as a smart speaker, may be used. The user's voice is collected by this speaker, and the image forming apparatus 1 uses this speaker as an audio input unit, with the receiving unit 103 receiving the audio analysis results from the speaker.

[0050] The present invention is not limited to the configuration of the above embodiments and various modifications are possible. Furthermore, the configuration and processing shown in the above embodiments using Figures 1 to 9 are merely one embodiment of the present invention and are not intended to limit the present invention to such configuration and processing.

Claims

1. An image forming apparatus comprising an image forming unit that forms an image on a recording medium, Display unit and A display control unit that displays an operation screen on the display unit, An operating unit into which user manual input instructions are entered, A voice input unit where the user's voice is input, A receiving unit that receives voice instructions based on voice input to the voice input unit and manual input instructions, The system includes a control unit that controls the operation of the image forming apparatus and executes a job based on the manual input instructions and voice instructions received by the reception unit, The control unit, The system switches between a manual input-only mode in which only the manual input instructions are received by the reception unit, and a voice input-enabled mode in which both the voice instructions and the manual input instructions are received by the reception unit. When the operation screen for accepting input of information for which input by voice command is prohibited is displayed on the display unit by the display control unit, switch to the manual input only mode. Image forming apparatus, in which, when the control unit is switched to the voice input enabled mode, the display control unit, when displaying both a first input item that accepts voice instructions and a second input item that accepts only manual instructions on the operation screen, displays an unacceptable image or message indicating that voice input is not accepted on the second input item.

2. The image forming apparatus according to claim 1, wherein the display control unit causes the display unit to display both a first button indicating the first input item and a second button indicating the second input item on the operation screen, and displays the unacceptable image or the unacceptable message superimposed on the second button.

3. The image forming apparatus according to claim 2, wherein the display control unit causes the display unit to display a receivable image or receivable message indicating that the voice input can be received, superimposed on the first button.

4. When the control unit is switched to the voice input enabled mode, The image forming apparatus according to claim 3, wherein the display control unit further displays the receivable image or the receivable message in the area of ​​the operation screen where the first button and the second button are not displayed on the display unit.

5. The image forming apparatus according to claim 2, wherein the display control unit causes the display unit to display an image in which a "×" symbol is superimposed on a design representing a microphone as the unacceptable image.

6. The image forming apparatus according to claim 3, wherein the display control unit causes the display unit to display an image including a design representing a microphone as the receivable image.

7. When the control unit is switched to the manual input-only mode, The image forming apparatus according to claim 1, wherein the display control unit causes the display unit to display the unacceptable image or unacceptable message on the operation screen.

8. The image forming apparatus according to claim 1, wherein the information whose input via voice command is prohibited in advance is private information necessary for authentication or information of the recipient of data transmission.

Images