Image forming device

Abstract

This image formation device (1) comprises: a reception unit (103) which receives a manual input instruction through an operation unit (47) and a speech instruction through a microphone (22); and a control unit (100) which executes a job on the basis of a setting received by the reception unit (103). The control unit (100) switches a dedicated manual input mode in which only the manual input instruction is received by the reception unit and a speech inputtable mode in which the speech instruction and the manual input instruction are received by the reception unit, and switches into the dedicated manual input mode when an operation screen (SC3) for receiving an input of information for which an input through a speech instruction has been forbidden is displayed on a display unit (101) by a display control unit (SC2).

Description

[Technical field]

[0001] The present invention relates to an image forming apparatus capable of receiving voice instructions. [Background technology]

[0002] Some image forming devices, such as copiers and multifunction devices, are equipped with an operation panel that allows a user to manually input operations. By operating the operation panel, a user can select one function from among a number of functions (e.g., copy function, scanner function, facsimile function) or configure settings for a function.

[0003] Also, various image forming apparatuses that allow voice instructions have been proposed and put to practical use. For example, the following Patent Document 1 describes a method of reflecting the contents of voice instructions in job settings, and the following Patent Document 2 describes a method of setting multiple jobs based on keywords included in the user's voice. o It is described that the user can narrow down the job history information to the job history information that he / she desires. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-098383 A [Patent Document 2] JP 2019-205052 A Summary of the Invention

[0005] However, when inputting by voice, what the user is uttering is easily transmitted to those around. If the operation content is simply function selection or setting, there is no problem if it is transmitted to those around, but it is undesirable from a security standpoint if personal information such as a user ID or password is transmitted to those around. Furthermore, the accuracy of input cannot be maintained with voice input, and there are cases where the instructions cannot be input accurately. However, the above-mentioned Patent Documents 1 and 2 do not disclose any means for solving this problem when inputting by voice.

[0006] The present invention has been made in consideration of the above circumstances, and has an object to ensure security and input accuracy when uttering and inputting voice for voice instructions.

[0007] According to one aspect of the present invention, there is provided an image forming apparatus including an image forming unit that forms an image on a recording medium, the image forming apparatus including a display unit, a display control unit that causes an operation screen to be displayed on the display unit, an operation unit into which manual input instructions are input by manual operation by a user, a voice input unit into which voice is input from the user, a reception unit that receives voice instructions based on the voice input to the voice input unit and the manual input instructions, and a control unit that controls an operation of the image forming apparatus based on the manual input instructions and the voice instructions received by the reception unit to execute a job, the control unit switching between a manual input only mode in which only the manual input instructions are received by the reception unit and a voice input enabled mode in which the voice instructions and the manual input instructions are received by the reception unit, and switching to the manual input only mode when the operation screen for receiving input of information that is prohibited in advance from being input by voice instructions is displayed on the display unit by the display control unit. When the display control unit causes both the input items that accept the voice instruction and the input items that accept only the manual input instruction to be displayed on the operation screen, the display control unit causes the input items that accept only the manual input instruction to be displayed with an image or a message indicating that voice input is not accepted, and the control unit switches to the voice input enabled mode, and the accepting unit does not accept the voice instruction indicating information that is prohibited in advance from being input by the voice instruction, and accepts the voice instruction indicating information other than the information that is prohibited in advance from being input by the voice instruction. This is what we have in mind.

[0008] According to the present invention, it is possible to ensure security and input accuracy when uttering and inputting voice for voice instructions. [Brief description of the drawings]

[0009] [Figure 1] 1 is a perspective view showing an external appearance of an image forming apparatus according to an embodiment of the present invention; [Diagram 2] 1 is a functional block diagram illustrating a schematic internal configuration of an image forming apparatus. [Diagram 3] 5A and 5B are diagrams showing an example of an operation screen displayed on a display unit. [Figure 4] 5A and 5B are diagrams showing an example of an operation screen displayed on a display unit. [Diagram 5]FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. [Figure 6] FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. [Figure 7] FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. [Figure 8] 5 is a flowchart illustrating an example of a process performed by a control unit of the image forming apparatus. [Figure 9] FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] An image forming apparatus according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a perspective view showing the appearance of an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a functional block diagram showing a schematic main internal configuration of the image forming apparatus. The image forming apparatus 1 according to the first embodiment is a multifunction machine having multiple functions such as a copy function, a printer function, a scanner function, and a facsimile function, and includes an original feeding unit 6, an original reading unit 5, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, a memory unit 8, a human sensor 21, an operation unit 47, a facsimile communication unit 71, a network interface unit 91, a microphone 22, and a speaker 23.

[0011] The document feeder 6 is configured to be openable and closable by a hinge or the like (not shown) on the top surface of the document reading unit 5, and functions as a document pressing cover when reading a document placed on a platen glass (not shown). The document feeder 6 is also called an ADF (Auto Document Feeder) or DP (Document Processor), and includes a document placement tray 61, and supplies documents placed on the document placement tray 61 to the document reading unit 5 one by one.

[0012] A description will be given of a case where a document reading operation is performed by the image forming apparatus 1. The document reading unit 5 optically reads an image of a document supplied to the document reading unit 5 by the document feeding unit 6 or a document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory or the like (not shown).

[0013] A description will be given of an image forming operation performed by the image forming apparatus 1. Based on image data generated by a document reading operation or image data received from a computer serving as an external device (e.g., a personal computer) connected via a network, the image forming unit 12 forms a toner image on a recording paper serving as a recording medium fed from a paper feed unit 14.

[0014] The fixing unit 13 applies heat and pressure to the recording paper on which the toner image has been formed by the image forming unit 12, thereby fixing the toner image to the recording paper, and the recording paper that has been subjected to the fixing process is discharged to a discharge tray 151. The paper supply unit 14 includes a plurality of paper supply cassettes 141.

[0015] The storage unit 8 is a large-capacity storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores various control programs and the like.

[0016] The human sensor 21 detects a person approaching the image forming apparatus 1. As the human sensor 21, for example, a sensor that detects infrared rays emitted by a human body is used.

[0017] The operation unit 47 receives instructions, such as an instruction to execute an image forming operation, from an operator regarding various operations and processes that can be executed by the image forming apparatus 1. The operation unit 47 includes a display unit 473 that displays operation guides and the like for the operator. The operation unit 47 also receives input of instructions from the user via a touch panel included in the display unit 473, based on the user's operation (touch operation) on an operation screen displayed on the display unit 473 or the user's operation on physical keys.

[0018] The display unit 473 is composed of an LCD (Liquid Crystal Display) or the like. The display unit 473 is equipped with a touch panel. When the operator touches a button or key displayed on the screen, the touch panel receives an instruction associated with the touched position.

[0019] The facsimile communication section 71 includes an encoding / decoding section, a modulation / demodulation section, and an NCU (Network Control Unit), all of which are not shown, and transmits and receives facsimile data using a public telephone line network or the like.

[0020] The network interface unit 91 is a unit for connecting a network within a local area or on the Internet. outside It is a communication interface that transmits and receives various data to and from external devices (e.g., personal computers).

[0021] The microphone 22 collects sounds around the image forming apparatus 1 and converts them into an electrical signal (audio data). The microphone 22 is provided at an appropriate location where it is easy to collect the voice of the user, for example, in the operation unit 47.

[0022] The speaker 23 outputs operation sounds and sound effects when operating the operation unit 47, and explains the operation method. G The speaker 23 outputs various sounds such as a guidance sound, a warning sound when a problem occurs in the image forming apparatus 1, etc. For example, the speaker 23 is provided in a location that cannot be seen from the outside of the image forming apparatus 1, for example, in the operation unit 47.

[0023] The control unit 10 includes a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and a dedicated hardware circuit. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). OThe audio processing device includes a processing unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103.

[0024] The control unit 10 functions as a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103 by the operation of the processor in accordance with a control program stored in the storage unit 8. However, the control unit 100 and the like can also be configured by hardware circuits, without relying on the operation of the control unit 10 in accordance with a control program. The same applies to each embodiment below unless otherwise stated.

[0025] The control unit 100 is responsible for controlling the overall operation of the image forming apparatus 1. The control unit 100 is connected to the document feed unit 6, the document reading unit 5, the image forming unit 12, the fixing unit 13, the paper feed unit 14, the storage unit 8, the motion sensor 21, the operation unit 47, the facsimile communication unit 71, the network interface unit 91, the microphone 22, and the speaker 23, and performs drive control of each of these units. For example, the control unit 100 controls the operation of the image forming unit 12, etc., to form the document image obtained by reading by the document reading unit 5 on recording paper as a recording medium.

[0026] Furthermore, when an approaching person is detected by the motion sensor 21, the control unit 100 controls the microphone 22 to be in an on state to enable voice input to the microphone 22, and when a predetermined time (e.g., 30 seconds) has elapsed since the motion sensor 21 stopped detecting an approaching person, the control unit 100 controls the microphone 22 to be in an off state. Note that the control unit 100 can also switch the microphone 22 on and off according to an instruction input to the operation unit 47.

[0027] Display control unit 101 controls the display on display unit 473. For example, display control unit 101 displays on display unit 473 a selection screen for allowing a user to select a function to be executed from among a plurality of functions executable by image forming apparatus 1, and also displays on display unit 473 a setting screen, which is at a lower level than the selection screen, for receiving input related to the setting of each function.

[0028] 3(A) and (B) are diagrams showing examples of screens displayed on the display unit 473. The operation screen SC1 shown in FIG. 3(A) is a selection screen for allowing the user to select a function to be executed from among a plurality of functions that can be executed by the image forming apparatus 1. The operation screen SC1 displays a "Copy" button, a "Send (scanner function)" button, a "Fax (facsimile function)" button, and the like. Note that the operation screen SC1 as the selection screen is also a "Home" screen. When the user presses the "Copy" button, the operation unit 47 receives an instruction to select the copy function, and the control unit 100 causes the display unit 473 to display the operation screen SC2 shown in FIG. 3(B) in accordance with this instruction.

[0029] The operation screen SC2 is displayed on the display unit 473 as a lower hierarchical layer than the "Home" screen. The operation screen SC2 is a setting screen for receiving input related to the settings of the "Copy" function. In the center of the setting screen for the "Copy" function, six buttons are displayed, labeled "Paper Selection," "Color Selection," "Page Combination," "Reduce / Enlarge," "Double-Sided / Split," and "Staple / Punch." These buttons are images for receiving settings related to the "Copy" function.

[0030] A symbol G1 with a microphone design is displayed on the operation screen SC1 shown in Fig. 3(A) and the operation screen SC2 shown in Fig. 3(B) (upper left in Figs. 3(A) and (B)). The display of the symbol G1 indicates that voice input to the microphone 22 is possible. That is, the control unit 100 turns on the microphone 22 and causes the symbol G1 to be displayed on the operation screen SC2 when the microphone 22 is in a state where voice input is possible.

[0031] On the other hand, when the control unit 100 turns off the microphone 22 and places the microphone 22 in a state in which voice input is not possible, as shown in the examples in Figures 4(A) and 4(B), a symbol G2 consisting of a symbol G1 with a microphone design and an image of an "X" superimposed thereon is displayed on the operation screen SC1 and operation screen SC2 (upper left in Figures 3(A) and (B)).

[0032] The voice analysis unit 102 converts the electrical signal (voice data) converted by the microphone 22 into text data using existing voice recognition technology, and recognizes voice instructions from the user by analyzing the text data using existing natural language processing technology.

[0033] The reception unit 103 receives, as instructions from the user, instructions input by manual input operation via the operation unit 47 (including a touch panel) for the screen currently displayed on the display unit 473, and voice instructions recognized by the voice analysis unit 102 (the analysis result by the voice analysis unit 102) via the microphone 22. The control unit 100 executes a job according to the contents of the instructions received by the reception unit 103.

[0034] The display control unit 101 displays on the display unit 473 a setting screen that displays the instructions input by manual input operation or the contents indicated by the voice instruction. For example, when the operation screen SC2 as the setting screen shown in FIG. 3B is displayed on the display unit 473, the user inputs instructions to set "paper selection" to "A4", "color selection" to "black and white", and "page combination" to "2in1" via the operation unit 47, and the reception unit 103 receives these instructions. At this time, the display control unit 101 displays on the display unit 473 the operation screen SC2 (setting screen) that switches the setting of "paper selection" from "automatic" to "A4", the setting of "color selection" from "full color" to "black and white", and the setting of "page combination" from "off" to "2in1", as shown in FIG. 5.

[0035] When the operation screen SC1 shown in FIG. 3(A) is displayed on the display unit 473, the user speaks the keyword “black and white copy” and the reception unit 103 receives these voice instructions via the speaker 23 and the voice analysis unit 102, the display control unit 101 displays the operation screen SC2 as shown in FIG. 6 on the display unit 473.

[0036] The control unit 100 switches between a manual input only mode in which only manual input instructions input by operation of the operation unit 47 are accepted by the acceptance unit 103, and a voice input enabled mode in which the acceptance unit 103 accepts the voice instructions and the manual input instructions. Here, the control unit 100 may use either of the following methods to prevent the acceptance unit 103 from accepting voice instructions as the manual input only mode: (i) turning off the microphone 22 so that only manual input instructions are accepted by the acceptance unit 103, or (ii) preventing the acceptance unit 103 from accepting voice instructions that are input to the microphone 22 in the on state and analyzed by the voice analysis unit 102. The control unit 100 switches to the manual input only mode when an operation screen for accepting input of information that is prohibited in advance from being input by voice instructions is displayed on the display unit 473 by the display control unit 101. The information that is prohibited in advance from being input by voice instructions is predetermined voice input prohibited information, such as taboo words that are undesirable to be leaked (e.g., user IDs or passwords, etc.) and / or instructions that cannot be input accurately by voice input because the accuracy of the input cannot be maintained (e.g., email addresses to which emails are to be sent, IP addresses to which data is to be sent, etc.). The information that is prohibited in advance from being input by voice instructions is hereinafter referred to as voice input prohibited information.

[0037] When the display control unit 101 is switched to the voice input enabled mode, the display control unit 101 causes the operation screen displayed on the display unit 473 to display an image or a message indicating that voice instructions are accepted. On the other hand, when the display control unit 101 is switched to the manual input only mode, the display control unit 101 causes the operation screen displayed on the display unit 473 to display an image or a message indicating that voice instructions are not accepted.

[0038] As shown in the example of Fig. 7, when an authentication screen SC3 requesting input of a user ID and password is displayed on the display unit 473, the control unit 100 switches the operation mode of the image forming apparatus 1 to a manual input only mode, and the reception unit 103 is set to a state in which it does not accept voice instructions for the user ID and password, but only accepts manual input operations. The display control unit 101 also displays a symbol G2 consisting of a microphone with an "X" superimposed on it on the authentication screen SC3, indicating that these operation targets do not accept voice instructions. The authentication screen SC3 is displayed when system settings are performed other than at the time of login. When performing private printing, a password is requested to be entered, and in this case, a similar authentication screen SC3 is also displayed.

[0039] Next, an example of processing performed by the control unit 10 of the image forming apparatus 1 will be described with reference to the flowchart shown in Fig. 8. This processing is performed when switching of the operation screen displayed on the display unit 473 occurs. As an initial setting, the control unit 100 switches the operation mode of the image forming apparatus 1 to a voice input enabled mode.

[0040] When the operation screen of the display unit 473 is switched by the display control unit 101, the control unit 100 determines whether the operation screen after switching is an operation screen for accepting input of the voice input prohibition information (S1).

[0041] Here, the control unit 100 , cut When it is determined that the operation screen after the switch is an operation screen for accepting input of the above-mentioned voice input prohibited information (S1 "Yes"), the operation mode of the image forming apparatus 1 is switched to a manual input only mode (S2), and the reception unit 103 does not accept voice instructions for the user ID and password, but only accepts manual input operations.

[0042] At this time, the display control unit 101 causes an image or a message indicating that the voice instruction cannot be accepted to be displayed on the operation screen, as shown in the example of FIG. 7 (S3).

[0043] On the other hand, the control unit 100 , cut When it is determined that the operation screen after the change is not an operation screen for accepting the input of the voice input prohibited information (S1 "No"), the operation mode of the image forming apparatus 1 is kept in the voice input enabled mode (S4). After this, the process ends.

[0044] Thus, according to the embodiment, when an operation screen for accepting input of the voice input prohibited information, for example, private information (confidential information) such as a user ID or password, is displayed on the display unit 473, the reception unit 103 does not accept voice instructions but only accepts manual input instructions, so that the user does not vocalize personal information such as a user ID or password, and it is possible to prevent leakage of confidential information and ensure security. Also, when an operation screen for accepting destination information for data transmission, such as an email address to which an e-mail is to be sent and an IP address to which data is to be sent, as the voice input prohibited information is displayed on the display unit 473, the reception unit 103 does not accept voice instructions but only accepts manual input instructions, so that the user inputs the destination information by manually operating the operation unit 47, and the accuracy of the input of the destination information (instruction content) is maintained, and information (instructions) can be input accurately.

[0045] Further, a further embodiment will be described. The display control unit 101 may display both input items that accept voice instructions and input items that only accept manual input instructions on the operation screen of the display unit 473 (for example, the operation screen SC1 shown in FIG. 3(A)). When display control unit 101 displays such an operation screen on the display unit 473, the display control unit 101 displays an image or a message indicating that voice input is not accepted for the input items that only accept manual input instructions.

[0046] For example, as shown in an example of an operation screen SC4 in FIG. 9, the display control unit 101 causes the operation screen SC4 to display a symbol G1 with a microphone design on the buttons of “Copy,” “Send,” “Fax,” and “User Box” that accept voice instructions, and in contrast, causes the display control unit 101 causes the buttons of “System Settings” and “Internet,” which do not accept voice instructions, to display a symbol G2 with an “X” superimposed on a microphone design as an image indicating that voice input is not accepted.

[0047] Such an operation screen S C4 When displaying the image, the control unit 100 switches the operation mode of the image forming apparatus 1 to a voice input mode. Information Based on the content of the voice command, the reception unit 103 performs processing to not accept a voice command indicating voice input prohibition information, and to accept a voice command other than voice input prohibition information.

[0048] Next, a further embodiment will be described. The control unit 100 stores the total number of voice instructions and manual input instructions received by the reception unit 103. When the operation screen to be the initial screen is displayed on the display unit 473 by the display control unit 101, the control unit 100 switches the operation mode of the image forming device 1 to either the manual input only mode or the voice input possible mode, whichever has the greater total number of received instructions. However, even in this case, the reception unit 103 does not accept voice instructions for inputting voice input prohibited information, but only accepts manual input instructions. This makes it possible to improve convenience for the user by switching to a mode that the user frequently uses when the initial screen is displayed, while ensuring the security of the information to be input and the accuracy of the input.

[0049] Up to this point, we have explained the case where the voice data collected by the microphone 22 and converted is analyzed by the voice analysis unit 102 in the image forming device 1. However, as a further embodiment, a speaker with a built-in microphone and an AI (artificial intelligence) assistant function known as a smart speaker may be adopted, and the user's voice may be collected by the speaker. The image forming device 1 may use the speaker as a voice input unit, and the voice analysis results from the speaker may be received by the reception unit 103.

[0050] The present invention is not limited to the above-described embodiment, and various modifications are possible. condition The configuration and processing shown in the above embodiment with reference to FIGS. 1 to 9 are merely one embodiment of the present invention, and the present invention is not limited to these configurations and processing.

Claims

1. An image forming apparatus including an image forming unit that forms an image on a recording medium, A display unit; A display control unit that displays an operation screen on the display unit; an operation unit into which a manual input instruction is input by a user's manual operation; a voice input unit for inputting voice from a user; a reception unit that receives a voice instruction based on the voice input to the voice input unit and the manually input instruction; a control unit that controls an operation of the image forming apparatus based on the manual input instruction and the voice instruction received by the reception unit to execute a job, The control unit is switching between a manual input only mode in which only the manual input instruction is accepted by the accepting unit and a voice input enabled mode in which both the voice instruction and the manual input instruction are accepted by the accepting unit; when the operation screen for receiving input of information that is prohibited from being input by voice instruction is displayed on the display unit by the display control unit, switching to the manual input only mode; when displaying both the input item that accepts the voice instruction and the input item that accepts only the manual input instruction on the operation screen, the display control unit displays the input item that accepts only the manual input instruction with an image or a message indicating that voice input is not accepted; The control unit switches to the voice input enabled mode, The reception unit does not accept the voice instruction indicating information the input of which is prohibited in advance by the voice instruction, and accepts the voice instruction indicating information other than the information the input of which is prohibited in advance by the voice instruction.

2. When the control unit switches to the manual input only mode, The image forming apparatus according to claim 1 , wherein the display control unit causes the operation screen to display an image or a message indicating that the voice instruction cannot be accepted.

3. 2. The image forming apparatus according to claim 1, wherein the control unit stores a total number of received voice instructions and manual input instructions received by the receiving unit, and when the operation screen to be used as an initial screen is displayed on the display unit by the display control unit, the control unit switches to either the manual input only mode or the voice input enabled mode, whichever has the greater total number of received instructions.

4. 2. The image forming apparatus according to claim 1, wherein the information that is prohibited from being input by voice instruction in advance is private information necessary for authentication, or information on a destination of data transmission.

5. A human presence sensor is further provided for detecting a person approaching the image forming apparatus. The control unit is When an approaching person is detected by the human presence sensor, the voice input unit is set to a state in which voice input is possible; 2. The image forming apparatus according to claim 1, wherein the voice input unit is turned off to disable voice input when a predetermined time has elapsed since the human sensor stopped detecting an approaching person.

Images