Image forming apparatus
The image forming apparatus ensures secure and accurate voice command input by displaying unacceptable messages for voice input on sensitive operations and switching input modes, addressing security and accuracy issues in existing technologies.
Patent Information
- Application Number
- JP2026037919
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-07-29
- Filing Date
- 2026-03-10
- Publication Date
- 2026-11-11
- Estimated Expiration
- 2043-07-20
AI Technical Summary
Existing image forming apparatuses face issues with security and input accuracy when using voice commands, as personal information can be inadvertently transmitted to the surroundings, and voice input may not ensure accurate instruction input.
The apparatus includes a display unit that displays both voice and manual input items, with unacceptable messages for voice input on sensitive information, and switches between voice and manual input modes based on the operation screen content, ensuring secure and accurate input.
This approach enhances security by preventing leakage of personal information and improves input accuracy by restricting voice commands on sensitive operations, while allowing voice input where necessary.
Smart Images

Figure 0007948474000001 
Figure 0007948474000002 
Figure 0007948474000003
Abstract
Description
TECHNICAL FIELD
[0001] The present invention relates to an image forming apparatus that allows voice instructions.
BACKGROUND ART
[0002] Some image forming apparatuses such as copiers and multi-function peripherals are provided with an operation panel for a user to perform manual input operations. A user can perform operations via the operation panel to select one function from a plurality of functions (for example, a copy function, a scanner function, a facsimile function), or make settings for the functions.
[0003] In addition, various image forming apparatuses that enable voice instructions have been proposed and put into practical use. For example, the following Patent Document 1 describes reflecting the content of a voice instruction in job settings, and the following Patent Document 2 describes narrowing down job history information intended by a user from a plurality of pieces of job history information based on keywords included in the user's voice.
PRIOR ART DOCUMENTS
PATENT DOCUMENTS
[0004]
PATENT DOCUMENT 1
PATENT DOCUMENT 2
SUMMARY OF THE INVENTION
[0005] However, when performing voice input, the content uttered by the user is easily transmitted to the surroundings. If the operation content is merely function selection or setting, there is no problem even if it is transmitted to the surroundings, but it is not preferable in terms of security that personal information such as a user ID and a password is transmitted to the surroundings. In addition, there are cases where the input accuracy is not ensured by voice input and the instruction content is such that an accurate instruction cannot be input. However, the above Patent Documents 1 and 2 do not disclose any means for solving the above problem at the time of voice input.
[0006] This invention has been made in view of the above circumstances, and aims to ensure security and input accuracy when inputting voice commands by uttering them.
[0007] An image forming apparatus according to one aspect of the present invention is an image forming apparatus comprising an image forming unit for forming an image on a recording medium, the apparatus comprising a display unit, a display control unit for displaying an operation screen on the display unit, an operation unit for receiving manual input instructions by a user, a reception unit for receiving voice instructions and the manual input instructions, and a control unit for controlling the operation of the image forming apparatus and executing a job based on the manual input instructions or voice instructions received by the reception unit, wherein when the display control unit displays both a first input item for receiving voice instructions and a second input item for receiving only manual input instructions on the operation screen to the display unit, it displays an unacceptable image or unacceptable message indicating that voice instructions are not accepted for the second input item.
[0008] According to the present invention, it becomes possible to ensure security and input accuracy when inputting voice commands by uttering them. [Brief explanation of the drawing]
[0009] [Figure 1] This is a perspective view showing the external appearance of an image forming apparatus according to one embodiment of the present invention. [Figure 2] This is a functional block diagram that schematically shows the main internal components of an image forming apparatus. [Figure 3] (A) and (B) are diagrams showing examples of operation screens displayed on the display unit. [Figure 4] (A) and (B) are diagrams showing examples of operation screens displayed on the display unit. [Figure 5] This figure shows an example of the operation screen displayed on the display unit. [Figure 6] This figure shows an example of the operation screen displayed on the display unit. [Figure 7]This figure shows an example of the operation screen displayed on the display unit. [Figure 8] This flowchart shows an example of processing performed by the control unit of an image forming apparatus. [Figure 9] This figure shows an example of the operation screen displayed on the display unit. [Modes for carrying out the invention]
[0010] Hereinafter, an image forming apparatus according to one embodiment of the present invention will be described with reference to the drawings. Figure 1 is a perspective view showing the external appearance of an image forming apparatus according to one embodiment of the present invention. Figure 2 is a functional block diagram schematically showing the main internal configuration of the image forming apparatus. The image forming apparatus 1 according to the first embodiment is a multifunction device that combines multiple functions such as a copy function, a printer function, a scanner function, and a facsimile function, and is composed of a document feeding unit 6, a document reading unit 5, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, a storage unit 8, a human presence sensor 21, an operation unit 47, a facsimile communication unit 71, a network interface unit 91, a microphone 22, and a speaker 23.
[0011] The document feeding unit 6 is configured to open and close on the upper surface of the document reading unit 5 by a hinge (not shown), and functions as a document holder cover when reading documents placed on a platen glass (not shown). The document feeding unit 6 is also known as an ADF (Auto Document Feeder) or DP (Document Processor), and is equipped with a document tray 61 that supplies documents placed on the document tray 61 to the document reading unit 5 one at a time.
[0012] The process of reading a document in the image forming apparatus 1 will now be explained. The document reading unit 5 optically reads the image of the document supplied to the document reading unit 5 by the document feeding unit 6, or the document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory (not shown) or the like.
[0013] A case where an image forming operation is performed in the image forming apparatus 1 will be described. Based on image data generated by a document reading operation and image data received from a computer as an external apparatus (for example, a personal computer) connected to a network, the image forming unit 12 forms a toner image on recording paper as a recording medium fed from the paper feeding unit 14.
[0014] The fixing unit 13 heats and pressurizes the recording paper on which the toner image has been formed by the image forming unit 12 to fix the toner image onto the recording paper, and the recording paper subjected to the fixing processing is discharged to a discharge tray 151. The paper feeding unit 14 includes a plurality of paper feeding cassettes 141.
[0015] The storage unit 8 is a large-capacity storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various control programs and the like.
[0016] The human sensor 21 detects a person approaching the image forming apparatus 1. As the human sensor 21, for example, a sensor that detects infrared rays emitted by a human body is used.
[0017] The operation unit 47 receives instructions such as an image forming operation execution instruction from an operator for various operations and processes executable by the image forming apparatus 1. The operation unit 47 includes a display unit 473 that displays operation guidance and the like for the operator. Further, the operation unit 47 receives input of instructions from the user based on a user's operation (touch operation) on the operation screen displayed on the display unit 473 via a touch panel included in the display unit 473 and a user's operation on physical keys.
[0018] The display unit 473 is configured by an LCD (Liquid Crystal Display) or the like. The display unit 473 includes a touch panel. When the operator performs an operation of touching buttons or keys displayed on the screen, the touch panel receives an instruction associated with the touched position.
[0019] The facsimile communication unit 71 includes an unillustrated encoding / decoding section, a modulation / demodulation section, and an NCU (Network Control Unit), and performs facsimile transmission and reception using a public telephone line network or the like.
[0020] The network interface unit 91 is a communication interface that transmits and receives various data to and from an external device (for example, a personal computer) in a local area or on the Internet.
[0021] The microphone 22 collects sound around the image forming apparatus 1 and converts it into an electrical signal (audio data). The microphone 22 is provided at an appropriate position where it can easily collect the voice uttered by the user, for example, on the operation unit 47.
[0022] The speaker 23 outputs various sounds such as operation sounds and effect sounds when operating the operation unit 47, guidance voices explaining operation methods, and warning sounds when a trouble occurs in the image forming apparatus 1. For example, the speaker 23 is provided at a position not visible from the outside of the image forming apparatus 1, for example, inside the operation unit 47.
[0023] The control unit 10 is configured to include a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and a dedicated hardware circuit. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit), etc. The control unit 10 includes a control section 100, a display control section 101, a voice analysis section 102, and a reception section 103.
[0024] The control unit 10 functions as a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103 through operation by the processor in accordance with the control program stored in the memory unit 8. However, these control units 100, etc., can also be configured by hardware circuits, rather than by operation in accordance with the control program by the control unit 10. The same applies to each embodiment below unless otherwise specified.
[0025] The control unit 100 is responsible for the overall operation control of the image forming apparatus 1. The control unit 100 is connected to the document feeding unit 6, document reading unit 5, image forming unit 12, fixing unit 13, paper feeding unit 14, storage unit 8, human presence sensor 21, operation unit 47, facsimile communication unit 71, network interface unit 91, microphone 22, and speaker 23, and performs drive control of each of these units. For example, the control unit 100 controls the operation of the image forming unit 12, etc., to form the document image obtained by reading by the document reading unit 5 onto the recording paper used as a recording medium.
[0026] Furthermore, when the motion sensor 21 detects an approaching person, the control unit 100 controls the microphone 22 to turn it on, enabling voice input to the microphone 22. After a predetermined time (for example, 30 seconds) has elapsed since the motion sensor 21 stopped detecting an approaching person, the control unit 100 controls the microphone 22 to turn it off. Note that the control unit 100 can also switch the microphone 22 on and off according to instructions input to the operation unit 47.
[0027] The display control unit 101 controls the display on the display unit 473. For example, the display control unit 101 displays a selection screen on the display unit 473 for the user to select a function to be executed from among several functions that can be executed in the image forming apparatus 1, and also displays a setting screen on the display unit 473, which is at a lower level than the selection screen, for receiving input related to the settings of each function.
[0028] Figures 3(A) and 3(B) show examples of screens displayed on the display unit 473. The operation screen SC1 shown in Figure 3(A) is a selection screen that allows the user to select a function to execute from among several functions that can be executed by the image forming apparatus 1. The operation screen SC1 displays buttons such as "Copy," "Send (Scanner function)," and "Fax (Facsimile function)." The operation screen SC1, which functions as a selection screen, is also the "Home" screen. When the user presses the "Copy" button, the operation unit 47 receives a copy function selection instruction, and the control unit 100 displays the operation screen SC2 shown in Figure 3(B) on the display unit 473 according to this instruction.
[0029] The operation screen SC2 is displayed on the display unit 473 as a lower level than the "Home" screen. The operation screen SC2 is a settings screen for receiving input related to the "Copy" function settings. In the center of the "Copy" function settings screen, six buttons are displayed, labeled "Paper Selection," "Color Selection," "Page Collation," "Reduce / Enlarge," "Duplex / Split," and "Staple / Punch." These buttons are images for receiving settings related to the "Copy" function.
[0030] The operation screen SC1 shown in Figure 3(A) and the operation screen SC2 shown in Figure 3(B) (top left in Figures 3(A) and (B)) display the symbol G1, which is a microphone. The display of symbol G1 indicates that audio input to the microphone 22 is possible. In other words, the control unit 100 displays the symbol G1 on the operation screen SC2 when the microphone 22 is turned on and in a state where audio input is possible.
[0031] On the other hand, when the control unit 100 turns off the microphone 22 and makes it impossible to input audio from the microphone 22, the operation screen SC1 and operation screen SC2 (upper left in Figures 3(A) and 3(B)) display a symbol G2 which is a symbol G1 which is a microphone, with an "×" image superimposed on it.
[0032] The voice analysis unit 102 converts the electrical signals (voice data) converted by the microphone 22 into text data using existing voice recognition technology, and then analyzes the text data using existing natural language processing technology to recognize voice instructions from the user.
[0033] The reception unit 103 receives instructions from the user via manual input through the operation unit 47 (including the touch panel) on the screen currently displayed on the display unit 473, and voice instructions (analysis results by the voice analysis unit 102) recognized by the voice analysis unit 102 via the microphone 22. The control unit 100 executes a job according to the content of the instructions received by the reception unit 103.
[0034] The display control unit 101 displays a settings screen on the display unit 473 that shows the content indicated by the instructions entered by manual input or the voice instructions. For example, when the operation screen SC2, which is a settings screen as shown in Figure 3(B), is displayed on the display unit 473, the user inputs instructions via the operation unit 47 to set "Paper Selection" to "A4", "Color Selection" to "Black and White", and "Page Consolidation" to "2in1", and the reception unit 103 receives these instructions. At this time, the display control unit 101 displays an operation screen SC2 (settings screen) on the display unit 473, as shown in Figure 5, which switches the "Paper Selection" setting from "Automatic" to "A4", the "Color Selection" setting from "Full Color" to "Black and White", and "Page Consolidation" from "Off" to "2in1".
[0035] When the operation screen SC1 shown in Figure 3(A) is displayed on the display unit 473, and the user speaks the keyword "black and white copy," and the reception unit 103 receives these voice commands via the speaker 23 and the voice analysis unit 102, the display control unit 101 displays the operation screen SC2 shown in Figure 6 on the display unit 473.
[0036] The control unit 100 switches between a manual input-only mode in which only manual input instructions entered by the operation unit 47 are accepted by the reception unit 103, and a voice input-enabled mode in which both voice instructions and manual input instructions are accepted by the reception unit 103. Here, the method by which the control unit 100 prevents the reception unit 103 from accepting voice instructions in the manual input-only mode may be either (i) turning off the microphone 22 so that only manual input instructions are accepted by the reception unit 103, or (ii) preventing the reception unit 103 from accepting voice instructions that are input to the microphone 22 while it is on and analyzed by the voice analysis unit 102. When an operation screen for accepting input of information for which input by voice instruction is prohibited in advance is displayed on the display unit 473 by the display control unit 101, the control unit 100 switches to the manual input-only mode. The information that is prohibited from being entered via voice commands as described above is, for example, forbidden words that should not be leaked (e.g., user ID or password), and / or instructions that cannot be accurately entered via voice input because accuracy cannot be maintained (e.g., email address to send emails to, IP address to send data to, etc.). This information that is prohibited from being entered via voice commands as described above will be referred to as voice input prohibited information below.
[0037] When the display control unit 101 is switched to voice input enabled mode, it displays an image or message on the operation screen displayed on the display unit 473 indicating that voice commands can be accepted. On the other hand, when the display control unit 101 is switched to manual input only mode, it displays an image or message on the operation screen displayed on the display unit 473 indicating that voice commands cannot be accepted.
[0038] As shown in Figure 7, when the authentication screen SC3, which prompts for the input of a user ID and password, is displayed on the display unit 473, the control unit 100 switches the operating mode of the image forming apparatus 1 to manual input only mode, and the reception unit 103 is set to accept only manual input operations and not voice commands for the user ID and password. In addition, the display control unit 101 displays the symbol G2, which is a microphone symbol with an "X" superimposed on it, on the authentication screen SC3 to indicate that these operations do not accept voice commands. The authentication screen SC3 is displayed in situations other than login, such as when performing system settings. Also, when performing private printing, the user is prompted to enter a password, and in this case, the same authentication screen SC3 is displayed.
[0039] Next, an example of the processing performed by the control unit 10 of the image forming apparatus 1 will be explained based on the flowchart shown in Figure 8. This processing is performed when a change occurs in the operation screen displayed on the display unit 473. As an initial setting, the control unit 100 switches the operating mode of the image forming apparatus 1 to the voice input enabled mode.
[0040] When the operation screen of the display unit 473 is switched by the display control unit 101, the control unit 100 determines whether the switched operation screen is an operation screen for accepting the input of the above-mentioned voice input prohibition information (S1).
[0041] Here, when the control unit 100 determines that the operation screen after the switch is an operation screen for accepting the input of the above voice input prohibition information (S1 "Yes"), it switches the operation mode of the image forming apparatus 1 to manual input only mode (S2), and the reception unit 103 is set to not accept voice instructions for the user ID and password, and to accept only manual input operations.
[0042] At this time, the display control unit 101 displays an image or message on the operation screen indicating that voice commands cannot be accepted, as shown in the example in Figure 7 (S3).
[0043] On the other hand, if the control unit 100 determines that the operation screen after the switch is not an operation screen for accepting the input of the above-mentioned voice input prohibition information (S1 "No"), it keeps the operating mode of the image forming apparatus 1 in the voice input enabled mode (S4). After this, the process ends.
[0044] Thus, according to the above embodiment, when an operation screen for accepting input of voice-input prohibited information, such as private information (confidential information) like a user ID or password, is displayed on the display unit 473, the reception unit 103 does not accept voice instructions and only accepts manual input instructions. As a result, the user does not utter personal information such as a user ID or password, thus preventing the leakage of confidential information and ensuring security. Furthermore, when an operation screen for accepting recipient information for data transmission, such as an email address to send an email to or an IP address to send data to, as voice-input prohibited information is displayed on the display unit 473, the reception unit 103 does not accept voice instructions and only accepts manual input instructions. As a result, the user manually operates the operation unit 47 to input the recipient information, ensuring accuracy in the input of the recipient information (instruction content) and enabling accurate information (instructions).
[0045] Further embodiments will be described. The display control unit 101 may display both input items that accept voice commands and input items that accept only manual commands on the operation screen of the display unit 473 (for example, the operation screen SC1 shown in Figure 3(A)). When the display control unit 101 displays such an operation screen on the display unit 473, it displays an image or message indicating that voice input is not accepted for input items that accept only manual commands.
[0046] For example, as shown in Figure 9 as an example of the operation screen SC4, the display control unit 101 displays the symbol G1, which is a microphone, for the buttons "Copy," "Send," "Fax," and "User Box" that accept voice commands on the operation screen SC4, while displaying the symbol G2, which is a microphone with an "X" superimposed on it, as an image to indicate that voice input is not accepted for the buttons "System Settings" and "Internet" that do not accept voice commands.
[0047] When the SC4 operation screen is displayed, the control unit 100 switches the operating mode of the image forming apparatus 1 to the voice input enabled mode. Based on the content of the voice information input from the voice analysis unit 102, the reception unit 103 processes voice instructions that indicate voice input prohibition information but does not accept voice instructions that indicate voice input prohibition information.
[0048] Next, a further embodiment will be described. The control unit 100 stores the total number of voice commands and manual input commands received by the reception unit 103. When the operation screen to be used as the initial screen is displayed on the display unit 473 by the display control unit 101, the control unit 100 switches the operating mode of the image forming apparatus 1 to the mode with the higher total number of received commands, either the manual input-only mode or the voice input-enabled mode. However, even in this case, the reception unit 103 does not accept voice commands for input of voice input prohibited information, and only accepts manual input commands. This makes it possible to improve convenience for the user by switching to the mode that the user frequently uses when the initial screen is displayed, while ensuring the security and accuracy of the information to be input.
[0049] Up to this point, we have described the case in which the audio data collected and converted by the microphone 22 is analyzed by the audio analysis unit 102 in the image forming apparatus 1. However, as a further embodiment, a speaker with a built-in microphone and AI (artificial intelligence) assistant function, known as a smart speaker, may be used. The user's voice is collected by this speaker, and the image forming apparatus 1 uses this speaker as an audio input unit, with the receiving unit 103 receiving the audio analysis results from the speaker.
[0050] The present invention is not limited to the configuration of the above embodiments and various modifications are possible. Furthermore, the configuration and processing shown in the above embodiments using Figures 1 to 9 are merely one embodiment of the present invention and are not intended to limit the present invention to such configuration and processing.
Claims
1. An image forming apparatus comprising an image forming unit that forms an image on a recording medium, Display unit and A display control unit that displays an operation screen on the display unit, An operating unit into which user manual input instructions are entered, A reception unit that receives voice-based instructions and the aforementioned manual input instructions, The system comprises a control unit that controls the operation of the image forming apparatus and executes a job based on the manual input instruction or voice instruction received by the reception unit, Image forming apparatus, wherein the display control unit, when displaying both a first input item that accepts voice commands and a second input item that accepts only manual commands on the operation screen, displays an unacceptable image or message indicating that voice commands are not accepted on the second input item.
2. The image forming apparatus according to claim 1, wherein the display control unit causes the display unit to display both a first button indicating the first input item and a second button indicating the second input item on the operation screen, and displays the unacceptable image or the unacceptable message superimposed on the second button.
3. The image forming apparatus according to claim 2, wherein the display control unit causes the display unit to display a receivable image or receivable message indicating that it can receive the voice instruction, superimposed on the first button.
4. The image forming apparatus according to claim 3, wherein the display control unit further displays the receivable image or the receivable message in the area of the operation screen where the first button and the second button are not displayed on the display unit.
5. The image forming apparatus according to claim 2, wherein the display control unit causes the display unit to display an image in which a "×" symbol is superimposed on a design representing a microphone as the unacceptable image.
6. The image forming apparatus according to claim 3, wherein the display control unit causes the display unit to display an image including a design representing a microphone as the receivable image.
7. The image forming apparatus according to claim 1, wherein the information whose input via voice command is prohibited in advance is private information necessary for authentication or information of the recipient of data transmission.
Citation Information
Patent Citations
Data processor, data processing method and computer program
JP2007079852A
Merchandise trading system, computer program for realizing the system, and merchandise trading method
JP2007333778A
Refrigerator
JP2014196847A
Information processing device, input means selection method, and computer program
JP2016126704A
Job history identification device, image processing device, server, job history identification method, and program
JP2019205052A
