Image forming apparatus

Abstract

This system enables efficient power saving when returning the image forming apparatus from a power-saving state. [Solution] The image forming apparatus (1) comprises a human presence sensor (21), a microphone (22), a reception unit (103), and a control unit (100). When the image forming apparatus (1) is in a power-saving state, if the human presence sensor (21) detects an approaching person, the control unit (100) enables voice input, releases the operating mechanism necessary for executing the function corresponding to the content indicated by the voice instruction received by the reception unit (103) from the power-saving state to the normal operating state, and keeps the operating mechanism necessary for executing the function not corresponding to the content indicated by the voice instruction in the power-saving state.

Description

Technical Field

[0001] The present invention relates to an image forming apparatus capable of accepting voice instructions.

Background Art

[0002] Some image forming apparatuses such as copying machines and multifunction peripherals include an operation panel for a user to perform manual input operations. By performing operations via the operation panel, a user can select one function from among a plurality of functions (e.g., a copy function, a scanner function, a facsimile function) or perform settings for a function.

[0003] Various image forming apparatuses capable of accepting voice instructions have been proposed and put into practical use. For example, the following Patent Document 1 describes reflecting the content of a voice instruction in job settings, and the following Patent Document 2 describes narrowing down job history information intended by a user from among a plurality of pieces of job history information based on keywords included in the user's voice.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

[0005] Some image forming apparatuses have a power-saving mode that allows the operating mechanism of the image forming apparatus to be set to a power-saving state. In addition, the microphone used for voice input for voice instructions is turned on, for example, when a person is detected by a motion sensor. When a person passes in front of the image forming apparatus, the microphone is turned on, and the power-saving mode is deactivated, returning the operating mechanism of the image forming apparatus from the power-saving state to a normal operating state. However, simply because a person is detected by a motion sensor, and it is unknown which function of the image forming apparatus that person will use, returning the entire operating mechanism of the image forming apparatus from the power-saving state to a normal operating state is undesirable from the perspective of achieving efficient power saving. Patent documents 1 and 2 mentioned above do not disclose a means to address this problem and achieve efficient power saving.

[0006] This invention has been made in view of the above circumstances, and aims to achieve efficient power saving when restoring an image forming apparatus from a power-saving state. [Means for solving the problem]

[0007] An image forming apparatus according to one aspect of the present invention includes: an audio input unit that receives audio input from a user; a storage unit that stores a table that associates necessity conditions for each of a plurality of different operating mechanisms provided by the image forming apparatus with each function, indicating whether or not to set it to a normal operating state; and a control unit that refers to the table based on an audio instruction input via the audio input unit, determines which operating mechanisms are necessary for executing the function corresponding to the audio instruction and which are not necessary for executing the function, releases the operating mechanisms determined to be necessary from the power-saving state to the normal operating state, and maintains the operating mechanisms determined to be unnecessary in the power-saving state. [Effects of the Invention]

[0008] According to the present invention, efficient power saving can be achieved when restoring an image forming apparatus from a power-saving state. [Brief explanation of the drawing]

[0009] [Figure 1] This is a perspective view showing the external appearance of an image forming apparatus according to one embodiment of the present invention. [Figure 2] This is a functional block diagram that schematically shows the main internal components of an image forming apparatus. [Figure 3] (A) and (B) are diagrams showing examples of operation screens displayed on the display unit. [Figure 4] This figure shows an example of the operation screen displayed on the display unit. [Figure 5] This figure shows an example of the operation screen displayed on the display unit. [Figure 6] This figure shows an example of the relationship between keywords spoken by the user and the unit that disables the power-saving state. [Figure 7] This flowchart shows an example of processing performed by the control unit of an image forming apparatus. [Figure 8] This figure shows an example of the operation screen displayed on the display unit. [Modes for carrying out the invention]

[0010] Hereinafter, an image forming apparatus according to one embodiment of the present invention will be described with reference to the drawings. Figure 1 is a perspective view showing the external appearance of an image forming apparatus according to one embodiment of the present invention. Figure 2 is a functional block diagram schematically showing the main internal configuration of the image forming apparatus. The image forming apparatus 1 according to the first embodiment is a multifunction device that combines multiple functions such as a copy function, a printer function, a scanner function, and a facsimile function, and is composed of a document feeding unit 6, a document reading unit 5, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, a storage unit 8, a human presence sensor 21, an operation unit 47, a facsimile communication unit 71, a network interface unit 91, a microphone 22, and a speaker 23.

[0011] The document feeding unit 6 is configured to open and close on the upper surface of the document reading unit 5 by a hinge (not shown), and functions as a document holder cover when reading documents placed on a platen glass (not shown). The document feeding unit 6 is also known as an ADF (Auto Document Feeder) or DP (Document Processor), and is equipped with a document tray 61 that supplies documents placed on the document tray 61 to the document reading unit 5 one at a time.

[0012] The process of reading a document in the image forming apparatus 1 will now be explained. The document reading unit 5 optically reads the image of the document supplied to the document reading unit 5 by the document feeding unit 6, or the document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory (not shown) or the like.

[0013] The image forming operation performed by the image forming apparatus 1 will now be described. Based on the image data generated by the document reading operation and the image data received from a network-connected external device (for example, a personal computer), the image forming unit 12 forms a toner image on the recording paper, which is fed from the paper feeding unit 14.

[0014] The fixing unit 13 heats and pressurizes the recording paper on which the toner image has been formed by the image forming unit 12 to fix the toner image to the recording paper, and the fixing process is discharged into the output tray 151. The paper feeding unit 14 is equipped with multiple paper feed cassettes 141.

[0015] The storage unit 8 is a high-capacity storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive), and stores various control programs and the like.

[0016] The motion sensor 21 detects a person approaching the image forming apparatus 1. For example, the motion sensor 21 may be a sensor that detects infrared radiation emitted by the human body.

[0017] The operation unit 47 receives instructions such as an image forming operation execution instruction from an operator who is a user regarding various operations and processes executable by the image forming apparatus 1. The operation unit 47 includes a display unit 473 that displays operation guidance and the like for the operator. Further, the operation unit 47 receives input of instructions from the user based on a user's operation (touch operation) on an operation screen displayed on the display unit 473 or a user's operation on physical keys via the touch panel included in the display unit 473.

[0018] The display unit 473 is composed of an LCD (Liquid Crystal Display) or the like. The display unit 473 includes a touch panel. When the operator performs an operation of touching buttons or keys displayed on the screen, an instruction associated with the touch-operated position is received via the touch panel.

[0019] The facsimile communication unit 71 includes an unillustrated encoding / decoding unit, a modulation / demodulation unit, and an NCU (Network Control Unit), and transmits and receives facsimiles using a public telephone line network or the like.

[0020] The network interface unit 91 is a communication interface that transmits and receives various data to and from an external device (e.g., a personal computer) in a local area or on the Internet.

[0021] The microphone 22 is an audio input unit that collects sound around the image forming apparatus 1 and converts the collected sound into electrical signals (audio data). The microphone 22 is provided at an appropriate location where it is easy to collect the voice uttered by the user, for example, in the operation unit 47.

[0022] The speaker 23 outputs various sounds including operation sounds and sound effects when operating the operation unit 47, guidance voice explaining an operation method, and a warning sound when a trouble occurs in the image forming apparatus 1. For example, the speaker 23 is provided at a location invisible from the outside of the image forming apparatus 1, for example, inside the operation unit 47.

[0023] The control unit 10 comprises a processor, RAM (Random Access Memory), ROM (Read Only Memory), and dedicated hardware circuits. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 10 includes a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103.

[0024] The control unit 10 functions as a control unit 100, a display control unit 101, a voice analysis unit 102, and a reception unit 103 through operation by the processor in accordance with the control program stored in the memory unit 8. However, these control units 100, etc., can also be configured by hardware circuits, rather than by operation in accordance with the control program by the control unit 10. The same applies to each embodiment below unless otherwise specified.

[0025] The control unit 100 is responsible for the overall operation control of the image forming apparatus 1. The control unit 100 is connected to the document feeding unit 6, document reading unit 5, image forming unit 12, fixing unit 13, paper feeding unit 14, storage unit 8, human presence sensor 21, operation unit 47, facsimile communication unit 71, network interface unit 91, microphone 22, and speaker 23, and performs drive control of each of these units. For example, the control unit 100 controls the operation of the image forming unit 12, etc., to form the document image obtained by reading by the document reading unit 5 onto the recording paper used as a recording medium.

[0026] Furthermore, when the motion sensor 21 detects an approaching person, the control unit 100 controls the microphone 22 to turn it on, enabling voice input to the microphone 22. After a predetermined time (for example, 30 seconds) has elapsed since the motion sensor 21 stopped detecting an approaching person, the control unit 100 controls the microphone 22 to turn it off. Note that the control unit 100 can also switch the microphone 22 on and off according to instructions input to the operation unit 47.

[0027] Furthermore, when the motion sensor 21 detects an approaching person, the control unit 100 turns on the microphone 22, enabling voice input.

[0028] The display control unit 101 controls the display operation of the display unit 473. For example, the display control unit 101 displays a selection screen on the display unit 473 for the user to select a function to be executed from among several functions that can be executed in the image forming apparatus 1, and also displays a setting screen on the display unit 473, which is a lower layer than the selection screen, for receiving input related to the settings of each function.

[0029] Figures 3(A) and 3(B) show examples of screens displayed on the display unit 473. The operation screen SC1 shown in Figure 3(A) is a selection screen that allows the user to select a function to be executed from among several functions that can be executed in the image forming apparatus 1. Operation screen SC1 displays buttons such as "Copy," "Send (Scanner function)," and "Fax (Facsimile function)." Operation screen SC1, which functions as a selection screen, also serves as the home screen. When the user presses the "Copy" button, the operation unit 47 receives a copy function selection instruction, and the control unit 100 displays the operation screen SC2 shown in Figure 3(B) on the display unit 473 according to this instruction.

[0030] The operation screen SC2 is displayed on the display unit 473 as a lower level than the "Home" screen. The operation screen SC2 is a settings screen for receiving input related to the "Copy" function settings. In the center of the "Copy" function settings screen, six buttons are displayed labeled "Paper Selection," "Color Selection," "Page Collation," "Reduce / Enlarge," "Duplex / Split," and "Staple / Punch." These buttons are images for receiving settings related to the "Copy" function.

[0031] Furthermore, on the SC2 operation screen, below the six buttons mentioned above, there is a button for accepting the specification of a favorite registration setting, which has pre-registered settings that differ from the default values. This button is labeled, for example, "ID Card Copy." "ID Card Copy" is a function used when you want to copy both the front and back of an ID card, such as a driver's license or health insurance card, onto a single sheet of paper. For "ID Card Copy," settings different from the default values ​​are pre-registered as "Copy" function settings, such as "A6 (Paper Selection)," "Color (Color Selection)," "2in1 (Page Collation)," "A6 (Document Size)," "Do not set (Continuous Scanning)," "Set (Erase Outside Document Area)," and "Outer Frame: 1mm (Frame Eraser)." Therefore, when the user presses the "ID Card Copy" button, the operation unit 47 receives an instruction to reflect these different default settings in the copy function, and this instruction is then received by the reception unit 103.

[0032] The voice analysis unit 102 converts the electrical signals (voice data) converted by the microphone 22 into text data using existing voice recognition technology, and then analyzes the text data using existing natural language processing technology to recognize voice instructions from the user.

[0033] The reception unit 103 receives instructions from the user via manual input through the operation unit 47 (including the touch panel) on the screen currently displayed on the display unit 473, and voice instructions (analysis results by the voice analysis unit 102) recognized by the voice analysis unit 102 via the microphone 22. The control unit 100 executes a job according to the content of the instructions received by the reception unit 103.

[0034] The display control unit 101 displays a settings screen on the display unit 473 that shows the content indicated by the instructions entered by manual input or the voice instructions. For example, when the operation screen SC2, which is a settings screen as shown in Figure 3(B), is displayed on the display unit 473, the user inputs instructions via the operation unit 47 to set "Paper Selection" to "A4", "Color Selection" to "Black and White", and "Page Consolidation" to "2in1", and the reception unit 103 receives these instructions. At this time, the display control unit 101 displays the operation screen SC2 (settings screen) on the display unit 473, as shown in Figure 4(A), which switches the "Paper Selection" setting from "Automatic" to "A4", the "Color Selection" setting from "Full Color" to "Black and White", and "Page Consolidation" from "Off" to "2in1".

[0035] When the operation screen SC1 shown in Figure 3(A) is displayed on the display unit 473, if the user utters the keyword "black and white copy", the voice instruction to set the value to "black and white copy" is received by the reception unit 103 via the microphone 22 and the voice analysis unit 102. In other words, when the display control unit 101 is displaying the operation screen SC1, which is a selection screen, on the display unit 473, and a voice instruction is input to the microphone 22 and received by the reception unit 103 via the voice analysis unit 102, the display control unit 101 transitions the display screen of the display unit 473 from the operation screen SC1, which is a selection screen, to the operation screen SC2, which is a setting screen for receiving the setting value indicated by the voice instruction. Furthermore, as shown in the example in Figure 5, the display control unit 101 displays the setting value indicated by the received voice instruction, in this case "black and white copy", on the operation screen SC2. Furthermore, information regarding which function each setting screen corresponds to and what kind of setting values ​​it accepts is pre-stored in memory built into the control unit 10, for example, through an operation based on the control program. Based on this information, the display control unit 101 identifies the setting screen that accepts the setting values ​​indicated by the voice command.

[0036] Furthermore, the control unit 100 controls the multiple operating mechanisms provided in the image forming apparatus 1 to a predetermined power-saving state. A predetermined power-saving state means that the operating mechanisms are not in a standby state where they can be immediately operated, but in a sleep state where power consumption is reduced as much as possible. The above operating mechanisms include, for example, a UI (User Interface) unit, a scanner unit, a printing (image forming) unit, and a facsimile unit. The UI unit is an operating mechanism that includes an operation unit 47. The scanner unit is an operating mechanism that includes a document reading unit 5. The printing unit is an operating mechanism that includes an image forming unit 12 and a fixing unit 13. The facsimile unit is an operating mechanism that includes a facsimile communication unit 71.

[0037] When the image forming apparatus 1 is in a power-saving state, if the motion sensor 21 detects an approaching person, the control unit 100 enables voice input by switching the microphone 22 to a state where voice input is possible, and switches the operating mechanisms necessary for executing the function corresponding to the content indicated by the voice instruction received by the reception unit 103 out of the power-saving state to the normal operating state, while the operating mechanisms necessary for executing the function not corresponding to the content indicated by the voice instruction remain in the power-saving state.

[0038] For example, if the reception unit 103 receives a voice command containing the keyword "copy," the control unit 100 will deactivate the power-saving state for the UI unit, scanner unit, and printing unit that are pre-stored in association with the copy function indicated by the voice command. On the other hand, at this time, the control unit 100 will not deactivate the power-saving state for the facsimile unit that is not pre-stored in association with the copy function.

[0039] Figure 6 shows an example of the relationship between keywords spoken by the user and included in voice instructions, and the operating mechanism that cancels the power-saving state. In Figure 6, units that cancel the power-saving state and return to a normal operating state are indicated as "ON," and units that do not cancel the power-saving state are indicated as "OFF." In Figure 6, the keywords "copy" correspond to the copy function, "transmit" corresponds to the transmit function, and "fax" corresponds to the facsimile function. In other words, Figure 6 shows the relationship between each function that can be performed by the image forming apparatus 1 and the operating mechanism associated with each function that cancels the power-saving state.

[0040] Furthermore, the reception unit 103 receives voice instructions for the pre-registered favorite settings mentioned above. For example, if the user speaks the key code "ID card copy" and the reception unit 103 receives a voice instruction regarding ID card copying via the microphone 22 and the voice analysis unit 102, or if the user presses the "ID card copy" button and the reception unit 103 receives a manual input instruction via the operation unit 47, the reception unit 103 accepts the setting of the copy function with the content (setting value) that has been pre-registered as a favorite setting for ID card copying.

[0041] When the image forming apparatus 1 is in a power-saving state, if the reception unit 103 receives a voice command for a favorite registration setting, the control unit 100 will release the power-saving state of the operating mechanism necessary for executing the function to be set by the favorite registration setting indicated by the voice command and return it to the normal operating state, while other operating mechanisms that are not necessary for executing that function will remain in a power-saving state.

[0042] Next, an example of processing performed by the control unit 10 of the image forming apparatus 1 will be explained based on the flowchart shown in Figure 7. This processing is performed when the image forming apparatus 1 is in a power-saving state, a person approaching is detected by the motion sensor 21, the control unit 100 turns on the microphone 22 to enable voice input to the microphone 22, and a voice instruction is received by the reception unit 103 via the microphone 22 and the voice analysis unit 102.

[0043] The control unit 100 identifies a function associated with the content of the voice instruction received by the reception unit 103 (S1). The control unit 100 then determines the operating mechanism necessary to execute the identified function (S2). The control unit 100 releases the determined operating mechanism from the power-saving state and returns it to the normal operating state (S3). At this time, the control unit 100 maintains the power-saving state for operating mechanisms necessary to execute functions not associated with the content of the voice instruction, i.e., operating mechanisms other than the determined operating mechanism.

[0044] Thus, according to the above embodiment, when a user gives a voice command while the power saving mode is set, the power saving state of the image forming apparatus 1 is not completely deactivated. Instead, only the power saving state of the units necessary for executing the function associated with the content of the voice command is deactivated. In other words, the operating mechanisms for executing functions not associated with the voice command entered by the user remain in a power saving state. Therefore, according to the above embodiment, efficient power saving can be achieved when returning the image forming apparatus 1 from the power saving state.

[0045] Here, a modified version of the above embodiment will be described. For example, when the operation screen SC1 shown in Figure 3(A) is displayed on the display unit 473, if the user utters the keyword "black and white copy", the voice instruction is received by the reception unit 103 via the microphone 22 and the voice analysis unit 102, and the control unit 100 can identify that the function associated with the content indicated by the voice instruction is the copy function.

[0046] However, when the operation screen SC1 is displayed on the display unit 473, if the user speaks the keyword "2in1" and the voice instruction is received by the reception unit 103, the "2in1" indicated by the voice instruction is common to multiple functions, including the copy function, scanner function, and facsimile function. Therefore, the control unit 100 cannot narrow down and identify the function associated with the content indicated by the voice instruction to just one.

[0047] Therefore, if the content of the voice instruction received by the reception unit 103 is associated with multiple functions, the control unit 100 releases the operating mechanisms necessary for executing those multiple functions from the power-saving state and returns them to the normal operating state, while keeping the operating mechanisms not necessary for executing those multiple functions in the power-saving state. For example, if a user speaks the keyword "2in1" and the voice instruction is received by the reception unit 103 via the microphone 22 and the voice analysis unit 102, the control unit 100 releases the power-saving state of the UI unit, scanner unit, and printing unit, which are necessary for executing all functions associated with that voice instruction, and returns them to the normal operating state.

[0048] Further modifications of the above embodiment will now be described. In the above embodiment, the control unit 100 turns on the microphone 22 when the motion sensor 21 detects an approaching person while the image forming apparatus 1 is in a power-saving state. Alternatively, the control unit 100 may turn on the microphone 22 to enable voice input only when the motion sensor 21 detects an approaching person and the detection of the approaching person continues for a predetermined time (for example, 30 seconds). In this case, even if the motion sensor 21 detects an approaching person who is merely passing by the image forming apparatus 1 without operating it, the voice instruction will not be received by the reception unit 103. This prevents noise or other unwanted input to the microphone 22, which could result in inaccurate voice instructions being received by the reception unit 103.

[0049] In yet another embodiment, when the control unit 100 acquires state information indicating that the state of any mechanical part of the image forming apparatus 1 has changed, it may, in addition to the above control, perform control to release the operating mechanism necessary for executing the function using that mechanical part from the power-saving state and return it to the normal operating state, while maintaining the power-saving state for the operating mechanisms that are not necessary for executing the function using that mechanical part.

[0050] For example, when the image forming apparatus 1 is in a power-saving state and a person approaching is detected by the motion sensor 21, the control unit 100 acquires open / close detection information from an open / close switch (not shown) that detects the opening and closing of the document feeding unit 6, and the open / close detection information indicates "open," the control unit 100 identifies the transmission function and copy function that are pre-associated with the "open" information, and the display control unit 101 displays an operation screen SC3 (an example is shown in Figure 8) on the display unit 473 to receive input of a selection instruction to choose which of the transmission function and copy function to execute. At this point, the control unit 100 may release the operating mechanisms necessary for executing the transmission and copy functions from the power-saving state and return to the normal operating state. Alternatively, the control unit 100 may not release the operating mechanisms necessary for executing the transmission and copy functions from the power-saving state and return to the normal operating state at this point, but when the receiving unit 103 receives the selection instruction indicating which of the transmission and copy functions to execute via voice instruction or manual input instruction, it may release the operating mechanisms necessary for executing the function selected by the selection instruction from the power-saving state and return to the normal operating state.

[0051] Up to this point, we have described the case in which the audio data collected and converted by the microphone 22 is analyzed by the audio analysis unit 102 in the image forming apparatus 1. However, as a further embodiment, a speaker with a built-in microphone and AI (artificial intelligence) assistant function, known as a smart speaker, may be used to collect the user's voice, and the image forming apparatus 1 may use the speaker as an audio input unit and have the reception unit 103 receive the audio analysis results from the speaker as set values.

[0052] The present invention is not limited to the configuration of the above embodiments and various modifications are possible. Furthermore, the configuration and processing shown in the above embodiments using Figures 1 to 8 are merely one embodiment of the present invention and are not intended to limit the present invention to such configuration and processing.

Claims

1. A voice input unit that accepts voice input from the user, A storage unit that stores a table that associates the necessity conditions for each of the multiple different operating mechanisms of the image forming apparatus with the conditions for whether or not to set it to a normal operating state, for each function, An image forming apparatus comprising: a control unit that, based on voice instructions input via the voice input unit, refers to the table, determines which operating mechanisms are necessary for executing the function corresponding to the voice instruction and which are not necessary for executing the function, and releases the operating mechanisms determined to be necessary from the power-saving state to the normal operating state, and maintains the operating mechanisms determined to be unnecessary in the power-saving state.

2. The aforementioned table is configured such that, for each of the multiple different operating mechanisms, a necessity condition is associated with each predetermined keyword, indicating whether or not the function corresponding to the keyword should be in a normal operating state when it is executed. The image forming apparatus according to claim 1, wherein the control unit determines the operating mechanism necessary for executing the function corresponding to the keyword by referring to the table based on the keyword extracted from the voice instruction.

3. The aforementioned multiple different operating mechanisms include a user interface unit, a scanner unit, a printing unit, and a facsimile unit. The image forming apparatus according to claim 2, wherein the table is configured such that for each keyword corresponding to the copy function, the transmit function, and the facsimile function, a first value indicating the normal operating state and a second value indicating the maintenance of a power-saving state are associated for each of the user interface unit, the scanner unit, the printing unit, and the facsimile unit.

4. The image forming apparatus according to claim 3, wherein the control unit, when the keyword extracted from the voice instruction corresponds to the copy function, sets the user interface unit, the scanner unit, and the printing unit to a normal operating state and maintains the facsimile unit in the power-saving state.

5. The image forming apparatus according to claim 3, wherein the control unit, when the keyword extracted from the voice instruction corresponds to the transmission function, sets the user interface unit and the scanner unit to a normal operating state and maintains the printing unit and the facsimile unit in the power-saving state.

6. The image forming apparatus according to claim 3, wherein the control unit, when the keyword extracted from the voice instruction corresponds to the facsimile function, sets the user interface unit, the scanner unit, and the facsimile unit to the normal operating state and maintains the printing unit in the power-saving state.

Images