Image forming apparatus

The image forming apparatus addresses the need for faster instruction changes by integrating a storage and control unit to process voice commands directly, eliminating network communication delays and enhancing operability through visual confirmation.

JP2025158284APending Publication Date: 2025-10-17KYOCERA DOCUMENT SOLUTIONS INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024060674
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-04
Publication Date
2025-10-17

AI Technical Summary

Technical Problem

Existing image forming devices require communication time when adding or changing instruction content due to the presence of a network interposed between the device and the virtual assistant server, reducing operability.

Method used

An image forming apparatus with a storage unit, acquisition unit, and output unit that stores executable process types and conditions, allowing direct voice command execution without network communication, using a control unit to process user voice inputs and display commands.

Benefits of technology

Eliminates communication time for adding or changing instructions, enabling faster response times and simplified voice recognition, allowing users to visually confirm and modify commands without manual operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025158284000001_ABST
    Figure 2025158284000001_ABST
Patent Text Reader

Abstract

To provide an image forming apparatus that can eliminate the need of communication time.SOLUTION: An image forming apparatus 10 comprises a storage unit 28, an acquisition unit 32, an output unit 33, and a display unit 21. The storage unit 28 stores a plurality of executable processing types L1 and processing conditions L2. The acquisition unit 32 acquires a voice. The output unit 33 outputs a command from the voice acquired by the acquisition unit 32 by using the processing types L1 and processing conditions L2. The display unit 21 displays the command. Preferably, the display unit 21 displays checking of at least one of change and addition for the command. Preferably, when at least one of change and addition is performed after the display unit 21 displays the checking, the acquisition unit 32 newly acquires a voice.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an image forming apparatus. [Background technology]

[0002] Patent Document 1 discloses an image forming device that recognizes voice instructions from a user and is controlled based on the contents of the instructions. The image forming device is connected via a network to a virtual assistant server that converts voice data into text data through voice recognition processing. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2020-091448 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the image forming device of Patent Document 1, a network is interposed between the image forming device and the virtual assistant server, so when adding or changing instruction content, communication time is required, which reduces operability. Therefore, an image forming device that does not require communication time when adding or changing instruction content is desired.

[0005] The present invention has been made in view of the above-mentioned problems, and has as its object to provide an image forming apparatus that does not require communication time when adding or changing instruction content. [Means for solving the problem]

[0006] According to one aspect of the present invention, an image forming apparatus includes a storage unit, an acquisition unit, an output unit, and a display unit. The storage unit stores a plurality of executable process types and process conditions. The acquisition unit acquires voice. The output unit uses the process types and the process conditions to output a command from the voice acquired by the acquisition unit. The display unit displays the command. [Effects of the Invention]

[0007] According to the image forming apparatus of the present invention, communication time can be eliminated. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an image forming apparatus according to an embodiment of the present invention. [Figure 2] 1 is a block diagram of an image forming apparatus according to an embodiment of the present invention. [Figure 3] FIG. 4 is a diagram showing a command list of the image forming apparatus according to the embodiment. [Figure 4] 10 is a flowchart of a voice recognition process executed by a control unit of the image forming apparatus according to the present embodiment. [Figure 5] 10 is a flowchart of a word extraction process executed during a voice recognition process. [Figure 6] 10 is a flowchart of a command setting process executed during a voice recognition process. [Figure 7] FIG. 3 is a diagram showing a first image displayed on a display unit of the image forming apparatus according to the present embodiment. [Figure 8] FIG. 10 is a diagram showing a second image displayed on the display unit of the image forming apparatus according to the present embodiment. [Figure 9] FIG. 10 is a diagram showing a third image displayed on the display unit of the image forming apparatus according to the embodiment. [Figure 10] FIG. 10 is a diagram showing a fourth image displayed on the display unit of the image forming apparatus according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference characters and description thereof will not be repeated.

[0010] An image forming apparatus 10 according to an embodiment of the present invention will be described with reference to Figures 1 and 2. Figure 1 is a diagram showing the image forming apparatus 10 according to an embodiment of the present invention. Figure 2 is a block diagram of the image forming apparatus 10 according to this embodiment.

[0011] The image forming apparatus 10 is, for example, a copier, a printer, or a multifunction peripheral. In the following, as an example, a case will be described in which the image forming apparatus 10 is a multifunction peripheral having a printer function, a copy function, a facsimile function, and a network communication function.

[0012] 1 and 2, the image forming apparatus 10 includes an image reading unit 11, an image forming unit 12, an operation display unit 23, a FAX communication unit 24, a network communication unit 25, a microphone 26, a storage unit 28, and a control unit 31. Hereinafter, the network communication unit 25 may be referred to as the NW communication unit 25.

[0013] The image reading unit 11 reads an image from an original document M. The image reading unit 11 has an original document table 120 and an original document transport unit 110. The image reading unit 11 reads an image formed on the original document M and generates read data. Specifically, the image reading unit 11 reads an image formed on the original document M transported by the original document transport unit 110, or an image formed on the original document M placed on the original document table 120. Specifically, the image reading unit 11 is composed of an automatic original document feeder, an original document image scanning device (scanner), etc.

[0014] The image forming unit 12 includes an image forming section 220 , a paper feed cassette 230 , a conveying section 240 , and a discharge section 270 .

[0015] The image forming unit 220 forms an image on the recording medium P. For example, the image forming unit 220 forms an image on the recording medium P based on the read data. The image forming unit 220 includes a plurality of toner containers.

[0016] The plurality of toner containers are detachably attached to the image forming apparatus 10. Each of the plurality of toner containers contains toner of a different color. The toner in the toner container is supplied to the image forming unit 220.

[0017] The image forming unit 220 includes an exposure unit, a photosensitive drum, a charging unit, a developing unit, a primary transfer roller, a cleaning unit, an intermediate transfer belt, a secondary transfer roller, and a fixing unit.

[0018] A recording medium P for printing is accommodated in paper feed cassette 230. The recording medium P is transported by transport unit 240. When printing is performed, the recording medium P in paper feed cassette 230 passes through image forming unit 220 and is discharged from discharge unit 270.

[0019] The conveying section 240 conveys the fed recording medium P to the image forming section 220. After the image forming section 220 forms an image on the recording medium P, the conveying section 240 further conveys the recording medium P from the image forming section 220 and discharges the recording medium P to the outside of the image forming apparatus 10.

[0020] The FAX communication unit 24 transmits or receives FAX images. Specifically, the FAX communication unit 24 transmits and receives image data and the like to and from other image forming devices and facsimile devices (neither of which are shown) via a network. The received FAX images are printed on a recording medium P by the image forming unit 12. The FAX images are also written as read data into a storage area of ​​the storage unit 28.

[0021] The NW communication unit 25 is capable of communicating with electronic devices equipped with communication devices that use the same communication method (protocol). Specifically, the NW communication unit 25 communicates with other electronic devices via a network such as a LAN (Local Area Network). The NW communication unit 25 is, for example, a communication interface equipped with a communication module such as a LAN board.

[0022] The operation display unit 23 is used to allow a user to operate the image forming apparatus 10. The operation display unit 23 includes a display unit 21 and an operation unit 22.

[0023] The display unit 21 displays images. The display unit 21 is configured with a display such as an LCD (Liquid Crystal Display) or ELD (Electro Luminescence Display) having a touch panel function. The display unit 21 displays commands. A command is an instruction from a user to cause the image forming apparatus 10 to execute an image formation process. In other words, a command includes the content of a job to be executed by the image forming apparatus 10 and time conditions such as a start time.

[0024] User operations are input through the operation unit 22. In this embodiment, in which a touch panel functions as the operation display unit 23, the display unit 21 and a part of the operation unit 22 may be integrated. Furthermore, the operation unit 22 of the operation display unit 23 may be a physical button. Furthermore, the operation unit 22 of the operation display unit 23 may have a touch panel and physical buttons.

[0025] The microphone 26 receives voice input by picking up sounds generated around the image forming apparatus 10. The microphone 26 is, for example, arranged in the same area as the operation display unit 23. The microphone 26 outputs a signal indicating the input voice. In this embodiment, the user uses voice to specify the content of the job to be executed by the image forming apparatus 10. Hereinafter, the type of job may be referred to as a processing type, and the specific execution conditions of the job may be referred to as processing conditions. Furthermore, the processing type and processing conditions may be collectively referred to as a unit command to be executed by the image forming apparatus 10, and a word corresponding to the start time of the image forming apparatus 10 may be referred to as a start command.

[0026] The control unit 31 is a hardware circuit configured by a processor such as a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), etc. The control unit 31 controls the operation of each operating unit of the image forming apparatus 10 by having the processor read and execute a control program stored in the storage unit 28.

[0027] The storage unit 28 is, for example, a hard disk drive (HDD) or a solid state drive (SSD). The storage unit 28 may include a random access memory (RAM) and a read only memory (ROM). The storage unit 28 stores various data and a control program for controlling the operation of each unit of the image forming apparatus 10. The control program is executed by the control unit 31. In addition, the image read by the image reading unit 11 is written as read data to a predetermined data area of ​​the storage unit 28.

[0028] Continuing, the voice recognition process executed by the control unit 31 will be described with reference to Fig. 1 to Fig. 3. Fig. 3 is a diagram showing a command list L of the image forming apparatus 10 according to this embodiment.

[0029] 1 to 3, a plurality of process types L1 and process conditions L2 are stored in the storage unit 28. Specifically, a command list L corresponding to the image forming apparatus 10 is stored in the storage unit 28. The command list L specifies a plurality of process types L1 that can be executed by the image forming apparatus 10 and a plurality of process conditions L2.

[0030] The process type L1 indicates the type of process that can be executed by the image forming apparatus 10. The process type L1 corresponds to the main feature (main function) of the image forming apparatus 10. The process type L1 is, for example, scan, copy, fax, and send.

[0031] The processing conditions L2 are specific execution conditions when any of the processing types L1 is executed. The processing conditions L2 correspond to sub-features (sub-functions) of the image forming apparatus 10. The processing conditions L2 include, for example, a setting of whether or not to perform color copying, the number of processing sections, the copy size, and the copy magnification.

[0032] The control unit 31 executes a voice recognition process. As shown in Fig. 2, the control unit 31 has an acquisition unit 32 and an output unit 33. By executing a control program, the control program realizes the functions of the acquisition unit 32 and the output unit 33.

[0033] The acquisition unit 32 acquires voice. Specifically, the acquisition unit 32 acquires the voice of the user collected by the microphone 26. The voice collected by the microphone 26 includes the voice of the user and environmental noise present around the user.

[0034] The output unit 33 outputs commands based on the user's voice acquired by the acquisition unit 32 using the process type L1 and the process condition L2. This eliminates communication time when adding or changing instructions. Specifically, the memory unit 28 stores multiple process types L1 and process conditions L2 corresponding to the image forming apparatus 10, allowing commands for operating the image forming apparatus 10 to be output based on the user's voice. Furthermore, because the memory unit stores multiple executable process types and process conditions, voice recognition processing can be simplified, and a voice recognition function can be implemented in the image forming apparatus 10. In other words, implementing a voice recognition function in the image forming apparatus 10 reduces the communication time required for converting the user's voice into a command. As a result, the response time of the image forming apparatus 10 can be shortened. Furthermore, because commands can be displayed on the display unit 21, the user can quickly change or add commands after visually confirming them. In this embodiment, a command refers to a syntax consisting of a dedicated instruction word for operating the image forming apparatus 10 and a time condition for executing the process.

[0035] The control unit 31 controls the display unit 21 to display a confirmation of at least one of the changes and additions for the command. This allows the user to execute the process of the image forming apparatus 10 without using their own hands to operate the operation unit 22. Specifically, the user can visually confirm the voice command.

[0036] When at least one of a change and an addition is made based on confirmation on the display unit 21, the acquisition unit 32 acquires new voice uttered by the user. This allows the user to easily execute the processing of the image forming device 10. Therefore, the user can continue to change or add commands by voice.

[0037] The output unit 33 extracts multiple words from the speech using a trained model that estimates speech. This allows the output unit 33 to extract multiple words from the speech picked up by the microphone 26. Specifically, the output unit 33 can remove unnecessary noise from the picked up speech and estimate unclear parts of the picked up speech. Therefore, the output unit 33 can extract only the user's speech from the picked up speech with high accuracy.

[0038] The output unit 33 uses named entity recognition to output a command from the plurality of words. This allows the output unit 33 to output a command related to the operation of the image forming device 10 from the collected voice. Specifically, the output unit 33 can output a command including the type of process to be executed by the image forming device 10, the execution conditions, and the start time of the process.

[0039] The processing types L1 include scan, copy, fax, and send. The processing conditions L2 include color, number of copies, size, and magnification. This allows commands to be easily output from the user's voice. Therefore, the user can operate the multifunction device by voice.

[0040] Next, the processing executed by the control unit 31 will be described in detail with reference to FIGS. 4 to 10. FIG. 4 is a flowchart of the voice recognition processing executed by the control unit 31 of the image forming apparatus 10 according to this embodiment. FIG. 5 is a flowchart of the word extraction processing executed during the voice recognition processing. FIG. 6 is a flowchart of the command setting processing executed during the voice recognition processing. FIG. 7 is a diagram showing a first image G1 displayed on the display unit 21 of the image forming apparatus 10 according to this embodiment. Specifically, the first image G1 is an image on the display unit 21 indicating completion of command setting. FIG. 8 is a diagram showing a second image G2 displayed on the display unit 21 of the image forming apparatus 10 according to this embodiment. Specifically, the second image G2 is an image on the display unit 21 showing an example of a command being set in the middle of being set. FIG. 9 is a diagram showing a third image G3 displayed on the display unit 21 of the image forming apparatus 10 according to this embodiment. Specifically, the third image G3 is an image on the display unit 21 showing another example of a command being set in the middle of being set. FIG. 10 is a diagram showing a fourth image G4 displayed on the display unit 21 of the image forming apparatus 10 according to this embodiment. In detail, the fourth image G4 is an image of the display unit 21 indicating that no command exists.

[0041] 4, the processing of the control unit 31 includes steps S1 to S5. Steps S1 to S5 are performed by the processor of the control unit 31 executing a program stored in the storage unit 28. In step S1, the control unit 31 reads various pieces of information. The processing proceeds to step S2.

[0042] In step S2, control unit 31 performs a word extraction process. Specifically, control unit 31 collects a voice uttered by the user via microphone 26 and extracts a plurality of words related to the operation of image forming apparatus 10. The process proceeds to step S3.

[0043] In step S3, control unit 31 performs a command setting process. Specifically, control unit 31 selects a command required for processing by image forming apparatus 10 from the extracted multiple words. Based on the selected multiple words, control unit 31 sets a command for causing image forming apparatus 10 to execute the processing. In step S3, it is determined whether the command needs to be changed or added. The process proceeds to step S4.

[0044] In this embodiment, a command is composed of a unit command and a start command. The unit command is composed of a processing type L1 (see FIG. 3) which is a main feature, and a processing condition L2 (see FIG. 3) which is a sub-feature. In other words, the unit command is a word related to processing by the image forming apparatus 10 which is listed in the command list L. The start command is a word indicating the start of processing, such as start or start.

[0045] In step S4, the control unit 31 outputs the set command to each operation unit. Each operation unit to which the command is input executes the processing content defined in the command. The processing proceeds to step S5.

[0046] In step S5, the control unit 31 causes the display unit 21 to display the completion of the command execution by the image forming apparatus 10. The process then ends.

[0047] 7, in step S5, the display unit 21 displays a first image G1 indicating that the command has been set. The first image G1 includes a plurality of icons and a plurality of display areas.

[0048] Each of the multiple icons functions as a button for receiving instructions for the image forming apparatus 10. The multiple icons are turned on by user operation. The multiple icons include a first icon 41, a second icon 42, a third icon 43, a fourth icon 44, a fifth icon 45, a sixth icon 46, and a seventh icon 47 (see FIG. 10 ). The first icon 41 receives an instruction to execute copying to the image forming unit 12. The second icon 42 receives an instruction to execute transmission to the NW communication unit 25. The third icon 43 receives an instruction to stop an ongoing process. The fourth icon 44 receives a command set based on the user's voice or an instruction by operating an icon to start execution. The fifth icon 45 receives an instruction to end the current process and start accepting voice instructions to execute a new process. The sixth icon 46 receives an instruction to end a process. The seventh icon 47 receives an instruction to refer to the command list L.

[0049] Each of the multiple display areas functions as a response display unit for a user's voice instruction. The multiple display areas include a first area 51, a second area 52, a third area 53, and a fourth area 54 (see FIG. 8). The first area 51 displays the acquired user's voice instruction. The second area 52 displays the response content from the image forming device 10. The third area 53 displays the content of the set command. The fourth area 54 displays an inquiry regarding whether the set command needs to be changed or added.

[0050] Next, the word extraction process (step S2) will be described. As shown in Fig. 5, the process of control unit 31 includes steps S21 to S25. Steps S21 to S25 are executed by the processor of control unit 31 executing a program stored in storage unit 28.

[0051] In step S21, the control unit 31 determines whether or not there is a user's voice operating the image forming apparatus 10. If the control unit 31 determines that there is no user's voice (No in step S21), the process ends. If the control unit 31 determines that there is a user's voice (Yes in step S21), the process proceeds to step S22.

[0052] In step S22, the acquisition unit 32 acquires the user's voice collected via the microphone 26. The process proceeds to step S23. The voice acquired via the microphone 26 includes environmental noise and the like in addition to the user's voice.

[0053] In step S23, the output unit 33 collects the user's voice including noise and extracts multiple words from the collected voice. As shown in FIG. 2, the memory unit 28 stores a machine learning trained model 29 that detects only the user's voice from the collected voice. The trained model 29 may employ a DNN (Deep Neural Network) as a model. In particular, a RNN (Recurrent Neural Network) model is preferable. The RNN may also be a LSTM (Long Short-Term Memory). The trained model 29 estimates the user's voice, which has become unclear due to the removal of noise.

[0054] Next, the output unit 33 uses natural language processing to extract multiple meaningful words from the user's voice from which noise has been removed. Specifically, the output unit 33 extracts multiple words from the user's voice through morphological analysis, syntactic analysis, semantic analysis, and context analysis. The process proceeds to step S24.

[0055] 5, in step S24, the output unit 33 recognizes a command from a plurality of words. Specifically, the output unit 33 recognizes a command from a plurality of words extracted using named entity recognition. The command includes a unit command and a start command. The process proceeds to step S25.

[0056] In step S25, the output unit 33 outputs the recognized command, and the process proceeds to step S3.

[0057] Next, the command setting process (step S3) will be described. As shown in Fig. 6, the process of control unit 31 includes steps S31 to S38. Steps S31 to S38 are executed by the processor of control unit 31 executing a program stored in storage unit 28.

[0058] In step S31, the control unit 31 determines whether the image forming apparatus 10 can execute the command. Whether the command can be executed is determined based on the words written in the command list L. If the control unit 31 determines that the command cannot be executed (No in step S31), the process proceeds to step S36. If the control unit 31 determines that the command can be executed (Yes in step S31), the process proceeds to step S32.

[0059] In step S32, the control unit 31 sets a command as an instruction from the user, and the process proceeds to step S33.

[0060] In step S33, the control unit 31 displays the set command in the second area 52 (see FIG. 8). As shown in FIG. 8, the display unit 21 displays a second image G2 showing an example of a command before it has been set. The second image G2 includes multiple icons, similar to the first image G1. For example, if the user's instruction is to "make four color copies," then "Color" and "4Part" are displayed in the third area 53, which corresponds to the command display area. As shown in FIG. 6, the process proceeds to step S34.

[0061] In step S34, the control unit 31 determines whether the user has changed and / or added commands. As shown in FIG. 8, a query regarding whether the user has changed and / or added commands is displayed in the fourth area 54. As shown in FIG. 6, if the control unit 31 determines that the user has changed and / or added commands (No in step S34), the process returns to step S2 (see FIG. 4). The user again issues voice instructions to the image forming apparatus 10.

[0062] As shown in FIG. 9, the display unit 21 displays a third image G3 showing another example of a command before it has been set. Similar to the first image G1, the third image G3 includes multiple icons. For example, when adding an instruction to "Perform EcoPrint" to a command, the user vocalizes the condition to be added. The control unit 31 displays "Enable EcoPrint and Make Poster Print" in the first area 51, which corresponds to the request display area. The control unit 31 also displays "EcoPrint: On" in the third area 53.

[0063] As shown in FIG. 6, if the control unit 31 determines that no command has been changed and / or added (Yes in step S34), the process proceeds to step S35.

[0064] In step S35, the control unit 31 determines whether or not the user has performed a process execution operation. If the control unit 31 determines that the user has not performed a process execution operation (No in step S35), the process returns to step S33. If the control unit 31 determines that the user has performed a process execution operation (Yes in step S35), the process returns to step S4 (see FIG. 4). The process execution operation is the user turning on the fourth icon 44. If a start command is present, the control unit 31 determines that the user has performed a process execution operation.

[0065] If the result of step S31 is No, the control unit 31 displays a warning in step S36, and the process proceeds to step S37.

[0066] As shown in FIG. 10, in step S36, the display unit 21 displays a fourth image G4. Like the first image G1, the fourth image G4 includes multiple icons. For example, if the user requests "Collect 5 Part Black," which does not exist in the processing conditions L2 of the image forming device 10, the control unit 31 indicates in the second area 52 that the user's request does not exist in the processing conditions L2 of the image forming device 10. The control unit 31 displays a seventh icon 47 in the second area 52 that accepts an instruction to refer to the command list L.

[0067] 6, in step S37, the control unit 31 determines whether or not there is a request to display the command list L. If the control unit 31 determines that there is no request to display the command list L (No in step S37), the processing ends. If the control unit 31 determines that there is a request to display the command list L (Yes in step S37), the processing proceeds to step S38.

[0068] In step S38, the control unit 31 displays the command list L on the display unit 21. The process returns to step S2 (see FIG. 4).

[0069] Furthermore, the processing of the control unit 31 of this embodiment can be similarly performed for scanning, faxing, or transmission. FIG. 11 is a diagram showing a fifth image G5 displayed on the display unit 21 of the image forming apparatus 10 according to this embodiment. The fifth image G5 is displayed on the display unit 21 when the user selects the fax function and the image reading unit 11 reads the image to be sent. The fifth image G5 includes multiple icons. The multiple icons include a first button icon A1. The first button icon A1 accepts an instruction for pixelation processing. The pixelation processing for a fax image is omitted because it is the same as the pixelation processing of the scanned data SC described with reference to FIGS. 4 to 10.

[0070] The embodiments of the present invention have been described above with reference to the drawings. However, the present invention is not limited to the above embodiments and can be embodied in various forms without departing from the spirit of the present invention. The drawings mainly show each component in a schematic manner to facilitate understanding, and the thickness, length, number, spacing, etc. of each component shown in the drawings may differ from the actual ones due to the convenience of creating the drawings. Furthermore, the speed, material, shape, dimensions, etc. of each component shown in the above embodiments are merely examples and are not particularly limited, and various modifications are possible within a range that does not substantially deviate from the configuration of the present invention.

[0071] (1) As described with reference to Figures 1 to 10, microphone 26 is arranged in the same area as operation and display unit 23, but the present invention is not limited to this. Microphone 26 may be arranged in an area separate from operation and display unit 23, or may be separate from image forming device 10.

[0072] (2) As described with reference to Figures 1 to 10, image forming device 10 is capable of scanning, copying, faxing, and sending, but the present invention is not limited to this. Image forming device 10 only needs to be able to perform at least one type of processing in response to a user's voice, and may also be able to perform processing types other than scanning, copying, faxing, and sending.

[0073] (3) As described with reference to Figures 1 to 10, image forming device 10 is capable of executing color, number of copies, size, and magnification, but the present invention is not limited to this. Image forming device 10 only needs to be able to execute at least one processing condition in response to user voice input, and may be able to execute processing conditions other than color, number of copies, size, and magnification.

[0074] (4) As described with reference to Figures 1 to 10, the trained model 29 is an RNN, but the present invention is not limited to this. The trained model 29 may be an SVM (Support Vector Machine), a CNN (Convolutional Neural Network), or another trained model. [Industrial Applicability]

[0075] The present invention provides an image forming apparatus and has industrial applicability. [Explanation of symbols]

[0076] 10: Image forming device 21:Display section 23:Display section 28: Storage section 29: Trained model 32: Acquisition part 33: Output section L1: Processing type L2: Processing conditions

Claims

1. a storage unit that stores a plurality of executable process types and process conditions; an acquisition unit that acquires audio; an output unit that outputs a command from the speech acquired by the acquisition unit using the process type and the process condition; a display unit that displays the command; An image forming apparatus comprising:

2. The image forming apparatus according to claim 1 , wherein the display unit displays a confirmation of at least one of a change and an addition for the command.

3. The image forming apparatus according to claim 2 , wherein the acquisition unit acquires new audio when at least one of the change and the addition is performed after the confirmation display on the display unit.

4. The image forming apparatus according to claim 1 , wherein the output unit extracts a plurality of words from the speech using a trained model that estimates the speech.

5. The image forming apparatus according to claim 4 , wherein the output unit outputs the command from the plurality of words using named entity recognition.

6. 3. The image forming apparatus according to claim 1, wherein the plurality of processing types include scanning, copying, faxing, and sending, and the processing conditions include color, number of copies, and size.

Citation Information

Patent Citations

  • Voice operation system, voice operation method, and voice operation program

    JP2020091448A