Image forming apparatus
The image forming apparatus addresses user identification and simultaneous job processing by recognizing user voices and setting execution orders, ensuring efficient job execution even with multiple users.
Patent Information
- Application Number
- JP2021110864
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-07-02
- Publication Date
- 2025-07-23
- Estimated Expiration
- 2041-07-02
AI Technical Summary
Conventional image forming apparatuses with voice operation systems lack user identification, allowing multiple users to simultaneously instruct different jobs, leading to processing challenges.
An image forming apparatus equipped with an audio input interface, memory, and processor that recognizes user voice inputs, identifies speakers, and sets execution orders for multiple jobs based on user information and function databases, enabling smooth processing of simultaneous voice instructions.
Enables smooth execution of multiple jobs from multiple users by setting parallel and serial execution orders based on user priorities and capabilities, ensuring efficient job processing even with simultaneous voice commands.
Smart Images

Figure 0007712125000001 
Figure 0007712125000002 
Figure 0007712125000003
Abstract
Description
Technical Field
[0001] Embodiments of the present invention relate to an image forming apparatus.
Background Art
[0002] Conventionally, for image forming apparatuses such as digital multi-function peripherals, voice operation systems have been proposed that enable operations such as job execution instructions to be given by voice using voice recognition. However, many of the voice operation systems applied to conventional image forming apparatuses do not have a function of identifying the speaker who executes the voice operation. For this reason, image forming apparatuses such as digital multi-function peripherals to which a voice operation system is applied have a problem that anyone can instruct job execution or the like by voice.
[0003] In addition, by providing a function for identifying a user in the voice operation system, it becomes possible to confirm the usage rights for each individual user. However, since the image forming apparatus receives instructions by voice, it is easy for a plurality of users to instruct a plurality of different jobs simultaneously. For this reason, an image forming apparatus that can smoothly process a plurality of jobs from a plurality of users even when a plurality of users instruct jobs by voice simultaneously is desired.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] The problem to be solved by the present invention is to provide an image forming apparatus that can smoothly operate a job instructed by a user by voice.
Means for Solving the Problems
[0006] According to an embodiment, an image forming apparatus includes an audio input interface and a memory and a processor. The audio input interface acquires input audio input by a microphone. The memory includes a storage area for storing a user information database that associates voice data, function names, and function IDs for each user, and a storage area for storing a function database that stores setting values associated with the function IDs. The processor recognizes Based on the user information database an instruction given by voice function name from the input audio acquired by the audio input interface and identifies a speaker from the input audio. Based on the function database, identify the content of the job corresponding to the combination of the function name recognized from the input voice and the speaker identified, When acquiring audio uttered by a plurality of speakers during the same period, the processor sets each an execution order of a plurality of jobs recognized from the audio uttered by the plurality of speakers Based on the content of each job corresponding to the combination of each function name and speaker and executes the plurality of jobs in the set execution order.
Brief Description of the Drawings
[0007]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Modes for Carrying Out the Invention
[0008] Hereinafter, this embodiment will be described with reference to the drawings. First, the configuration of the digital multi-functional peripheral (MFP) 1 as an image forming apparatus according to the embodiment will be described. FIG. 1 is a block diagram showing a configuration example of the digital multi-functional peripheral 1 as an image forming apparatus according to the embodiment. As shown in FIG. 1, the digital multi-functional peripheral 1 includes a scanner 2, a printer 3, and an operation panel 4. Further, the digital multi-functional peripheral 1 includes a microphone 6 for inputting audio and a speaker 7 for outputting audio.
[0009] The scanner 2 is installed on the upper part of the main body of the digital multi-functional peripheral. The scanner 2 is a device that optically reads an image of a document. The scanner 2 includes a control unit 20 and an image reading unit 21. The image reading unit 21 reads an image of a document set on the document table glass. Further, the image reading unit 21 reads an image of a document conveyed by an automatic document feeder (ADF).
[0010] The control unit 20 of the scanner 2 controls the scanner 2. The control unit 20 is composed of a processor, a memory, and the like. The control unit 20 realizes various processes by the processor executing a program stored in the memory. For example, the control unit 20 executes a scanning process by the image reading unit 21 in response to an operation instruction from the system control unit 5.
[0011] The printer 3 forms an image on a medium such as paper. The printer 3 includes a control unit 30 and an image forming unit 31. The image forming unit 31 forms an image on the paper taken out from the paper feed cassette. The image forming unit 31 may form an image by any image forming method. For example, when the image forming unit 31 is an electrophotographic method, a developer image is formed on an image carrier such as a photosensitive drum, and the developer image on the image carrier is transferred. Further, when the image forming unit 31 is an inkjet method, an image is formed on the paper by ink ejected from an inkjet head.
[0012] The control unit 30 of the printer 3 is in charge of controlling the printer 3. The control unit 30 is composed of a processor, a memory, etc. The control unit 30 realizes various processes by the processor executing the programs stored in the memory. For example, the control unit 30 executes an image forming process (printing process) by the image forming unit 31 in response to an operation instruction from the system control unit 5.
[0013] The operation panel 4 is a user interface. The operation panel 4 has a control unit 40, a display unit (display) 41, a touch panel 42, and operation buttons 43. The display unit 41 displays operation guides and the like. The touch panel 42 is provided on the display screen of the display unit 41. The touch panel 42 detects the part touched by the user on the display screen of the display unit 41.
[0014] The control unit 40 of the operation panel 4 is in charge of controlling the operation panel 4. The control unit 40 is composed of a processor, a memory, etc. The control unit 40 realizes various processes by the processor executing the programs stored in the memory. For example, the control unit 40 controls the display of the display unit 41 in response to an instruction from the system control unit 5.
[0015] The system control unit 5 controls the entire MFP1. The system control unit 5 has a processor 50, a ROM 51, a RAM 52, a storage device 53, a communication interface (I / F) 54, an interface 55, and an interface 56, etc.
[0016] The processor 50 realizes various processing functions by executing programs. The processor 50 is, for example, a CPU. The processor 50 is connected to the control unit 20 of the scanner 2, the control unit 30 of the printer 3, and the control unit 40 of the operation panel 4 via an interface.
[0017] The RAM 52 functions as a working memory or a buffer memory. The ROM 51 is a non-rewritable non-volatile memory. The ROM 51 functions as a program memory for storing programs. The processor 50 realizes various processing functions by executing the programs stored in the ROM 51 or the storage device 53 using the RAM 52.
[0018] The storage device 53 is a rewritable non-volatile memory. For example, the storage device 53 is composed of a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage device 53 stores data such as control data, control programs, and setting information.
[0019] The storage device 53 has storage areas 531, 532, and 533. The storage area 531 stores various programs. For example, the storage area 531 stores a voice recognition program for recognizing the content of voice and a person identification (person authentication) program for identifying the speaker from the voice. The processor 50 recognizes the voice input from the microphone 6 or the like by executing the voice recognition program. Also, the processor 50 performs personal (authentication) identification to identify the person who uttered the input voice by executing the person identification program.
[0020] The storage area 532 stores a user information database for storing information (user information) about a pre-registered user (registrant). The storage area 533 stores a registered function database for storing information about the functions to be executed by voice recognition set by the registrant. The user information stored in the storage area 532 and the information stored in the storage area 533 will be described in detail later.
[0021] The communication interface 54 is an interface for performing data communication with an external device. For example, the communication interface 54 communicates with user terminals such as a PC and a mobile terminal via a network. The communication interface 54 may be configured to input voice information for instructing execution of a job such as printing an image (print job) from a user terminal such as a PC.
[0022] The interface 55 connects the microphone 6 for inputting voice. The interface 55 is an example of a voice input interface. The interface 55 is an interface for acquiring the voice (input voice) input by the microphone 6. The processor 50 acquires the voice input to the microphone 6 via the interface 55. When the microphone is the microphone 106 connected to the user terminal 101, the communication interface 54 functions as a voice input interface.
[0023] The interface 56 connects the speaker 7 for outputting voice. The interface 56 is an example of a voice output interface. The interface 56 is an interface for outputting the voice signal of the voice emitted by the speaker 7. The processor 50 outputs the voice signal of the voice emitted by the speaker 7 via the interface 56. When the speaker is the speaker 107 connected to the user terminal 101, the communication interface 54 functions as a voice output interface.
[0024] FIG. 2 is a diagram schematically showing a configuration example of a processing system in which the user terminal 101 is connected to the digital multifunction machine 1. In the network system shown in FIG. 2, a plurality of user terminals 101 are connected to the digital multifunction machine 1. Each user terminal 101 may be a personal computer (PC) or a mobile terminal such as a smartphone or a tablet PC. The user terminal 101 includes a microphone 106 and a speaker 107. The microphone 106 and the speaker 107 may be provided in the user terminal 101 or may be connected via an interface.
[0025] The digital multi-function device 1 receives an execution instruction for a job from each user terminal 101. For example, the digital multi-function device 1 acquires an execution instruction for a job by voice input to the microphone 106 of the user terminal 101. Also, the digital multi-function device 1 may output the execution content of the job by voice from the speaker 107 according to the recognition result of the voice input to the microphone 106 of the user terminal 101.
[0026] Next, the operation by voice recognition of the digital multi-function device 1 as an image forming apparatus according to the embodiment will be described. FIG. 3 is a diagram showing a configuration example of a user information database (DB) stored in the storage area 532 of the digital multi-function device 1. The user information stored in the user information database of the storage area 532 is information about a registrant who gives an execution instruction for an operation (job) by voice to the digital multi-function device 1. The digital multi-function device 1 permits the execution of a job by voice instruction for a user in whom user information is registered in the user information database. Also, the digital multi-function device 1 has a function of restricting the processes permitted to the user based on the information stored in the user information DB.
[0027] In the example shown in FIG. 3, the user information database stores information such as user ID, user name, voice data, execution authority, upper limit of usage amount, function ID, function name, and priority for each user as user information. The user ID is identification information for identifying the user. The user name is the name of the user. The voice data is voice data for person identification for identifying the user from the input voice. The voice data may be feature data of the voice extracted from the voice. The execution authority is information indicating the functions permitted to be executed by the digital multi-function device 1 for the user. The upper limit of the usage amount is information indicating the usage amount or usage conditions permitted for the user.
[0028] The function ID and function name are information indicating functions (voice execution functions) to be executed in the voice registered by the user. The function ID is identification information for identifying the voice execution function registered by the user. The function name is the name of the voice execution function registered by the user. The priority is information indicating the priority related to the execution of jobs instructed by the user. The priority may be the priority order set serially, or may be information (group name, job title, etc.) for determining the priority order.
[0029] For example, a user with a user ID of "USER1" has a user name of "AAAA" and the authority to execute jobs such as Copy, Scan, and Print. Also, the user of "USER1" is limited to 100 color prints and has no limit on the number of monochrome prints. Furthermore, the user of "USER1" registers a function with a function name of "Economical Copy" and a function ID of "FUNC1" as a registered function (registered function) that can be executed by voice instruction. Also, since the priority of the user of "USER1" is "1", the job is executed prior to other users with higher priority.
[0030] Also, in the example shown in FIG. 3, a user with a user ID of "USER2" has a user name of "BBBB" and the authority to execute Copy and Print. Also, the user of "USER2" is limited to 50 color prints and 50 monochrome prints. Furthermore, the user of "USER2" registers a function with a function name of "Copy for Meeting Materials" and a function ID of "FUNC2" as a registered function (registered function) that can be executed by voice instruction. Also, since the priority of the user of "USER2" is "2", the execution order of the job is set with higher priority after the user with a priority of "1".
[0031] FIG. 4 is a diagram showing a configuration example of a function database (DB) stored in the storage area 533 of the digital multifunction device 1. The function database stored in the storage area 533 shown in FIG. 4 stores information regarding functions (voice execution functions) that the digital multi-function device 1 can execute based on voice instructions from the user. The digital multi-function device 1 identifies the voice execution function to be executed in response to a voice instruction from the user identified by voice speaker identification from the information registered in the function database.
[0032] In the example shown in FIG. 4, the function database stores information such as a function ID, a function name, and setting values. The function ID is identification information for identifying a voice execution function. The function name is the name of the voice execution function registered by the user. The setting value is setting information indicating the content of the voice execution function.
[0033] In the example shown in FIG. 4, the voice execution function with the function ID "FUNC1" has a function name of "Economical Copy" and is a copy job of the execution content indicated by the setting value. Specifically, the setting value of the function with the function ID "FUNC1" is that the color mode is monochrome, the density is automatic, the paper is A4, the duplex mode is from single-sided to double-sided, and the Nin1 mode is 2in1. Thus, the voice execution function with the function ID "FUNC1" is set to a copy job that prints the image of the original on both sides of A4 paper in 2in1 with automatic monochrome density setting.
[0034] Also, the function with the function ID "FUNC2" has a function name of "Copy for Meeting Materials" and is a copy job of the execution content indicated by the setting value. The setting value of the function with the function ID "FUNC2" is that the color mode is color, the density is automatic, the paper is A4, the duplex mode is from single-sided to double-sided, and the Nin1 mode is "none". Thus, the voice execution function with the function ID "FUNC2" is set to a copy job that prints the image of the original on both sides of A4 paper with automatic color density setting.
[0035] Next, the registration process of the voice execution function that the user instructs to execute by voice in the digital multi-function device 1 will be described. FIG. 5 is a flowchart for explaining an operation example of the registration process of the voice execution function that the user executes by voice in the digital multi-function device 1. First, the processor 50 of the digital multi-function machine 1 receives a registration process for a voice execution function for the user in response to a voice instruction from the user. A user who has already registered user information instructs the digital multi-function machine 1 to register a function of instructing execution by voice toward the microphone 6 or the microphone 106 of the user terminal 101. The digital multi-function machine 1 acquires, as input voice, a voice instruction instructing the registration of the voice execution function issued by the user. The digital multi-function machine 1 recognizes the input voice to recognize the registration instruction of the voice execution function, and registers the voice execution function with the recognized content.
[0036] The processor 50 acquires (ACT11) voice (input voice) including a registration instruction of the voice execution function input by the user to the microphone 6 (or the microphone 106). When the input voice is acquired, the processor 50 performs voice recognition and person identification on the input voice.
[0037] That is, the processor 50 recognizes the content of the input voice by executing a voice recognition program (ACT12). The processor 50 executes processing according to the content of the input voice recognized by voice recognition. Here, it is assumed that the content of the input voice acquired in ACT11 is a registration instruction of the voice execution function.
[0038] In addition, the processor 50 identifies (ACT13) the speaker of the input voice by executing a person identification program. Here, the processor 50 identifies which user the speaker of the input voice is registered in the user information database. For example, the processor 50 calculates the similarity between the feature amount of the input voice and the feature amount of the voice data (voice data for person identification) of each user registered in the user information database. When there is voice data whose similarity to the feature amount of the input voice is equal to or greater than a predetermined value, the processor 50 determines that the user of the voice data is the speaker of the input voice.
[0039] If the processor 50 cannot identify that the speaker of the input voice is a user who has already registered voice data in the user information database (ACT14, NO), the registration process of the function is terminated.
[0040] When it can be determined that the speaker of the input voice is a user registered in the user information database (ACT14, YES), the processor 50 executes registration of the voice execution function for the user (ACT15). For example, the processor 50 acquires an input voice including the content of the voice execution function that the user issues toward the microphone 6. The processor 50 recognizes the content of the voice execution function from the voice generated by the user by executing a voice recognition program.
[0041] The processor 50 specifies the content of the voice execution function instructed by the user from the recognition result of the input voice. If the content of the specified voice execution function is a function that the user can perform, the processor 50 issues a function ID for the voice execution function. The processor 50 registers the issued function ID and function name in the user information database as the user information of the user. In addition, the processor 50 determines a setting value indicating the content of the specified voice execution function, and registers the setting value indicating the content of the voice execution function in the function database in association with the function ID and the function name.
[0042] For example, assume that a registered user issues a voice toward the microphone 6 saying "Register a function in the MFP", "The function name is 'Economical Copy', register it in duplex, monochrome, and 2in1". Then, the processor 50 has the microphone 6 collect the voice that the user has said "Register a function in the MFP" from the microphone 6, and inputs the voice collected by the microphone 6 as an input voice. The processor 50 recognizes that the content of the input voice is "Register a function in the MFP" by executing a voice recognition program. In addition, the processor 50 specifies the user who is the speaker of the input voice by executing a person identification program.
[0043] Furthermore, the processor 50 identifies the content of the voice execution function "The function name is 'Economical Copy', double-sided, monochrome, 2in1, registered" from the input voice by voice recognition. If the content of the identified voice execution function is a function that can be performed by the user, the processor 50 issues a function ID. The processor 50 registers the issued function ID and function name in the user information database in association with the user. In addition, the processor 50 registers the setting value indicating the content of the identified voice execution function in the function database in association with the function ID and function name.
[0044] Next, the operation in which the digital multifunction peripheral 1 as an image forming apparatus according to the embodiment executes processing in response to a voice instruction from the user will be described. FIG. 6 is a flowchart for explaining an operation example in which the digital multifunction peripheral 1 as an image forming apparatus according to the embodiment executes various functions in response to a voice instruction from the user. The processor 50 of the digital multifunction peripheral 1 executes the processing of the job instructed by each user in response to a voice instruction from the user. A user who has registered user information voices the job to be executed by the digital multifunction peripheral 1 toward the microphone 6 or the microphone 106 of the user terminal 101. The digital multifunction peripheral 1 acquires, as input voice, the voice instruction instructing the execution of the job uttered by the user. The digital multifunction peripheral 1 recognizes the input voice to recognize the content of the voice instruction, and accepts the execution of the job with the recognized content.
[0045] The processor 50 acquires (ACT111), via the interface 55, the voice (input voice) including the job execution instruction input by the user to the microphone 6 (or the microphone 106). For example, the user voices the content of the job. Specifically, the user voices the content of the job by uttering "Copy double-sided, monochrome, 2in1" in voice. In addition, the user may voice the execution of a function registered as a voice execution function. For example, by uttering "Economical Copy" in voice, the execution of the voice execution function registered with the function name "Economical Copy" is instructed in voice.
[0046] When the processor 50 acquires the input voice through the interface 55, it performs voice recognition and person identification on the input voice. The processor 50 recognizes the content of the input voice by executing a voice recognition program (ACT112). Here, assume that the content of the input voice acquired in ACT11 is an instruction to execute a job.
[0047] Also, the processor 50 identifies the user (speaker) of the input voice by executing a person identification program (ACT113). For example, the processor 50 identifies the speaker based on the similarity between the feature amount of the input voice and the feature amounts of the voice data (voice data for person identification) of each user registered in the user information database.
[0048] If the processor 50 cannot identify that the speaker of the input voice is a user registered in the user information database (ACT114, NO), it does not accept the execution of the job. However, as an operation, it may also accept jobs with specific functions for unregistered users (users not recognized as registered users). In this case, if the content of the job recognized from the input voice is a job content permitted for the unregistered user, the processor 50 may execute the processing after ACT115.
[0049] If it can be identified that the speaker of the input voice is a user registered in the user information database (ACT114, YES), the processor 50 checks the execution authority of the user (ACT115). The processor 50 determines whether the content of the job recognized from the input voice includes a function for which the user does not have the execution authority. For example, if the content of the job recognized from the input voice includes a function for which the user does not have the execution authority, the processor 50 determines that there is no execution authority for the job. If it is determined that the user does not have the execution authority (ACT115, NO), the processor 50 aborts the execution of the job instructed by the input voice.
[0050] When it is determined that there is the right to execute the voice - instructed job (ACT115, YES), the processor 50 determines whether the voice - instructed job is within the upper limit of the usage amount set for the user (ACT116). The processor 50 calculates the usage amount of the user when the voice - instructed job is executed. The processor 50 determines whether the calculated usage amount is within the upper limit of the usage amount set for the user. When it is determined that the usage amount exceeds the upper limit due to the execution of the voice - instructed job (ACT116, NO), the processor 50 aborts the execution of the voice - instructed job.
[0051] When it is determined that the usage amount is within the upper limit even if the voice - instructed job is executed (ACT116, YES), the processor 50 determines whether a plurality of jobs are instructed from a plurality of users simultaneously (ACT117). When a job is instructed by voice, it is assumed that another user instructs another job before the voice instruction is completed.
[0052] The voice instruction of a job for the digital multi - function machine 1 takes time from when one user starts speaking until the speaking ends. On the other hand, the processor 50 of the digital multi - function machine 1 recognizes the voices emitted by a plurality of users simultaneously for each voice emitted by each user. Thereby, even when a plurality of users instruct jobs by voice simultaneously, the digital multi - function machine 1 can receive the voice instructions of jobs from a plurality of users.
[0053] When receiving a plurality of jobs from a plurality of users with voice input simultaneously (ACT117), the processor 50 sets a processing procedure (execution order) for executing the plurality of jobs (ACT118). The processor 50 sets the execution order of the processes to be executed in parallel and the processes to be executed serially as the processing procedure for executing the plurality of jobs instructed from a plurality of speakers simultaneously.
[0054] The processor 50 identifies processes that can be executed in parallel for a plurality of jobs. The processor 50 sets the processing procedures of the plurality of jobs so as to execute in parallel the processes that can be executed in parallel. For example, the processor 50 sets the processing procedures so as to execute in parallel the process using the scanner 2 (scan job) and the process using the printer 3 (print job). When a first user issues a scan job by voice instruction, the processor 50 sets to execute the print job instructed by a second user at the same time in parallel with the scan job of the first user.
[0055] Also, the processor 50 sets the execution order for processes to be executed serially in a plurality of jobs. For example, a plurality of print jobs instructed by a plurality of users cannot be executed in parallel because one printer is used. Therefore, the processor 50 sets the execution order for serially executing a plurality of print jobs instructed by a plurality of users.
[0056] The processor 50 sets the execution order based on the priority set for each user who has given voice instructions for a plurality of jobs. In the example shown in FIG. 3, the user with the user ID "USER1" (referred to as user 1) has a priority of "1" and the user with the user ID "USER1" (referred to as user 2) has a priority of "2". Therefore, when user 1 and user 2 give voice instructions for jobs to be executed serially at the same time, the processor 50 sets the execution order to execute the job of user 2 after the job of user 1.
[0057] Also, the processor 50 determines the execution content for each job received by voice instruction (ACT119). When receiving a job from one user, the processor 50 sets the execution content of the job according to the content of the voice instruction by the user and the default settings.
[0058] Also, when receiving a plurality of jobs from a plurality of users, the processor 50 determines the execution content of each job so that the execution results of the plurality of jobs for each user are easy to understand. For example, when receiving a plurality of print jobs from a plurality of users at the same time, the processor 50 sets a paper output method for each print job of each user.
[0059] As a specific example, when the printer 3 has a plurality of output trays, the processor 50 sets the execution content of each job so that the results of the print jobs of each user are output to different output trays. Thereby, the results of the print jobs instructed from a plurality of users at the same time can be output to different output trays. Also, when the output tray of the printer 3 has a movable configuration, the processor 50 sets the execution content of each job so that the output tray is moved for each output of the results of the print jobs of each user. Thereby, the results of the print jobs instructed from a plurality of users at the same time can be output to different locations (or orientations) on the output tray.
[0060] After determining the execution content of each job received by voice instruction, the processor 50 outputs the voice indicating the execution content from the speaker 7 (ACT120). For example, when the processor 50 determines the execution content for a plurality of jobs from a plurality of users at the same time, the processor 50 outputs the voice indicating the execution order and execution content of each job from the speaker 7. Thereby, the user who instructed the job by voice can confirm the content of the job executed according to the voice recognition result by voice. Also, after determining the execution content of each job received by voice instruction, the processor 50 executes each job with the set execution content in the set execution order (ACT121).
[0061] According to the above processing, the digital multifunction machine according to the embodiment recognizes the content of the job instructed by voice from the input voice and identifies the user of the input voice. When the digital multifunction machine acquires voice instructions issued by a plurality of users at the same time, the digital multifunction machine sets an execution order for the plurality of jobs instructed by the plurality of users by voice. According to the embodiment, even when a plurality of users give voice instructions simultaneously, the jobs instructed by each user can be executed smoothly.
[0062] In addition, the digital multi-function machine according to the embodiment sets the execution order so as to execute in parallel the processes that can be executed in parallel among the plurality of jobs instructed by a plurality of users by voice at the same time. As a result, even for jobs instructed by different users, the processes that can be executed in parallel are executed in parallel, so that a plurality of jobs can be processed smoothly.
[0063] In addition, the digital multi-function machine according to the embodiment sets the execution order based on the priorities set for each user for the plurality of jobs instructed by a plurality of users by voice at the same time. Thereby, the plurality of jobs instructed by a plurality of users can be executed in the order of the preset priorities, and the plurality of jobs can be processed smoothly.
[0064] In addition, the digital multi-function machine according to the embodiment is set to output the results of the plurality of jobs instructed by a plurality of users by voice at the same time by different output methods. Thereby, it is possible to make it easy to distinguish the plurality of jobs instructed by a plurality of users at the same time for each user.
[0065] In addition, the digital multi-function machine according to the embodiment may set an upper limit number of jobs that can be executed for the plurality of jobs recognized from the voices uttered by a plurality of speakers at the same time. When the number of jobs recognized from the voices uttered by a plurality of speakers at the same time exceeds the upper limit number, the processor 50 makes the jobs exceeding the predetermined number unexecutable.
[0066] In this case, the processor 50 causes the speaker 7 to output the unexecutable jobs by voice via the interface 56. In addition, the processor 50 may display information indicating the unexecutable jobs on the display unit of the operation panel 4 or the like. In addition, the processor 50 may record information indicating the unexecutable jobs in a storage device or the like as log information. As a result, the user can recognize the job that has become unexecutable because the upper limit number of cases has been exceeded.
[0067] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalent scope thereof. Hereinafter, the content described in the claims of the present application at the time of filing is appended. [1] a voice input interface for acquiring input voice input by a microphone, a processor that recognizes the content of the job instructed by voice from the input voice acquired by the voice input interface, identifies the speaker from the input voice, and when acquiring voices emitted by a plurality of speakers in the same period, sets the execution order of the plurality of jobs recognized from the voices emitted by the plurality of speakers, and executes the plurality of jobs in the set execution order; An image forming apparatus having the above. [2] The processor sets an execution order for executing in parallel the processes that can be executed in parallel among the plurality of jobs. The image forming apparatus according to [1]. [3] The processor sets the execution order of the plurality of jobs according to the priority set for each of the plurality of speakers. The image forming apparatus according to any one of [1] or [2]. [4] When the plurality of jobs include a plurality of print jobs, the processor sets different paper discharge methods for the plurality of print jobs. The image forming apparatus according to any one of [1] to [3]. [5] Furthermore, it has a voice output interface for outputting a voice signal output by a speaker, and the processor causes the speaker to output, via the voice output interface, a voice indicating the execution content of the plurality of jobs recognized from the voices emitted by the plurality of speakers in the same period. The image forming apparatus according to any one of [1] to [4].
Description of Reference Numerals
[0068] 1... Digital multi-function peripheral (MFP, image forming apparatus), 2... Scanner, 3... Printer, 4... Operation panel, 5... System control unit, 6... Microphone, 7... Speaker, 20... Control unit, 21... Image reading unit, 30... Control unit, 31... Image forming unit, 50... Processor, 53... Storage device, 54... Communication interface, 55... Interface (voice input interface), 56... Interface (voice output interface), 101... User terminal, 106... Microphone, 107... Speaker.
Claims
1. An audio input interface for acquiring input audio input by a microphone; A memory including a storage area for storing a user information database that stores information associating audio data, function names, and function IDs for each user, and a storage area for storing a function database that stores setting values associated with the function IDs; A processor that recognizes a function name instructed by voice based on the user information database from the input audio acquired by the audio input interface, identifies a speaker from the input audio, specifies the content of a job corresponding to a combination of the function name recognized from the input audio and the identified speaker based on the function database, and when acquiring audio emitted by a plurality of speakers simultaneously, sets an execution order of a plurality of jobs based on the content of each job corresponding to a combination of the function name and the speaker recognized from each audio emitted by the plurality of speakers, and executes the plurality of jobs in the set execution order; An image forming apparatus having the above.
2. The processor sets an execution order for executing in parallel processes that can be executed in parallel among the plurality of jobs based on the content of each job corresponding to a combination of the function name and the speaker recognized from each audio emitted by the plurality of speakers. The image forming apparatus according to Claim 1.
3. The user information database further stores a priority associated with a function name for each user. The processor sets the execution order of the plurality of jobs according to the priority corresponding to a combination of the function name and the speaker recognized from each audio emitted by the plurality of speakers. The image forming apparatus according to any one of Claims 1 or 2.
4. When the plurality of jobs include a plurality of print jobs, the processor sets different paper discharge methods for the plurality of print jobs based on the content of each job corresponding to a combination of the function name and the speaker recognized from each audio emitted by the plurality of speakers. The image forming apparatus according to any one of Claims 1 to 3.
5. Furthermore, it has an audio output interface for outputting an audio signal output by a speaker. The processor causes a speaker to output, via the audio output interface, an audio indicating the content of each job corresponding to a combination of the function name and the speaker recognized from each audio emitted by the plurality of speakers simultaneously. The image forming apparatus according to any one of Claims 1 to 4.
Citation Information
Patent Citations
Printing apparatus, printing system, printing method, job processing method, storage medium, and program
JP2005161841A
Device and system for processing image
JP2007076316A
Electronic device and speech operation program
JP2007171534A
Printer, control method of printer, and program
JP2016035514A
Image formation apparatus, image formation system, image formation method and program
JP2018187801A