Job content generation device and job content generation program

Abstract

This job content generation device for generating, on the basis of voice data indicating voice received by a smart speaker, job content to be executed by an image formation device corrects at least one of a plurality of setting values in the job content if the plurality of setting values in the job content are a combination such that these setting values cannot be simultaneously set, so that the resulting combination of a plurality of setting values in the job content can be simultaneously set (S73).

Description

Technical Field

[0001] The present invention relates to a job content generation device and a job content generation program that generate the content of a job to be executed by an image forming apparatus based on voice data indicating the voice received by a voice reception device that receives the voice input from a user.

Background Art

[0002] Conventionally, a voice operation system for operating an image forming apparatus via a smart speaker as a voice reception device is known (see, for example, Patent Document 1). When the voice operation system described in Patent Document 1 generates the content of a job based on voice data indicating the voice received by the smart speaker, if the generated job content is not executable by the image forming apparatus, an error is notified from the smart speaker.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the voice operation system described in Patent Document 1, when the content of a job generated based on voice data indicating the voice received by the smart speaker is not executable by the image forming apparatus, an error is always notified from the smart speaker, so there is a problem that it cannot be said that it is highly convenient for the user.

[0005] Therefore, an object of the present invention is to provide a job content generation device and a job content generation program that can improve convenience.

[0006] A job content generation device according to one aspect of the present invention is a job content generation device that generates the content of a job to be executed by an image forming apparatus based on voice data indicating voice received by a voice reception device, and includes a processor, and a control unit that functions as a job content generation unit that, when the processor executes a job content generation program, corrects at least one of the multiple setting values ​​in the content to a setting value that is part of a predetermined combination that can be set simultaneously, if the multiple setting values ​​in the content are in a predetermined combination that cannot be set simultaneously.

[0007] With this configuration, the job content generation device according to one aspect of the present invention can improve convenience by automatically correcting at least one of the multiple setting values ​​in the job content so that, in cases where a combination of multiple setting values ​​in the job content cannot be set simultaneously, the combination becomes one in which multiple setting values ​​in the job content can be set simultaneously.

[0008] A job content generation device according to one aspect of the present invention may generate the content using a machine learning model based on the voice data.

[0009] With this configuration, the job content generation device according to one aspect of the present invention corrects at least one of the multiple setting values ​​in the job content so that, if there is a combination in which multiple setting values ​​in the job content cannot be set simultaneously, the combination becomes such that multiple setting values ​​in the job content can be set simultaneously. Therefore, even if the job content is incorrectly generated in the process of generating the job content using a machine learning model based on voice data, the job content can be corrected.

[0010] In a job content generation device according to one aspect of the present invention, if a combination of multiple setting values ​​in the content cannot be set simultaneously, the device may correct at least one of the multiple setting values ​​in the content based on the state of the image forming apparatus so that a combination can be made in which multiple setting values ​​in the content can be set simultaneously.

[0011] With this configuration, the job content generation device according to one aspect of the present invention corrects at least one of a plurality of setting values ​​in the job content based on the state of the image forming apparatus, thereby improving the appropriateness of the corrected job content.

[0012] A job content generation device according to one aspect of the present invention may perform the correction using the information transmitted from the image forming device by requesting the image forming device to transmit information indicating the status of the image forming device, and if it is determined that the combination is predetermined and cannot be set, and if it is possible to correct to the appropriate combination even without the information, the device may perform the correction without obtaining the information from the image forming device without making the request to the image forming device, and without using the information.

[0013] With this configuration, the job content generation device according to one aspect of the present invention can omit the process of acquiring information from the image forming apparatus, even though the information indicates the state of the image forming apparatus and is not necessary for correcting the job content.

[0014] In a job content generation device according to one aspect of the present invention, if a plurality of the setting values ​​in the content include a copy job setting value as the setting value that the type of job is copy, and a setting value that the source of the file used for the job is an external storage device attached to the image forming apparatus, the copy job setting value may be corrected to a setting value that the type of job is print when the external storage device is actually attached to the image forming apparatus.

[0015] With this configuration, a job content generation device according to one aspect of the present invention, when multiple setting values ​​in the job content include a copy job setting value indicating that the job type is copy, and a setting value indicating that the source of the files used for the job is an external storage device attached to the image forming apparatus, corrects the copy job setting value to a setting value indicating that the job type is print when an external storage device is actually attached to the image forming apparatus, thereby improving the appropriateness of the corrected job content.

[0016] In a job content generation device according to one aspect of the present invention, if a plurality of setting values ​​in the content include a setting value indicating that the type of job is a copy, a document size setting value indicating the size of the document to be used in the job, and a paper size setting value indicating the size of the paper on which the image will be printed in the job, the device may make a correction to swap the size indicated by the document size setting value and the size indicated by the paper size setting value if the size of the document actually set in the image forming device is the size indicated by the paper size setting value and not the size indicated by the document size setting value.

[0017] With this configuration, a job content generation device according to one aspect of the present invention, when the multiple setting values ​​in the job content include a setting value indicating that the job type is a copy, a setting value indicating the size of the original document to be used in the job, and a setting value indicating the size of the paper on which the image will be printed in the job, performs a correction by swapping the size indicated by the original size setting value and the size indicated by the paper size setting value when the size of the original document actually set in the image forming apparatus is the size indicated by the paper size setting value and not the size indicated by the original size setting value, thereby improving the appropriateness of the corrected job content.

[0018] In a job content generation device according to one aspect of the present invention, if a plurality of the setting values ​​in the content include a copy job setting value as the setting value indicating that the type of job is copy, and a setting value indicating the file name of the file to be used for the job, the copy job setting value may be corrected to the setting value indicating that the type of job is print.

[0019] With this configuration, the job content generation device according to one aspect of the present invention can improve convenience by automatically correcting the copy job setting value to a setting value indicating that the job type is print when the multiple setting values ​​in the job content include a copy job setting value indicating that the job type is copy and a setting value indicating the file name of the file to be used in the job.

[0020] In a job content generation device according to one aspect of the present invention, if a plurality of setting values ​​in the content include a setting value indicating that the type of job is document transmission, a transmission method setting value indicating the type of document transmission method, and a transmission encryption setting value indicating the type of encryption at the time of document transmission, and the type of encryption indicated in the transmission encryption setting value does not correspond to the type of transmission method indicated in the transmission method setting value, the transmission encryption setting value may be corrected to correspond to the type of transmission method indicated in the transmission method setting value.

[0021] With this configuration, a job content generation device according to one aspect of the present invention can improve convenience when, in the case where multiple setting values ​​in the job content include a setting value indicating that the job type is document transmission, a transmission method setting value indicating the type of document transmission method, and a transmission encryption setting value indicating the type of encryption at the time of document transmission, the encryption type indicated in the transmission encryption setting value does not correspond to the transmission method type indicated in the transmission method setting value, and the encryption type indicated in the transmission encryption setting value corresponds to the transmission method type indicated in the transmission method setting value.

[0022] A job content generation program according to an aspect of the present invention causes a computer to function as a job content generation unit that generates the content of a job to be executed by an image forming apparatus based on audio data indicating audio received by an audio reception device that receives audio, and when a plurality of setting values in the content are a predetermined combination in which they cannot be set simultaneously, the job content generation unit corrects at least one of the plurality of setting values in the content to a setting value that is a predetermined combination in which they can be set simultaneously.

[0023] With this configuration, a computer that executes a job content generation program according to an aspect of the present invention corrects at least one of the plurality of setting values in the job content so that the plurality of setting values in the job content are in a combination in which they can be set simultaneously when the combination of the plurality of setting values in the job content is a combination in which they cannot be set simultaneously, thus improving convenience.

Effect of the Invention

[0024] According to the job content generation device and the job content generation program according to the present invention, convenience can be improved.

Brief Description of the Drawings

[0025] [Figure 1] It is a block diagram of an audio operation system according to an embodiment of the present invention. [Figure 2] It is a block diagram of the job content generation device shown in FIG. 1 when the job content generation device is constituted by one computer. [Figure 3] It is a diagram showing an example of information for determining inappropriate job content shown in FIG. 2. [Figure 4] It is a block diagram of the job instruction generation device shown in FIG. 1 when the job instruction generation device is constituted by one computer. [Figure 5] It is a block diagram of the image forming apparatus shown in FIG. 1 in the case of an MFP. [Figure 6]Figure 1 is a sequence diagram of the operation of the voice control system when the image forming apparatus is operated via a smart speaker. [Figure 7] Figure 6 is a sequence diagram of the "job content determination" process. [Figure 8] Figure 7 shows the "job execution" sequence diagram. [Modes for carrying out the invention]

[0026] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0027] First, the configuration of a voice-operated system according to one embodiment of the present invention will be described.

[0028] Figure 1 is a block diagram of the voice control system 10 according to this embodiment.

[0029] As shown in Figure 1, the voice control system 10 includes a job content generation device 30 and a job command generation device 40. A smart speaker 20 is connected to the voice control system 10 as a voice reception device that receives voice input from the user. The voice control system 10 may also include at least one other smart speaker with a similar configuration to the smart speaker 20.

[0030] The job content generation device 30 generates the content of a job to be executed by the image forming apparatus described later (hereinafter referred to as "job content") based on voice data indicating voice received by the smart speaker. The job content generation device 30 may be composed of one computer or multiple computers.

[0031] The job command generation device 40 generates job commands (hereinafter referred to as "job commands") that can be interpreted by the image forming apparatus described later, based on the job content generated by the job content generation device 30. The job command generation device 40 may be composed of one computer or multiple computers. The voice operation system 10 may also include at least one other job command generation device with a configuration similar to that of the job command generation device 40.

[0032] The voice control system 10 is connected to an image forming apparatus 50, such as a dedicated printer or an MFP (Multifunction Peripheral). In addition to the image forming apparatus 50, at least one more image forming apparatus with a configuration similar to the image forming apparatus 50 may be connected to the voice control system 10.

[0033] The smart speaker 20 can communicate with the job content generation device 30 via a network 11, such as the internet.

[0034] In the voice control system 10, the job content generation device 30 communicates with the job command generation device 40 via a network 11, such as the Internet.

[0035] The image forming apparatus 50 can communicate with any of the job command generation devices within the same network, such as a LAN (Local Area Network). For example, the image forming apparatus 50 can communicate with the job command generation device 40 within the same network 12. That is, the job command generation device 40 is located within network 12. On the other hand, the job content generation device 30 is located outside network 12 because it is connected to the job command generation device 40 via a different network 11, such as the Internet, as described above.

[0036] Figure 2 is a block diagram of the job content generation device 30 when the job content generation device 30 is configured by a single computer.

[0037] As shown in Figure 2, the job content generation device 30 includes an operation unit 31, which is an operation device such as a keyboard or mouse into which various operations are input; a display unit 32, which is a display device such as an LCD (Liquid Crystal Display) that displays various information; a communication unit 33, which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly via wired or wireless connection without going through a network; a storage unit 34, which is a non-volatile storage device such as a semiconductor memory or HDD (Hard Disk Drive) that stores various information; and a control unit 35 that controls the entire job content generation device 30.

[0038] The memory unit 34 stores a job content generation program 34a for generating job content based on voice data. The job content generation program 34a may be installed in the job content generation device 30 during the manufacturing stage, or it may be additionally installed in the job content generation device 30 from an external storage medium such as a USB (Universal Serial Bus) memory, or it may be additionally installed in the job content generation device 30 from a network.

[0039] The memory unit 34 stores a text data conversion model 34b, which is a machine learning model for converting audio data into text data, and a job content conversion model 34c, which is a machine learning model for converting text data into job content.

[0040] The memory unit 34 stores inappropriate job content determination information 34d, which is information used to determine inappropriate job content.

[0041] Figure 3 shows an example of information 34d used to determine inappropriate job content.

[0042] As shown in Figure 3, the information 34d for determining inappropriate job content indicates, for each inappropriate combination, a predetermined combination of multiple setting values ​​that cannot be set simultaneously in the job content (hereinafter referred to as "inappropriate combination"), the priority order for determining which inappropriate combination applies, and a method for correcting the inappropriate combination. The combination of setting values ​​indicated by the method for correcting the inappropriate combination is an example of a predetermined combination that can be set simultaneously in the job content.

[0043] For example, the inappropriate job content determination information 34d shown in Figure 3 includes an inappropriate combination (hereinafter referred to as "inappropriate combination A") in which multiple setting values ​​in the job content include a setting value indicating that the job type is copy (hereinafter referred to as "copy job setting value") and a setting value indicating that the source of the files used in the job is a USB memory as an external storage device attached to the image forming apparatus (hereinafter referred to as "source setting value"). In the inappropriate job content determination information 34d shown in Figure 3, the copy job setting value is expressed as "Job type: copy". In the inappropriate job content determination information 34d shown in Figure 3, the source setting value is expressed as "Source: USB memory".

[0044] Furthermore, for example, the inappropriate job content determination information 34d shown in Figure 3 includes multiple setting values ​​in the job content, which include a copy job setting value, a setting value indicating the size of the original document used for the job (hereinafter referred to as the "original size setting value"), and a setting value indicating the size of the paper on which the image will be printed in the job (hereinafter referred to as the "paper size setting value"), and includes an inappropriate combination (hereinafter referred to as "inappropriate combination B") in which the size of the original document actually set in the image forming apparatus is not the size indicated by the original size setting value.

[0045] Furthermore, for example, the inappropriate job content determination information 34d shown in Figure 3 includes an inappropriate combination (hereinafter referred to as "inappropriate combination C") in which multiple setting values ​​in the job content include a copy job setting value and a setting value indicating the file name of the file used in the job (hereinafter referred to as "file name setting value").

[0046] Furthermore, for example, the inappropriate job content determination information 34d shown in Figure 3 includes multiple setting values ​​in the job content, which include a setting value indicating that the job type is document transmission (hereinafter referred to as "transmission job setting value"), a setting value indicating the type of document transmission method (hereinafter referred to as "transmission method setting value"), and a setting value indicating the type of encryption used when transmitting the document (hereinafter referred to as "transmission encryption setting value"), and includes an inappropriate combination (hereinafter referred to as "inappropriate combination D") in which the type of encryption shown in the transmission encryption setting value does not correspond to the type of transmission method shown in the transmission method setting value. In the inappropriate job content determination information 34d shown in Figure 3, the transmission job setting value is expressed as "Job type: Transmission".

[0047] Regarding priority, for example, since the priority of inappropriate combination C is lower than that of inappropriate combinations A and B, whether or not a combination falls under inappropriate combination C is determined only if it does not fall under either inappropriate combination A or B.

[0048] In the inappropriate job content determination information 34d shown in Figure 3, the method for correcting inappropriate combination A is to correct the copy job setting value to the setting value that indicates the job type is print (hereinafter referred to as the "print job setting value") when a USB memory is actually installed in the image forming apparatus. In the inappropriate job content determination information 34d shown in Figure 3, the print job setting value is represented as "Job type: Print".

[0049] In the inappropriate job content determination information 34d shown in Figure 3, the method for correcting inappropriate combination B is to swap the size indicated in the document size setting value with the size indicated in the paper size setting value when the size of the document actually set in the image forming apparatus is the size indicated in the paper size setting value.

[0050] In the inappropriate job content determination information 34d shown in Figure 3, the method for correcting inappropriate combination C is to correct the copy job setting value to the print job setting value.

[0051] In the inappropriate job content determination information 34d shown in Figure 3, the method for correcting inappropriate combination D is to correct the encryption type shown in the transmission encryption setting value to one that corresponds to the transmission method type shown in the transmission method setting value.

[0052] The control unit 35 shown in Figure 2 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory) that stores programs and various data, and a RAM (Random Access Memory) used as a working area for the CPU of the control unit 35. The CPU of the control unit 35 executes programs stored in the storage unit 34 or the ROM of the control unit 35.

[0053] The control unit 35 functions as a job content generation unit 35a that generates job content based on voice data by executing the job content generation program 34a.

[0054] Figure 4 is a block diagram of the job instruction generation device 40 when the job instruction generation device 40 is configured by a single computer.

[0055] As shown in Figure 4, the job instruction generation device 40 includes an operation unit 41 which is an operation device such as a keyboard or mouse into which various operations are input, a display unit 42 which is a display device such as an LCD that displays various information, a communication unit 43 which is a communication device that communicates with external devices via a network such as a LAN or the Internet, or directly by wired or wireless connection without going through a network, a storage unit 44 which is a non-volatile storage device such as a semiconductor memory or HDD that stores various information, and a control unit 45 which controls the entire job instruction generation device 40.

[0056] The memory unit 44 stores a job instruction generation program 44a for generating job instructions based on job content. The job instruction generation program 44a may be installed in the job instruction generation device 40 during the manufacturing stage, or it may be additionally installed in the job instruction generation device 40 from an external storage medium such as a USB memory, or it may be additionally installed in the job instruction generation device 40 from a network.

[0057] The control unit 45 includes, for example, a CPU, a ROM that stores programs and various data, and RAM as memory used as a workspace for the CPU of the control unit 45. The CPU of the control unit 45 executes programs stored in the storage unit 44 or the ROM of the control unit 45.

[0058] The control unit 45 functions as a job instruction generation unit 45a that generates job instructions based on the job content by executing a job instruction generation program 44a.

[0059] The job command generation unit 45a performs a process to correct at least one of the multiple setting values ​​in the content of a job to be executed by the image forming apparatus 50 to a setting value that can be set simultaneously in a predetermined combination, if the multiple setting values ​​in the content are in a predetermined combination that cannot be set simultaneously.

[0060] Figure 5 is a block diagram of the image forming apparatus 50 when the image forming apparatus 50 is an MFP (Multifunction Printer).

[0061] As shown in Figure 5, the image forming apparatus 50 includes an operation unit 51 which is an operation device such as buttons into which various operations are input; a display unit 52 which is a display device such as an LCD which displays various information; a printer 53 which is a printing device which prints images onto a recording medium such as paper; a scanner 54 which is a reading device which reads images from an original document; a USB port 55; a communication unit 56 which is a communication device which communicates with external devices via a network such as a LAN or the Internet, or directly by wired or wireless connection without going through a network; a fax communication unit 57 which is a fax device which communicates faxes with an external facsimile device (not shown) via a communication line such as a public telephone line; a storage unit 58 which is a non-volatile storage device such as a semiconductor memory or HDD which stores various information; and a control unit 59 which controls the entire image forming apparatus 50.

[0062] The memory unit 58 stores a job execution program 58a for executing jobs. The job execution program 58a may be installed in the image forming apparatus 50 during the manufacturing stage, or it may be additionally installed in the image forming apparatus 50 from an external storage medium such as a USB memory, or it may be additionally installed in the image forming apparatus 50 from a network.

[0063] The control unit 59 includes, for example, a CPU, a ROM that stores programs and various data, and RAM as memory used as a workspace for the CPU of the control unit 59. The CPU of the control unit 59 executes programs stored in the storage unit 58 or the ROM of the control unit 59.

[0064] The control unit 59 functions as a job execution unit 59a that executes a job by running the job execution program 58a.

[0065] Next, we will describe the operation of the voice control system 10 when the image forming apparatus is operated via a smart speaker.

[0066] In the following description, the smart speaker that accepts voice commands for operating the image forming apparatus is assumed to be the smart speaker 20. Furthermore, the image forming apparatus that is the target of the voice commands received by the smart speaker 20 is assumed to be the image forming apparatus 50.

[0067] Figure 6 is a sequence diagram of the operation of the voice control system 10 when the image forming apparatus 50 is operated via the smart speaker 20. Figure 7 is a sequence diagram of the "job content determination" shown in Figure 6. Figure 8 is a sequence diagram of the "job execution" shown in Figure 7.

[0068] The user inputs voice commands into the smart speaker 20 indicating the operation they want to perform on the image forming apparatus 50.

[0069] When voice input is received, the smart speaker 20 accepts the voice input to itself, as shown in Figures 6 to 8 (S61).

[0070] When the smart speaker 20 completes the processing in S61, it transmits voice data indicating the voice received in S61 to the job content generation device 30 (S62).

[0071] For example, if a user inputs the voice command "copy on both sides" into the smart speaker 20, the smart speaker 20 sends voice data indicating the voice command "copy on both sides" to the job content generation device 30 (S62).

[0072] In S62, when voice data is transmitted from the smart speaker 20, the job content generation unit 35a of the job content generation device 30 converts the voice data transmitted from the smart speaker 20 into text data using the text data conversion model 34b (S63).

[0073] When the processing in S63 is completed, the job content generation unit 35a converts the text data generated in S63 into job content using the job content conversion model 34c (S64).

[0074] For example, if voice data indicating "copy on both sides" is transmitted from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating "copy on both sides" into job content that includes the content "job type: copy" and "print side: double-sided" (S63-S64). Here, "print side: double-sided" is the setting value that prints on both sides of the paper on which the image will be printed in the job. That is, the job content generation unit 35a uses predetermined keywords as setting values ​​related to each setting item that constitutes the job (for example, "job type", "print side", "source", "original size", "file name", "transmission method", "encryption method", "destination", etc.). For example, for the setting item "job type", the keywords are "copy", "print", "transmit", etc. Also, for the setting item "print side", the keywords are "double-sided", "single-sided", etc. For the setting item "source", the keywords are "USB memory", "user box", etc. For the setting item "original size", the keywords are "A4", "A3", "B4", etc. The system stores the following: For example, if the setting item is "File name", it stores "File A", "File B", etc. If the setting item is "Sending method", it stores "FTP sending", etc. If the setting item is "Encryption method", it stores "FTP encryption", "E-mail encryption", etc. If the setting item is "Recipient", it stores "Taro", "Jiro", etc. The system then determines whether the voice data contains the keyword, and if the keyword is contained, it further determines the setting item corresponding to the word indicated by the keyword, thereby converting the voice data into components that make up the job content, such as "Job type: Copy" or "Print side: Double-sided".

[0075] Furthermore, for example, if voice data indicating "Print the files on the USB memory" is transmitted from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating "Print the files on the USB memory" into job content that includes "Job type: Print" and "Source: USB memory" (S63-S64). However, the job content generation unit 35a may also mistakenly convert it into job content that includes "Job type: Copy" and "Source: USB memory" (S63-S64).

[0076] Furthermore, for example, if voice data indicating the voice "Copy from A4 to A3" is transmitted from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating the voice "Copy from A4 to A3" into job content that includes the contents "Job type: Copy", "Document size: A4", and "Paper size: A3" (S63-S64). However, the job content generation unit 35a may also mistakenly convert it into job content that includes the contents "Job type: Copy", "Document size: A3", and "Paper size: A4" (S63-S64). Here, "Document size: A3" is a document size setting value indicating that the size of the document set in the image forming apparatus is A3 size. "Document size: A4" is a document size setting value indicating that the size of the document set in the image forming apparatus is A4 size. "Paper size: A3" is a paper size setting value indicating that the size of the paper on which the image is printed in the job is A3 size. "Paper size: A4" is a paper size setting that indicates the size of the paper on which the image will be printed in the job is A4 size.

[0077] Furthermore, for example, if voice data indicating the voice "Copy file A" is sent from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating the voice "Copy file A" into job content that includes the content "Job type: Copy" and "File name: File A". Here, "File name: File A" is a file name setting value that indicates that the file name of the file to be used for the job is "File A".

[0078] Furthermore, for example, if voice data indicating the voice message "Encrypt the image and send the document to Taro via FTP" is sent from the smart speaker 20 to the job content generation device 30, the job content generation unit 35a of the job content generation device 30 converts the voice data indicating the voice message "Encrypt the image and send the document to Taro via FTP" into job content that includes the following: Job type: Send, Sending method: FTP Send, Encryption method: FTP Encryption, and Recipient: Taro (S64). However, the job content generation unit 35a may also mistakenly convert it into job content that includes the following: Job type: Send, Sending method: FTP Send, Encryption method: E-mail Encryption, and Recipient: Taro (S64). Here, "Recipient: Taro" is a setting value that indicates "Taro" as the recipient of the document. "Sending method: FTP Send" is a sending method setting value that indicates FTP Send as the type of document sending method. "Encryption method: FTP Encryption" is a sending encryption setting value that indicates "FTP Encryption" as the type of encryption when sending the document. "Encryption Method: Email Encryption" is a transmission encryption setting value that indicates "Email Encryption" as the type of encryption used when sending a document.

[0079] When the processing in S64 is completed, the job content generation unit 35a requests the job command generation unit 40 to transmit information indicating the status of the image forming apparatus 50 (S65).

[0080] When the job command generation unit 45a of the job command generation device 40 receives a request in S65 from the job content generation device 30 to transmit information indicating the status of the image forming apparatus 50, it requests the image forming apparatus 50 to transmit information indicating the status of the image forming apparatus 50 (S66).

[0081] When the job command generation device 40 requests in S66 for the image forming apparatus 50 to transmit information indicating the status of the image forming apparatus 50, the job execution unit 59a of the image forming apparatus 50 transmits information indicating the status of the image forming apparatus 50 to the job command generation device 40 (S67). For example, the job execution unit 59a transmits to the job command generation device 40 the following information indicating the status of the image forming apparatus 50: whether or not a USB memory is inserted into the USB port 55, whether or not a document is set in the scanner 54, and, if a document is set in the scanner 54, information indicating the size of the document set in the scanner 54 (S67).

[0082] For example, the image forming apparatus 50 determines that a USB memory is connected to the USB port 55 if its control unit 59 can communicate with the USB memory via the USB port 55. The control unit 59 also determines whether a document is set in the scanner 54 based on a document detection signal received from a sensor that detects whether a document is placed on the document scanning platform (for example, a flatbed or the document placement platform of an automatic document feeder) of the scanner 54. Alternatively, the control unit 59 stores size information received by an operation unit (provided by the image forming apparatus 50) that inputs size information indicating the size of the recording paper stored in the paper feed cassette, and detects the size of the recording paper stored in the paper feed cassette used for printing based on the stored size information.

[0083] When the job command generation unit 45a of the job command generation device 40 receives information indicating the status of the image forming apparatus 50 from the image forming apparatus 50 in S67, it transmits the information indicating the status of the image forming apparatus 50 that was transmitted from the image forming apparatus 50 in S67 to the job content generation device 30 (S68).

[0084] In S68, the job content generation unit 35a of the job content generation device 30 receives information indicating the status of the image forming apparatus 50 transmitted from the job command generation device 40. Based on the job content generated in S64, the received information indicating the status of the image forming apparatus 50, and the inappropriate job content determination information 34d, it determines whether the job content generated in S64 is inappropriate (S69).

[0085] For example, if the job content generation unit 35a generates a job content in S64 that includes the content "Job type: Copy" and "Source: USB memory", then in S69 it determines that the job content generated in S64 is inappropriate because it falls under the aforementioned inappropriate combination A.

[0086] Furthermore, for example, if the job content generation unit 35a generates a job content in S64 that includes the following information: "Job type: Copy", "Document size: A3", and "Paper size: A4", and "A4" is transmitted from the job command generation unit 40 in S68 as the size of the document set in the image forming apparatus 50, then the job content generated in S64 falls under the aforementioned inappropriate combination B, and therefore, in S69, it is determined that the job content generated in S64 is inappropriate.

[0087] Furthermore, for example, if the job content generation unit 35a generates a job content in S64 that includes the content "Job type: Copy" and "File name: File A", then in S69 it is determined that the job content generated in S64 is inappropriate because it falls under the aforementioned inappropriate combination C.

[0088] Furthermore, for example, if the job content generation unit 35a generates a job content in S64 that includes the following information: "Job type: Send", "Sending method: FTP transmission", "Encryption method: E-mail encryption", and "Recipient: Taro", then the job content generated in S64 falls under the aforementioned inappropriate combination D, and therefore, in S69, it is determined that the job content generated in S64 is inappropriate.

[0089] If the job content generation unit 35a determines in S69 that the job content generated in S64 is inappropriate, it determines whether the job content generated in S64 can be corrected (S70) based on the job content generated in S64, information indicating the status of the image forming apparatus 50 received from the job command generation device 40 (S68), and inappropriate job content determination information 34d.

[0090] For example, if the job content generation unit 35a generates a job content in S64 that includes the content "Job type: Copy" and "Source: USB memory," then in S68, information indicating that a USB memory is not installed in the image forming apparatus 50 is transmitted from the job command generation unit 40. Upon receiving this information, in S70, based on the inappropriate job content determination information 34d, the unit determines that the job content generated in S64 cannot be corrected.

[0091] In S70, if the job content generation unit 35a determines that the job content generated in S64 cannot be corrected, the job content generation unit 35a notifies the smart speaker 20 of the error (S71).

[0092] When the smart speaker 20 receives notification of an error from the job content generation device 30 in S71, it outputs the error notified in S71 from the job content generation device 30 as an audio (S72).

[0093] Furthermore, if the job content generation unit 35a determines in S70 that the job content generated in S64 is correctable, it corrects the job content generated in S64 based on the job content generated in S64, the information indicating the status of the image forming apparatus 50 transmitted from the job command generation device 40 in S68, and the inappropriate job content determination information 34d (S73).

[0094] For example, if the job content generation unit 35a generates a job content in S64 that includes the content "Job type: Copy" and "Source: USB memory," and in S68 the job command generation unit 40 transmits that a USB memory is installed in the image forming apparatus 50, the job content generated in S64 that includes the content "Job type: Copy" and "Source: USB memory" is corrected to a job content that includes the content "Job type: Print" and "Source: USB memory" based on the "Correction method" of the inappropriate job content determination information 34d.

[0095] Furthermore, for example, if the job content generation unit 35a generates a job content in S64 that includes "Job type: Copy", "Document size: A3", and "Paper size: A4", and "A4" is transmitted from the job command generation unit 40 in S68 as the size of the document set in the image forming apparatus 50, the job content generated in S64 that includes "Job type: Copy", "Document size: A3", and "Paper size: A4" is corrected to a job content that includes "Job type: Copy", "Document size: A4", and "Paper size: A3" based on the "Correction method" of the inappropriate job content determination information 34d.

[0096] Furthermore, for example, if the job content generation unit 35a generates a job content in S64 that includes the content "Job type: Copy" and "File name: File A", it corrects the job content generated in S64 that includes the content "Job type: Copy" and "File name: File A" to a job content that includes the content "Job type: Print" and "File name: File A" based on the "Correction method" of the inappropriate job content determination information 34d.

[0097] Furthermore, for example, if the job content generation unit 35a generates a job content in S64 that includes the content "Job type: Send", "Sending method: FTP transmission", "Encryption method: E-mail encryption", and "Recipient: Taro", it corrects the job content generated in S64 that includes the content "Job type: Send", "Sending method: FTP transmission", "Encryption method: E-mail encryption", and "Recipient: Taro", based on the "correction method" of the inappropriate job content determination information 34d, to a job content that includes the content "Job type: Send", "Sending method: FTP transmission", "Encryption method: FTP encryption", and "Recipient: Taro".

[0098] If the job content generation unit 35a determines in S69 that the job content generated in S64 is not inappropriate, or if the processing in S73 is completed, it transmits the job content determined to be inappropriate in S69, or the job content corrected in S73, to the job command generation device 40 (S74).

[0099] The transmission method in S74 can be any method that enables the transmission of job content from the job content generation device 30 to the job command generation device 40. For example, if a publish-subscription type messaging service is used as the transmission method in S74, the job content generation unit 35a can transmit the job content by publishing a message containing the job content. Similarly, if a publish-subscription type messaging service is used as the transmission method in S74, the job command generation unit 45a of the job command generation device 40 can receive the job content by subscribing to the published message.

[0100] In S74, when the job content is transmitted from the job content generation device 30, the job command generation unit 45a of the job command generation device 40 converts the job content transmitted from the job content generation device 30 into a job command that can be interpreted by the image forming apparatus 50, that is, a job command in a format that can be accepted by the interface provided by the image forming apparatus 50 (S75).

[0101] When the processing in S75 is completed, the job instruction generation unit 45a transmits the job instruction generated in S75 to the image forming apparatus 50 (S76).

[0102] The transmission method in S76 can be any method that enables the transmission of job commands from the job command generation device 40 to the image forming apparatus 50. For example, if the Web service interface provided by the image forming apparatus 50 is used as the transmission method in S76, the job command generation unit 45a transmits the job command by calling this Web service. Also, if the Web service interface provided by the image forming apparatus 50 is used as the transmission method in S76, the job execution unit 59a of the image forming apparatus 50 receives the job command transmitted by calling this Web service.

[0103] When the job execution unit 59a of the image forming apparatus 50 receives a job command from the job command generation device 40 in S76, it executes the job in accordance with the job command received from the job command generation device 40 in S76 (S77).

[0104] As explained above, the job content generation device 30 improves convenience by correcting at least one of the multiple setting values ​​in the job content so that the combination of multiple setting values ​​in the job content can be set simultaneously, when the combination cannot be set simultaneously (S73). For example, the job content generation device 30 improves convenience by correcting the copy job setting value to a print job setting value when the multiple setting values ​​in the job content include a copy job setting value and a file name setting value. Also, for example, the job content generation device 30 improves convenience by correcting the encryption type shown in the transmission encryption setting value to one that corresponds to the transmission method type shown in the transmission method setting value when the multiple setting values ​​in the job content include a transmission job setting value, a transmission method setting value and a transmission encryption setting value, and the type of encryption shown in the transmission encryption setting value does not correspond to the type of transmission method shown in the transmission method setting value.

[0105] In particular, the job content generation device 30 corrects at least one of the multiple setting values ​​in the job content based on the state of the image forming apparatus 50, thereby improving the appropriateness of the corrected job content. For example, when the multiple setting values ​​in the job content include a copy job setting value and a read source setting value, and a USB memory is actually installed in the image forming apparatus 50, the job content generation device 30 corrects the copy job setting value to a print job setting value, thereby improving the appropriateness of the corrected job content. Also, for example, when the multiple setting values ​​in the job content include a copy job setting value, a document size setting value and a paper size setting value, and the size of the document actually set in the image forming apparatus is the size indicated by the paper size setting value rather than the size indicated by the document size setting value, the job content generation device 30 corrects the size indicated by the document size setting value and the size indicated by the paper size setting value by swapping them, thereby improving the appropriateness of the corrected job content.

[0106] The job content generation device 30 corrects at least one of the multiple setting values ​​in the job content if there is a combination that cannot be set simultaneously, so that the combination can be set simultaneously. Therefore, even if the job content is incorrectly generated in the process of generating the job content using a machine learning model based on voice data, the job content can be automatically corrected.

[0107] The voice operation system 10 has a job content generation device 30 that needs to have high processing power to generate job content based on voice data indicating voice received by the smart speaker 20, but this device is not located inside the same network 12 as the image forming apparatus 50. The job command generation device 40 that generates job commands that the image forming apparatus 50 can interpret based on the job content generated by the job content generation device 30 is located inside the same network 12 as the image forming apparatus 50. Therefore, the processing power required for the computer constituting the job command generation device 40, which is located inside the same network 12 as the image forming apparatus 50, can be reduced.

[0108] Since the voice control system 10 includes a job command generation device 40 that generates job commands that the image forming apparatus 50 can interpret, within the same network 12 as the image forming apparatus 50, the image forming apparatus 50 can be operated via the smart speaker 20 even if the image forming apparatus 50 does not have a mechanism to receive job commands that it can interpret from outside the network 12.

[0109] The voice operation system 10 requires a job content generation device 30, which needs high processing power to convert voice data representing voice received by the smart speaker 20 into job content using machine learning models, namely text data conversion model 34b and job content conversion model 34c. Since the job content generation device 30 is not located within the same network 12 as the image forming apparatus 50, the processing power required for computers located within the same network 12 as the image forming apparatus 50 can be reduced.

[0110] In this embodiment, the job content generation device 30 converts the voice data transmitted from the smart speaker 20 into text data before converting it into job content. However, the job content generation device 30 may also directly convert the voice data transmitted from the smart speaker 20 into job content using a machine learning model without converting it into text data.

[0111] In this embodiment, the job content generation device 30 acquires the status of the image forming apparatus 50 after processing in S64. However, if, after processing in S64, the job content generation device 30 determines, based on the inappropriate job content determination information 34d, that the job content generated in S64 is an inappropriate combination, and that it can be corrected to an appropriate combination based on the inappropriate job content determination information 34d, it may not request the image forming apparatus 50 to transmit information indicating the status of the image forming apparatus 50. In this case, processing in S65 to S69 is not performed, and after the above determination, the job content generation device 30 performs the processing in S70 based on the information indicated by the inappropriate job content determination information 34d. This omits the request to transmit and the reception of information indicating the status of the image forming apparatus 50, which is unnecessary for correcting the job content. The job content generation device 30 requests the image forming apparatus 50 to transmit information indicating the status of the image forming apparatus 50 only if it is not possible to correct the job content to an appropriate combination based on the information indicated by the inappropriate job content determination information 34d.

[0112] In this embodiment, the voice control system 10 includes a job command generation device 40 in addition to the job content generation device 30. However, the job content generation device 30 may also have the function of the job command generation device 40, which is to generate job commands that can be interpreted by the image forming apparatus 50. If the job content generation device 30 has the function of the job command generation device 40, it may be located inside the network 12.

[0113] In this embodiment, the voice control system 10 employs a USB memory as the external storage device attached to the image forming apparatus. However, the external storage device attached to the image forming apparatus may be a storage device other than a USB memory.

Claims

1. A job content generation device that generates the content of a job to be executed by an image forming apparatus based on voice data indicating voice received by a voice reception device, The job content generation device is The image forming apparatus includes a processor, and the processor executes a job content generation program, and when there is a predetermined combination of multiple setting values ​​in the content that cannot be set simultaneously, the control unit functions as a job content generation unit that corrects at least one of the multiple setting values ​​in the content to a predetermined combination that can be set simultaneously, based on the state of the image forming apparatus. The aforementioned job content generation unit, By requesting the image forming apparatus to transmit information indicating the status of the image forming apparatus, the correction is performed using the information transmitted from the image forming apparatus. A job content generation device that, if it is determined that the combination cannot be set as described above and that it can be corrected to an appropriate combination even without the information described above, does not make the request to the image forming apparatus, does not obtain the information from the image forming apparatus, and performs the correction without using the information described above.

2. The job content generation device according to claim 1, which generates the content using a machine learning model based on the aforementioned audio data.

3. The aforementioned job content generation unit, If the set value in the above content is a predetermined combination that cannot be set, including the set value that the type of job is a copy and the set value that the source of the files used for the job is an external storage device attached to the image forming apparatus, The job content generation apparatus according to claim 1, wherein when the external storage device is actually installed in the image forming apparatus, the copy job setting value is corrected to the setting value that the type of job is printing, thereby correcting the multiple setting values ​​in the content to a predetermined combination of setting values ​​that can be set simultaneously.

4. The aforementioned job content generation unit, If the multiple settings in the above content are a predetermined combination that cannot be set, including the setting that the type of job is copy, the document size setting as the setting that indicates the size of the document used for the job, and the paper size setting as the setting that indicates the size of the paper on which the image will be printed in the job, The job content generation apparatus according to claim 1, wherein if the size of the original document actually set in the image forming apparatus is the size indicated by the paper size setting value and not the size indicated by the original document size setting value, the apparatus corrects the multiple setting values ​​in the content to a predetermined combination of setting values ​​that can be set simultaneously by swapping the size indicated by the original document size setting value and the size indicated by the paper size setting value.

5. The aforementioned job content generation unit, If any of the above settings are a predetermined combination that cannot be set, including a copy job setting as the setting that the type of job is a copy, and a setting that indicates the file name of the file used for the job, The job content generation device according to claim 1, wherein the copy job setting value is corrected to the setting value that the type of job is printing, thereby correcting the multiple setting values ​​in the content to a predetermined combination of setting values ​​that can be set simultaneously.

6. The aforementioned job content generation unit, If any of the above settings are a predetermined combination that cannot be set, including the setting that the type of job is document transmission, the transmission method setting as the setting that indicates the type of document transmission method, and the transmission encryption setting as the setting that indicates the type of encryption used when transmitting the document, The job content generation device according to claim 1, wherein when the type of encryption indicated in the encryption setting value at transmission does not correspond to the type of transmission method indicated in the transmission method setting value, the type of encryption indicated in the encryption setting value at transmission corresponds to the type of transmission method indicated in the transmission method setting value, thereby correcting the multiple setting values ​​in the content to a predetermined combination of setting values ​​that can be set simultaneously.

7. Computers It functions as a job content generation unit that generates the content of a job to be executed by an image forming apparatus based on audio data indicating audio received by an audio receiving device. If the job content generation unit determines that multiple setting values ​​in the content cannot be set simultaneously in a predetermined combination, it corrects at least one of the multiple setting values ​​in the content to a predetermined combination that can be set simultaneously, based on the state of the image forming apparatus. By requesting the image forming apparatus to transmit information indicating the status of the image forming apparatus, the correction is performed using the information transmitted from the image forming apparatus. A job content generation program that, if it is determined that the combination cannot be set as described above and that it can be corrected to an appropriate combination even without the information described above, does not make the request to the image forming apparatus, does not obtain the information from the image forming apparatus, and performs the correction without using the information described above.

Images