Printing system, printer, speech processing server, and program

WO2025094270A1PCT designated stage expired Publication Date: 2025-05-08KYOCERA CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/039273
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-10-31
Publication Date
2025-05-08

AI Technical Summary

Technical Problem

When the existing printing system notifies the printer status information to the user, it needs to control the server through the printer, resulting in a complex communication process and an increase in the load on the control server, making it difficult to effectively notify the user of the printer status.

Method used

The printer directly transmits the status information to the audio processing server, rather than controlling the server through the printer, thereby simplifying the communication process and reducing the load on the control server, and notifying the user of the status information through the audio output unit.

Benefits of technology

It realizes the function of directly notifying the printer status information to the user without increasing the load of the printer control server, simplifying the communication process and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023039273_08052025_PF_FP_ABST
    Figure JP2023039273_08052025_PF_FP_ABST
Patent Text Reader

Abstract

A printing system according to an aspect of the present invention comprises: a printer; a speech input / output unit that receives a speech input; a speech processing server that generates a control instruction on the basis of the speech input received by the speech input / output unit; and a printer control server that controls the printer on the basis of the control instruction. The printer transmits printer state information regarding the state of the printer to the speech processing server without going through the printer control server. The speech processing server causes the speech input / output unit to output speech based on the printer state information.
Need to check novelty before this filing date? Find Prior Art

Description

Printing system, printer, audio processing server, and program

[0001] The present disclosure relates to a printing system, a printer, a voice processing server, and a program.

[0002] Conventionally, there is known a printing system that can control a printer (e.g., an MFP (Multifunction Printer)) by voice (see Patent Document 1). Such a system includes a printer, a voice input / output unit (e.g., a smart speaker), a voice processing server that manages the voice input / output unit, and a printer control server that controls the printer. When the voice input / output unit receives a voice instruction from a user, it transmits voice data representing the speech content to the voice processing server. The voice processing server transmits an operational instruction to the printer control server based on the voice data. The printer control server controls the printer in accordance with the operational instruction from the voice processing server.

[0003] Japanese Patent Application Laid-Open No. 2021-12431

[0004] A printing system according to a first aspect includes a printer, a voice input / output unit that accepts voice input, a voice processing server that generates control instructions based on the voice input accepted by the voice input / output unit, and a printer control server that controls the printer based on the control instructions. The printer transmits printer status information regarding the status of the printer to the voice processing server without going through the printer control server. The voice processing server causes the voice input / output unit to output voice based on the printer status information.

[0005] The printer of the second aspect is a printer that can be used in a printing system that utilizes an audio input / output unit, and is equipped with a communication unit that communicates with an audio processing server that generates control instructions based on audio input received by the audio input / output unit, and with a printer control server that controls the printer based on the control instructions, and a control unit that controls the communication unit to send printer status information regarding the status of the printer to the audio processing server without going through the printer control server.

[0006] A voice processing server according to a third aspect is a voice processing server usable in a printing system that controls a printer using a voice input / output unit, and includes a communication unit that communicates with the voice input / output unit, the printer, and a printer control server that controls the printer, and a control unit that generates control instructions for the printer control server based on voice input accepted by the voice input / output unit. The communication unit receives printer status information regarding the status of the printer from the printer without going through the printer control server. The control unit causes the voice input / output unit to output voice based on the printer status information.

[0007] The program according to the fourth aspect causes a printer that can be used in a printing system that utilizes an audio input / output unit to communicate with an audio processing server that generates control instructions based on audio input received by the audio input / output unit, and to communicate with a printer control server that controls the printer based on the control instructions, and to send printer status information regarding the status of the printer to the audio processing server without going through the printer control server.

[0008] 1 is a diagram illustrating an example of the configuration of a printing system according to an embodiment. FIG. 2 is a diagram illustrating an example of the configuration of a voice input / output unit according to an embodiment. FIG. 3 is a diagram illustrating an example of the configuration of a voice processing server according to an embodiment. FIG. 4 is a diagram illustrating an example of the configuration of a table stored by the voice processing server according to an embodiment. FIG. 5 is a diagram illustrating an example of the configuration of a printer control server according to an embodiment. FIG. 6 is a diagram illustrating an example of the configuration of a table stored by the printer control server according to an embodiment. FIG. 7 is a diagram illustrating an example of the configuration of a printer according to an embodiment. FIG. 8 is a diagram illustrating an example of the operation of a printing system according to a first embodiment. FIG. 9 is a diagram illustrating an example of the operation of a printing system according to a second embodiment. FIG. 10 is a diagram illustrating an example of the operation of a printing system according to a third embodiment. FIG. 11 is a diagram illustrating an example of the operation of a printing system according to a modified example of the third embodiment. FIG. 12 is a diagram illustrating an example of the operation of a printing system according to a fourth embodiment. FIG. 13 is a diagram for explaining the operation of a printing system according to a fifth embodiment. FIG. 14 is a diagram illustrating an example of the configuration of a printing system according to another embodiment.

[0009] A communication system according to an embodiment will be described with reference to the drawings. In the description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0010] In the printing system described in Patent Document 1, information about the printer status (also referred to as "printer status information") is not notified to the user by voice via an audio input / output unit. Although not described in Patent Document 1, one possible method of notifying the user of printer status information is to transmit information in the reverse order of the print instruction from the user. Specifically, it is thought that the printer notifies the voice processing server of the printer status information via the printer control server, and the voice processing server causes the voice input / output unit to output voice based on the printer status information, thereby making it possible to notify the user of the printer status information by voice.

[0011] However, if the printer control server is involved in the notification of printer status information from the printer to the voice processing server, the communication procedure becomes more complicated and the load on the printer control server increases. Therefore, with conventional technology, it is difficult to notify the user of printer status information by voice using the voice input / output unit.

[0012] In the following embodiments, a printing system that can notify a user of printer status information by voice using a voice input / output unit will be described. Each of the following embodiments may be implemented independently, or two or more of the embodiments may be combined and implemented.

[0013] (1) First Embodiment A printing system according to the first embodiment will be described. The printing system according to the first embodiment is a system that can perform printing using a printer by utilizing an audio input / output unit.

[0014] (1.1) Example of Configuration of Printing System Fig. 1 is a diagram showing an example of the configuration of a printing system 1 according to this embodiment. The printing system 1 has an audio input / output unit 100, an audio processing server 200, a printer control server 300, and a printer 400. The audio input / output unit 100, the audio processing server 200, the printer control server 300, and the printer 400 are communicably connected via a network 10 such as the Internet.

[0015] The audio input / output unit 100 is a device having a function of inputting and outputting audio and a function of communicating via the network 10. The audio input / output unit 100 may be a so-called smart speaker. The audio input / output unit 100 may also be a smartphone, a tablet terminal, a notebook PC, or the like. In this embodiment, an example will be described in which the audio input / output unit 100 is a device separate from the printer 400. However, the audio input / output unit 100 may also be integrated with the printer 400. The audio input / output unit 100 transmits audio data corresponding to audio spoken by a user via the network 10. In this embodiment, the audio input / output unit 100 receives audio input from the user to instruct control (e.g., printing) of the printer 400. The audio input / output unit 100 outputs the audio data received via the network 10 as audio.

[0016] The voice processing server 200 communicates with the voice input / output unit 100 via the network 10 and manages the voice input / output unit 100. The voice processing server 200 may be a server operated by the voice input / output unit 100 and / or a provider providing a voice processing service. The voice processing server 200 may be configured by a single computer or may be a cloud server logically configured by one or more computers. The voice processing server 200 can transmit and receive voice data to and from the voice input / output unit 100 via the network 10. The voice processing server 200 may perform voice recognition on the voice data from the voice input / output unit 100. The voice processing server 200 may synthesize voice data from text data and transmit the voice data to the voice input / output unit 100. The voice processing server 200 generates a control instruction for controlling the printer 400 based on the voice data from the voice input / output unit 100 and transmits the control instruction to the printer control server 300 via the network 10. The control instruction may be a request for controlling the printer 400. In this embodiment, a case where the voice processing server 200 generates a print instruction will be mainly described.

[0017] The printer control server 300 communicates with the printer 400 via the network 10 and controls the printer 400. The printer control server 300 may be a server operated by the printer 400 and / or a business that provides a printer control service. The printer control server 300 may be configured as a single computer, or may be a cloud server logically configured by one or more computers. The printer control server 300 controls the printer 400 based on control instructions from the voice processing server 200. For example, the printer control server 300 causes the printer 400 to print by transmitting print data (print job) that can be printed by the printer 400 to the printer 400.

[0018] Printer 400 is a device having a printing function for forming an image on paper and a communication function via network 10. Printer 400 may be an MFP that has, in addition to a printing function, at least one of a scanner function for reading an image from a document, a copy function for printing the read image, and a facsimile function for sending the read image to another device. In this embodiment, printer 400 is controlled by printer control server 300. For example, printer 400 performs printing according to print data (print job) from printer control server 300.

[0019] Thus, the printing system 1 according to this embodiment includes a printer 400, an audio input / output unit 100 that accepts audio input, an audio processing server 200 that generates control instructions based on the audio input accepted by the audio input / output unit 100, and a printer control server 300 that controls the printer 400 based on the control instructions.

[0020] In this embodiment, the printer 400 generates printer status information regarding the status of the printer 400 and transmits the printer status information to the voice processing server 200. Specifically, the printer 400 transmits the printer status information to the voice processing server 200 without going through the printer control server 300. The voice processing server 200 causes the voice input / output unit 100 to output voice based on the printer status information from the printer 400. In this way, the printer status information is notified to the user by voice from the voice input / output unit 100. Here, by the printer 400 transmitting the printer status information to the voice processing server 200 without going through the printer control server 300, it is possible to prevent the communication procedure from becoming complicated and the load on the printer control server 300 from increasing.

[0021] The printer 400 may transmit the printer status information to the voice processing server 200 only within a predetermined time from the start or end of printing. If the printer 400 transmits the printer status information to the voice processing server 200 at any timing, the voice input / output unit 100 may report the printer status information by voice at an inappropriate timing, such as when the user is absent. Furthermore, if the printer 400 transmits the printer status information to the voice processing server 200 only within a predetermined time from the start or end of printing, the voice input / output unit 100 can report the printer status information by voice at an appropriate timing, allowing the user to understand the printer status information in association with printing.

[0022] The printer status information may be information related to a printing error. A printing error may be, for example, a printing stop (i.e., an abnormal end) due to a paper jam or running out of ink, or a lack of ink. By announcing such printer status information aloud through the audio input / output unit 100, the user can learn the information related to the printing error through audio.

[0023] The printer status information may be information indicating that printing has been completed successfully. A successful completion of printing may mean that printing has been completed without any errors. By providing such printer status information through audio from the audio input / output unit 100, the user can understand from the audio that printing has been completed successfully.

[0024] In this embodiment, it is assumed that the user has previously created a first user account (also referred to as a "printer control account"), which is a user account for the printer control server 300 (printer control service), and a second user account (also referred to as a "voice processing account"), which is a user account for the voice processing server 200 (voice processing service). In addition, in this embodiment, it is assumed that the printer control account and the voice processing account are associated with each other.

[0025] (1.2) Configuration Examples of Each Device A configuration example of each device according to the first embodiment will be described. Note that the configuration of each device described below is an example, and each device may include hardware other than that shown in the drawings. Furthermore, in the configuration of each device described below, multiple blocks may be combined into one block, or one block may be divided into two or more blocks.

[0026] (1.2.1) Example of the Configuration of the Audio Input / Output Unit Fig. 2 is a diagram showing an example of the configuration of the audio input / output unit 100 according to the embodiment. The audio input / output unit 100 includes a speaker 101, a microphone 102, a communication unit 103, and a control unit 110. The speaker 101, the microphone 102, the communication unit 103, and the control unit 110 are electrically connected to one another via, for example, a bus 120.

[0027] The speaker 101 outputs sound under the control of the control unit 110. Specifically, the speaker 101 converts an electrical signal (sound signal) from the control unit 110 into sound and outputs the sound.

[0028] The microphone 102 converts sounds around the audio input / output unit 100, for example, sounds uttered by a user, into electrical signals (audio signals) and outputs the audio signals to the control unit 110. The control unit 110 converts the audio signals into digital audio data.

[0029] The communication unit 103 is a communication interface that performs communication via the network 10 under the control of the control unit 110. The communication unit 103 may perform wireless communication or wired communication. For example, the communication unit 103 may be configured to include a circuit and an antenna for performing wireless communication according to a predetermined wireless communication method. For example, the communication unit 103 may be wirelessly connected to an external access point. The predetermined wireless communication method may be a wireless LAN wireless communication method conforming to the IEEE 802.11 standard series or a short-range wireless communication method conforming to the Bluetooth (registered trademark) standard.

[0030] The control unit 110 performs overall control of the audio input / output unit 100. The control unit 110 includes a processor 104 and a memory 105. The operations of the audio input / output unit 100 described above and below may be operations under the control of the control unit 110.

[0031] The processor 104 executes a program stored in the memory 105 and controls the speaker 101, the microphone 102, and the communication unit 103. The processor 104 includes a CPU (Central Processing Unit).

[0032] The memory 105 includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The CPU loads programs stored in the ROM into the RAM and executes them. The ROM stores control programs and data tables executed by the CPU, embedded OS (Operating System) programs, etc. The RAM is composed of, for example, an SRAM (Static RAM) that requires a backup power source. The RAM also has a memory area for storing setting information and management data for the audio input / output unit 100. The RAM is also used as the CPU's main memory and work memory.

[0033] The voice input / output unit 100 configured in this manner accepts voice input from the user and transmits voice data to the voice processing server 200. Specifically, the control unit 110 converts the voice signal from the microphone 102 into voice data and controls the communication unit 107 to transmit the voice data to the voice processing server 200. In this embodiment, voice recognition is performed by the voice processing server 200, but at least a part of the voice recognition may be performed by the control unit 110.

[0034] Furthermore, the audio input / output unit 100 receives audio data from the audio processing server 200 and outputs audio based on the audio data. Specifically, the control unit 110 converts the audio data received by the communication unit 107 from the audio processing server 200 into an audio signal, outputs the audio signal to the speaker 101, and the speaker 101 outputs the audio. The control unit 110 may convert audio data stored in advance into an audio signal and output the audio from the speaker 101.

[0035] (1.2.2) Example of the configuration of the voice processing server Fig. 3 is a diagram showing an example of the configuration of the voice processing server 200 according to the embodiment. The voice processing server 200 includes a communication unit 201 and a control unit 210. The communication unit 201 and the control unit 210 are electrically connected to each other via a bus 220, for example.

[0036] The communication unit 201 is a communication interface that performs communication via the network 10 under the control of the control unit 210. The communication unit 201 may perform wireless communication or wired communication. In this embodiment, the communication unit 201 performs communication with the audio input / output unit 100, communication with the printer control server 300, and communication with the printer 400.

[0037] The control unit 210 performs overall control of the voice processing server 200. The control unit 210 includes a processor 202 and a memory 203. The operations of the voice processing server 200 described above and below may be performed under the control of the control unit 210.

[0038] The processor 202 executes a program stored in the memory 203. The processor 202 includes a CPU.

[0039] The memory 203 includes a ROM and a RAM. The CPU loads a program stored in the ROM into the RAM and executes it. The ROM stores control programs executed by the CPU, data tables, and the like. The ROM may include a solid state drive (SSD) and / or a hard disk drive (HDD). The RAM is configured, for example, with a static RAM (SRAM) that requires a backup power source. The RAM is also used as the CPU's main memory and work memory.

[0040] In the voice processing server 200 configured in this manner, the communication unit 201 receives voice data representing the content of the voice input received by the voice input / output unit 100. The control unit 210 generates a print instruction for the printer control server 300 based on the voice input received by the voice input / output unit 100 (i.e., the voice data from the voice input / output unit 100), and controls the communication unit 201 to transmit the print instruction to the printer control server 300.

[0041] The control unit 210 may perform speech recognition on the voice data from the voice input / output unit 100 and convert the voice data into text data. The control unit 210 may generate a print instruction by recognizing and extracting a predetermined word (for example, a word indicating that the user desires printing) included in the text data.

[0042] Furthermore, the communication unit 201 receives printer status information relating to the status of the printer 400 from the printer 400 without going through the printer control server 300. The control unit 210 causes the voice input / output unit 100 to output voice based on the printer status information. Here, the control unit 210 controls the communication unit 201 to transmit voice data based on the printer status information to the voice input / output unit 100.

[0043] FIG. 4 is a diagram showing an example of the configuration of a table stored in the control unit 210 (memory 203) of the voice processing server 200 according to the embodiment. As shown in FIG. 4(1), the control unit 210 (memory 203) stores a table associating voice processing accounts, voice input / output unit information, and printer control accounts. In the illustrated example, the voice processing account includes a user ID for the voice processing server 200 (voice processing service). The voice processing account may include other information such as a password. The voice input / output unit information includes a voice input / output unit ID. The voice input / output unit information may include address information (e.g., an IP address) of the corresponding voice input / output unit 100. The printer control account includes a user ID for the printer control server 300 (printer control service). The printer control account may include other information such as a password. As shown in FIG. 4(2), the control unit 210 (memory 203) may store printer information instead of or in addition to the printer control account. The printer information includes a printer ID.

[0044] It is assumed that the control unit 210 (memory 203) stores address information of the printer control server 300 in advance.

[0045] (1.2.3) Example of the Configuration of the Printer Control Server Fig. 5 is a diagram showing an example of the configuration of the printer control server 300 according to this embodiment. The printer control server 300 has a communication unit 301 and a control unit 310. The communication unit 301 and the control unit 310 are electrically connected to each other via a bus 320, for example.

[0046] The communication unit 301 is a communication interface that performs communication via the network 10 under the control of the control unit 310. The communication unit 301 may perform wireless communication or wired communication. In this embodiment, the communication unit 301 performs communication with the voice processing server 200 and communication with the printer 400.

[0047] The control unit 310 performs overall control of the printer control server 300. The control unit 310 includes a processor 302 and a memory 303. The operations of the printer control server 300 described above and below may be operations under the control of the control unit 310.

[0048] The processor 302 executes a program stored in the memory 303. The processor 302 includes a CPU.

[0049] The memory 303 includes a ROM and a RAM. The CPU loads a program stored in the ROM into the RAM and executes it. The ROM stores control programs executed by the CPU, data tables, and the like. The ROM may include an SSD and / or an HDD. The RAM is configured, for example, with an SRAM that requires a backup power source. The RAM is also used as the CPU's main memory and work memory.

[0050] In the printer control server 300 configured in this manner, the communication unit 301 receives a print instruction from the voice processing server 200. The control unit 310 generates print data that can be printed by the printer 400 based on the print instruction, and controls the communication unit 301 to transmit the print data to the printer 400.

[0051] FIG. 6 is a diagram showing an example of the configuration of a table stored in the control unit 310 (memory 303) of the printer control server 300 according to the embodiment. As shown in FIG. 6-1, the control unit 310 (memory 303) stores a table associating printer control accounts with printer information. In the example shown, the printer control account includes a user ID for the printer control server 300 (printer control service). The printer control account may also include other information such as a password. The printer information includes a printer ID. The printer information may also include address information of the corresponding printer 400. Note that if one user owns multiple printers 400, a default printer 400 may be set in advance, or information about a printer 400 identified by asking the user questions may be registered.

[0052] (1.2.4) Example of Printer Configuration Fig. 7 is a diagram showing an example of the configuration of a printer 400 according to this embodiment. The printer 400 has an image processing unit 410, a communication unit 403, an operation panel 420, and a control unit 430. The image processing unit 410, the communication unit 403, the operation panel 420, and the control unit 430 are electrically connected to one another via, for example, a bus 440.

[0053] The image processing unit 410 performs image processing including printing (image formation). In this embodiment, the image processing unit 410 includes a printing unit 401 and a scanner unit 402, but the image processing unit 410 does not necessarily have to include the scanner unit 402.

[0054] The printing unit 401 forms an image on a recording medium (paper) using a recording method such as inkjet or electrophotography under the control of the control unit 430. In this embodiment, the printing unit 401 prints on paper print data received from the printer control server 300 by the communication unit 403. The printing unit 401 may also manage ink information including the amount of remaining ink and paper information including the number of sheets of paper in the stack.

[0055] The scanner unit 402 optically reads an original placed on a platen (not shown) and converts it into electronic data (image data) under the control of the control unit 430. The control unit 430 transmits the image data converted into a specified file format to an external device via the network 10 or stores it in a storage area (for example, memory 407). The copy function is realized by transferring image data generated by reading an original placed on the platen with the scanner unit 402 to the printing unit 401, which then prints the image data on paper.

[0056] The communication unit 403 is a communication interface that communicates via the network 10 under the control of the control unit 430. The communication unit 403 may perform wireless communication or wired communication. For example, the communication unit 403 may be configured to include a circuit and an antenna for performing wireless communication according to a predetermined wireless communication method. For example, the communication unit 403 can be wirelessly connected to an external access point. The predetermined wireless communication method may be a wireless LAN wireless communication method conforming to the IEEE 802.11 standard series or a short-range wireless communication method conforming to the Bluetooth (registered trademark) standard. In this embodiment, the communication unit 403 communicates with the voice processing server 200 and the printer control server 300.

[0057] The operation panel 420 has a display unit 404 and an operation unit 405. The display unit 404 is composed of, for example, an LCD, and displays various information under the control of the control unit 430. The operation unit 405 includes switches and / or buttons that allow the user to perform various input operations. If the display unit 404 is a touch panel display, at least some of the functions of the operation unit 405 may be realized by the touch panel display.

[0058] The control unit 430 performs overall control of the printer 400. The control unit 430 includes a processor 406 and a memory 407. The operations of the printer 400 described above and below may be operations under the control of the control unit 430.

[0059] The processor 406 executes a program stored in the memory 407 and controls the image processing unit 410, the communication unit 403, and the operation panel 420. The processor 406 includes a CPU.

[0060] The memory 407 includes a ROM and a RAM. The CPU loads programs stored in the ROM into the RAM and executes them. The ROM stores control programs executed by the CPU, data tables, embedded OS programs, etc. The RAM is composed of, for example, an SRAM that requires a backup power source. The RAM also has a memory area for storing setting information and management data for the printer 400. The RAM is also used as the CPU's main memory and work memory. The RAM temporarily stores image data, etc. when image processing is performed.

[0061] In the printer 400 configured as described above, the communication unit 403 receives print data from the printer control server 300. The control unit 430 controls the printing unit 401 to print the print data received by the communication unit 403 on paper. The control unit 430 also controls the communication unit 403 to transmit printer status information regarding the status of the printer 400 to the voice processing server 200 without going through the printer control server 300. In this embodiment, the control unit 430 (memory 407) is assumed to have stored in advance server information including address information (e.g., IP address) of the voice processing server 200.

[0062] The control unit 430 may control the communication unit 403 to transmit printer status information to the voice processing server 200 only within a predetermined time from the start or end of printing. The start of printing may be the timing when the printing unit 401 actually starts printing, or the timing when the communication unit 403 receives print data from the printer control server 300. The end of printing may be the timing when printing ends normally, or the timing when printing ends abnormally due to the occurrence of an error.

[0063] The printer status information may be information related to a printing error. For example, when the control unit 430 detects the occurrence of an error, the control unit 430 may generate printer status information including information indicating the type of the detected error (an error code).

[0064] The printer status information may be information indicating that printing has ended normally. For example, when the control unit 430 detects that printing has ended normally, the control unit 430 may generate printer status information including information indicating that printing has ended normally.

[0065] (1.3) Example of Operation of Printing System An example of operation of the printing system 1 according to this embodiment will be described below. Fig. 8 is a diagram showing an example of operation of the printing system 1 according to the first embodiment.

[0066] In step S101, the voice input / output unit 100 receives voice input from the user instructing printing. For example, the voice input is the user's voice saying, "Please print ~." The voice input may include information indicating the printer 400 to be controlled. In this case, the voice input is the user's voice saying, "Please print ~ on ~'s printer."

[0067] In step S102, the voice input / output unit 100 transmits voice data corresponding to the voice input of the speaker 101 to the voice processing server 200. The voice processing server 200 receives the voice data from the voice input / output unit 100 and identifies the user's voice processing account.

[0068] In step S103, the voice processing server 200 performs voice recognition on the voice data and recognizes that a print instruction has been issued by the user.

[0069] Here, the voice processing server 200 may identify the print target. The printer control server 300 may identify the print target. For example, the print target may be content owned (managed) by the printer control server 300, content owned (managed) by the voice processing server 200, content held on a user's terminal or in cloud storage, content from a third-party service, or third-party content made public by a third party. For example, the content to be printed may be a crossword puzzle, a coloring book, a specified photo, a specified text data file, etc.

[0070] In step S104, the voice processing server 200 identifies at least one of the printer control account and the printer information corresponding to the user's voice processing account, for example, using the table in Fig. 4, generates a print instruction including the identified information (and information indicating the print target), and transmits the generated print instruction to the printer control server 300. The printer control server 300 receives the print instruction.

[0071] In step S105, the printer control server 300 identifies the printer 400 (specifically, the printer ID) to be controlled based on the print instruction, for example, using the table in Fig. 6. The printer control server 300 converts the content to be printed into data that can be printed by the identified printer 400, and generates print data (print job).

[0072] In step S106, the printer control server 300 transmits the generated print data to the specified printer 400. The printer 400 receives the print data.

[0073] In step S107, upon receiving the print data, the printer 400 starts a printing operation for printing the print data onto paper. The printing operation may include operations such as head cleaning.

[0074] In step S108, the printer 400 may end the printing operation. This end may be a normal end without an error or an abnormal end due to an error.

[0075] In step S109, the printer 400 detects a change in the printer status, such as a paper jam or the end of printing, and generates printer status information indicating the printer status.

[0076] In step S110, the printer 400 transmits the printer status information to the voice processing server 200. The voice processing server 200 receives the printer status information.

[0077] For example, the printer 400 detects changes in the printer status that occur before one print job (print task) is completed and generates printer status information. If an error occurs before one print job is successfully completed, the printer 400 may transmit printer status information indicating the error to the voice processing server 200. If one print job (print task) is successfully completed, the printer 400 transmits printer status information indicating the successful completion to the voice processing server 200.

[0078] After transmitting printer status information related to the completion of one print job to the voice processing server 200, the printer 400 does not need to transmit any further printer status information to the voice processing server 200. For example, after receiving a new print job from the printer control server 300 after the completion of one print job, the printer 400 does not send printer status information related to that print job to the voice processing server 200. This prevents confusion about which print the printer status information is for.

[0079] For example, the printer 400 may transmit the printer status information to the voice processing server 200 within a specific time (e.g., one hour) from the end of printing or the receipt of printing, and may not transmit the printer status information to the voice processing server 200 after the specific time has elapsed.

[0080] In step S111, the voice processing server 200 generates voice data based on the printer status information from the printer 400. For example, if the printer status information indicates an error, the voice processing server 200 generates voice data according to the type of error. Such voice data may be generated by synthesizing natural language text such as "Paper jam has occurred" or "Out of ink." If the printer status information indicates normal completion, the voice processing server 200 generates voice data indicating the normal completion. Such voice data may be generated by synthesizing natural language text such as "Printing has completed successfully."

[0081] If the voice processing server 200 does not receive printer status information indicating normal completion of printing from the printer 400 within a predetermined time from the timing of the print instruction (e.g., the timing of step S103 or S104), the voice processing server 200 may cause the voice input / output unit 100 to output voice regarding an abnormality in the printer 400. In this case, the voice processing server 200 generates voice data regarding the abnormality in the printer 400. Such voice data may be generated by synthesizing natural language text, such as, "Ten minutes have passed since you issued the print instruction, but you have not received any notification that printing is complete. Please check the status of the printer."

[0082] In step S112, the voice processing server 200 transmits the voice data to the voice input / output unit 100. The voice input / output unit 100 receives the voice data.

[0083] In step S113, the voice input / output unit 100 converts the received voice data into voice and outputs it (that is, notifies the user by voice).

[0084] (2) Second Embodiment A printing system 1 according to a second embodiment will be described, focusing mainly on the differences from the first embodiment.

[0085] In the above embodiment, it is assumed that the server information (specifically, address information) of the voice processing server 200 is registered in advance in the printer 400. However, it is desirable to be able to handle cases where there are multiple voice processing servers 200 or where the address information of the voice processing server 200 is changed.

[0086] Therefore, in the second embodiment, the printer control server 300 transmits server information for specifying the voice processing server 200 as the destination of the printer status information to the printer 400. The printer 400 transmits the printer status information to the voice processing server 200 based on the server information received from the printer control server 300.

[0087] For example, the communication unit 301 of the printer control server 300 according to this embodiment transmits server information of the voice processing server 200 to the printer 400 when transmitting print data to the printer 400. After transmitting the server information of the voice processing server 200 to the printer 400, the control unit 310 of the printer control server 300 may control not to transmit the server information to the printer 400 if there is no change in the server information. Note that the control unit 310 of the printer control server 300 may acquire the server information from the voice processing server 200 when receiving a print instruction from the voice processing server 200, or may acquire and store the server information of the voice processing server 200 when establishing a communication connection with the voice processing server 200.

[0088] The communication unit 403 of the printer 400 according to this embodiment receives server information for specifying the voice processing server 200 as the destination of the printer status information from the printer control server 300. The control unit 430 of the printer 400 controls the communication unit 403 to transmit the printer status information to the voice processing server 200 based on the server information. The control unit 430 of the printer 400 may store the server information of the printer control server 300. If the control unit 430 of the printer 400 does not receive the server information of the voice processing server 200 when receiving print data from the printer control server 300, it may specify the destination of the printer status information (the voice processing server 200) based on the stored server information.

[0089] FIG. 9 is a diagram showing an example of the operation of the printing system 1 according to the second embodiment.

[0090] Steps S201 to S203 are the same as those in the first embodiment. In step S204, the voice processing server 200 generates a print instruction and transmits the generated print instruction to the printer control server 300. At that time, the voice processing server 200 may transmit server information including its own address information to the printer control server 300.

[0091] Step S205 is the same as in the first embodiment. In step S206, the printer control server 300 transmits print data to the printer 400. At that time, the printer control server 300 transmits server information including address information of the voice processing server 200 to the printer 400.

[0092] Steps S207 to S209 are the same as those in the first embodiment. In step S210, the printer 400 identifies the destination (voice processing server 200) of the printer status information based on the server information received from the printer control server 300. In step S211, the printer 400 transmits the printer status information to the identified destination (voice processing server 200).

[0093] Steps S212 to S214 are the same as those in the first embodiment.

[0094] (3) Third Embodiment A printing system 1 according to a third embodiment will be described, focusing mainly on the differences from the first and second embodiments.

[0095] In the above-described embodiment, it is desirable to enhance security because a third party may spoof the printer 400 and send printer status information from an unauthorized printer 400 to the voice processing server 200. Furthermore, when a user issues a print instruction multiple times, it is desirable for the user to be able to know which print the printer status information corresponds to.

[0096] Therefore, in this embodiment, the printer control server 300 transmits first identification information related to printing to the voice processing server 200, and transmits second identification information corresponding to the first identification information to the printer 400. When transmitting printer status information, the printer 400 transmits third identification information based on the second identification information to the voice processing server 200. The first to third identification information may be the same information.

[0097] Each of the first to third identification information may include a printer control account (i.e., a user ID for controlling the printer). Each of the first to third identification information may include a print ID for identifying the print, for example, a serial number (print number) indicating the number of times the print has been made, and / or time information (timestamp). The serial number (print number) may be a serial number on a user account basis, or may be a serial number on a server basis. Each of the first to third identification information may be information obtained by converting the above information according to a predetermined rule.

[0098] When the voice processing server 200 receives the printer status information and the third identification information from the printer 400, the voice processing server 200 confirms the authenticity of the printer 400 based on the first identification information and the third identification information. In response to confirmation of the authenticity of the printer 400, the voice processing server 200 causes the voice input / output unit 100 to output voice based on the printer status information.

[0099] For example, if the relationship between the first identification information and the third identification information is correct (e.g., they match), the voice processing server 200 determines that the printer 400 that sent the printer status information is legitimate, and causes the voice input / output unit 100 to output voice based on the printer status information. On the other hand, if the relationship between the first identification information and the third identification information is incorrect (e.g., they do not match), the voice processing server 200 determines that the printer 400 that sent the printer status information is invalid (illegal), and does not cause the voice input / output unit 100 to output voice based on the printer status information, or causes the voice input / output unit 100 to output voice indicating that abnormal processing has been received.

[0100] FIG. 10 is a diagram showing an example of the operation of the printing system 1 according to the third embodiment.

[0101] Steps S301 to S305 are the same as those in the first embodiment. In step S306, the printer control server 300 transmits to the voice processing server 200 first identification information generated based on the printer control account (user ID) and / or print ID.

[0102] In step S307, printer control server 300 transmits the print data to printer 400. At that time, printer control server 300 transmits second identification information corresponding to the first identification information to printer 400. The second identification information may be the same as the first identification information, or may be information obtained by converting the first identification information according to a predetermined rule.

[0103] Steps S308 to S310 are the same as those in the first embodiment. In step S311, the printer 400 transmits printer status information to the voice processing server 200. At that time, the printer 400 transmits third identification information corresponding to the second identification information to the printer 400. The third identification information may be the same as the second identification information, or may be information obtained by converting the second identification information according to a predetermined rule.

[0104] In step S312, the voice processing server 200 receives the printer status information and the third identification information from the printer 400 and verifies the authenticity of the printer 400 based on the first identification information and the third identification information. The voice processing server 200 may identify the print ID (i.e., which print it is) based on the first identification information and / or the third identification information.

[0105] In step S313, the voice processing server 200 generates voice data based on the printer status information in response to confirmation of the authenticity of the printer 400. If the voice processing server 200 identifies the print ID, it may generate voice data in association with the print ID. Such voice data may be generated by synthesizing natural language text, such as, "The printing of the hiragana crossword puzzle requested first has been completed. The printing of the photo requested second has encountered a paper jam."

[0106] Steps S314 and S315 are the same as those in the first embodiment.

[0107] (3.1) Modification of the Third Embodiment The above-described third embodiment may be modified as follows: Differences between this modification and the above-described embodiment will be described.

[0108] In this modified example, the voice processing server 200 transmits first identification information related to printing to the printer control server 300. The printer control server 300 transmits second identification information corresponding to the first identification information to the printer 400. When transmitting printer status information, the printer 400 transmits third identification information based on the second identification information to the voice processing server 200.

[0109] When the voice processing server 200 receives the printer status information and the third identification information from the printer 400, the voice processing server 200 confirms the authenticity of the printer 400 based on the first identification information and the third identification information. In response to confirmation of the authenticity of the printer 400, the voice processing server 200 causes the voice input / output unit 100 to output voice based on the printer status information.

[0110] FIG. 11 is a diagram showing an example of the operation of the printing system 1 according to a modified example of the third embodiment.

[0111] Steps S401 to S403 are the same as those in the first embodiment. In step S404, the voice processing server 200 transmits a print instruction to the printer control server 300. At that time, the voice processing server 200 transmits first identification information generated based on the printer control account (user ID) and / or print ID to the voice processing server 200.

[0112] Step S405 is the same as in the first embodiment. In step S406, the printer control server 300 transmits the print data to the printer 400. At that time, the printer control server 300 transmits second identification information corresponding to the first identification information to the printer 400.

[0113] Steps S407 to S409 are the same as those in the first embodiment. In step S410, the printer 400 transmits printer status information to the voice processing server 200. At that time, the printer 400 transmits third identification information corresponding to the second identification information to the printer 400. The third identification information may be the same as the second identification information, or may be information obtained by converting the second identification information according to a predetermined rule.

[0114] In step S411, the voice processing server 200 receives the printer status information and the third identification information from the printer 400 and verifies the authenticity of the printer 400 based on the first identification information and the third identification information. The voice processing server 200 may identify the print ID (i.e., which print it is) based on the first identification information and / or the third identification information.

[0115] In step S412, the voice processing server 200 generates voice data based on the printer status information in response to confirmation of the authenticity of the printer 400. If the voice processing server 200 identifies the print ID, it may generate voice data in association with the print ID. Such voice data may be generated by synthesizing natural language text, such as, "The printing of the hiragana crossword puzzle requested first has been completed. The printing of the photo requested second has encountered a paper jam."

[0116] Steps S413 and S414 are the same as those in the first embodiment.

[0117] (4) Fourth Embodiment A printing system 1 according to a fourth embodiment will be described, focusing mainly on the differences from the first to third embodiments.

[0118] In the above embodiment, an example was described in which, when the printer status information indicates the occurrence of an error, an error code indicating the type of the error is included in the printer status information. In this case, the voice processing server 200 may need to have a correspondence table between error codes and error contents (also referred to as an "error correspondence table"). Furthermore, due to reasons such as the limited number of error codes, it is difficult to notify the user of more detailed printer status information.

[0119] Therefore, in this embodiment, the printer 400 transmits printer status information including text (text data) in a natural language to the voice processing server 200. The text may include text indicating how to deal with the error that has occurred (i.e., how to resolve the error). Upon receiving such printer status information, the voice processing server 200 causes the voice input / output unit 100 to output voice based on the text.

[0120] This allows the voice processing server 200 to notify the user of the error content by voice, even if it does not have a correspondence table between error codes and error content. Although it is possible to provide detailed support by preparing an error correspondence table for each printer model, this would make the preparation of the voice processing server 200 extremely cumbersome. Even if the error correspondence table is made somewhat generic and not model-specific, more detailed information can be provided by sending text.

[0121] For example, the printer 400 transmits printer status information including an alert voice ID that identifies the text to be notified by voice, the error code of the error that occurred, and text related to the error, to the voice processing server 200. Specifically, the printer 400 transmits 01 (corresponding to a paper jam) as the error code, and also transmits text data such as "Paper is jammed in paper feed tray 1" or "Paper is jammed in panel 2 on the right side of the main body" to the voice processing server 200.

[0122] The voice processing server 200 that receives such printer status information converts the text in the printer status information having the notification voice ID into voice data and transmits the voice data to the voice input / output unit 100. The voice processing server 200 may convert the text directly into voice data, or may convert the text into voice data by changing the expression of the text, etc.

[0123] FIG. 12 is a diagram showing an example of the operation of the printing system 1 according to the fourth embodiment.

[0124] Steps S501 to S509 are the same as those in the first embodiment. In step S510, the printer 400 transmits printer status information including text in a natural language to the speech processing server 200.

[0125] In step S511, the voice processing server 200 receives the printer status information and generates voice data based on the text.

[0126] Steps S512 and S513 are the same as those in the first embodiment.

[0127] (5) Fifth Embodiment A printing system 1 according to a fifth embodiment will be described, focusing mainly on the differences from the first to fourth embodiments.

[0128] In the above-described embodiment, it is assumed that one user uses (owns) one audio input / output unit 100, but in this embodiment, it is assumed that one user may use multiple audio input / output units 100. Fig. 13 is a diagram for explaining the operation of the printing system 1 according to the fifth embodiment. In the illustrated example, there are two audio input / output units 100, 100a and 100b, but there may be three or more audio input / output units 100.

[0129] In this embodiment, when there are multiple audio input / output units 100, the audio processing server 200 receives audio data for executing printing from the first audio input / output unit 100a, and then, in response to receiving other audio data from the second audio input / output unit 100b, causes the second audio input / output unit 100b to output audio based on printer status information. Here, the audio data from the second audio input / output unit 100b is not limited to audio data related to printing, but may also be audio data instructing an operation unrelated to printing (for example, audio instructing to turn on the lights or play music), or may be non-instructive conversation or everyday sounds.

[0130] Here, if the voice processing server 200 receives voice data for executing printing from the first voice input / output unit 100a and then receives other voice data from the second voice input / output unit 100b, i.e., if the first voice input / output unit 100a accepts voice input for executing printing and then another sound (especially the voice of the same user) is input to the second voice input / output unit 100b, it can be inferred that a user is present near the second voice input / output unit 100b. The voice processing server 200 may recognize an individual from the voice and confirm whether the individual who issued the printing command has input the voice from the second voice input / output unit.

[0131] Therefore, in such a case, the voice processing server 200 causes the second voice input / output unit 100b, rather than the first voice input / output unit 100a, to output voice based on the printer status information. That is, the voice processing server 200 transmits voice data based on the printer status information from the printer 400 to the second voice input / output unit 100b, rather than the first voice input / output unit 100a.

[0132] However, it is also possible that the first audio input / output unit 100a and the second audio input / output unit 100b are located close to each other. Therefore, when the audio processing server 200 receives audio data for executing printing from the first audio input / output unit 100a and then receives other audio data from the second audio input / output unit 100b, but does not receive the other audio data from the first audio input / output unit 100a, the audio processing server 200 may cause the second audio input / output unit 100b to output audio based on the printer status information.

[0133] In addition, if the voice processing server 200 receives voice data for executing printing from the first voice input / output unit 100a and then receives other voice data from the second voice input / output unit 100b, it may cause both the first voice input / output unit 100a and the second voice input / output unit 100b to issue an alert, but if there is no user in the vicinity of the first voice input / output unit 100a, this information is unnecessary and information leakage may occur.

[0134] In this embodiment, when the voice processing server 200 receives voice data for executing printing from the first voice input / output unit 100a and then receives other voice data from the second voice input / output unit 100b, the voice processing server 200 may further distinguish between the following cases. Specifically, if the other voice data is voice data related to printing (or the same printer 400), the voice processing server 200 causes the second voice input / output unit 100b to output voice based on the printer status information. On the other hand, if the other voice data is voice data not related to printing, the voice processing server 200 causes the first voice input / output unit 100a to output voice based on the printer status information.

[0135] If the other sound data is not related to printing, it can be assumed that someone else is issuing a command not related to printing. Therefore, if the other sound data is not related to printing, the sound processing server 200 causes the first sound input / output unit 100a, not the second sound input / output unit 100b, to output sound based on the printer status information.

[0136] The voice processing server 200 may issue voice notifications from all of the voice input / output units 100 linked to the user's account, regardless of the situation. Basically, the voice processing server 200 causes the voice input / output unit 100 that transmitted the voice data for executing printing to issue a voice notification, but the user may be able to set additional voice input / output units 100 that should issue a voice notification. For example, the voice input / output unit 100 that should issue a voice notification for each printer may be set as the additional voice input / output unit 100 that corresponds to a person in a position such as the owner or manager of the printer.

[0137] (6) Other Embodiments In the above embodiment, an example has been described in which the voice input / output unit 100 receives voice input from a user instructing printing. However, the voice input / output unit 100 may also receive voice input instructing printer control other than printing. For example, the voice input / output unit 100 may receive voice input instructing startup of the printer 400. In this case, the voice processing server 200 may generate a startup instruction instructing startup of the printer 400, and the printer control server 300 may control startup of the printer 400 based on the startup instruction. Alternatively, the voice input / output unit 100 may receive voice input instructing maintenance of the printer 400. In this case, the voice processing server 200 may generate a maintenance instruction instructing maintenance of the printer 400, and the printer control server 300 may control maintenance of the printer 400 based on the maintenance instruction. Even in the case of such startup or maintenance, the printer 400 can send printer status information indicating an error or normal completion to the voice processing server 200, and the voice processing server 200 can notify this by voice via the voice input / output unit 100.

[0138] Although the above-described embodiment assumes the case where there is only one voice processing server 200, multiple voice processing servers 200 may be present. FIG. 14 illustrates an exemplary configuration of a printing system 1 according to another embodiment. In the illustrated example, there is a voice processing server 200a corresponding to the voice input / output unit 100a, and a voice processing server 200b corresponding to the voice input / output unit 100b. Here, a single user may print via different voice processing servers 200, or different users may print via different voice processing servers 200. In either case, it is desirable for the printer 400 to transmit printer status information to the voice processing server 200 that received a print instruction requiring notification. From a security perspective, it is preferable for the printer 400 to transmit printer status information only to the voice processing server 200 that issued the print instruction requiring notification. From a convenience perspective, it is preferable for the printer 400 to transmit printer status information to all voice processing servers 200 that issued print instructions for active and pending prints (or, if necessary, the most recently completed print) if different voice processing servers 200 issued print instructions. The printer 400 may also transmit printer status information to all the voice processing servers 200, including information on printing that occurred a predetermined period ago.

[0139] The operational flows in the above-described embodiments do not necessarily have to be executed in chronological order according to the order shown in the flow diagrams. For example, steps in the operations may be executed in an order different from that shown in the flow diagrams, or may be executed in parallel. Furthermore, some steps in the operations may be deleted, or additional steps may be added to the process.

[0140] A program may be provided that causes a computer (audio input / output unit 100, audio processing server 200, printer control server 300, printer 400) to execute the operations according to the above-described embodiments. The program may be recorded on a computer-readable recording medium. Using a computer-readable recording medium, the program can be installed on a computer. Here, the computer-readable medium on which the program is recorded may be a non-transitory print medium. The non-transitory storage medium is not particularly limited, and may be, for example, a storage medium such as a CD-ROM or a DVD-ROM.

[0141] As used in this disclosure, the terms "based on" and "depending on / in response to" do not mean "based only on" or "depending only on," unless expressly stated otherwise. The term "based on" means both "based only on" and "based at least in part on." Similarly, the term "depending on" means both "depending only on" and "depending at least in part on." Furthermore, the terms "include," "comprise," and variations thereof do not mean including only the listed items, but may mean including only the listed items or may include additional items in addition to the listed items. Furthermore, the term "or," as used in this disclosure, is not intended to mean an exclusive or. Furthermore, any reference to elements using designations such as "first," "second," etc., as used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used herein as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed therein or that the first element must precede the second element in some way. In this disclosure, where articles are added by translation, such as a, an, and the in English, these articles shall include the plural unless the context clearly indicates otherwise.

[0142] The above describes the embodiments in detail with reference to the drawings, but the specific configuration is not limited to that described above, and various design changes can be made within the scope that does not deviate from the gist of the invention.

[0143] (7) Supplementary Notes The following are additional notes regarding the features of the above-described embodiment.

[0144] (Supplementary Note 1) A printing system comprising: a printer; an audio input / output unit that accepts audio input; an audio processing server that generates control instructions based on the audio input accepted by the audio input / output unit; and a printer control server that controls the printer based on the control instructions, wherein the printer transmits printer status information regarding the status of the printer to the audio processing server without going through the printer control server, and the audio processing server causes the audio input / output unit to output audio based on the printer status information.

[0145] (Supplementary Note 2) The printing system according to Supplementary Note 1, wherein the control instruction is a print instruction that instructs printing, and the printer control server causes the printer to perform the printing based on the print instruction.

[0146] (Supplementary Note 3) The printing system according to Supplementary Note 2, wherein the printer transmits the printer status information to the voice processing server only within a predetermined time from the start or end of the printing.

[0147] (Supplementary Note 4) The printing system according to Supplementary Note 2 or 3, wherein the printer status information is information relating to an error in the printing.

[0148] (Supplementary Note 5) The printing system according to Supplementary Note 2 or 3, wherein the printer status information is information indicating that the printing has ended normally.

[0149] (Supplementary Note 6) In the printing system described in Supplementary Note 5, if the voice processing server does not receive information indicating that the printing has been completed successfully from the printer within a predetermined time from the timing of the print instruction, the voice input / output unit outputs a voice regarding an abnormality in the printer.

[0150] (Appendix 7) A printing system as described in any of Appendices 1 to 6, wherein the printer control server transmits server information to the printer to identify the voice processing server as the destination of the printer status information, and the printer transmits the printer status information to the voice processing server based on the server information received from the printer control server.

[0151] (Appendix 8) A printing system described in any of Appendices 1 to 7, wherein the printer control server transmits first identification information related to the control of the printer to the voice processing server, transmits second identification information corresponding to the first identification information to the printer, and the printer transmits third identification information based on the second identification information to the voice processing server when transmitting the printer status information.

[0152] (Appendix 9) A printing system described in any of Appendices 1 to 7, wherein the voice processing server transmits first identification information related to control of the printer to the printer control server, the printer control server transmits second identification information corresponding to the first identification information to the printer, and the printer transmits third identification information based on the second identification information to the voice processing server when transmitting the printer status information.

[0153] (Supplementary Note 10) The printing system according to Supplementary Note 8 or 9, wherein each of the first identification information, the second identification information, and the third identification information includes information indicating a user ID and / or information indicating a print ID for identifying printing.

[0154] (Appendix 11) A printing system as described in any of Appendices 8 to 10, wherein the voice processing server, upon receiving the printer status information and the third identification information from the printer, confirms the legitimacy of the printer based on the first identification information and the third identification information, and, upon confirmation of the legitimacy of the printer, causes the voice input / output unit to output voice based on the printer status information.

[0155] (Supplementary Note 12) The printing system according to any one of Supplementary Notes 1 to 11, wherein the printer transmits the printer status information including text in a natural language to the voice processing server.

[0156] (Supplementary Note 13) The printing system according to Supplementary Note 12, wherein the voice processing server causes the voice input / output unit to perform voice output based on the text.

[0157] (Supplementary Note 14) The printing system according to Supplementary Note 12 or 13, wherein the printer status information is information relating to a printing error in the printer, and the text includes text indicating how to deal with the error.

[0158] (Appendix 15) In a printing system described in any of Appendices 1 to 14, when there are multiple audio input / output units, the audio processing server receives audio data for controlling the printer from a first audio input / output unit, and then, in response to receiving other audio data from a second audio input / output unit, causes the second audio input / output unit to output audio based on the printer status information.

[0159] (Appendix 16) The audio processing server, when the other audio data is audio data related to the control of the printer, causes the second audio input / output unit to output audio based on the printer status information; and when the other audio data is audio data not related to the control of the printer, causes the first audio input / output unit to output audio based on the printer status information. This is the printing system described in Appendix 15.

[0160] (Supplementary Note 17) A printer that can be used in a printing system that utilizes a voice input / output unit, comprising: a communication unit that communicates with a voice processing server that generates control instructions based on voice input received by the voice input / output unit, and with a printer control server that controls the printer based on the control instructions; and a control unit that controls the communication unit to send printer status information regarding the status of the printer to the voice processing server without going through the printer control server.

[0161] (Supplementary Note 18) A voice processing server that can be used in a printing system that controls a printer using a voice input / output unit, comprising: a communication unit that communicates with the voice input / output unit, with the printer, and with a printer control server that controls the printer; and a control unit that generates control instructions for the printer control server based on voice input accepted by the voice input / output unit, wherein the communication unit receives printer status information regarding the status of the printer from the printer without going through the printer control server, and the control unit causes the voice input / output unit to output voice based on the printer status information.

[0162] (Supplementary Note 19) A program that causes a printer that can be used in a printing system that utilizes a voice input / output unit to communicate with a voice processing server that generates control instructions based on voice input received by the voice input / output unit, and to communicate with a printer control server that controls the printer based on the control instructions, and to send printer status information regarding the status of the printer to the voice processing server without going through the printer control server.

[0163] 1: Printing system 10: Network 100: Audio input / output unit 101: Speaker 102: Microphone 103: Communication unit 104: Processor 105: Memory 107: Communication unit 110: Control unit 120: Bus 200: Audio processing server 201: Communication unit 202: Processor 203: Memory 210: Control unit 220: Bus 300: Printer control server 301: Communication unit 302: Processor 303: Memory 310: Control unit 320: Bus 400: Printer 401: Printing unit 402: Scanner unit 403: Communication unit 404: Display unit 405: Operation unit 406: Processor 407: Memory 410: Image processing unit 420 : Operation panel 430 : Control unit 440 : Bus

Claims

1. A printing system comprising: a printer; an audio input / output unit that accepts audio input; a audio processing server that generates control instructions based on the audio input accepted by the audio input / output unit; and a printer control server that controls the printer based on the control instructions, wherein the printer transmits printer status information regarding the status of the printer to the audio processing server without going through the printer control server, and the audio processing server causes the audio input / output unit to output audio based on the printer status information.

2. The printing system according to claim 1, wherein the control instruction is a print instruction for instructing printing, and the printer control server causes the printer to perform the printing based on the print instruction.

3. The printing system according to claim 2, wherein the printer transmits the printer status information to the voice processing server only within a predetermined time from the start or end of the printing.

4. The printing system according to claim 2, wherein the printer status information is information regarding a printing error.

5. The printing system according to claim 2, wherein the printer status information is information indicating that the printing has ended normally.

6. The printing system according to claim 5, wherein if the voice processing server does not receive information indicating that the printing has been completed successfully from the printer within a predetermined time from the timing of the print instruction, it causes the voice input / output unit to output a voice regarding an abnormality in the printer.

7. The printing system described in claim 1, wherein the printer control server transmits server information to the printer for identifying the voice processing server as the destination of the printer status information, and the printer transmits the printer status information to the voice processing server based on the server information received from the printer control server.

8. A printing system as described in claim 1, wherein the printer control server transmits first identification information related to the control of the printer to the voice processing server, transmits second identification information corresponding to the first identification information to the printer, and the printer transmits third identification information based on the second identification information to the voice processing server when transmitting the printer status information.

9. A printing system as described in claim 1, wherein the voice processing server transmits first identification information related to control of the printer to the printer control server, the printer control server transmits second identification information corresponding to the first identification information to the printer, and the printer transmits third identification information based on the second identification information to the voice processing server when transmitting the printer status information.

10. A printing system as described in claim 8 or 9, wherein each of the first identification information, the second identification information, and the third identification information includes information indicating a user ID and / or information indicating a print ID for identifying printing.

11. A printing system as described in claim 8 or 9, wherein the voice processing server, upon receiving the printer status information and the third identification information from the printer, verifies the legitimacy of the printer based on the first identification information and the third identification information, and, upon confirmation of the legitimacy of the printer, causes the voice input / output unit to output voice based on the printer status information.

12. The printing system according to claim 1, wherein the printer transmits the printer status information including natural language text to the voice processing server.

13. The printing system according to claim 12, wherein the voice processing server causes the voice input / output unit to perform voice output based on the text.

14. The printing system according to claim 12 or 13, wherein the printer status information is information relating to a printing error in the printer, and the text includes text indicating a method of dealing with the error.

15. A printing system as described in claim 1, wherein when there are multiple audio input / output units, the audio processing server receives audio data for controlling the printer from a first audio input / output unit, and then, in response to receiving other audio data from a second audio input / output unit, causes the second audio input / output unit to output audio based on the printer status information.

16. The printing system described in claim 15, wherein the voice processing server: when the other sound data is sound data related to the control of the printer, causes the second sound input / output unit to output sound based on the printer status information; and when the other sound data is sound data not related to the control of the printer, causes the first sound input / output unit to output sound based on the printer status information.

17. A printer that can be used in a printing system that utilizes a voice input / output unit, comprising: a communication unit that communicates with a voice processing server that generates control instructions based on voice input received by the voice input / output unit, and communicates with a printer control server that controls the printer based on the control instructions; and a control unit that controls the communication unit to send printer status information regarding the status of the printer to the voice processing server without going through the printer control server.

18. A voice processing server usable in a printing system that controls a printer using a voice input / output unit, comprising: a communication unit that communicates with the voice input / output unit, with the printer, and with a printer control server that controls the printer; and a control unit that generates control instructions for the printer control server based on voice input accepted by the voice input / output unit, wherein the communication unit receives printer status information regarding the status of the printer from the printer without going through the printer control server, and the control unit causes the voice input / output unit to output voice based on the printer status information.

19. A program that causes a printer that can be used in a printing system that utilizes a voice input / output unit to communicate with a voice processing server that generates control instructions based on voice input received by the voice input / output unit, and to communicate with a printer control server that controls the printer based on the control instructions, and to transmit printer status information regarding the status of the printer to the voice processing server without going through the printer control server.

Citation Information

Patent Citations

  • Cooperation system and device-control server

    JP2017028586A

  • Voice control device and printer, and control method and program thereof

    JP2019046102A

  • Printing method, voice control system and program

    JP2019067258A

  • Wireless terminal, management server, intention interpretation server, control method thereof, and program

    JP2019109752A

  • Information processing device, information processing system, information processing method and information processing program

    JP2020087386A