Peripheral equipment management system, method and printing device control system

Abstract

The present invention provides a peripheral device management system, method and printing device control system. The peripheral device management system comprises: a management unit for managing peripheral devices; a control unit for generating an operation instruction for the peripheral device in response to an instruction received through a voice control device, based on an administrator account associated with the voice control device and a service account associated with the peripheral device, by specifying a peripheral device corresponding to the instruction; and a unit for sending the generated operation instruction to the specified peripheral device; wherein, when the voice control device receives an instruction related to maintenance, the control unit generates a maintenance operation instruction for the peripheral device.

Description

Technical Field

[0001] The invention relates to a peripheral equipment management system, a peripheral equipment management method and a printing device control system. Background Art

[0002] There is a known technology for controlling a printing device by giving voice commands directly to the printing device or an information processing device connected to the printing device. Japanese Patent Laid-Open No. 2006-95984 describes a technology that can cause a printing device to execute a function that can be instructed to the printing device from a UI of a printer application by voice commands. Summary of the invention

[0003] In the technology described in Japanese Patent Laid-Open No. 2006-95984, in order to control a printing device, a user needs to say something about the printing device or an information processing device connected to the printing device that he / she wants to instruct. In such a mechanism, in an environment where there are multiple printing devices, it is difficult to issue instructions only to a specific printing device.

[0004] The present invention can control a specific printing device even in an environment where a plurality of printing devices exist.

[0005] According to one aspect of the present invention, there is provided a peripheral device management system, comprising: a management unit for managing peripheral devices; a control unit for generating, in response to an instruction received through a voice control device, an operation instruction for the peripheral device by specifying a peripheral device corresponding to the instruction, based on an administrator account associated with the voice control device and a service account associated with the peripheral device; and a unit for sending the generated operation instruction to the specified peripheral device; wherein, in a case where the voice control device accepts an instruction related to maintenance, the control unit generates a maintenance operation instruction for the peripheral device.

[0006] According to a second aspect of the present invention, there is provided a peripheral device management method using a management unit, wherein the management unit is used to manage peripheral devices, the method comprising: in response to an instruction received through a voice control device, based on an administrator account associated with the voice control device and a service account associated with the peripheral device, by specifying a peripheral device corresponding to the instruction, generating an operation instruction for the peripheral device; and sending the generated operation instruction to the specified peripheral device; wherein, in a case where the voice control device accepts an instruction related to maintenance, the operation instruction for maintenance is generated for the peripheral device.

[0007] According to a third aspect of the present invention, a printing device control system is provided, which includes a printing device management server system for generating operation instructions based on voice instructions accepted through a voice control device, and a printing device for operating based on the operation instructions generated by the printing device management server system, the printing device management server system including: a determination unit, which is used to: determine whether the operation can be performed in the printing device according to the setting content included in the voice instruction based on the setting items associated with the type of operation as the object of the voice instruction sent by the voice control device, a first sending unit, which is used to send message data to the voice control device when the determination unit determines that the specified operation can be performed, the message data being used to inquire about the setting content of the setting item that enables the operation to be performed, and a generation unit, which is used to generate an operation instruction for performing the operation by acquiring the setting content of other setting items except the setting items associated with the type of operation when the determination unit determines that the specified operation can be performed.

[0008] According to the present invention, even in the case where there are a plurality of printing apparatuses, a specific printing apparatus among the plurality of printing apparatuses can be controlled by a voice command.

[0009] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 is a block diagram showing the configuration of a printing apparatus control system;

[0011] Figure 2 is a block diagram showing a configuration of a voice control device;

[0012] Figure 3 is a block diagram showing the configuration of the MFP;

[0013] Figure 4 is a block diagram showing the configuration of a voice control device management server and a printing apparatus management server;

[0014] Figure 5 is a sequence diagram showing a process of associating a voice control device and an MPF ​​with each other;

[0015] Figure 6 is a timing chart showing a process of activating a printing device control system;

[0016] Figure 7 is a timing chart showing the process from user instruction to execution of head cleaning;

[0017] Figure 8 is a table showing a summary of functions and setting items that can be instructed to the printing device;

[0018] Fig. 9 is a timing chart showing processing of a printing apparatus control system according to the specifications of the printing apparatus; and

[0019] Fig.10 It is a table showing the correspondence between printing devices and specification information. DETAILED DESCRIPTION

[0020] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the present invention. A plurality of features are described in the embodiments, but the present invention is not limited to requiring all of these features, and a plurality of these features can be appropriately combined. In addition, in the accompanying drawings, the same reference numerals are given to the same or similar structures, and their redundant descriptions are omitted.

[0021] [First embodiment]

[0022] System Configuration

[0023] Figure 1 is a block diagram showing the configuration of a printing apparatus control system according to the present embodiment. Figure 1 The printing device control system shown is a system in which a voice control device 100, a voice control device management server 200, a printing device management server 300, and an MFP 400 are communicatively connected via a network (e.g., the Internet). The voice control device 100 can send voice data corresponding to a voice uttered by a user via the network, and can output voice data received via the network by voice. The voice control device 100 can be a computer device such as a smartphone, a computer, a tablet computer, or a so-called smart speaker, which has a voice input / output function and a communication function, and can be connected to the voice control device management server 200 at the application layer. The voice control device management server 200 is composed of a server or a server group that manages the voice control device 100. The voice control device management server 200 performs a predetermined process (described later) according to the content of the voice data received from the voice control device 100, for example. Note that the MFP 400 is an example of a management object peripheral device. The present invention is not limited to a printing device such as an MFP, and can also be applied to other peripheral devices. However, in this example, an MFP with a printing function will be taken as an example.

[0024] The voice control device management server 200 may be provided by, for example, a cloud server. In this case, the voice control service provided by the voice control device management server 200 may change according to the cloud server used. For example, voice data may be input from the voice control device 100, and the voice control device management server 200 may perform voice recognition. On the contrary, the voice control device management server 200 may merge the voice data according to the text data, thereby outputting the obtained data to the voice control device 100 to reproduce it. As an optional manner, the voice control device 100 may perform voice recognition and voice merging, and may input / output text data. This example assumes the former configuration. The functions of the voice control device management server 200 may be performed not only by one server, but also by multiple servers that cooperate with each other. Note that the voice control device management server 200 manages the voice control device 100, and performs processing such as specifying an administrator account by authenticating the user based on the voice data output from the voice control device. In addition, the voice control device management server 200 specifies a service account for a printing service associated with the administrator account.

[0025] The printing device management server 300 controls the MFP 400 and is composed of, for example, a server or a server group that generates operation instruction data (or operation instruction) in response to a request from the voice control device management server 200 and sends it to the MFP 400. The printing device management server 300 manages the user and the image forming device (e.g., MFP) in association with each other through, for example, a management table. That is, the printing device management server 300 stores the service account of the printing service and the information related to the image forming device (e.g., MFP 400) (e.g., identification information such as a model name or a device name) in association with each other. Note that the printing device management server 300 can be connected to a plurality of MFPs. In addition, the functions of the printing device management server 300 can be performed not only by one server but also by a plurality of servers that cooperate with each other.

[0026] Since the printing device management server 300 is implemented by being installed in a server, the server may be considered as the printing device management server hereinafter. Although some functions of the voice control device management server 200 may be provided by an application provided by a cloud server or the like, a provider of the printing device management server 300 may provide an interface for the printing device management server 300. The interface for the printing device management server 300 is similar to, for example, Figure 6 , 79, corresponds to the process between the voice control device management server 200 and the printing device management server 300. In this case, hereinafter, the printing device management server 300 and the interface between the voice control device management server 200 and the printing device management server 300 may be collectively considered as a printing device management system or a peripheral device management system.

[0027] Hardware configuration of voice control devices

[0028] Figure 2 1 is a block diagram showing the hardware configuration of the voice control device 100. The voice control device 100 includes a speaker 101, a CPU 102, a ROM 103, a microphone 104, a RAM 105, an external storage device 106, a communication unit 107, and a short-range wireless communication unit 108. Note that Figure 2 The blocks shown are interconnected using, for example, an internal bus. Note also that CPU is an acronym for Central Processing Unit, ROM is an acronym for Read Only Memory, and RAM is an acronym for Random Access Memory. In the present embodiment, for example, when the CPU 102 loads a program stored in the ROM 103 into the RAM 105 and executes the program, the operation of the voice control device 100 is implemented.

[0029] The speaker 101 outputs speech based on speech data. The CPU 102 is provided on, for example, a system control board, and controls the speech control device 100 as a whole. The ROM 103 stores fixed data (for example, a control program), a data table, and an embedded operating system (OS) program to be executed by the CPU 102. In the present embodiment, each control program stored in the ROM 103 is an object of software execution control of the embedded OS stored in the ROM 103. The software execution control is, for example, timing scheduling, task switching, or interrupt processing. The microphone 104 receives speech, for example, speech uttered by a user, on a peripheral device of the speech control device 100. The received speech is converted into digital speech data by, for example, a program executed by the CPU 102.

[0030] The RAM 105 is composed of, for example, a static random access memory (SRAM) or the like that requires a backup power supply. Note that the RAM 105 retains data by a primary power supply (not shown) for data backup, so that data (such as program control variables) can be retained without being lost. In addition, a storage area is also provided in the RAM 105 to store setting information and management data of the voice control device 100. The RAM 105 is also used as a main memory and a working memory for the CPU 102. The external storage device 106 stores application software.

[0031] The communication unit 107 includes a circuit and an antenna for performing communication according to a predetermined wireless communication method. For example, the communication unit 107 can be wirelessly connected to an external access point. In addition, the communication unit 107 can be temporarily operated as an access point. The wireless communication used in the present embodiment may have the ability to operate according to a wireless communication method of a wireless LAN that conforms to the IEEE802.11 standard series, or may have the ability to operate according to other wireless communication methods. The short-range wireless communication unit 108 performs short-range wireless communication with other devices that exist within a predetermined short range from the voice control device 100. Note that the short-range wireless communication unit 108 performs communication using a wireless communication method different from that of the communication unit 107. In the present embodiment, the short-range wireless communication unit 108 performs communication according to The communication partner includes, for example, a voice control device management server 200 connected via a network such as the Internet.

[0032] The voice recognition / voice output unit 109 recognizes voice output via the microphone 104 to generate voice data, and also converts voice data received from the outside (for example, from the voice control device management server 200 ) or pre-held message data into a voice signal to output voice from the speaker 101 .

[0033] Common hardware configuration of the server

[0034] Figure 4 is a block diagram showing a schematic configuration of a server in which the voice control device management server 200 and the printing apparatus management server 300 are operable.

[0035] CPU 201 is a central processing unit for controlling each unit described below. Storage device 210 stores application 211, database 212, OS and various files read out by CPU 201. External storage medium reading device 202 is a device for reading information (such as files) stored in an external storage medium (such as an SD card). Memory 203 is composed of RAM, etc., and CPU 201 temporarily stores or caches data in memory 203 as needed. Display unit 204 is composed of, for example, LCD, and displays various information. Operation unit 205 is composed of a keyboard, mouse, etc. used by the user to perform various input operations. Network communication unit 206 is connected to a network (such as the Internet) via network connection unit 207 to perform various communications. Network communication unit 206 supports wired LAN or wireless LAN. For wired LAN, network connection unit 207 is a connector for connecting a wired LAN cable. For wireless LAN, network connection unit 207 is an antenna. Note that in this embodiment, if the image processing apparatus performs wireless communication via a wireless LAN, wireless communication conforming to the IEEE802.11 standard series is performed. The network connection unit 207 can support both wired LAN and wireless LAN. The USB communication unit 208 is connected to various peripheral devices via the USB connection unit 209 to perform various communications.

[0036] Furthermore, for example, when the CPU 201 loads a program required for processing from the disk device to the memory 203 and executes the program, the voice control device management server 200 (or the printing apparatus management server 300) according to the present embodiment is implemented. Figure 2 The voice recognition function of the voice recognition / voice output unit 109 shown may be included in Figure 4 In this case, including Figure 4 The configured device can, for example, recognize a voice signal emitted from the voice control device 100, recognize a predetermined word, and extract the predetermined word. Although the present embodiment describes the voice control device management server 200 and the printing device management server 300 as separate devices (information processing devices), these servers may also be composed of a printing control device that combines the service functions of both. As an optional manner, each of the voice control device management server 200 and the printing device management server 300 may be composed of a plurality of servers. The display unit 204 and the operation unit 205 are not necessary to perform the functions of the present embodiment.

[0037] Configuration of image processing device

[0038] Figure 34 is a block diagram showing a schematic configuration of an MFP 400 as an image processing device. Note that this specification takes an MFP (multifunction printer) that performs a printing function, a maintenance function, etc. as an example of a peripheral device. However, an image processing device, a copier, a fax machine, a printing device with a single function, etc. may also be used. Note that the MFP 400 is used as an image forming device for forming an image on a printing medium by a predetermined printing method, for example, an inkjet printing method or an electrophotographic method may be adopted as a printing method.

[0039] In the MFP 400 , a printing function is implemented by a printer unit 501 , a scanner function is implemented by a scanner unit 502 , and a storage function is implemented by a memory card attachment unit 503 and a memory card 504 .

[0040] The printer unit 501 prints image data stored in the memory 504 or the like received from the outside on a printing sheet by a printing method such as an inkjet printing method or an electrophotographic method. In addition, the printer unit 501 manages ink information including the remaining amount of ink and sheet information including the number of stacked sheets. For example, for the inkjet method, the printer unit 501 may have a cleaning function for restoring ink discharge capability or a mechanism for function restoration.

[0041] The scanner unit 502 optically reads an original set on an original table (not shown), converts it into electronic data, and transmits the image data converted into a specified file format to an external device via a network or stores the image data in a storage area (not shown) such as an HDD, etc. When the image data generated by the scanner unit 502 reading the original placed on the original table is transmitted to the printer unit 501, a copy service is implemented, and the printer unit 501 prints the image data on a printing sheet.

[0042] The memory card 504 attached to the memory card attachment unit 503 stores various file data. The file data can be read out from an external device via a network and edited. In addition, the file data can be stored in the memory card 504 from an external device.

[0043] In addition, the MFP 400 includes a CPU 505, a program memory 506, a working memory 508, a display unit 509, an operation unit 510, a network communication unit 512, a network connection unit 513, and a flash memory 511. The CPU 505 is a central processing unit for controlling each unit in the MFP 400. The program memory 506 is composed of a ROM, etc., and stores various program codes and an application 507 for communicating with a server device. The application 507 accesses the printer unit 501 to obtain consumables information related to ink, sheets, etc. The working memory 508 is composed of a RAM, etc., and temporarily stores or caches image data, etc. when executing each service. The display unit 509 is composed of, for example, an LCD, and displays various information. The operation unit 510 is composed of switches, etc., which are used by the user to perform various input operations.

[0044] The network communication unit 512 connects the MFP 400 to a network to perform various communications. The MFP 400 can be connected to a network (e.g., the Internet) via the network connection unit 513. The server that provides the printing device management server 300 is also connected to the network. The network communication unit 512 supports a wired LAN or a wireless LAN. For a wired LAN, the network connection unit 513 is a connector for connecting a wired LAN cable. For a wireless LAN, the network connection unit 513 is an antenna. Note that in this embodiment, if the image processing device performs wireless communication via a wireless LAN, wireless communication that complies with the IEEE802.11 standard series is performed. The network communication unit 512 can perform wired communication via a wired LAN or wireless communication via a wireless LAN solely or simultaneously. Note that the network connection unit 513 can support both a wired LAN and a wireless LAN. The flash memory 511 is a non-volatile memory for storing image data received by the network communication unit 512, etc. When the CPU 505 reads out a program necessary for processing and executes the program, processing of the MFP 400 (described later) is implemented. Although not shown, the image processing device may also be based on The standard implements short-range wireless communication. The short-range wireless communication and the above-mentioned wireless communication through the wireless LAN can be implemented by different chips or the same chip.

[0045] Notice, Figure 2 , Figure 3 and Figure 4 The configuration shown is only an example, and each device may include Figure 2 , Figure 3 and Figure 4 Hardware components other than those shown. Figure 2 , Figure 3 and Figure 4 In each of the figures, multiple blocks can be integrated into one block, and one block can also be divided into two or more blocks. That is, Figure 2, Figure 3 and Figure 4 Each of the illustrated devices may have other configurations as long as the processing according to the present embodiment (to be described later) can be performed.

[0046] Creation of printing device control system

[0047] Next, a process of associating the voice control apparatus 100 and the MFP 400 with each other in order for the user to use the service of the printing device control system (the operation of the present embodiment) will be described. This associating process is a user registration process necessary for the user to use the service of the printing device control system (the operation of the present embodiment) by voice instruction. This associating process associates the MFP 400 that performs printing in response to the user voice accepted by the voice control apparatus 100 with the voice control apparatus 100. Figure 5 1 is a sequence diagram showing the processes in which the voice control device 100 and the MFP 400 are associated with each other. The processes executed by each device in the sequence diagram are implemented when the CPU of each device executes the program stored in the ROM or the like of each device. The program executed by the user terminal is a voice control application. Note that before this process, the printing device management server 300 is registered in the voice control device management server 200. For example, the URL of the authentication screen of the printing device management server 300 has been registered in the voice control device management server 200, and the sending destination of the authentication information for the printing device management server 300 when the authentication is performed on the authentication screen has been registered in the printing device management server 300. Specifically, using the voice control application of the user terminal (for example, a personal computer or a mobile terminal such as a smartphone), the user logs in in advance to the administrator account (user account for the voice control device 100) issued and managed by the voice control device management server 200. This enables the voice control device management server 200 to recognize the information related to the voice control application of the user terminal associated with the administrator account. In addition, the user terminal recognizes the information related to the administrator account (user ID and password). Note that by adding a display unit (such as a touch panel) to Figure 2 The configuration obtained by the hardware configuration shown generally constitutes a user terminal.

[0048] At the beginning Figure 5Prior to the timing sequence shown, the voice control device 100 and the administrator account are associated with each other. Specifically, when acquiring information related to the administrator account from the user terminal via the local area network, the voice control device 100 sends its own identification information and information related to the administrator account to the voice control device management server 200. Therefore, the voice control device management server 200 manages the voice control device 100 and the administrator account in association with each other. Note that if a display unit is provided on the voice control device 100, the user can log in to the administrator account using the display unit, thereby associating the voice control device 100 with the administrator account.

[0049] In addition, at the beginning Figure 5 Prior to the sequence shown, it is preferable to associate the user's voice data with the administrator account. Specifically, the voice control device 100 sends the voice data based on the voice received from the user to the voice control device management server 200. Then, the voice control device management server 200 manages the user's voice data and the administrator account in association with each other. This embodiment assumes that multiple administrator accounts can be registered in association with one voice control device 100. Note that if a microphone and a speaker are provided on a user terminal, the user terminal can send the voice data based on the voice received by the user terminal to the voice control device management server 200. Specifically, it is preferable to link the acceptance of the voice and the administrator account to each other by the user issuing an instruction using the voice control application in the user terminal. In this case as well, the voice control device management server 200 can manage the accepted voice data and the administrator account in association with each other.

[0050] In addition, at the beginning Figure 5 Prior to the sequence shown, the user acquires a service account managed by the printing device management server 300. The service account managed by the printing device management server 300 is a user account required to use the print service provided by the printing device management server 300.

[0051] Although one or more management target image processing devices can be registered in the printing device management server 300, Figure 5 During the process shown, the registration process may or may not be performed.

[0052] exist Figure 5In the sequence shown, the user uses the user terminal that is pre-associated with the voice control device 100 to send a registration request of the printing device management server 300 to the voice control device management server 200 (S501). For example, the registration request in S501 can be executed on a local application installed on the user terminal, or from a web page via a web browser. Note that the voice control device 100 and the user terminal can be associated with each other using the user information (administrator account) of the voice control device management server 200 described above. Therefore, if the voice control device 100 has the necessary input / output capabilities, the voice control device 100 can be used as a user terminal.

[0053] Upon receiving a registration request from the printing device management server 300, the voice control device management server 200 requests the user terminal to access a pre-registered authentication URL, wherein the printing device management server 300 authenticates the user (performs user authentication) (S502). Upon receiving the request, the user terminal sends an authentication request to the printing device management server 300 based on the received authentication URL (S503), and the printing device management server 300 sends authentication screen data to the user terminal (S504). When acquiring the authentication screen data, the user terminal displays an authentication screen based on the authentication screen data. The user then uses the displayed authentication screen to enter authentication information, which is authentication information required to use the services of the pre-registered printing device management server 300. The required authentication information includes, for example, a user ID and password for a service account registered for the user to log in to the printing device management server 300.

[0054] If the user inputs authentication information necessary for using the service of the printing device management server 300 on the user terminal, the user terminal sends the input authentication information to the printing device management server 300 (S505). The printing device management server 300 performs authentication processing based on the authentication information sent from the user terminal. If the authentication processing is successfully completed, the printing device management server 300 sends a callback signal (callback) to the voice control device management server 200 (S506). The destination of the callback signal is pre-registered in the printing device management server 300, and the callback signal includes an access token generated based on the authentication information authenticated by the printing device management server 300.

[0055] The voice control device management server 200 acquires an access token for accessing the printing device management server 300 through the callback signal. The voice control device management server 200 stores the information of the refresh token or access token acquired in S506 and necessary for accessing the printing device management server 300 together with the information of the voice control device 100 associated with the user terminal (S507).

[0056] The voice control device management server 200 can access the printing device management server 300 using the acquired access token. Then, the printing device management server 300 can specify the login user (corresponding to the service account) based on the access token, thereby specifying the MFP 400 registered by the user. Note that in the present embodiment, the validity period of the access token or the refresh token is an indefinite period (or, in actual use, the validity period can be regarded as an indefinite period). In S507, the access token can be saved in association with the user information (administrator account) used when the user terminal logs in to the voice control device management server 200. That is, for a given user, the user information (administrator account) of the voice control device management server 200 and the access token saved in S507 (i.e., the user information (service account) of the printing device management server 300) are linked to each other. This enables the user of the voice control device 100 to log in to the printing device management server 300 and use the MFP, i.e., the image forming device under the management of the printing device management server 300 and associated with the user.

[0057] In the above description, the user authentication operation is exemplified as a method of associating the voice control apparatus 100 and the MFP 400 with each other. However, other methods may be used as long as the voice control apparatus 100 and the MFP 400 can be associated with each other.

[0058] ·Users use MFP

[0059] The following will refer to Figure 6 and Figure 7 100 will be described as follows: a process from when a user issues a voice instruction to when the MFP 400 associated with the voice control device 100 performs a designated operation. It is assumed that the user of the voice control device 100 has logged in to the voice control device management server 200. In this state, the voice control device 100 can accept voice instructions. Usually, the logged-in state can be maintained in order to accept voice instructions. The processing performed by each device in this sequence is implemented when the CPU of each device executes a program stored in the ROM or the like of each device.

[0060] To call the function of the MFP 400 (S601), the user speaks "Activate printer" to the microphone 104 of the voice control device 100. As a keyword (activation phrase) for calling the function of the MFP 400, the utterance content is registered in the voice control device management server 200 in advance.

[0061] The voice control device 100 transmits the utterance content received in S601 to the voice control device management server 200 (S602). Note that the voice data of the utterance content of the user may be transmitted intact, or the voice content may be converted into text data in the voice control device 100 and then transmitted. Then, the voice control device management server 200 confirms the MFP 400 managed by the printing device management server 300 to generate the utterance content based on the received keyword "activate printer".

[0062] To this end, the voice control device management server 200 sends a request to the printing device management server 300 to request printer information (S603). Before the request, the voice control device management server 200 logs in to the printing device management server 300 using the access token stored in association with the user information of the user who uttered the utterance content in S602. Note that the access token may be sent for each request. Figure 5 In the process shown, if the voice control device management server 200 once logs in to the printing device management server 300, the login state can be maintained before the logout operation. In this case, it is not necessary to perform the login operation for each request. Upon receiving the request, the printing device management server 300 obtains the information of the MFP 400 linked to the account of the user who is the source of the request (S604). In response, the printing device management server 300 returns the printer information of the MFP 400 to the voice control device management server 200 (S605). When acquiring the information of the MFP, the voice control device management server 200 generates message data (hereinafter referred to as message 1) for outputting voice from the speaker 101 of the voice control device 100 (S606 and S607). Message 1 is a message for inquiring about operations that can be instructed by the user. If the MFP 400 corresponding to the printing device management server 300 is not registered, even if the user instructs any operation next, no operation is specified for the MFP 400, and thus a message such as "There is no registered printer. You must register the printer to use it" is generated (S606). On the other hand, if the MFP 400 corresponding to the printing device management server 300 is registered, the user can use the system normally, and thus a message such as "What do you want to print?" is generated (S607). The voice control device management server 200 transmits the generated message 1 to the voice control device 100 (S607), and the voice control device 100 reproduces the received message 1 to the user by outputting the message 1 by voice from the speaker 101 (S608).

[0063] The printing device management server 300 generates the message 1 according to whether the MFP 400 is registered in the printing device management server 300. However, the generated message can be transformed in consideration of the past registration status. For example, if the MFP 400 was registered in the printing device management server 300 yesterday but not registered today, the possibility that the user intends to convert the registered printer and always fails to convert is considered. In this case, according to the user's environment, an announcement is made by generating a message such as "The printer cannot be found. You must register the printer to use the system." If two or more MFPs 400 are connected to the printing device management server 300, the user can predetermine the priority order and issue an operation instruction to the MFP 400 with the highest priority level, or, each time the user issues an operation instruction, the user can be asked about the MFP 400 to which the operation instruction is issued.

[0064] Then, the user hears the message 1 reproduced in S609, and instructs the operation to be performed in the MFP 400 by voice. Figure 7 to set the following description. Figure 7 In S701, the user says, for example, "maintenance". The voice control device 100 sends the speech content received in S701 to the voice control device management server 200 (S702). Similar to S602, the sending method at this time can be voice data or text data. Regarding the correspondence between the speech content and the operation indicated by the speech content, for example, predetermined keywords can be extracted by analyzing the text corresponding to the speech content, and then the operation can be determined based on the keyword, or the operation can be determined by pre-performing machine learning of the correspondence between the text and the operation and using the learned correspondence. Of course, these are only examples. As the operation to be performed, the specified operation is stored in a memory or the like.

[0065] The voice control device management server 200 determines whether to perform additional settings for the type of the specified operation (S703). Figure 8 The determination process is performed by viewing the operation setting table shown and confirming the presence / absence of additional setting items for the designated operation.

[0066] Operation Setting Table ( Figure 8 )

[0067] Figure 8 An example of a table held by the voice control device management server 200 is shown. Figure 8 The table shown is held in, for example, the storage device 210. For item 801 of the table, categories of functions that can be instructed to the printer are listed. Figure 8, as a list of instructions to the printer, a "print" function, a "copy" function, and a "maintenance" function are listed. For item 802, a specific function belonging to each instruction category is associated. In addition, additional setting items 803 can be specified according to the function. For example, in Figure 8 In , "difficulty level" is associated with "number place", and "intensity" is associated with "cleaning". In addition, for item 804, candidates for settable values ​​are associated as setting contents for each additional setting item 803. For example, in Figure 8 In the example, “Easy, Normal, Hard” is associated with the “Difficulty Level”. In addition, “-” indicates that there is no item with additional setting content.

[0068] As described above, corresponding to the classification 801 of the indicated operation, the operation setting table includes a function 802 for each operation, a necessary additional setting item 803 for each function, and a settable value 804 (i.e., an option) of the setting item, and these items may have a hierarchical relationship. The existence / non-existence of the attachment setting item is determined with reference to the classification 801 of the indicated operation (or instruction), that is, the existence / non-existence of other setting items other than the setting items associated with the classification of the operation instruction. The additional settings include the specifications of the function and the specifications of the setting items. Note that in the operation setting table, a text message for asking the user about the function and the setting value may be registered in each domain. For example, if the classification of the operation is "maintenance", "cleaning" or "nozzle detection pattern printing" may be selected as a function. A text message for asking the user about which function to select may be registered in association with the operation classification "maintenance".

[0069] As a result of the determination processing in S703, if it is determined that there are additional setting items, message data of message 2 (hereinafter, also referred to as message 2) is generated, which indicates the content output to the user by voice by the voice control device 100 (S704). The content of message 2 is the content indicating the operation that can be specified by the user next. For example, if "maintenance" is specified as the operation, "cleaning" and "nozzle detection pattern printing" are specified as Figure 8 In this case, as the content of message 2, message data of "Which one do you select, "Cleaning" or "Nozzle Check"?" is generated.

[0070] The voice control device management server 200 transmits the generated message 2 to the voice control device 100 (S705), and the voice control device 100 outputs the message 2 by voice through the speaker 101 to reproduce the received message 2 to the user (S706).

[0071] Subsequently, the user selects one of the settable values ​​for the additional setting item represented by the message 2 reproduced in S706, and speaks the additional setting (S707). For example, for the message 2 related to the above-mentioned cleaning intensity, "strong" is spoken. The voice control device 100 sends the received speech content to the voice control device management server 200 (S708). Similar to S602, the sending method at this time can be voice data or text data. The received additional settings are stored in association with the operations received and stored in S702.

[0072] Upon receiving the request, the voice control device management server 200 confirms whether all setting information for cleaning has been set (S709). If it is determined that all setting information has not been set, for example, if the reference Figure 8 If the operation setting table shown determines that there are more necessary setting items, S704 to S709 for setting the items are repeated. For example, if "cleaning" is selected as the function of the maintenance operation, it is determined that there is "intensity" as an additional setting item. Then, message data of message 2 (hereinafter, also referred to as message 2 for short) is generated, which represents the content output to the user by voice by the voice control device 100 (S704). The content of message 2 is the content representing the operation to be instructed by the user next. For example, if "cleaning" is specified as the operation, there is "intensity" as an additional setting item. Figure 8 In the additional setting item "Strength" in the example, there are two settable values ​​"Normal, Strong". In this case, as the content of Message 2, message data "Do you want to perform normal cleaning or strong cleaning?" is generated. In S709, by accepting the user's input (utterance) to the message and making necessary selections, it is determined whether all setting values ​​have been set. Figure 8 The determination process is performed by using the operation setting table shown in FIG. Figure 7 In the embodiment, the processing in S704 to S709 is a loop processing, and thus only the processing of the first loop is described above.

[0073] If all setting values ​​have been set, operation instruction data is generated (S710) based on information of "operation" (e.g., "maintenance"), "function of MFP 400" (e.g., "cleaning"), and "additional setting value" (e.g., "strength"), all of which have been obtained through the above series of interactions. Then, the voice control device management server 200 sends the generated operation instruction data to the printing device management server 300 (S711). The printing device management server 300 issues an operation instruction to the MFP 400 based on the received operation instruction data (S712), and the MFP 400 then operates according to the instruction (S713). In the above example, for example, the MFP 400 performs head cleaning with the specified intensity. The MFP 400, which is the object of the operation instruction, is generated by Figure 5In the process shown, the MFP is associated with the user account of the user of the voice control device 100. That is, even in the case where the printing device management server 300 manages a plurality of MFPs 400, the user can issue an operation instruction to the MFP he / she uses.

[0074] As described above, according to the present embodiment, if there are additional setting items, a voice for requesting the user's additional setting items is generated and output, and then the user speaks the desired items. With this configuration, even if the setting items for indicating the MFP 400 have a hierarchical structure, the user does not need to operate the setting screen, thereby improving usability.

[0075] Furthermore, even in an environment where a plurality of MFPs exist, the MFP associated with the user can be operated by voice without affecting the remaining MFPs.

[0076] In the above description, if the user says "strong", the processing enters the operation of performing S713. However, after S709, the voice control device management server 200 may generate confirmation message data of "Are you sure you want to perform strong cleaning?" and send it to the voice control device 100. The message can be generated based on the operation stored for each user input and the setting value associated with the operation. In this case, the confirmation message is output from the speaker 101 of the voice control device 100. Then, if the user says "yes", the voice control device 100 outputs the message of "start strong cleaning" from the speaker 101. Similar to S708, the voice control device 100 sends the speech content "yes" to the voice control device management server 200. After that, the processing of S710 to S713 is performed. In the above example, if the user says "no", the processing can be repeated from S704. By prompting the user to confirm by outputting a confirmation message with voice, the user can confirm the indicated operation and then perform the operation.

[0077] As described above, in this embodiment, in addition to printing, maintenance instructions such as cleaning can also be issued via voice control device 100. Printing device management server 300 can Figure 8 The execution history of the operation of item 801 is maintained in, for example, the storage device 210. In this case, the response information (S714) as a response to the voice control device management server 200 may include the execution history of the operation. For example, strong cleaning may be recommended to a user who repeatedly performs ordinary cleaning in a short period of time. The priority level of each setting value may be determined based on previous operations. As an option, a default setting value may be determined.

[0078] Can Figure 8The information of the table shown is confirmed to be changeable by the user of the printing device management server 300 (ie, the user is also the user of the voice control apparatus 100). For example, the user can change (edit) the content of each of items 801, 802, 803, and 804 on the UI screen displayed by the display unit 204.

[0079] [Second embodiment]

[0080] exist Figure 6 In the example, from the time when the user issues an operation instruction to the time when the message 1 is generated, the voice control device management server 200 inquires the printing device management server 300 for printer information, and generates the message 1 according to the presence / absence of the printer. However, between the old model MFP 400 and the new model MFP 400, the operation that can be instructed from the printing device management server 300 may be different. In this case, when the message is generated according to the model used by the user and notified to the user, the usability can be improved. Fig. 9 A process of generating a message based on the specification information of the MFP 400 will be described.

[0081] To call the function of the MFP 400, the user speaks "Activate printer" to the microphone 104 of the voice control device 100 (S901). The utterance content as a keyword (activation phrase) to call the function of the MFP 400 is registered in advance in the voice control device management server 200.

[0082] The voice control device 100 sends the speech content received in S901 to the voice control device management server 200 (S902). Note that the voice data of the user's speech content may be sent intact, or the voice data may be converted into text data in the voice control device 100 and then sent. Then, in order to generate speech content for the user, the voice control device management server 200 inquires the printing device management server 300 about the specification information of the MFP 400 based on the received keyword "activate printer" (S903). Similar to the first embodiment, at this time, the voice control device management server 200 logs in to the printing device management server 300 using an access token linked to a user account that has been used by the voice control device 100 to log in to the voice control device management server 200, thereby making an inquiry. Upon receiving the inquiry, the printing device management server 300 maintains, for example, in a storage device 210 Fig.10 The device management server 200 obtains specification information corresponding to the MFP 400 under its own management from the specification table shown (S904), and controls the device management server 200 in response to the voice (S905). Fig.10The printing device 1001 and the specification 1002 corresponding to the printing device are shown, and it is indicated that, for example, only the printing function can be instructed from the printing device management server 300 to the MFP 1. Note that Fig.10 The table shown may be provided outside the printing device management server 300, for example, an external cloud server or database. For example, if the MFP 400 is a model that accepts only the printing function, a message "Do you want to print?" is generated (S906). On the other hand, if the MFP 400 is a model that accepts both the printing function and the maintenance function, a message "Do you want to print or perform maintenance?" is generated (S907). The user may be enabled to select a function to be used from the functions of a device (e.g., a printing device).

[0083] In the present embodiment, the specification information of the MFP 400 is held in the printing apparatus management server 300. However, upon receiving a request from the voice control device management server 200, the specification information may be inquired of the MFP 400. In this case, the specification information of the MFP 400 that has been inquired may be cached, and when the voice control device management server 200 inquires for the specification information next time, a response may be returned based on the cached information.

[0084] As another example of changing the operation of the system based on the specification information of the MFP 400, consider printing a help page. The help page is a simple instruction manual in which functions that the user can instruct by voice in the system can be listed, and can be printed by the system. During the voice interaction process, the user may need guidance on functions in the system. In this case, when the user speaks a keyword such as "help" for requesting guidance, a notification according to the current interaction state can be output by voice.

[0085] If the user says "Help" to the voice output "What do you want to print?", message data may be generated by the voice control device management server 200 and output by the voice control device 100 through voice, and the message data provides a more detailed description, such as "You can print, copy, or perform maintenance. You can confirm the details by printing the help page. Do you want to print the help page?". Fig. 9Similar to the process shown in , if the user says "yes" in response to the message, the voice-controlled device management server 200 acquires the specification information of the MFP 400 via the printing device management server 300. For example, if the model of the MFP 400 supports only the printing function, the voice-controlled device management server 200 generates a help page including only the functions common to any model based on the acquired specification information of the MFP 400. On the other hand, if the model of the MFP 400 also supports the copy function and the maintenance function, the voice-controlled device management server 200 generates a help page including the functions used only by the new model in addition to the functions common to any model. A print request for the print data of the help page generated by the voice-controlled device management server 200 is sent to the printing device management server 300. Upon receiving the print request, the printing device management server 300 sends the print request to the MFP 400, and the MFP 400 prints the print data.

[0086] As described above, the voice guidance of the system can be changed according to the specification information of the MFP 400 held by the user, and the print content can be changed according to the specification information of the MFP 400 .

[0087] When using this system, the MFP 400 needs to be in an online state. When the MFP 400 is in an offline state, even if the user issues an operation instruction from the printing device management server 300 to the MFP 400 by voice instruction, the MFP 400 does not operate. In order to solve this problem, the MFP 400 is always maintained in a sleep state, and a setting (called automatic power-on setting) that automatically turns on the power according to the received operation instruction is enabled to perform a predetermined operation, so that the user can smoothly instruct the operation later. In order to enable the automatic power-on setting, the power of the MFP 400 needs to be ON. Therefore, the timing when the printing device management server 300 issues an instruction to enable the automatic power-on setting of the MFP 400 is important. For example, since the power of the MFP 400 is always ON when printing, after the user activates the system for the first time and issues a print instruction for the first time, an operation instruction to enable the automatic power-on setting is issued, thereby starting the automatic power-on setting and allowing the user to smoothly perform the operation instructed by voice in the MFP 400 from the next time.

[0088] According to the present embodiment, in the above configuration, according to the function of the device (e.g., the printing device associated with the user), the user can specify the function to be executed by voice. In addition, even when the function of the device associated with the user is changed, such as being expanded, the user can handle it flexibly.

[0089] Note that the techniques of both the first and second embodiments can be implemented simultaneously, so that a system including the techniques of both the first and second embodiments can be provided. In each embodiment, a device having functions other than the printing function can be set as a management object. In this case, the functions other than the printing function are the objects of the operation instructions.

[0090] Other embodiments

[0091] The embodiments of the present invention may also be implemented by reading and executing computer executable instructions (e.g., one or more programs) recorded on a storage medium (also more completely referred to as a "non-transitory computer-readable storage medium") to perform one or more functions in the above-mentioned embodiments, and / or a computer of a system or device including one or more circuits (e.g., an application-specific integrated circuit (ASIC)) for performing one or more functions in the above-mentioned embodiments, and the embodiments of the present invention may be implemented by, for example, reading and executing the computer executable instructions from the storage medium by the computer of the system or device to perform one or more functions in the above-mentioned embodiments, and / or controlling the one or more circuits to perform one or more functions in the above-mentioned embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessing unit (MPU)), and may include a network of separate computers or separate processors to read and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, a hard disk, a random access memory (RAM), a read-only memory (ROM), a memory of a distributed computing system, an optical disk (such as a compact disc (CD), a digital versatile disc (DVD), or a Blu-ray disc (BD) TM ), flash memory devices, memory cards, etc.

[0092] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0093] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A peripheral device management system, comprising: A management unit for managing peripheral devices; a control unit for generating, in response to an instruction received through the voice control device, an operation instruction for the peripheral device by specifying the peripheral device corresponding to the instruction based on an administrator account associated with the voice control device and a service account associated with the peripheral device; as well as a unit for sending the generated operation instruction to a designated peripheral device; wherein, when the voice control device receives a maintenance-related instruction that cannot specify a maintenance process to be executed by the peripheral device, the name of the first maintenance process and the name of the second maintenance process are output by voice, and an inquiry as to whether to execute one of the first maintenance process and the second maintenance process is output by voice, wherein, in a case where instruction information corresponding to an instruction to execute a first maintenance process is obtained and the first maintenance process is cleaning to restore ink discharge capability, An inquiry as to whether the user wants to perform normal cleaning or strong cleaning is output by voice, When receiving a response to the inquiry including a selection of normal cleaning or strong cleaning as instruction information, outputting a confirmation message corresponding to the selection by voice, and When a positive response to the confirmation message is received through voice, an operation request to perform normal cleaning is sent to the peripheral device when instruction information corresponding to normal cleaning is obtained, and an operation request to perform strong cleaning is sent to the peripheral device when instruction information corresponding to strong cleaning is obtained.

2. The peripheral device management system according to claim 1, wherein: The control unit also determines whether additional settings are required to generate the operation instruction, sends a message for requesting the additional settings to the voice control device if the additional settings are required, and generates the operation instruction for the peripheral device if the additional settings are not required.

3. The peripheral device management system according to claim 2, wherein: When accepting additional settings from the voice control device, the control unit determines whether other additional settings are required to generate the operation instruction, and sends a message for requesting other additional settings to the voice control device if other additional settings are required.

4. The peripheral device management system according to claim 2, wherein: The control unit determines whether the additional setting is required, referring to a table associating pre-stored operations and additional settings with each other.

5. The peripheral device management system according to claim 2, wherein: The control unit determines whether additional settings are required based on a response to an inquiry of the peripheral device corresponding to the designated command.

6. The peripheral device management system according to claim 1, wherein: The management unit provides services to authenticated users. In response to a registration request from a management unit of the terminal, subjecting the terminal to user authentication through the management unit, and storing user information of the authenticated user and user information of the terminal in association with each other, and The control unit associates the administrator account and the service account with each other based on the association relationship between the user information of the authenticated user and the user information of the terminal.

7. The peripheral device management system according to claim 1, wherein: The peripheral device has a printing function.

8. A peripheral device management method using a management unit, wherein the management unit is used to manage peripheral devices, the method comprising: In response to an instruction received through a voice control device, generating an operation instruction for the peripheral device by specifying the peripheral device corresponding to the instruction based on an administrator account associated with the voice control device and a service account associated with the peripheral device; as well as Sending generated operation instructions to the specified peripheral device; wherein, when the voice control device receives a maintenance-related instruction that cannot specify a maintenance process to be executed by the peripheral device, the name of the first maintenance process and the name of the second maintenance process are output by voice, and an inquiry as to whether to execute one of the first maintenance process and the second maintenance process is output by voice, wherein, in a case where instruction information corresponding to an instruction to execute a first maintenance process is obtained and the first maintenance process is cleaning to restore ink discharge capability, An inquiry as to whether the user wants to perform normal cleaning or strong cleaning is output by voice, When receiving a response to the inquiry including a selection of normal cleaning or strong cleaning as instruction information, outputting a confirmation message corresponding to the selection by voice, and When a positive response to the confirmation message is received through voice, an operation request to perform normal cleaning is sent to the peripheral device when instruction information corresponding to normal cleaning is obtained, and an operation request to perform strong cleaning is sent to the peripheral device when instruction information corresponding to strong cleaning is obtained.

9. A printing device control system, comprising a printing device management server system for generating an operation instruction in response to a voice instruction accepted by a voice control device, based on an administrator account associated with the voice control device and a service account associated with a printing device, by specifying a printing device corresponding to the voice instruction, and a printing device for operating based on the operation instruction generated by the printing device management server system, The printing device management server system comprises: a determining unit for determining, based on a setting item associated with a type of an operation as an object of a voice instruction sent by the voice control device, whether the operation can be performed in the printing apparatus according to the setting content included in the voice instruction, a first sending unit configured to send message data to the voice control device if the determining unit determines that the specified operation can be performed, the message data being used to inquire about setting contents of other setting items except the setting item associated with the type of operation, and a generating unit configured to generate an operation instruction for executing the operation by acquiring setting contents of other setting items except the setting items associated with the type of the operation when the determining unit determines that the specified operation can be executed, and In a case where the determination unit determines that the designated operation cannot be performed, outputting a query by voice, wherein, in a case where instruction information corresponding to an instruction to execute a first maintenance process is obtained and the first maintenance process is cleaning to restore ink discharge capability, An inquiry as to whether the user wants to perform normal cleaning or strong cleaning is output by voice, When receiving a response to the inquiry including a selection of normal cleaning or strong cleaning as instruction information, outputting a confirmation message corresponding to the selection by voice, and When a positive response to the confirmation message is received through voice, an operation request to perform normal cleaning is sent to the printing device when instruction information corresponding to normal cleaning is obtained, and an operation request to perform strong cleaning is sent to the printing device when instruction information corresponding to strong cleaning is obtained.

10. The printing device control system according to claim 9, wherein: The setting contents of setting items other than the setting items associated with the type of operation are defined by default.

11. The printing device control system according to claim 9, wherein: The setting contents of the setting items other than the setting item associated with the type of operation are the setting contents used by the previous operation.

12. The printing device control system according to claim 9, wherein: The message data sent by the first sending unit includes a plurality of selectable setting contents.

13. The printing device control system according to claim 9, wherein: The printing device management server system further includes: A storage unit is used to store setting items associated with the type of operation.

14. The printing device control system according to claim 13, wherein: The storage unit stores setting items and setting contents associated with the types of operations in association with each other.

15. The printing device control system according to claim 13, wherein: The storage unit stores a plurality of setting items associated with types of operations.

16. The printing device control system according to claim 15, wherein: The plurality of setting items have a hierarchical relationship.

17. The printing device control system according to claim 9, wherein: The printing device management server system further includes: a control unit for controlling the printing device to perform an operation based on the operation instruction generated by the generating unit, and In a case where the printing device has functions other than the printing function, the control unit accepts the printing function and the other functions based on specification information of the printing device.

18. The printing device control system according to claim 9, wherein: The printing device management server system further includes: The second sending unit is configured to send message data including the requested guidance to the voice control device when the voice instruction is an instruction requesting the guidance.

19. The printing device control system according to claim 9, wherein: The content of the voice command received by the voice control device includes setting contents of a plurality of setting items.

Images