Communication system, server system and communication device
Receiving user license information through voice control devices solves the problem of execution of new functions that have not obtained user licenses in the prior art, implements appropriate processing and user license management, and improves the security and user experience of the system.
Patent Information
- Application Number
- CN202110696760.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-07-02
- Filing Date
- 2021-06-23
- Publication Date
- 2024-12-24
- Estimated Expiration
- 2041-06-23
AI Technical Summary
When existing communication systems add new functions that are not licensed by users, it is difficult to perform appropriate processing, resulting in inconvenient functions.
The voice control device receives the permission information input by the user, acquires and executes functions related to the communication device, and ensures that the newly added functions are performed only after the user clearly permits.
It realizes appropriate processing and user license management when adding new functions, improving the security and user experience of the system.
Smart Images

Figure CN113890958B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a communication system, a server system and a communication device. Background Art
[0002] Conventionally, a communication system including an information processing device such as a server is known. If an instruction to execute a function related to a communication device such as a printer is input to a voice control device such as a smart speaker by voice, the information processing device executes a function corresponding to the execution instruction (Japanese Patent Publication No. 2019-046102).
[0003] In order to execute the functions related to the communication device, the information processing device needs to obtain permission to execute the functions from the user in advance. Even in a state where permission to execute some functions has been obtained, a new function for which execution permission has not yet been obtained from the user is sometimes added as a function related to the communication device. As the above-mentioned communication system becomes popular, it is required to appropriately execute processing when a new function for which execution permission has not yet been obtained from the user is added as a function related to the communication device. Summary of the invention
[0004] The present invention is directed to appropriately executing processing in the case where a new function for which execution permission has not yet been acquired from a user is added as a function related to a communication device.
[0005] According to an aspect of the present invention, a communication system includes a communication device and a server system. The server system includes: a receiving unit configured to receive information based on an input from a user who permits execution of at least one function related to the communication device, the execution of the at least one function being instructed by a voice input to a voice control device. The at least one function includes a function of causing the communication device to execute printing; and an acquiring unit configured to acquire information based on a predetermined voice input received from the user by voice by the voice control device indicating whether to permit execution of the predetermined function, when a predetermined function is newly added as a function related to the communication device and the execution is instructed by a voice input to the voice control device after an input from the user who permits execution of the at least one function is performed. The communication device includes: an executing unit configured to execute processing based on the predetermined function when the information based on the predetermined voice input indicates that execution of the predetermined function is permitted.
[0006] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0007] Figure 1 is a diagram showing an example of the configuration of a communication system.
[0008] Figure 2 is a block diagram schematically showing an example of a hardware configuration of a voice control device.
[0009] Figure 3 is a block diagram schematically showing an example of the hardware configuration of each server.
[0010] Figure 4 is a block diagram schematically showing an example of a hardware configuration of a communication device.
[0011] Figure 5 is a block diagram schematically showing an example of a hardware configuration of a terminal device.
[0012] Figure 6 is a sequence diagram showing an example of a registration process.
[0013] Figure 7 is a sequence diagram showing an example of a process for executing a function related to a communication device through a voice instruction.
[0014] Figure 8 is a sequence diagram illustrating an example of a printing process using a voice control device.
[0015] Fig. 9 is a diagram showing an example of a login screen.
[0016] Fig. 10A and Fig. 10B are diagrams each showing an example of a permission screen.
[0017] Fig.11 is a diagram showing an example of a table for guiding message necessity determination.
[0018] Fig.12 is a diagram showing an example of voice exchange between a user and a voice control device.
[0019] Fig.13 is a diagram showing an example of a table indicating descriptions of respective guide messages.
[0020] Fig.14A and Fig. 14B are diagrams each showing an example of a notification screen. DETAILED DESCRIPTION
[0021] Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. The following exemplary embodiments are not intended to limit the present invention described in the appended claims, and not all combinations of features described in the exemplary embodiments are always necessary for the solutions of the present invention.
[0022] <System Configuration>
[0023] A first exemplary embodiment of the present invention will be described below. Figure 1 An example of the construction of a communication system according to the present exemplary embodiment is shown. The communication system according to the present exemplary embodiment includes, for example, a voice control device 101, a voice control device management server (hereinafter referred to as a management server) 102, a relay server 103, a communication device 104, a terminal device 105, and an access point (AP) 106. The voice control device 101 is, for example, a smart speaker. The terminal device 105 is an optional terminal device such as a smart phone, a personal computer (PC), a tablet terminal, a mobile phone, and a personal digital assistant (PDA). In the following, the terminal device 105 will be described as a smart phone. The communication device 104 is a communication device according to the present exemplary embodiment, and is a printer that forms (prints) an image on a recording medium by applying a recording material such as ink to the recording medium. The communication device 104 may be a multi-function peripheral device including multiple functions such as a copy function, a FAX function, and a printing function. In the present exemplary embodiment, the communication device 104 is described as a device for printing using an inkjet method, but the printing method is not limited to the inkjet method. For example, the communication device 104 may be a device for printing using an electrophotographic method or a dye sublimation method. In the present exemplary embodiment, the communication device 104 is illustrated as a communication device, but the communication device is not limited thereto. For example, the communication device may be a device that can provide services other than printing services, such as a copying device, a fax device, a smart phone, a mobile phone, a tablet terminal, a PDA, a digital camera, a music reproduction device, a storage device, a projector, or a PC. For example, the AP 106 is a wireless local area network (LAN) router. The device connected to the AP 106 can use the Internet via the AP 106. In the present exemplary embodiment, the voice control device 101, the communication device 104, and the terminal device 105 are wirelessly connected to the AP 106 according to a wireless communication method for a wireless LAN that conforms to the IEEE 802.11 standard series.
[0024] The voice control device 101 and the terminal device 105 can communicate with the management server 102 via the AP 106 and the Internet. The communication device 104 can communicate with the relay server 103 via the AP 106 and the Internet. The voice control device 101 and the terminal device 105 can be connected (communicated) to each other via the AP 106. Figure 1In the system diagram shown, the voice control device 101, the communication device 104, and the terminal device 105 can use the Internet by connecting to the same AP, but the configuration is not limited to this configuration. For example, the voice control device 101, the communication device 104, and the terminal device 105 can access the Internet by connecting to different APs. The voice control device 101, the communication device 104, and the terminal device 105 can access the Internet by connecting to a cellular communication network such as Long Term Evolution (LTE) or the fourth generation (4G) without connecting to an AP.
[0025] In the present exemplary embodiment, the management server 102 is a server provided by a vendor of the voice control device 101, and manages processing performed by a voice instruction issued to the voice control device 101. The relay server 103 is a server provided by a vendor of the communication device 104, and manages processing performed by an instruction issued to the communication device 104 via the Internet. In the present exemplary embodiment, the relay server 103 provides a function of using the communication device 104 that can perform printing (i.e., a print service). The functions included in the print service are not limited to the function of causing the communication device 104 to perform printing. The print service may include other functions such as a function of causing the communication device 104 to perform a scan process, a function of checking the status of the communication device 104, and a function of causing the communication device 104 to perform maintenance.
[0026] In the present exemplary embodiment, one server (information processing device such as a PC) is used as the management server 102, and one server (information processing device such as a PC) is used as the relay server 103, but the configuration is not limited to this configuration. A plurality of servers may be used as the management server 102 or the relay server 103 by operating in collaboration. In other words, the server system of each of the management server 102 and the relay server 103 may include one or more servers.
[0027] Figure 2 2 is a block diagram schematically showing a hardware configuration of the voice control device 101. The voice control device 101 includes a speaker 201, a central processing unit (CPU) 202, a read-only memory (ROM) 203, a microphone 204, a random access memory (RAM) 205, an external storage device 206, a communication unit 207, and a near field communication unit 208. For example, Figures 2 to 4 The blocks shown are connected to each other via an internal bus. These components are only examples, and each device may include hardware components other than those shown in the drawings. Figures 2 to 4 A plurality of blocks in may be combined into one block, or one block may be divided into two or more blocks. In other words, each device may have any configuration as long as the following processing can be performed.
[0028] The speaker 201 emits a voice by the following processing. The CPU 202 is a system control unit and is a processor that controls the entire voice control device 101. The ROM 203 stores fixed data such as a control program, a data table, and an embedded operating system (OS) program to be executed by the CPU 202. In the present exemplary embodiment, the various control programs stored in the ROM 203 are used to perform software execution control such as scheduling, task switching, and interrupt processing under the control of the embedded OS stored in the ROM 203. The microphone 204 receives the voice around the voice control device 101. For example, the microphone 204 receives the voice emitted by the user. The RAM 205 includes a static RAM (SRAM) that requires a backup power supply. Because the data is maintained in the RAM 205 by a primary battery (not shown) for data backup, the RAM 205 can store data such as program control variables without losing data. The RAM 205 is also equipped with a storage area for storing setting information and management data of the voice control device 101. The RAM 205 is also used as a main memory and a working memory of the CPU 202. The external storage device 206 stores application software.
[0029] The communication unit 207 includes a circuit and an antenna for communicating according to a predetermined wireless communication method. For example, the communication unit 207 can be wirelessly connected to an access point. The communication unit 207 is sometimes used as an access point for temporary use. The wireless communication used in the present exemplary embodiment may have the ability to operate according to a wireless communication method (Wi-Fi) of a wireless LAN conforming to the IEEE 802.11 standard series, or may have the ability to operate according to other wireless communication methods.
[0030] The near field communication unit 208 performs near field communication with other devices existing within a fixed near field range of the voice control apparatus 101. The near field communication unit 208 communicates according to a wireless communication method different from the wireless communication method of the communication unit 207. In the present exemplary embodiment, the near field communication unit 208 performs near field communication according to Standard operation.
[0031] Figure 5 is a block diagram schematically showing a hardware configuration of the terminal device 105. As an example, the terminal device 105 includes an input interface 501, a CPU 502, a ROM 503, a display unit 504, a RAM 505, an external storage device 506, a communication unit 507, and a near field communication unit 508. These blocks are connected to each other via an internal bus.
[0032] The CPU 502 is a system control unit, and controls the entire terminal device 105. For example, in the RAM 505, the RAM 505 includes a dynamic RAM (DRAM) that requires a backup power supply. The RAM 505 is also used as a main memory and a working memory of the CPU 502. The ROM 503 stores fixed data such as a data table, an OS program, and a control program executed by the CPU 502. In the present exemplary embodiment, an application program for the voice control device 101 (hereinafter, a voice control application) is installed on the terminal device 105 and stored in the ROM 503.
[0033] The display unit 504 includes a light emitting diode (LED) or a liquid crystal display (LCD) and displays a screen based on various types of data. By including a touch display, the display unit 504 can have a function of receiving various inputs from a user. In other words, the display unit 504 can be an interface for receiving data input or operation instructions from a user, or an operation panel including a physical keyboard, buttons, and a touch panel. The communication unit 507 has a function similar to that of the above-mentioned communication unit 207, and can be wirelessly connected to other devices via AP 106. The near field communication unit 508 is a device that can perform near field communication with the near field communication unit 208 using the same wireless communication method as the wireless communication method of the near field communication unit 208.
[0034] Figure 3 1 is a block diagram schematically showing an example of the hardware configuration of the management server 102 and the relay server 103. In the present exemplary embodiment, one server is used as the management server 102, and one server is used as the relay server 103. However, a server system equivalent to the management server 102 or the relay server 103 may be formed by a plurality of servers operating in cooperation.
[0035] CPU 301 is a processor for controlling the following components. In addition to database 313, OS and application 312 to be read by CPU 301, disk device 302 also stores various files. External storage medium reading device 303 is used to read information, such as files stored in external storage media (such as secure digital (SD) card). Memory 304 includes RAM, etc. CPU 301 temporarily stores or buffers data in memory 304 as needed. Display unit 305 includes LED or LCD, and displays a screen based on various types of data. Operation unit 306 includes a keyboard and mouse for users to perform various input operations. Network communication unit 307 is connected to a network such as the Internet via network connection unit 308, and performs various types of communication. Network communication unit 307 communicates via wired LAN or wireless LAN. If network communication unit 307 supports wired LAN, network connection unit 308 is a connector for connecting a cable of wired LAN. If network communication unit 307 supports wireless LAN, network connection unit 308 is an antenna. The network connection unit 308 can support both wired LAN and wireless LAN. The universal serial bus (USB) communication unit 310 is connected to various peripheral devices via the USB connection unit 311, and various types of communications are performed according to the USB standard. The above components are connected to each other via the bus 309. The following processing of the management server 102 and the relay server 103 is realized by the CPU 301 reading the program required for the processing and executing the program.
[0036] Figure 4 is a block diagram schematically showing an example of the hardware configuration of the communication device 104 .
[0037] In the communication device 104 , a printing function is realized by a printer unit 401 , a scanner function is realized by a scanner unit 402 , and a storage function is realized by a memory card attachment unit 403 and a memory card 404 .
[0038] The printer unit 401 performs printing based on image data received from the outside or image data stored in the memory card 404. The printer unit 401 also manages ink information such as the remaining amount of ink and sheet information such as the remaining amount of sheets.
[0039] The scanner unit 402 optically reads an original placed on a platen (not shown), converts the read original into electronic data, and transmits image data further converted into a specified file format to an external device via a network, or stores the converted image data in a storage area (not shown) such as a hard disk drive (HDD). The copy function is realized by transmitting image data generated by reading the original placed on the platen using the scanner unit 402 to the printer unit 401, and the printer unit 401 prints an image based on the image data onto a print sheet.
[0040] The memory card 404 attached to the memory card attachment unit 403 stores various types of file data. The file data is sometimes read from an external device via a network and edited. The file data can also be stored in the memory card 404 from an external device.
[0041] The communication device 104 also includes a CPU 405, a program memory 406, a working memory 407, a display unit 408, an operation unit 409, a network communication unit 410, a network connection unit 411, and a flash memory 412. The CPU 405 is a processor for controlling components in the communication device 104. The program memory 406 includes a ROM, and stores various program codes and an application 415 for communicating with the relay server 103. In addition, the application 415 accesses the printer unit 401 and acquires ink information and sheet information. The working memory 407 includes a RAM, and temporarily stores or buffers image data when executing various services. The display unit 408 includes an LED or an LCD and displays a screen based on various types of data. The operation unit 409 includes a switch for the user to perform various input operations. The network communication unit 410 is connected to a network such as the Internet via the network connection unit 411, and performs various types of communications. The network communication unit 410 communicates via a wired LAN or a wireless LAN. If the network communication unit 410 supports a wired LAN, the network connection unit 411 is a connector for connecting a cable of the wired LAN. If the network communication unit 410 supports a wireless LAN, the network connection unit 411 is an antenna. The network connection unit 411 can support both a wired LAN and a wireless LAN. In the present exemplary embodiment, the network communication unit 410 supports a wireless LAN and is connected to the AP 106 according to a wireless communication method for a wireless LAN conforming to the IEEE802.11 standard series.
[0042] The flash memory 412 is a nonvolatile memory for storing image data received by the network communication unit 410. The above components are connected to each other via a bus 413. The following processing of the communication device 104 is realized by the CPU 405 reading a program required for the processing and executing the program.
[0043] <Printing Processing of Device 101 Using Voice Control>
[0044] exist Figure 1 In the communication system shown, a printing process using the voice control device 101 is performed. First, in order to perform the printing process using the voice control device 101, it is necessary to perform a registration process of the management server 102 to manage the devices in association. Figure 6 The registration process is described with reference to the sequence diagram in FIG. The process to be performed by each device in the sequence is realized by the CPU of the corresponding device executing the program stored in the ROM of the corresponding device. The program to be executed by the terminal device 105 is a voice control application.
[0045] First, a registration process for the management server 102 to manage devices in association will be described.
[0046] Before performing the registration process, the user logs in to the user account (hereinafter referred to as the first account) of the voice control device 101 managed by the management server 102 using the voice control application of the terminal device 105. Therefore, the management server 102 manages the terminal device 105 and the first account in association. Therefore, the management server 102 recognizes information about the voice control application of the terminal device 105 associated with the first account. The terminal device 105 recognizes information about the first account (account name, ID, password, etc.).
[0047] In step S601 , the voice control device 101 receives a predetermined operation from the user and transitions to a mode for executing a first registration process. Specifically, the voice control device 101 activates an access point included in the voice control device 101 .
[0048] Next, in step S602 , the terminal device 105 receives an execution instruction of a registration process from the user through an input performed on the screen displayed by the voice control application.
[0049] Next, in step S603 , the terminal device 105 connects to the access point included in the voice control apparatus 101 via Wi-Fi.
[0050] Next, in step S604, the terminal device 105 identifies an external access point to be connected to the voice control device 101. Specifically, the terminal device 105 searches for external access points in the vicinity and displays a list of discovered external access points. The terminal device 105 identifies the external access point selected by the user from the list. The method of identifying the external access point is not limited to this configuration. For example, the terminal device 105 may receive a list of external access points discovered by a search performed by the voice control device 101 from the voice control device 101 via a Wi-Fi connection, and identify the external access point selected by the user from the list. For example, when an instruction to perform a registration process has been received from the user, the terminal device 105 may identify the external access point to which the terminal device 105 has been connected.
[0051] Next, in step S605, the terminal device 105 sends information about the external access point identified in step S604 and information about the first account to the voice control device 101 via the Wi-Fi connection. After sending the information in step S605, the terminal device 105 may disconnect the Wi-Fi connection with the voice control device 101 and establish a Wi-Fi connection with the external access point identified in step S604.
[0052] In the above description, the voice control device 101 receives the information required for the first registration process via Wi-Fi, but the configuration is not limited to this configuration. For example, in the mode for performing the first registration process, the voice control device 101 may enable function, and through the terminal device 105 Connect to receive the information required for the first registration process.
[0053] Next, in step S606, the voice control device 101 deactivates the access point included in the voice control device 101 and disconnects the Wi-Fi connection with the terminal device 105. The voice control device 101 connects to the external access point via Wi-Fi based on the information about the external access point that has been received from the terminal device 105. If the Wi-Fi connection with the external access point is successfully established, the voice control device 101 may provide a voice notification indicating success.
[0054] Next, in step S607 , the voice control apparatus 101 accesses the management server 102 via the external access point, and transmits the information on the first account, which has been received from the terminal device 105 , and the identification information on the voice control apparatus 101 to the management server 102 .
[0055] Next, in step S608, the management server 102 manages the voice control device 101 and the first account in association based on the received information. The management server 102 has already managed the terminal device 105 and the first account in association. Therefore, through step S608, the voice control device 101, the terminal device 105 and the first account are associated.
[0056] Next, in step S609, the terminal device 105 uses the voice control device 101 to register the service (skill) to be used. In the present exemplary embodiment, the printing service corresponding to the communication device 104 is registered as a service using the voice control device 101. Therefore, the terminal device 105 sends information indicating that the user has selected the printing service supported by the communication device 104 to the management server 102. In the registration of the skill, the first account and the user account (hereinafter, the second account) managed by the relay server 103 in association with the printing service are associated. Therefore, the following processing will be referred to as account linking processing.
[0057] Next, in step S610, the management server 102 manages the first account and the print service supported by the communication device 104 in association with each other based on the received information. In other words, the print service supported by the communication device 104 is registered.
[0058] Next, in step S611 , the management server 102 transmits a uniform resource locator (URL) for logging into the print service to the terminal device 105 .
[0059] Next, in step S612, the terminal device 105 accesses the relay server 103 using the URL received in step S611, and requests login screen information from the relay server 103. The login screen information is information for displaying a login screen for logging into the second account.
[0060] Next, in step S613 , the relay server 103 transmits the login screen information to the terminal device 105 as a response to the request issued in step S612 .
[0061] Next, in step S614, the terminal device 105 displays a login screen. Since the login to the second account has been performed using, for example, a PC that controls the communication device 104, the relay server 103 manages the second account and the communication device 104 in association in advance. Fig. 9 An example of a login screen to be displayed at this time is shown. Area 901 is an area for inputting the ID of the second account, and area 902 is an area for inputting the password for logging into the second account. Area 903 is an area for issuing an instruction for logging into the second account.
[0062] Next, in step S615, the terminal device 105 receives an operation on the area 903. Then, the terminal device 105 transmits the login information input into the areas 901 and 902, the information on the first account, and the information on the management server 102 to the relay server 103.
[0063] Next, in step S616, the relay server 103 determines whether the received login information is correct. If the received login information is correct and the second account is successfully logged in, the relay server 103 sends the permission screen information to the terminal device 105. The permission screen information is information about the following screen, which is used to receive an input indicating whether the management server 102 is allowed to perform a function related to the communication device 104 (that is, a function that can be performed using the relay server 103). If the received login information is wrong and the login to the second account fails, the relay server 103 sends information indicating the login failure to the terminal device 105. If the terminal device 105 receives the information indicating the login failure, the terminal device 105 notifies the user that the login failed and the input login information is wrong, and then receives the input of the login information again.
[0064] Next, in step S617, the terminal device 105 displays a permission screen (input screen). Fig. 10A An example of a permission screen to be displayed at this time is shown. Area 1001 is an area indicating functions for permission check. For example, the functions for permission check include a function of causing the communication device 104 to execute printing and a function of causing the communication device 104 to execute scanning processing. If the execution of these functions is permitted, the management server 102 can execute the permitted functions based on the user instruction issued to the voice control device 101. Area 1002 is a button to be pressed in the case where the user does not permit the management server 102 to execute the function related to the communication device 104. In addition, area 1003 is a button to be pressed in the case where the user permits the management server 102 to execute the function related to the communication device 104. Hereinafter, the case where area 1003 is pressed will be described.
[0065] Next, in step S618, the terminal device 105 receives the operation performed on the area 1003. Then, the terminal device 105 transmits to the relay server 103 information indicating that execution of the function related to the communication device 104 has been permitted.
[0066] Next, in step S619, the relay server 103 manages the following information in association with the first account, indicating that the user corresponding to the first account has permitted the execution of the function indicated by the permission screen. In other cases, for example, the area 1002 is pressed, and information indicating that the execution of the function related to the communication device 104 has not been permitted is sent to the relay server 103. In this case, the relay server 103 manages the following information in association with the first account, indicating that the user corresponding to the first account has not permitted the execution of the function indicated by the permission screen. This enables the relay server 103 to manage the account and the function that the user corresponding to the account permits to execute. Thereafter, based on the information related to the management server 102 received in step S615, the relay server 103 accesses the management server 102. The relay server 103 sends an access token for permitting the first account to access, and information about the second account to the management server 102.
[0067] Next, in step S620, the management server 102 manages the first account and the second account in association based on the received information. The management server 102 recognizes that the user has permitted the execution of the function for the permission check. Thereafter, if the user requests the permitted function by voice via the voice control device 101, the permitted function is enabled to be executed.
[0068] Next, in step S621 , the management server 102 notifies the terminal device 105 that the association between the first account and the second account has been completed.
[0069] Next, in step S622, the terminal device 105 displays a notification screen for notifying that the association between the first account and the second account has been completed based on the notification issued in step S621. If the received operation on the area 1002 has not permitted the execution of the function related to the communication device 104, the terminal device 105 displays a screen for notifying that the association between the first account and the second account has failed.
[0070] This enables the management server 102 to manage each device and each account in association, and to recognize which information is to be sent to which device in the notification process of the present exemplary embodiment.
[0071] The processing performed by the terminal device 105 in the above description may be performed, for example, via a Web browser included in the terminal device 105 instead of the voice control application.
[0072] Will refer to Figure 7The sequence diagram shown in FIG. 1 is used to describe the processing of executing functions related to the communication device 104 by issuing a voice command to the voice control device 101. The processing to be performed by each device in this sequence is realized by the CPU of the corresponding device executing the program stored in the ROM of the corresponding device. Figure 6 In the state of the registration processing, the processing to be performed by each device in the sequence is performed.
[0073] First, the user speaks a first wake-up word corresponding to the voice control device 101 near the voice control device 101. The voice control device 101 accordingly changes to a mode for receiving a voice instruction from the user. A specific example of the first wake-up word includes the name of the voice control device. Thereafter, the user speaks a second wake-up word as an instruction to execute a function related to the communication device 104. A specific example of the second wake-up word includes a phrase "activate printer".
[0074] Therefore, in step S701 , by receiving the user's voice using the microphone 204 , the voice control apparatus 101 receives an instruction (a second wake-up word) to execute a function related to the communication device 104 .
[0075] Next, in step S702, the voice control device 101 transmits voice data based on the voice received in step S701 to the management server 102 via the Internet. When transmitting the voice data, the voice control device 101 may transmit the user's voice received using the microphone 204 as voice data without change, or may convert the user's voice into text data and transmit the text data as voice data.
[0076] Next, in step S703, the management server 102 analyzes the received voice data. Specifically, the management server 102 analyzes the voice data corresponding to the second wake-up word and identifies the first account associated with the voice control device 101, the relay server 103, and the second account.
[0077] exist Figure 6In the illustrated process, the management server 102 acquires the execution permission of the function related to the communication device 104 from the user. However, for example, by updating the communication device 104, the relay server 103, and the management server 102, a new function is sometimes added as a function related to the communication device 104. In the present exemplary embodiment, it is assumed that the application of the management server 102 is to be updated. If the update is performed, the management server 102 needs to acquire the execution permission of the function from the user in order to execute the added function via the management server 102. Examples of the newly added function include: a function of acquiring information about the communication device 104 and issuing a voice notification indicating the acquired information using the voice control device 101; and a function of causing the communication device 104 to perform maintenance processing. Examples of the newly added function also include: a function of causing the communication device 104 to perform copy processing; and a function of causing the communication device 104 to switch the power state of the communication device 104. In the case where the update is performed, it is desirable to issue a notification related to the update. Specifically, for example, if the function to be executed using the communication device 104 includes a function for which the execution permission has not yet been acquired from the user corresponding to the first account, it is desirable to issue a notification prompting the user to give the execution permission due to the execution of the update.
[0078] Therefore, in step S704, the management server 102 determines whether to issue a notification related to the update. In the present exemplary embodiment, the notification related to the update is issued by sending a guide message related to the update. This determination will be referred to as a guide message necessity determination.
[0079] A specific determination method in the determination of the necessity of the guidance message will be described. First, the management server 102 requests the relay server 103 for a determination result indicating whether a notification related to the update is issued. The relay server 103 keeps the following information: Fig.11104. In the table, the user ID 1101 is an ID indicating an account that uses a service provided by the relay server 103. The last use date 1102 is a date (or date and time) when each account last executed a function related to the communication device 104 via the service provided by the relay server 103. The update code 1103 is a flag indicating whether each account has executed a function related to the communication device 104 via the service provided by the relay server 103 after the last update date. The last update date indicates the date and time when a new function was last added as a function related to the communication device 104 by the most recently performed update. The management server 102 maintains information indicating the last update date in the database 313. For example, the relay server 103 compares the date and time when the function related to the communication device 104 was executed with the last update date, and updates the update code 1103 appropriately. If the update code 1103 indicates "1", it indicates that the corresponding account has executed the function related to the communication device 104 after the last update date. In other words, it indicates that no update has been performed after the date and time when the corresponding account last (most recently) executed the function related to the communication device 104. If the update code 1103 indicates "2", it indicates that after the last update date, the corresponding account has not yet executed the function related to the communication device 104. In other words, it indicates that an update has been performed after the date and time when the corresponding account last (most recently) executed the function related to the communication device 104. If the corresponding account has not executed the function using the communication device 104 after the last update date, the execution permission for the newly added function has not been obtained from the corresponding account. Therefore, in this exemplary embodiment, the relay server 103 determines whether to issue a notification related to the update based on the value of the update code 1103. Specifically, if the update code 1103 indicates "1", and the first account has executed the function related to the communication device 104 after the last update date, the relay server 103 determines that the determination result in step S704 indicates "no". If the update code 1103 indicates "2", and the first account has not executed the function related to the communication device 104 after the last update date, the relay server 103 determines to issue a notification related to the update. The details of the determination are not limited to this configuration. For example, the relay server 103 may include a flag that directly indicates whether the execution permission for all functions executed using the communication device 104 (including the functions added on the last update date) has been obtained from the corresponding account. Then, if the execution permission for all functions has been obtained from the corresponding account, the relay server 103 may determine not to issue a notification related to the update. If the execution permission for all functions has not been obtained from the corresponding account, the relay server 103 may determine to issue a notification related to the update.The relay server 103 notifies the management server 102 of the result obtained by such determination, and the management server 102 determines whether to issue a notification related to the update based on the received determination result. It has been described above that the relay server 103 performs the determination based on. Fig.11 The configuration of determining the table shown in FIG. 1 and notifying the management server 102 of the determination result is not limited to this configuration. For example, the management server 102 may maintain Fig.11 The table shown, and the above determination can be made on the management server 102 without querying the relay server 103.
[0080] If the determination result in step S704 indicates "No", the process proceeds to step S719 without executing the processes in steps S705 to S718. If the determination result in step S704 indicates "Yes", in step S705, the management server 102 updates the Fig.11 Specifically, the management server 102 updates the update code 1103 corresponding to the first account from "2" to "1".
[0081] Next, in step S706, the management server 102 generates a guidance message. The details of the method for generating the guidance message will be described below. In the present exemplary embodiment, a notification including a guidance message is issued only by a voice notification provided by the voice control device 101, but the construction is not limited to this construction. A notification including a guidance message may be issued by a screen notification provided by the terminal device 105. In this case, the management server 102 generates a guidance message for the voice control device 101 and a guidance message for the terminal device 105, respectively. If the guidance message for the terminal device 105 is sent to the terminal device 105 associated with the first account, the terminal device 105 displays a notification screen including a description of the guidance message. Alternatively, for example, the terminal device 105 may only provide a screen notification, while the voice control device 101 does not provide a voice notification.
[0082] The details of the method for generating the guidance message in step S706 will be described. First, the CPU 301 determines whether the user who has input the execution instruction to the voice control device 101 by voice in step S701 is a user with the authority to manage the communication device 104. The management server 102 pre-recognizes the characteristics of the voice uttered by the user with the authority to manage the communication device 104. Then, the CPU 301 makes a determination by comparing the pre-recognized voice with the voice input in step S701. The determination can be made by other methods. For example, the user ID 1101 can be associated with the authority information indicating whether the administrator authority is given in advance, and the determination can be made by referring to the authority information associated with the user ID 1101 (the user ID 1101 is the account corresponding to the user who input the voice).
[0083] The processing performed in the case where it is not determined that the user who has input the execution instruction to the voice control device 101 by voice in step S701 is a user with the authority to manage the communication device 104 will be described. The CPU 301 generates a guidance message R1 for notifying the user corresponding to the first account that the execution permission for the function added by the update will be provided by the user with the authority to manage the communication device 104. The management server 102 sends a table (such as Fig.13 In the table, message ID 1301 indicates an ID corresponding to each guidance message. Guidance message 1302 indicates a description of a notification to be notified using each guidance message. CPU 301 refers to Fig.13 The guidance message R1 is generated based on the table shown in FIG. The guidance message R1 may also include a message for prompting the user corresponding to the first account to have a user with authority to manage the communication device 104 perform an account linking process. Thereafter, the CPU 301 advances the process to step S707.
[0084] The processing performed in the case where it is determined that the user who has input an execution instruction to the voice control device 101 by voice in step S701 is a user with authority to manage the communication device 104 will be described. The CPU 301 generates a guidance message R2 for notifying the user corresponding to the first account that a function related to the communication device 104 is newly added, or for prompting the user corresponding to the first account to issue an execution permission for the newly added function. Fig.13The guidance message R2 may include information indicating the details of the newly added function. In other words, the guidance message R2 may vary based on the details of the newly added function. In addition, the guidance message R2 may also include a message for prompting the user corresponding to the first account to perform the account linking process. After that, the CPU 301 ends the present process, and the process proceeds to step S707.
[0085] Next, in step S707 , the management server 102 transmits the guidance message for the voice control device 101 generated in step S706 to the voice control device 101 .
[0086] Next, in step S708, the voice control device 101 notifies the guidance message received in step S707 by voice using the speaker 201. The user is prompted to issue execution permission for the function added by updating by notification including the description of the guidance message. If the message included in the notification issued at this time is the guidance message R2, the user is asked whether to make an input indicating whether the permission management server 102 executes the function added by updating by notification including the description of the guidance message. Therefore, in step S709, by receiving the user's voice using the microphone 204, the voice control device 101 receives the input indicating whether the permission management server 102 executes the function added by updating. If the message included in the notification issued in step S708 is the guidance message R1, since the input indicating whether the permission management server 102 executes the function added by updating is not received at this timing, the process does not enter step S709, but enters step S719.
[0087] In step S710, the management server 102 analyzes the received voice data. Then, in step S711, based on the analysis result, the management server 102 determines whether an input indicating whether the management server 102 is permitted to execute the function added by the update is made. If the determination result indicates "yes", in step S712, the management server 102 sends an authentication message. The authentication message is a message for asking the user whether to permit the management server 102 to execute the function added by the update. If the determination result indicates "no", the management server 102 advances the process to step S719 without sending the authentication message.
[0088] In step S713, the voice control device 101 notifies the description of the authentication message received in step S712 by voice using the speaker 201. Through the notification including the description of the authentication message, the user is asked whether to permit the management server 102 to execute the function added by the update. Therefore, in step S714, by receiving the user's voice using the microphone 204, the voice control device 101 receives an input indicating whether to permit the management server 102 to execute the function added by the update.
[0089] In step S715, the management server 102 analyzes the received voice data. Then, in step S716, based on the analysis result, the management server 102 determines whether an input for permitting the management server 102 to execute the function added by the update is made. In step S717, the management server 102 issues a notification based on the determination result (authentication result) in step S716.
[0090] In step S718, the relay server 103 performs processing based on the determination result (authentication result) in step S716 based on the received notification. Specifically, for example, if the determination result in step S716 indicates "yes", the relay server 103 manages the first account in association with information indicating that the user corresponding to the first account has permitted the execution of the function added by the update. With this configuration, if the user requests the permitted function thereafter, the permitted function can be executed. At this time, the relay server 103 can notify the management server 102 that information for issuing a voice notification indicating that the permission has been received will be sent to the voice control device 101. On the other hand, if the determination result in step S716 indicates "no", the relay server 103 manages the first account in association with information indicating that the user corresponding to the first account has not permitted the execution of the function indicated on the permission screen. In this case, control can be performed in such a manner that even if a wake-up word is input to the voice control device 101, the processing of receiving an input indicating whether to permit the management server 102 to execute the function added by the update will not be performed for a certain period of time. Alternatively, for example, the number of times the process of receiving an input indicating whether to permit the management server 102 to execute the function added by the update can be preset. If the user does not permit the execution of the function added by the update, the preset number of times can be reduced. Fig.11According to the table shown in FIG. 1 , every time a predetermined number of days have passed after the last update date, a process of receiving an input indicating whether the management server 102 is permitted to execute the function added by the update can be executed. Alternatively, for example, the user can perform an input for requesting the voice control device 101 to no longer perform a process of receiving an input indicating whether the management server 102 is permitted to execute the function added by the update. With this configuration, if such an input is performed, control is performed in such a manner that the process of receiving an input indicating whether the management server 102 is permitted to execute the function added by the update is no longer performed. If the execution of the function added by the update is not permitted, the relay server 103 performs control in such a manner that the function added by the update is not executed. Specifically, for example, control is performed so that when the voice control device 101 notifies the user of a list of functions that can be executed by voice input by voice (in step S721 described below), the function added by the update is prevented from being included in the list. In addition, for example, control is performed so that even in the case where the user issues an execution instruction by voice input (although the user does not permit the function added by the update), the function added by the update is prevented from being executed. If an execution instruction is issued by voice input (although the user does not permit a function added by updating), control may be performed in such a manner that a voice notification indicating that execution of the function specified in the execution instruction is not permitted is issued to the user by the voice control device 101 .
[0091] If the determination result in step S704 indicates "No", or if the operation in step S718 is completed, the operation in step S719 is performed. In step S719, the management server 102 notifies the relay server 103 that an execution instruction for executing a function related to the communication device 104 has been received. The information sent at this time includes information indicating the second account.
[0092] Next, in step S720, the relay server 103 recognizes that the execution of the print service is requested. The relay server 103 recognizes the second account based on the information received in step S719, and recognizes whether the function related to the communication device 104 is to be executed.
[0093] Next, in step S721, the relay server 103 transmits notification information for notifying a list of functions related to the communication device 104 to the management server 102. In the present exemplary embodiment, since both the notification of the voice control apparatus 101 and the notification of the terminal apparatus 105 are issued, the relay server 103 transmits the notification information for the voice control apparatus 101 and the notification information for the terminal apparatus 105, respectively. In the present exemplary embodiment, the description of the message to be notified by the voice control apparatus 101 is determined based on the notification information for the voice control apparatus 101. In other words, the relay server 103 controls the description of the message to be notified by the voice issued by the voice control apparatus 101. Similarly, the description of the message or graphic to be notified via the screen issued by the terminal apparatus 105 is determined based on the notification information for the terminal apparatus 105. In other words, the relay server 103 controls the description of the message or graphic to be notified via the screen issued by the terminal apparatus 105. For example, the function to be notified is a function that the user permits to execute. In the present exemplary embodiment, even if there is a function that has been added by update but not yet permitted, the management server 102 can execute the permitted function. Therefore, even if there is a function that has been added by update but not yet permitted, the permitted function is included in the notification.
[0094] Next, in step S722 , the management server 102 transmits voice notification information for issuing a voice notification indicating a list of functions related to the communication device 104 to the voice control apparatus 101 based on the received notification information.
[0095] Next, in step S723, the voice control device 101 issues a voice notification using the speaker 201 based on the received voice notification information, the voice notification indicating a list of functions to be executed using the communication device 104. Examples of the functions related to the communication device 104 are as described above. At this time, only a part of the functions to be executed using the communication device 104 may be notified instead of the list of functions to be executed using the communication device 104. In addition, the details of the functions to be executed using the communication device 104 may be notified. For example, if the function to be executed using the communication device 104 is a function to cause the communication device 104 to execute printing, the content to be printed by using the function (news, math problems, puzzles, etc.) may be notified.
[0096] Next, in step S724, the management server 102 sends screen notification information to the terminal device 105 associated with the first account based on the received notification information, and the screen notification information is used to provide a notification indicating a function related to the communication device 104 through a screen display. The operation in step S724 can be performed before the operation in step S722.
[0097] Next, in step S725, the terminal device 105 displays a notification screen for notifying functions related to the communication device 104 on the display unit 504 based on the received screen notification information. Specifically, for example, the terminal device 105 displays the following information: Fig.14A 1400 is shown. In the present exemplary embodiment, the terminal device 105 notifies the user of a more detailed description than the description notified by the voice control device 101 via the notification screen. The notification screen 1400 includes an area 1401 for notifying functions related to the communication device 104, and an area 1402 for notifying the type of content that can be printed using the print function. The description to be notified by the voice notification issued in step S723 and the description to be notified by the screen notification issued in step S725 may be different. Specifically, for example, although the message included in the area 1401 is included in the voice notification issued in step S723, the message included in the area 1402 may not be included in the voice notification issued in step S723. The items to be displayed on the notification screen are not limited to messages for notifying information about the communication device 104, such as messages displayed in areas 1401 and 1402. The notification screen may include a graphic for notifying information about the communication device 104.
[0098] This configuration enables the user to recognize a function related to the communication device 104 and issue an execution instruction to execute the function related to the communication device 104 .
[0099] With such a configuration, it is possible to generate an appropriate guidance message suitable for the details of the update or the state of the communication device 104. It is also possible to receive an input indicating whether the license management server 102 executes a function added by the update from the user by voice and easily perform reception of the input.
[0100] It is also possible to grant execution permission for the function added by updating by executing the account linking process in step S609 and subsequent steps again. Therefore, the guidance message may be, for example, a message for prompting the user to execute the account linking process. Fig. 10B An example of a permission screen displayed when a function for permission check is added by update is shown. In addition to the functions that have been displayed before the update, the functions added by the update are also displayed in area 1004. If an operation to area 1003 is received on the permission screen, all currently enabled functions including the functions added by the update are permitted to be executed.
[0101] If the function added by the update is permitted to be executed, the voice control device 101 may issue a voice notification for suggesting that the user input an instruction to execute the function by voice to the voice control device 101. The management server 102 and the relay server 103 may control the voice control device 101 to issue the voice notification accordingly.
[0102] The above describes a configuration in which a notification about an authentication message is issued when a notification about a guidance message is issued, and execution permission for a function is received by voice, but execution permission for a function may be received by voice at other timings. For example, in an account linking process, execution permission for a function may be received by voice (instead of via a screen), or execution permission for a function may be received via both a screen and voice.
[0103] Will refer to Fig.12 The voice exchange between the user and the voice control device 101 achieved by the above-described process when a function added by updating is permitted is described.
[0104] First, in step S1201, the user speaks a first wake-up word corresponding to the voice control device 101 near the voice control device 101. Next, in step S1202, the voice control device 101 issues a notification including a guide message and notifies the user that a function related to the communication device 104 has been newly added. Next, in step S1203, the user inputs an input by voice to indicate whether to permit the management server 102 to execute the function added by update. Next, in step S1204, the voice control device 101 asks the user by voice whether to permit the management server 102 to execute the function added by update. Next, in step S1205, the user performs a voice input to permit the management server 102 to execute the function added by update. Next, in step S1206, the voice control device 101 notifies the user that the execution permission for the function added by update has been received. In this way, in the present exemplary embodiment, the user can input the execution permission for the function only by performing voice exchange.
[0105] Next, the printing process using the voice control device 101 will be described. Figure 8 1 shows a sequence diagram of a printing process using the voice control device 101. The operations to be performed by each device in the sequence are realized by the CPU of the corresponding device executing the program stored in the ROM of the corresponding device. Figure 7 In the state of the processing described in the sequence, the operations to be performed by each device in the sequence are performed. In the present exemplary embodiment, even if a new function is added to the function of using the communication device 104 by updating, the association between the first account and the second account is not cancelled. Therefore, for example, even if Figure 7In the state where the determination result in step S704 of the process in indicates "yes" and the execution permission for the newly added function has not been obtained, the communication system can also execute the already permitted function. In other words, if the permission for the print function has been obtained from the user, the communication system can perform the following processing even in the state where the execution permission for the newly added function has not been obtained.
[0106] First, in order to use the print function among the functions related to the communication device 104, the user speaks the third wake-up word corresponding to the print function as a print instruction.
[0107] Thus, in step S801 , in response to receiving the user's voice using the microphone 204 , the voice control device 101 receives a print instruction (third wake-up word).
[0108] Next, in step S802 , the voice control device 101 transmits voice data based on the voice received in step S801 to the management server 102 via the Internet.
[0109] Next, in step S803 , the management server 102 transmits information based on the received voice data to the relay server 103 .
[0110] Next, in step S804 , the relay server 103 analyzes the information received in step S803 , and determines that execution of the print function is requested.
[0111] Next, in step S805, the relay server 103 transmits notification information for the voice control device 101, which is used to notify the type of content that can be printed using the print function by voice, to the management server 102. In the present exemplary embodiment, the type of content that can be printed using the print function is notified only by voice notification issued by the voice control device 101, but the type can be notified by screen notification provided by the terminal device 105. In other words, the relay server 103 can also transmit a notification message for the terminal device 105 to notify the type of content that can be printed using the print function through screen display.
[0112] Next, in step S806 , the management server 102 transmits voice notification information for notifying by voice the type of content printable by the print function to the voice control apparatus 101 based on the received notification information.
[0113] Next, in step S807, the voice control apparatus 101 notifies the type of content printable by the print function by voice using the speaker 201 based on the received voice notification information.
[0114] Therefore, the user identifies the type of content that can be printed using the print function, and selects the content to be printed by the print function by speaking the name of the content. At this time, the user can speak the print settings (number of copies to be printed, color settings, etc.) when printing the content.
[0115] Therefore, in step S808, by receiving the user's voice using the microphone 204, the voice control device 101 receives the selection of content to be printed using the print function and the print setting.
[0116] Next, in step S809, the voice control device 101 transmits voice data based on the voice received in step S808 to the management server 102 via the Internet.
[0117] Next, in step S810 , the management server 102 transmits information based on the received voice data to the relay server 103 .
[0118] Next, in step S811 , the relay server 103 analyzes the information received in step S810 , and identifies the content to be printed using the print function.
[0119] Next, in step S812, the relay server 103 generates print data in a binary format for printing the print target content, and a print job for causing the communication device 104 associated with the second account to execute printing of the print target content. The generated print data is stored in a predetermined storage area of the relay server 103. The generated print job includes information (URL, etc.) for acquiring the print data stored in the predetermined storage area of the relay server 103.
[0120] Next, in step S813 , the relay server 103 transmits the generated print job to the communication device 104 associated with the second account via the Internet.
[0121] Next, in step S814 , the communication device 104 transmits a request for acquiring print data stored in a predetermined storage area of the relay server 103 to the relay server 103 based on the received print job.
[0122] Next, in step S815, the relay server 103 transmits the print data generated in step S812 to the communication device 104 in response to the request received in step S814. The relay server 103 may transmit the print job including the print data in step S813 without transmitting the print job and the print data to the communication device 104 separately.
[0123] Next, in step S816, the communication device 104 starts executing printing based on the received print job and print data. If an error occurs during printing, the communication device 104 transmits status information indicating that the communication device 104 is in an error state to the relay server 103.
[0124] Next, in step S817, if printing by the communication device 104 is started, the relay server 103 transmits notification information for notifying the communication device 104 that the selected content is being printed to the management server 102. In the present exemplary embodiment, both the notification of the voice control apparatus 101 and the notification of the terminal device 105 are issued, so that the relay server 103 transmits the notification information for the voice control apparatus 101 and the notification information for the terminal device 105, respectively.
[0125] Next, in step S818 , the management server 102 transmits voice notification information for notifying the communication device 104 that the selected content is being printed to the voice control apparatus 101 based on the received notification information.
[0126] Next, in step S819, the voice control apparatus 101 notifies the communication device 104 by voice that the selected content is being printed, using the speaker 201, based on the received voice notification information.
[0127] Next, in step S820, the management server 102 transmits screen notification information for notifying the communication device 104 that the selected content is being printed to the terminal device 105 associated with the first account through screen display based on the received notification information. The process in step S820 may be performed before the process in step S818.
[0128] Next, in step S821, the terminal device 105 displays a notification screen for notifying the communication device 104 that the selected content is being printed on the display unit 504 based on the received screen notification information. Specifically, the terminal device 105 displays, for example, Fig. 14B Notification screen 1403 shown. In the present exemplary embodiment, the terminal device 105 notifies the user via the notification screen of a more detailed description than the description notified by the voice control device 101 by voice. The notification screen 1403 includes an area 1404 for notifying the communication device 104 that the selected content is being printed, and an area 1405 for notifying a wake-up word (different from the third wake-up word) for issuing a print instruction. In the present exemplary embodiment, the message included in area 1404 is also included in the voice notification issued in step S819. However, the message included in area 1405 is not notified by the voice notification issued in step S819, but only by the screen notification issued in step S821.
[0129] Thereafter, if printing based on the print job has been completed, then in step S822 , the communication device 104 transmits print completion status information indicating that printing has been completed to the relay server 103 .
[0130] In this manner, the communication device 104 can perform printing when triggered by a voice print instruction issued to the voice control apparatus 101 .
[0131] After step S822, based on the print completion status information, the relay server 103 may transmit notification information for notifying that printing has been completed to the voice control apparatus 101 or the terminal device 105.
[0132] With such a configuration, the user can control the communication device 104 through voice instructions to the voice control apparatus 101 .
[0133] (Other Exemplary Embodiments)
[0134] The exemplary embodiments of the present invention may also be implemented by providing a program for implementing one or more functions of the exemplary embodiments described above to a system or device via a network or storage medium, and a computer of the system or device reads and executes the program. The computer includes one or more processors or circuits. In order to read and execute computer executable commands, the computer may include a network of multiple individual computers or multiple individual processors or circuits.
[0135] The embodiments of the present invention may also be implemented by reading and executing computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more completely referred to as a "non-transitory computer-readable storage medium") to perform one or more functions in the above-mentioned embodiments, and / or a computer of a system or device including one or more circuits (e.g., an application-specific integrated circuit (ASIC)) for performing one or more functions in the above-mentioned embodiments, and the embodiments of the present invention may be implemented by, for example, reading and executing the computer executable instructions from the storage medium by the computer of the system or device to perform one or more functions in the above-mentioned embodiments, and / or controlling the one or more circuits to perform one or more functions in the above-mentioned embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessing unit (MPU)), and may include a network of separate computers or separate processors to read and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, a hard disk, a random access memory (RAM), a read-only memory (ROM), a memory of a distributed computing system, an optical disk (such as a compact disc (CD), a digital versatile disc (DVD), or a Blu-ray disc (BD) TM ), flash memory devices, memory cards, etc.
[0136] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.
[0137] Although exemplary embodiments have been described, it is to be understood that the present invention is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
Claims
1. A communication system, comprising: communication devices; as well as Server systems, Wherein, the server system comprises: a receiving unit configured to receive information based on an input from a user, the user permitting execution of at least one function related to the communication device, the execution of the at least one function being instructed by voice input to a voice control device, wherein the at least one function includes a function of causing the communication device to execute printing; and an acquisition unit configured to, in a case where a predetermined function is newly added as a function related to the communication device and the execution of which is instructed by voice input to the voice control device after an input from a user permitting execution of the at least one function is made, acquire information based on a predetermined voice input indicating whether execution of the predetermined function is permitted, which is received from the user by voice by the voice control device, wherein the predetermined voice input is generated by a server in the server system, and Wherein, the communication device comprises: An execution unit is configured to execute a process based on the predetermined function when the information input by the predetermined voice indicates that execution of the predetermined function is permitted.
2. The communication system according to claim 1, in, The server system further includes a processing unit configured to execute a process for causing the voice control device to notify a message by voice, the message being used to receive the predetermined voice input, and After the voice control device notifies the message by voice, the voice control device receives the predetermined voice input from the user by voice.
3. The communication system according to claim 2, in, The server system also includes: a third execution unit configured to, based on information about a first account corresponding to the voice control device and information about a second account corresponding to the communication device input on a terminal device, perform an association process for causing an execution instruction for executing a function to enter a state in which the execution instruction can be sent to the communication device by voice input to the voice control device; and a fourth execution unit configured to, when the association process is executed, execute a process for displaying an input screen on the terminal device for receiving an input from a user for permitting execution of the at least one function, and Here, when the predetermined function is newly added after the association process is performed and an input for permitting execution of the at least one function is received from the user on the input screen, a process for causing the voice control device to notify the message by voice is performed.
4. The communication system according to claim 2, in, performing processing for causing the voice control device to notify the message by voice based on performing voice input to the voice control device, and In which, in a case where a user who has made a voice input to the voice control device does not have the authority to permit the server system to perform a function related to the communication device, the message is used to obtain a message permitting the server system to perform the predetermined function from a user who has the authority to permit the server system to perform a function related to the communication device.
5. The communication system according to claim 2, wherein: The description of the message changes based on the details of the predetermined function added as a function related to the communication device.
6. The communication system according to claim 1, in, The server system also includes: a third execution unit configured to, based on information about a first account corresponding to the voice control device and information about a second account corresponding to the communication device input on a terminal device, perform an association process for causing an execution instruction for executing a function to enter a state in which the execution instruction can be sent to the communication device by voice input to the voice control device; and a fourth execution unit configured to, when the association process is executed, execute a process for displaying an input screen on the terminal device for receiving an input from a user for permitting execution of the at least one function, and The information based on the input from the user for permitting execution of the at least one function is received by receiving an input for permitting execution of the at least one function from the user on the input screen.
7. The communication system according to claim 1, wherein: The function related to the communication device and instructed to be executed by voice input to the voice control apparatus includes at least one of a function of causing the communication device to execute a process executable by the communication device or a function of acquiring information on a state of the communication device.
8. The communication system according to claim 7, wherein: The process that the communication device can execute includes at least one of a scanning process, a copying process, a maintenance process, or a process of switching a power state of the communication device.
9. The communication system according to claim 1, wherein: The predetermined function is added by updating a predetermined application program in the server system.
10. The communication system according to claim 1, wherein: When information corresponding to a predetermined voice input received by the voice control device indicates permission to execute the predetermined function, and an execution instruction to execute a function related to the communication device and which the user has permitted to execute is input to the voice control device by voice, processing corresponding to the function related to the communication device is executed in the communication device.
11. The communication system according to claim 1, wherein: In a state where the predetermined function has been newly added and execution permission for the predetermined function has not yet been obtained from the user, when an execution instruction to execute a function related to the communication device and for which the user has permitted execution is input to the voice control apparatus by voice, processing corresponding to the function related to the communication device and for which the user has permitted execution is performed in the communication device.
12. The communication system according to claim 1 further comprises a control unit, wherein the control unit is configured to control the voice control device to issue a voice notification when information corresponding to a predetermined voice input received by the voice control device indicates permission to execute the predetermined function, wherein the voice notification is used to suggest that a user input an execution instruction to execute the predetermined function to the voice control device by voice.
13. The communication system according to claim 1, wherein: The server system includes one or more information processing devices.
14. A server system, comprising: a receiving unit configured to receive information based on an input from a user, the user permitting execution of at least one function related to the communication device, the execution of the at least one function being instructed by voice input to a voice control device, wherein the at least one function includes a function of causing the communication device to execute printing; and An acquisition unit is constructed to, after an input from a user permitting execution of at least one function, acquire information based on a predetermined voice input indicating whether execution of the predetermined function is permitted, received from the user by the voice control device through voice, in a case where a predetermined function is newly added as a function related to the communication device and the execution of the function is indicated by voice input to the voice control device, wherein the predetermined voice input is generated by a server in the server system.
15. A communication device capable of receiving information sent from a server system, the server system comprising: a receiving unit configured to receive information based on an input from a user, the user permitting execution of at least one function related to the communication device, the execution of the at least one function being instructed by voice input to a voice control device, wherein the at least one function includes a function of causing the communication device to execute printing; and an acquisition unit configured to, in a case where a predetermined function is newly added as a function related to the communication device and the execution of which is instructed by voice input to the voice control device after an input from a user permitting execution of the at least one function is performed, acquire information based on a predetermined voice input indicating whether execution of the predetermined function is permitted and received from the user by voice by the voice control device, wherein the predetermined voice input is generated by a server in the server system, The communication device comprises: An execution unit is configured to execute a process based on the predetermined function when the information based on the predetermined voice input indicates that execution of the predetermined function is permitted.
Citation Information
Patent Citations
Voice control device and printer, and control method and program thereof
JP2019046102A
Information processing device and non-transitory computer readable medium
US20190079703A1
