System, system control procedure, speech operating device, speech operating device control procedure and program

Abstract

System comprising an information processing terminal (103) with an authentication module (330) for biometric authentication and a tamper-proof storage unit (226) that stores biometric information of a user that is necessary when authentication processing is performed using the authentication module (330), and a voice operating device (105) that receives voice input and performs processing according to the input, wherein the voice operating device (105) is configured to: Making a processing request according to a user's voice input to an external system (102) according to the input; Receiving an authentication request from the external system (102); Transmitted, via wireless communication (106), a request for authentication processing to the user's information processing terminal (103) in accordance with the received authentication request; and Transfer of an authentication result from the information processing terminal (103) to the external system (102), and where the information processing terminal (103) is configured to: Performing biometric authentication processing using the authentication module (330) and the biometric information stored in the storage unit (226) according to the authentication processing requirement from the voice operating device (105); and Transfer of an authentication result from the biometric authentication processing to the voice operating device (105), wherein the authentication result of the biometric authentication processing comprises a signature generated by using a secret key stored in the storage unit (226) in association with biometric information and verification data issued by the external system (102) in which a public key paired with the secret key is registered.

Description

BACKGROUND OF THE INVENTION Area of ​​the invention

[0001] The present invention relates to a system that provides a secure authentication method and improves user comfort. Description of the related technique

[0002] In recent years, Fast Identity Online (FIDO) has gained attention as a new authentication system that includes biometric authentication. Unlike passwords used in traditional ID / password authentication, once biometric information such as fingerprints and veins used for biometric authentication is leaked, it is impossible to rewrite it. Therefore, an information leak is catastrophic.

[0003] On the other hand, FIDO requires a prior registration process between a device in a user's hand and a server providing a web service. During this registration process, a secret key associated with the user's biometric information is stored on the device, and information such as authentication identification information related to the biometrics and a public key paired with the secret key are registered on the server. Furthermore, authentication is performed on the device in the user's hand, rather than on the server over the internet, and the authentication result, signed with the secure key, is transmitted over the network.Since the biometric information does not circulate over the network, it can therefore be said that the risk of information loss or leakage is low.

[0004] Meanwhile, in recent years, voice assistant devices (voice operating devices or voice control devices) with a speaker function have become widely used. Such a voice assistant device is referred to below as a voice assistant. A voice assistant is an information device with functions for interpreting user speech using a speech recognition function and executing various user instructions. Since such a voice assistant can be commanded by voice, it is advantageous in that it eliminates the effort of keystrokes and touch inputs required for conventional desktop computers and smartphones.

[0005] As an example of how a voice assistant can be used, it is installed in a living room of a house or similar space, allowing a user to play desired music by giving a voice command, or to order a product through an internet-based telemarketing service. Furthermore, voice assistants have not only been actively introduced in homes but also in public facilities, including accommodation establishments such as hotels.

[0006] Generally, accommodation establishments such as hotels provide comprehensive services for their guests, including event searches, ticket purchases, and room service. Voice assistants are expected to be a means for guests to easily access these services without requiring cumbersome effort.

[0007] JP 2003-132435 A discloses a hotel guest server system that enables service provision and payment to be carried out using room keys and personal identification numbers in hotels. JP 2003-132435 A discloses that a hotel room key has an RFID tag attached to it, which stores information in advance about a room number, a personal identification number, a guest number, an amount to be paid, or the like, and that payment is made simultaneously with check-out.

[0008] Furthermore, DE 20 2016 008 226 U1 discloses a system that includes capturing acoustic data representing a voice command spoken by a speaker and a speaker identification result indicating that the voice command was indeed spoken by a speaker. A voice function is selected, at least on the basis of a transcription of the audio data, and subsequently, a service provider corresponding to the selected voice function is chosen from a variety of different service providers. WO 2017 / 164 159 A1 refers to a system for biometric authentication at a terminal used by multiple people via a smartphone, where the smartphone receives an authentication request from a server providing the service requested by the user. However, unlike the present application, the data derived from the biometric data is compared on an authentication server.Furthermore, operation is not via an additional voice control device. Further state-of-the-art information is known from WO 2015 / 146 178 A1 and JP 2017 - 175 244 A.

[0009] With a traditional authentication method using an ID and password, a user is required to enter their ID and password to access various services, requiring the effort of entering and remembering this information, which is neither convenient nor comfortable. Furthermore, there remains the risk of information leakage or loss / leakage, including the ID and password.

[0010] When a user accesses a service via a voice assistant in a public place frequented by many unspecified people, such as a hotel, it is necessary to store various types of biometric information in the voice assistant to use an authentication method like FIDO described above. These various types of biometric information are referred to below as biometric authentication information.Storing biometric authentication information in a voice assistant used in a user's home is not a problem, whereas registering biometric authentication information in a device located in a place used by many unspecified people is likely to cause resistance or reluctance among users due to the possibility of a leak or loss / perforation of the biometric authentication information. SUMMARY OF THE INVENTION

[0011] It is an object of the present invention to provide a system that can improve user comfort and provide a secure authentication method.

[0012] The present invention, in its first aspect, provides a system as specified in claims 1 to 8.

[0013] The present invention, in its second aspect, provides a control method in a system as specified in claim 9.

[0014] The present invention, in its third aspect, provides a speech operating device as specified in claim 10.

[0015] The present invention, in its fourth aspect, provides a method for a speech operating device as specified in claim 11.

[0016] The fifth aspect of the present invention provides a computer program as specified in claim 12.

[0017] The present invention provides a system that offers a secure authentication method and improves user comfort.

[0018] Further features of the present invention will become clear from the following description of exemplary embodiments (with reference to the accompanying drawings). BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 is a representation illustrating an overall configuration of a system according to an embodiment of the present invention. Fig. Figure 2 is a diagram illustrating a hardware configuration example of a server. Fig. Figure 3 is a diagram illustrating a hardware configuration example of a mobile device. Fig. Figure 4 is a diagram illustrating a hardware configuration example of a voice assistant. Fig. Figures 5A to 5C are illustrations that demonstrate an example of a functional configuration of each device. Fig.Figure 6 is a flowchart illustrating a process for starting to use a service. Fig. Figure 7 is a flowchart illustrating a process that is carried out to use the service. Fig. Figure 8 is a flowchart illustrating a process for ending use of the service. Fig. Figure 9 is a representation illustrating an example of a check-in screen. Fig. Figure 10 is a representation illustrating an example of a biometric information registration screen. Fig. Figure 11 is a representation illustrating an example of a biometric information input request screen. Fig. Figure 12 is a representation illustrating an example of a checkout screen. Fig.Figure 13 is a flowchart illustrating a process that is carried out to use a music distribution service. Fig. Figure 14 is a flowchart illustrating a modified example of a process carried out to use a music distribution service. Fig. Figure 15 is a flowchart illustrating a modified example of a process carried out to use a music distribution service. DESCRIPTION OF THE EXAMPLES OF EXECUTION

[0019] Exemplary embodiments for the implementation of the present invention are described with reference to the drawings and the like.

[0020] It should be noted that the present invention relates to a mechanism in which a service provided by an external system via a network performs biometric authentication on a device (an information processing terminal) in the hand of a user in order to authenticate the user, and as a result, the service can authenticate the user. This can be achieved by pre-registering information related to biometric authentication, such as authentication identification information, a public key, and the like, in the device held by the user.

[0021] Although FIDO is treated as an example of such a mechanism, it should be noted beforehand that the present invention is not limited to FIDO. It should be noted that, although in the present embodiment a mobile terminal 103 carried or held by a user is described as an example of a device in the user's hand that performs biometric authentication, the invention is not limited thereto. As a further example, a second embodiment describes a case in which a voice assistant 105 and a server 102 perform biometric authentication. [First embodiment]

[0022] Fig. Figure 1 is a representation illustrating an example of an overall configuration of a system according to an embodiment of the present invention.

[0023] The in Fig. 1 The illustrated system includes the server 102, the mobile terminal 103 and voice assistants (voice operating devices) 105a to 105c.

[0024] It should be noted that, for the sake of simplicity, matters or issues common to voice assistants 105a to 105c are described using the reference to voice assistant 105. Although Fig.Figure 1 illustrates that three voice assistants 105 are connected to a network 101 and that the plurality of voice assistants 105 are installed. The invention is not limited thereto, and one or a plurality of voice assistants can be provided. Furthermore, the server 102 is an external system that provides services and can be constructed using a plurality of devices, and some or all of the devices can be set up using resources from virtual machines, storage, and the like.

[0025] Server 102 and the voice assistants 105 are connected via network 101. Network 101 can be, for example, a LAN (including the internet), a WAN, a telephone line, a dedicated digital line, an ATM, a frame relay line, a cable television line, a data broadcast line, and the like. Furthermore, network 101 is a so-called communication network, implemented by combining the lines described above. Network 101 can be any network capable of transmitting and receiving data.

[0026] Server 102 and voice assistants 105 are connected via mobile device 103 and a network 106. In addition to the network lines described above, such as a LAN, network 106 also includes, for example, short-range wireless communication such as near-field communication (NFC) or Bluetooth. ® .

[0027] In this embodiment, it is assumed that the voice assistants are installed in an accommodation facility such as a hotel. Voice assistants 105a to 105c are each installed in rooms 104a to 104c, which are hotel rooms. That is, voice assistant 105a is installed in room 104a. It should be noted that, for the sake of simplicity, situations or matters common to rooms 104a to 104c are described with reference to rooms 104.

[0028] Fig. Figure 2 is a diagram illustrating a hardware configuration example of Server 102.

[0029] A CPU 201 executes programs stored in a ROM 203, such as an operating system (OS) and applications, which are loaded from an external memory 210 onto a RAM 202. This means that the CPU 201, by executing a program stored in a readable memory medium, acts as each processing unit, carrying out the process of each flowchart described below.

[0030] RAM 202 is the main memory of the CPU 201 and functions / operates as a workspace or the like. A keyboard control 204 controls user input from a keyboard 208 or a pointing device, which is not illustrated. The pointing device is, for example, a mouse, a touchpad, a touch field, a control ball, or the like. A display control 205 controls the display of a display 209.

[0031] A disk controller 206 controls data access to external storage 210, such as a hard disk (HD) or a floppy disk (FD), which stores various types of data. A network I / F 207 is connected to a network and performs a process to control communication with another device connected to the network. A near-field communication I / F 211 is a network I / F that uses a near-field communication method such as NFC or Bluetooth. ® supported and communicates with the mobile device 103 and similar devices to exchange data.

[0032] Fig. Figure 3 is a diagram illustrating a hardware configuration example of the Mobile Device 103.

[0033] A CPU 222 executes programs stored in a ROM 224 and a memory device 225, and comprehensively controls each of the components described below via an internal bus 221. The programs also include a program that implements each of the flowcharts described below. A RAM 223 acts as a memory or workspace for the CPU 222.

[0034] The storage device 225 is a storage device such as a solid-state drive (SSD) or an SD memory card and functions / operates as an external storage device. A tamper module (TPM) 226 is a storage unit with a tamper-proof or sabotage / forgery protection feature to prevent stored data from being read from outside, for the purpose of processing or storing confidential information. A network interface 227 exchanges data unidirectionally or bidirectionally with an external network device.

[0035] The biometric information sensor 228 is a sensor that reads a user's biometric information and converts it, such as a fingerprint, iris scan, vein scan, voiceprint, facial image, or similar data, into a readable signal. It should be noted that biometric information is not limited to these. A touch panel 229 has two functions: display and input. It displays an application screen, keyboard, and the like, and outputs information about a touched screen position as signal information when the user applies pressure to the screen with their hand or a suitable stylus.

[0036] If an application uses the output signal information, the user can operate the application via the touch panel 229. A near-field communication (NFC) I / F 230 is a network I / F that uses a near-field communication method such as NFC or Bluetooth. ® It supports and communicates with server 102 and the like to exchange data.

[0037] Fig. Figure 4 is a representation illustrating a hardware communication example of a voice assistant 105.

[0038] The CPU 241 executes programs stored in a ROM 243, such as an operating system (OS) and applications, which are loaded from an external memory 248 into a RAM 242. This means that the CPU 241, by executing a program stored in a readable memory medium, acts as each processing unit, carrying out the process of each flowchart described below.

[0039] RAM 242 is main memory of the CPU 241 and functions / operates as a workspace or the like. A disk controller 244 controls data access to external storage 248, such as a hard disk (HD) or a floppy disk (FD), which stores various types of data. A network interface 245 is connected to a network and performs a process to control communication with another device connected to the network. A speaker control unit 246 controls a speaker 249. A microphone control unit 247 controls a microphone 250.

[0040] It should be noted that the voice assistant 105 is not limited in that it can use the in Fig.Figure 4 illustrates the hardware configuration. The voice assistant is a voice operating device that receives voice input and executes a process or processing according to the input, and which can also, for example, perform a biometric authentication process in the second embodiment, as described below. In this case, the voice assistant 105 can also be hardware for reading biometric information, for example, a camera or the like.

[0041] Fig. Figure 5A is a diagram illustrating an example of a functional configuration of Server 102.

[0042] On server 102, a hotel service 310 is operated as an example of a service to be provided to users. Hotel service 310 is implemented when the CPU 201 of server 102 reads a program stored in ROM 203 into RAM 202 and executes the program.

[0043] The Hotel Service 310 has a Registration Processing Unit 311, a Data Storage Unit 312, an Authenticator Information Processing Unit 313, an Authenticator Information Storage Unit 314, a Biometric Authentication Control Unit 315, a Service Processing Unit 316, and a Communication Unit 317. The Registration Processing Unit 311 is a software module that stores data such as user information and the user's accommodation history in the Data Storage Unit 312.

[0044] The Authenticator Information Processing Unit 313 is a software module that stores information regarding an Authenticator 330, described below, in the Authenticator Information Storage Unit 314 using a credential received by the Communication Unit 317. The Authenticator Information Processing Unit 313 also verifies claim information (a claim) received by the Communication Unit 317, which is described below.

[0045] The communication unit 317 is a software module that communicates with an external device, such as the voice assistant 105 or the mobile device 103, via the network I / F 207. The authenticator information storage unit 314 is a software module that stores information relating to the authenticator 330 (authenticator information), described below, in the external memory 210 or an external storage system (not illustrated) using Table G.

[0046] The biometric authentication control unit 315 is a software module that sends a biometric authentication request to the authenticator 330 and receives the result of the biometric authentication. In the present embodiment, the biometric authentication control unit 315 sends a biometric authentication request to the authenticator 330 of the mobile device 103 via the voice assistant 105. It should be noted that, although the biometric authentication control unit 315 is included in the hotel service 310 in the present embodiment, the present invention is not limited thereto.

[0047] The biometric authentication control unit 315 can, for example, be configured independently of the hotel service 310, and the hotel service 310 can call / invoke the independent biometric authentication control unit 315. By configuring the biometric authentication control unit 315 to be independent of the hotel service 310, as described above, the biometric authentication control unit 315 can be configured to be called / invoked not only by the hotel service 310, but also by another service.

[0048] The Service Processing Unit 316 is a software module that searches for service information and makes a service reservation in accordance with a service request received by the Communication Unit. The Service Processing Unit 316 stores information regarding the provision of a service (Service Provisioning Information), described below, in the Data Storage Unit 312 using Table D.

[0049] Fig. Figure 5B is a diagram illustrating an example of a functional configuration of the 103 mobile device.

[0050] The mobile device 103 runs an application 320 and an authenticator 330. The application 320 and the authenticator 330 are implemented when the CPU 222 of the mobile device 103 loads a program stored in the ROM 224 into the RAM 223 and executes the program.

[0051] Application 320 provides the authentication function using biometric information according to the present embodiment and a service of Server 102 to the user in cooperation with Server 102. Application 320 is a native or local application or a web browser installed on the mobile device 103. Application 320 has a display unit 321, a communication unit 322, and an authenticator registration control unit 323.

[0052] The display unit 321 is a software module that provides a user interface for an application installed on the mobile device 103 or receives user input via the touch panel 229. The communication unit 322 is a software module that communicates with an external device, such as the server 102, via the network interface 227 or the short-range communication interface 230. The authenticator registration control unit 323 is a software module that sends a request to the authenticator 330 to generate an authorization credential, as described below.

[0053] It should be noted that, although the authenticator registration control unit 323 is included in the application 320 in the present embodiment, the present invention is not limited thereto. For example, the authenticator registration control unit 323 can be configured independently of the application 320, and the application 320 can call / call the independent authenticator registration control unit 323. Furthermore, the authenticator registration control unit 323 can be configured by default in the operating system.

[0054] By configuring the Authenticator Registration Control Unit 323 to be independent of the Application 320, as described above, another Application can call / access the Authenticator Registration Control Unit 323 just like the Application 320.

[0055] The Authenticator 330 is an authentication module for biometric authentication using biometric information read by the Biometric Information Sensor 228. The Authenticator 330 comprises an Authenticator Registration Processing Unit 331, a Biometric Authentication Processing Unit 332, an Authentication Information Storage Unit 333, and a Biometric Information Request Unit 334.

[0056] The Authenticator Registration Processing Unit 331 receives a request to generate a credential from the Authenticator Registration Control Unit 323 of the Application 320 or the like. The Authenticator Registration Processing Unit 331 is also a software module that generates paired keys (a private key and a public key) and a credential. The Biometric Authentication Processing Unit 332 is a software module that receives a biometric authentication request from the Biometric Authentication Control Unit 315 of the Hotel Service 310 or the like and performs biometric authentication using biometric information read by the Biometric Information Sensor 228.

[0057] The authentication information storage unit 333 is a software module that stores authentication information and similar data for the TPM 226. The authentication information includes, for example, the information shown in Table A, which is described below. The biometric information request unit 334 is a software module that provides a user interface for receiving biometric input from the user via the touch panel 229.

[0058] Fig. 5C is a diagram illustrating an example of a functional configuration of the voice assistant 105.

[0059] The voice assistant 105 operates a voice service 340. Voice service 340 is implemented when the CPU 241 of the voice assistant 105 reads a program stored in its ROM 243 into RAM 242 and executes the program. Voice service 340 provides the service of server 102 to the user in cooperation with server 102.

[0060] The voice service 340 has a voice receiving unit 341, a voice analysis unit 342, a voice output unit 343, a biometric authentication control unit 344, and a communication unit 345. The voice receiving unit 341 is a software module that receives speech or voice output by the user via the microphone 250 of the voice assistant 105. The voice analysis unit 342 is a software module that analyzes the speech or voice received by the voice receiving unit 341.

[0061] The voice output unit 343 is a software module that provides guidance or instructions to the user via speech or voice through the speaker 249 of the voice assistant 105. The biometric authentication control unit 344 is a software module that sends a biometric authentication request to the authenticator 330 and receives the result of the biometric authentication. The communication unit 345 is a software module that communicates with an external device, such as the server 102 or the mobile device 103, via the network interface 245.

[0062] Next, different types of data that are stored by the mobile device 103 and the server 102 will be described.

[0063] Table A is an example of data that is stored in the TPM 226 by the authentication information storage unit 333 of the authenticator 330 of the mobile terminal 103. Table A Authentication information ID Service ID Secret Key Biometric information ID 407c-8841-79d hotel-service.com 1faea2da-a269-4fa7-812a-509470d9a0cb d493a744 4c04-428b-a7a2 service-a.com d7ae30c8-3775-4706-8597-aaf681bc30f5 dcc97daa 92b2-498d-bea6 service-b.com 36ae5eed-732b-4b05-aa7b-4dddb4be3267 51caacaa ... ... ... ...

[0064] In the authentication information management table shown in Table A, a record represents an entry of authentication information. The records in Table A are generated when mobile device 103 registers authenticator 330 with hotel service 310 on server 102 and are then added to Table A. The Authentication Information ID column stores IDs to uniquely identify each piece of authentication information. The Service ID column stores IDs to uniquely identify services that use the authentication function performed using biometric information.

[0065] In this example, domain names of services, specifically information from a top-level domain and a second-level domain, are used as the service IDs. For example, if the URL of hotel service 310 is http: / / www.hotel-service.com, then the service ID of hotel service 310 is assumed to be hotel-service.com. Secret keys are stored in the Secret Key column under generated paired keys. The public keys that correspond to (are paired with) the secret keys are registered with the services shown in the Service ID column.

[0066] The Biometric Information ID column stores IDs that correspond to attribute values ​​of biometric information. A process for storing information corresponding to each column of the Authentication Information Management table and a process for storing a public key in the service are described below. Note that the Authentication Information Management table shown as Table A is an example; Table A is not limited to this, and other information can be stored. For example, IDs used in a service to uniquely identify users, which are used in traditional authentication to verify the correspondence of user IDs and passwords in the service, can be stored in this table.

[0067] Tables B to G are examples of data that are stored in the external storage 210 or the like by the data storage unit 312 and the authenticator information storage unit 314 of the hotel service 310 of the server 102. Table B User ID password name address Old Profession user001 *** aaa aaa ABC 20 Student user002 *** bbb bbb def 30 employee ... ... ... ... ... ...

[0068] The user information management table shown in Table B represents data managed by the data storage unit 312 of hotel service 310. In the user information management table, a record represents a user information item. The User ID column stores IDs for uniquely identifying users of hotel service 310. The Password column stores passwords for authenticating users. A password is determined when a user registers with hotel service 310. Additionally, the user information management table can store attribute information about a user that is required when the user checks into the hotel, such as the user's name, address, age, occupation, and the like. Table C User ID Check-in date Check-out date Room number Voice assistant ID user001 12.07.2017 13.07.2017 Room 104a 105a user001 10.02.2017 11.07.2017 Room 104b 105b user002 12.07.2017 13.07.2017 Room 104c 105c ... ... ... ... ...

[0069] The accommodation history management table shown in Table C represents data managed by the data storage unit 312 of the Hotel Service 310. In the accommodation history management table, a record represents information about a user's stay. The User ID column stores values ​​from the User ID column of the user information managed in the User Information Management table (Table B). Additionally, the accommodation history management table stores the check-in date, check-out date, room number of the room where the user stayed, and the ID to specify the voice assistant installed in the room where the user stayed, as information about a stay. Table D User ID Service ID Service details Amount Date Payment information user001 s0001 Room service 1,000 yen 10.02.2017 Yes user001 s0001 Room service 1,000 yen 12.07.2017 No user002 s0002 Room service 2,000 yen 13.07.2017 No ... ... ... ... ... ...

[0070] The Service Information Management table shown in Table D represents data managed by the data storage unit 312 of Hotel Service 310. In the Service Information Management table, a record represents the status of a service being provided to a user. The User ID column stores the same values ​​as the User ID columns in Tables B and C described above. Additionally, the Service Information Management table stores the following elements as information specifying services being provided to users: Service IDs and Service Details, which identify specific details of the services provided; the dates on which the services were provided; and, in the case of a service requiring payment, the amount, payment information, and the like. Table E Voice assistant ID Mobile device (authenticator) 105a a12345 105b a23456 105c a34567 ... ...

[0071] The linking information management table shown in Table E represents data managed by the data storage unit 312 of the hotel service 310. In the linking information management table, the voice assistants 105 installed in the rooms where users have stayed are linked to the authenticators 330, which are the mobile devices 103 used by the users and registered with the hotel service 310.

[0072] As an example, a case is described in which a voice assistant 105 is installed in room 104a. The voice assistant 105a is installed in room 104a. When a user residing in room 104a registers the authenticator 330 in an authenticator registration process described below, the ID of the voice assistant 105a and the ID of the registered authenticator are linked and stored.

[0073] It should be noted that there are also cases in which two or more users use the voice assistant 105 in one room. In this case, an authenticator registration is carried out with reference to each of the authenticators 330, which are the mobile devices 103 owned by the users. Then, in the linking information management table, two or more authenticators 330 are linked to a voice assistant 105 and registered within it. Table F authentication request User ID Expiry date 65C9B063-9C33 user001 13.07.2017T12:00:34Z 7317EFBA-4E63 user101 13.07.2017T12:03:12Z ... ... ...

[0074] The attestation challenge management table shown in Table F represents data managed by the data storage unit 312 of the hotel service 310. In the attestation challenge management table, a record represents a piece of information / information element of an attestation challenge. The attestation challenge is a parameter used as verification data to perform a challenge-response authentication and is issued for each user.

[0075] The process for issuing authentication requests is described below. The authentication request column stores the values ​​of the authentication request. The user ID column stores the user IDs of the users for whom the authentication request is issued. The expiration date column stores the expiration dates of the authentication requests. Table G Authentication information ID Public key User ID 407c-8841-79d AC43C5FB-BFA2-48D1-A71B-FB04ACDA347A user001 4c04-428b-a7a2 8143CA9F-35C9-4333-*948F-BFCE66A74310 user002 ... ... ...

[0076] The authentication information management table shown in Table G represents data managed by the authentication information storage unit 314 of the hotel service 310. In the authentication information management table, a record represents authentication information / an authentication information element. When authentication 330 is registered with server 102, a record is added to the authentication information management table.

[0077] The Authentication Information ID column stores the values ​​of the authentication information managed by the registered authenticator 330 in the authentication information management table (Table A). The Public Key column stores public keys that correspond to (are paired with) secret keys generated by the authenticator 330 and managed in the authentication information management table (Table A).

[0078] This means that, with reference to secret keys and public keys linked to the same values ​​of the authentication information IDs in the authentication information table (Table A) and the authenticator information management table (Table G), data encrypted with the secret keys stored in Table A can be decrypted with the public keys stored in Table G. The User ID column stores IDs used by Hotel Service 310 to uniquely identify users.

[0079] Next, a process for initiating the use of hotel service 310 when a new guest (user) checks into the hotel is described, with reference to Fig. 6 described.

[0080] In the process of initiating use of the hotel service 310, a process is executed to register the authenticator 330 of the mobile device 103 carried or held by the user in the server 102.

[0081] Although the following describes a case in which the authenticator 330 of the mobile device 103 is registered, the same description applies to a case in which an authenticator is included in the voice assistant 105. It should be noted that registering information about the authenticator 330 in the server 102 is simply referred to as registering an authenticator.

[0082] It should be noted that in order to use the Hotel Service 310, a user is assumed to have pre-installed the Hotel Service 310-related application 320 on the mobile device 103. Alternatively, the URL of a web service provided by the Hotel Service 310 can be determined / set, and then a service screen for using the Hotel Service 310 can be displayed in the web browser of the mobile device 103.

[0083] A case is described in which a user uses application 320 on mobile device 103 to initiate the process of using hotel service 310. Application 320 initially displays a check-in screen via user interaction. Specifically, the check-in screen is displayed by navigating a (not illustrated) menu within application 320.

[0084] Fig.Figure 9 is an example of the check-in screen displayed by the display unit 321 of application 320.

[0085] The user enters user attribute information necessary for checking into a hotel, such as their name, address, age, occupation, or similar information, and a password to be used in the hotel service 310.

[0086] The description now returns to Fig. Step 6 back. In step S401, application 320, upon receiving the user information, transmits a user registration request via communication unit 322 to hotel service 310. Note that the request includes the attribute information and password entered by the user. Communication unit 317 of hotel service 310 receives the request transmitted by application 320 in step S401.

[0087] In step S402, the registration processing unit 311 of the hotel service 310 issues a user ID and stores user information, including the user ID, in the user information management table (Table B) of the data storage unit 312. The user information includes the attribute information and password received in step S401. In step S403, the authenticator information processing unit 313 of the hotel service 310 transmits a credential generation request to the application 320 via the communication unit 317.

[0088] The following describes a parameter that is included in the authorization certificate generation request.

[0089] The parameter included in the credential generation request is composed of account information, an encryption parameter, a authentication request, and an authentication extension area. The account information stores the user ID registered in step S402 for Hotel Service 310 and the attribute information associated with that user ID.

[0090] The encryption parameter stores attribute information regarding registered authentication information, such as an encryption algorithm supported by the Hotel Service 310, or similar information. The authentication request stores verification data used to perform challenge-response authentication. The verification data, namely the authentication request, is generated when the parameter included in the credential generation request is created in step S402.

[0091] The generated authentication request is then stored in the authentication request management table (Table F) along with the user ID, expiration date, and other information. The authentication extension area stores an extension parameter that can be determined / set by the hotel service 310. For example, the authentication extension area stores a parameter for controlling the operation of authenticator 330, and so on.

[0092] The description now returns to Fig. 6. The communication unit 322 of application 320 receives the credential generation request transmitted in step S403. Upon receiving the credential generation request, the display unit 321 of application 320 displays a biometric information registration screen to request the user to enter biometric information used in biometric authentication.

[0093] Fig. Figure 10 is an example of the biometric information registration screen.

[0094] The biometric information registration screen prompts the user to enter biometric information to register the authenticator 330 with the hotel service 310. A button 721 is used to read biometric information such as a fingerprint and incorporates the biometric information sensor 228. It should be noted that information from a vein, iris, speech expression, facial image, or the like can be used as biometric information, and there is no limitation to this.

[0095] Here, the mobile terminal 103 is configured such that any biometric information, or a combination of any number of biometric information, is entered as the biometric information to be used in biometric authentication. Although, in the present embodiment, the input of biometric information is requested at the time of check-in, as described above, the present invention is not limited to this. For example, the input of biometric information can be requested later, when biometric authentication is actually required, without requiring the input of biometric information at the time of check-in.

[0096] When the biometric information sensor 228 reads the biometric information on the biometric information registration screen, the authenticator registration control unit 323 transmits the biometric information to the application 320 and requests the generation of an authorization credential. The request at this time includes the parameter contained in the authorization credential generation request received from the hotel service 310 in step S403, and a service ID, in addition to the read biometric information.

[0097] The Service ID is an ID used to uniquely identify a service for which the authenticator 330 is registered, as described in the authentication information management table (Table A). In this case, the Service ID of the hotel service 310 is included. Additionally, an Application ID, which is an ID used to uniquely specify the application 320 used to register the authenticator 330 with the hotel service 310, or similar, may be included.

[0098] The description now returns to Fig.Back to step 6. In step S404, the biometric authentication processing unit 332 of the authenticator 330 generates a biometric information ID to uniquely identify a feature amount of the biometric information received by the application 320 and the biometric information itself. The feature amount of the biometric information is a value obtained by converting information that is unique to an individual, such as the pattern of a fingerprint, the pattern of an iris, the shape of a vein or artery, or a voiceprint, into a value that does not compromise uniqueness. In biometric authentication, the individual is specified using the feature amount that is unique to that individual.

[0099] In step S405, the Authenticator Registration Processing Unit 331 generates a secret key / public key pair and an authentication information ID to uniquely identify authentication information. Then, the Authenticator Registration Processing Unit 331 stores the following information in the authentication information management table (Table A) stored in the TPM 226 via the authentication information storage unit 333: the biometric information ID generated in step S404, the secret key and authentication information ID generated in step S405, and the service ID for which the authenticator is registered.

[0100] In the present embodiment, the service ID of the hotel service 310 is stored, which is included in the credential generation request received by the authenticator 330 from the application 320. In step S406, the authenticator registration processing unit 331 generates a credential.

[0101] The credential is described below.

[0102] The authentication credential is comprised of an authentication information ID, an algorithm, a public key, and a verification. The authentication information ID is the one generated in step S405 and stored in the authentication information management table (Table A). The public key is the public key of the key pair generated in step S405.

[0103] The algorithm stores an algorithm that was used to generate the key pair in step S405. Additionally, the authentication represents data obtained by encrypting the authentication request of the parameter included in the credential generation request received in step S403, using the secret key generated in step S405. The authenticator registration processing unit 331 transmits the credential generated in step S406 and an authenticator ID to specify the authenticator 330 of application 320 to application 320.

[0104] In step S407, the communication unit 322 of application 320 transmits the credential and authenticator ID received from authenticator 330 to hotel service 310. In step S408, the authenticator information processing unit 313 of hotel service 310 performs a registration process for authenticator 330 using the received credential.

[0105] The following describes an authorization credential registration process performed by the Authenticator Information Processing Unit 313.

[0106] First, the Authenticator Information Processing Unit 313 decrypts the authentication contained in the credential using the public key included in the same credential to verify that the registration request is not unlawful.

[0107] Furthermore, Authenticator Information Processing Unit 313 specifies a record from a authentication request column of the authentication request management table (Table F) that has the same value as the value obtained by encrypting the authentication with the public key. Then, Authenticator Information Processing Unit 313 sets the user ID of the specified record as the user ID associated with the credential.

[0108] Then, the Authenticator Information Processing Unit 313 stores (registers) the authentication information ID and public key included in the credential and the user ID associated with the credential in the Authenticator Information Management Table (Table G).

[0109] The description now returns to Fig.6. In step S409, the registration processing unit 311 stores a link between the voice assistant 105, which is installed in the room where the user is staying, and the authenticator ID received in step S407 in the link information management table (Table E). Finally, the communication unit 317 of the hotel service 310 reports to the application 320 of the mobile device 103 that the authenticator registration process was completed normally / properly.

[0110] Next, using Fig. 7 describes a process carried out by a user to use the hotel service 310 via the voice assistant 105.

[0111] The user makes a request to use hotel service 310 via voice to the voice assistant 105. For example, if the user wants room service, the request can be made by saying "Tell me the room service list".

[0112] It should be noted that room service is just one example of a service provided by the 310 hotel service, and there are no limitations to this. Using the 310 hotel service, it is also possible to reserve tickets, taxis, and similar services. Furthermore, the user can also contact the hotel via the 310 hotel service to request that their room does not require cleaning, or for other similar reasons.

[0113] In step S501, the voice receiving unit 341 of the voice service 340 of the voice assistant 105 receives a request to provide the service via the user's voice. In step S502, the speech analysis unit 342 analyzes the received voice and determines the details of the request. In step S503, the communication unit 345 transmits a processing request analyzed in step S502 to the hotel service 310.

[0114] The communication unit 317 of the hotel service 310 receives a request from the voice assistant 105. In step S504, the service processing unit 316 of the hotel service 310 performs processing corresponding to the received request. Specifically, the service processing unit 316 first determines whether user authentication is necessary to execute the received request. Whether user authentication is required is configured in advance when information regarding the service is registered in the hotel service 310.

[0115] For example, it may be configured that a request accompanied by a payment requires user authentication. If it is determined that user authentication is not necessary to execute the request, the service processing unit 316 performs processing appropriate to the request without requiring or requesting user authentication. Here, a case is described where the request is "Tell me a list of room services." This means that a list of available room services can be transmitted to the voice assistant 105, which serves as a request source.

[0116] Since the request is not accompanied by a payment, Service Processing Unit 316 determines that user authentication is not necessary. As a processing operation corresponding to the request "Tell me a list of room service," Service Processing Unit 316 then searches for room service. Note that processing that would be performed if user authentication were necessary is described below in step S510.

[0117] In step S505, the service processing unit 316 responds to the voice assistant 105 via the communication unit 317 with a list of room services. It should be noted that at this time, the service processing unit 316 can search the service information management table (table D) for a previous room service order history from the user associated with the voice assistant 105, which serves as a request source, and respond with the list along with suggested room service information.

[0118] The communication unit 345 of the voice service 340 receives a room service list from the hotel service 310. In step S506, the voice output unit 343 of the voice service 340 provides voice guidance to the user regarding the received room service list. The user then requests a specific room service menu item by voice command to the voice assistant 105. This means that a request is made to the hotel service 310.

[0119] Since the processes of steps S507 to S509, in which the voice assistant 105 receives the request and transmits the user's request to the hotel service 310, are identical to the processes of steps S501 to S503, a description of these is omitted. In step S510, the service processing unit 316 of the hotel service 310 performs processing according to the received request. Specifically, the service processing unit 316 determines whether user authentication is necessary to execute the received request, as is the case in step S504.

[0120] Since the request is for a specific room service menu, and this request is accompanied by payment, the service processing unit 316 determines that user authentication is necessary. Therefore, in step S511, the authenticator information processing unit 313 of the hotel service 310 makes a user authentication request, i.e., a biometric authentication request, via the communication unit 317 to the voice assistant 105. At this time, the authenticator information processing unit 313 generates a biometric authentication parameter and includes it in the request.

[0121] The biometric authentication parameter is described below.

[0122] The biometric authentication parameter represents data used when the hotel service 310 performs authentication of the application 320. The biometric authentication parameter is constructed from a claim prompt and a claim extension area. The claim prompt stores verification data used to perform a challenge-response authentication.

[0123] The claim extension area stores an extension parameter that can be determined / set by Hotel Service 310 for use by Hotel Service 310 to control the operation of Authenticator 330 or similar devices. For example, the claim extension area stores a parameter for controlling the operation of Authenticator 330 or similar devices.

[0124] The description now returns to Fig.Back to step 7. In step S511, when the Authenticator Information Processing Unit 313 of the Hotel Service 310 makes a biometric authentication request to the Voice Assistant 105 via the Communication Unit 317, the request additionally includes the following information. Specifically, the Authenticator Information Processing Unit 313 includes the Authenticator ID from the Linking Information Management Table (Table E) to specify the Authenticator 330, which is linked to the Voice Assistant 105, serving as a request source.

[0125] Additionally, the Authenticator Information Processing Unit 313 includes information such as the amount of the order or similar details in the request. It should be noted that at this time, the Authenticator Information Processing Unit 313 can also include suggestion information recommended to the user in the request. For example, the Authenticator Information Processing Unit 313 specifies user information for the room (Room 104) corresponding to the voice assistant 105, which serves as a request source, from the Accommodation History Management table (Table C) via the Service Processing Unit 316.

[0126] The Authenticator Information Processing Unit 313 then retrieves the user's past service history from the Service Information Management table (Table D) based on the user information and includes recommendation information for the user in the request. Additionally, the Authenticator Information Processing Unit 313 can include promotional or advertising information from a service unrelated to the user, or similar information, in the request.

[0127] In step S512, the biometric authentication control unit 344 of the voice service 340 specifies the authenticator 330, which serves as a reporting or notification target for the biometric authentication request received in step S511, from the authenticator ID included in the request. In step S513, the biometric authentication control unit 344 makes a biometric authentication request to the mobile device 103. Note that the biometric authentication request includes an Auth biometric authentication parameter.

[0128] The Auth biometric authentication parameter, which is included in the biometric authentication request transmitted by the voice assistant 105 to the mobile device 103, is described.

[0129] The Auth biometric authentication parameter comprises the biometric authentication parameter generated by the Authenticator Information Processing Unit 313 of the Hotel Service 310 and transmitted by the Hotel Service 310 to the Voice Assistant 105 in step S511 described above. The Auth biometric authentication parameter also includes a Service ID and a Web Origin.

[0130] The service ID stores information about the top-level domain and the second-level domain of hotel service 310. For example, if the URL of hotel service 310 is http: / / www.hotel-service.com, the service ID is hotel-service.com. The web origin is a combination of a protocol, a hostname, and a port, and the origin of hotel service 310 is stored in this example.

[0131] The description now returns to Fig.7. Back. When the mobile device 103 receives the biometric authentication request in step S514, biometric authentication processing is performed. The biometric authentication processing performed by the mobile device 103 is described below.

[0132] When the mobile terminal 103 receives the biometric authentication request, the display unit 321 of the application 320 displays a biometric information input request screen.

[0133] Fig. Figure 11 is an example of the biometric information input request screen displayed by the display unit 321 of application 320.

[0134] The biometric information entry screen prompts the user to enter their biometric information in order to perform biometric authentication on the mobile device 103. It should be noted that, although the display unit 321 of the application 320 displays the biometric information entry screen in this embodiment, the authenticator 330 may also have a display unit (not illustrated) and display the screen.

[0135] Button 811 is a button for reading biometric information and includes the biometric information sensor 228. It should be noted that the biometric information input request screen also displays various types of information included in the biometric authentication request transmitted in step S511 from the hotel service 310 to the voice assistant 105. This information includes, for example, details about the price of the menu the user has requested or ordered, suggested menu items to be recommended to the user, promotional or advertising information from another service, and the like.

[0136] When the biometric information sensor 228 reads the biometric information on the biometric information input request screen, the authenticator registration control unit 323 of the application 320 transmits the biometric information to the authenticator 330 and makes an authentication request. It should be noted that the authenticator registration control unit 323 includes the Auth biometric authentication parameter, which was received from the voice assistant 105 in step S513, in the authentication request.

[0137] The biometric authentication processing unit 332 of the authenticator 330 captures a feature value of the received biometric information. Based on this captured feature value, the biometric authentication processing unit 332 specifies a record from the authentication information management table (Table A) managed by the authentication information storage unit 333. Specifically, it specifies an authentication information ID and a secret key, which are contained in the authentication information management table (Table A) corresponding to the biometric information, since a biometric information ID is specified by the feature value.

[0138] This means that the secret key is retrieved if authenticator 330 is successful during authentication after biometric authentication has been performed. It should be noted that, just like the feature amount, it can be verified whether the service ID included in the Auth biometric authentication parameter matches the one in Table A. Then, biometric authentication processing unit 332 generates a signature obtained by encrypting a claim request included in the Auth biometric authentication parameter with the specified secret key. Furthermore, biometric authentication processing unit 332 generates claim information that includes the specified authentication information ID and the generated signature.

[0139] In step S515, the biometric authentication processing unit 332 responds to the voice assistant 105 with the generated claim information. In step S516, the communication unit 345 of the voice service 340 responds to the hotel service 310 with the claim information received in step S515.

[0140] It should be noted that if the result of the biometric authentication processing in step S514 is an authentication failure, or if the user does not enter biometric information for a certain period of time, the display unit 321 of application 320 will display a message on the biometric information entry screen indicating that authentication has failed and the process will end. Then, information indicating that the result of the biometric authentication processing is an authentication failure will be provided in each of steps S515 and S516. Upon receiving the information that authentication has failed, the hotel service 310 will terminate the process. Fig. 7.

[0141] In step S517, the Authenticator Information Processing Unit 313 of the Hotel Service 310 verifies the claim information received in step S516. Specifically, the Authenticator Information Processing Unit 313 verifies whether the claim information matches or corresponds to a claim request contained in a biometric authentication parameter generated in step S511. Note that the Authenticator Information Management Table (Table G) is used to specify a public key.

[0142] The signature included in the claim information is decrypted using the public key specified by the authentication ID included in the claim information. The authenticator information management table (Table G) is used to specify the public key. Then, it is verified whether the decrypted value matches the claim request included in the biometric authentication parameter generated in step S511.

[0143] If the decoded value does not match the claim request included in the biometric authentication parameter generated in step S511, the service processing unit 316 of hotel service 310 responds to voice assistant 105 with information indicating that user authentication has failed. Service processing unit 316 then terminates the process. Upon receiving the information that user authentication has failed, voice delivery unit 343 of voice service 340 reports to the user, via speech or voice, that the request received in step S507 was not executed.

[0144] On the other hand, if the decoded value matches the claim request included in the biometric authentication parameter generated in step S511, the process proceeds to step S518. In step S518, the service processing unit 316 of the hotel service 310 confirms the provision of the service, i.e., the commissioning or ordering of the room service menu, according to the request received in step S507.

[0145] Service Processing Unit 316 stores information regarding the confirmed service in the Service Information Management table (Table D). It should be noted that, since payment is made simultaneously with checkout, data indicating that no payment was made is stored in the payment information section of the Service Information Management table. Service Processing Unit 316 then submits a service provision request to the service provider.

[0146] In step S519, the service processing unit 316 transmits a reception result of the service provision request, which was received by the voice assistant 105 in step S509, to the voice assistant 105. In step S520, the voice output unit 343 of the voice service 340 reports the reception result received in step S519 to the user by speech or voice.

[0147] Next, using Fig. 8 describes a process for ending the use of hotel service 310 when the guest (user) checks out of the hotel.

[0148] In the process of terminating the use of the Hotel Service 310, a registration cancellation process is performed in which the registration of the authenticator 330 of the mobile device 103, which is carried or held by the user, is cancelled or deleted / revoked from the Hotel Service 310.

[0149] First, the user causes the mobile device 103's application 320 to display a checkout screen via a user operation. Specifically, the checkout screen is displayed by operating a (not illustrated) menu display of application 320.

[0150] Fig. Figure 12 is an example of the checkout screen displayed by the display unit 321 of application 320.

[0151] The service fee incurred due to the user's use of the service during their hotel stay will be displayed on the checkout screen. Upon receiving an instruction to display the checkout screen via a user interface, application 320 will inquire about the details of the service the user received from hotel service 310 during their hotel stay, via communication unit 322.

[0152] Hotel service 310 retrieves the details of the service received by the user from the service information management table (Table D) stored in data storage unit 312 and transmits these details to application 320. Application 320 calculates the total cost of the service received by the user in the service information management table, for example, based on the received service details, and displays the total as the service charge on the checkout screen. The user reviews the details of the service received and the service charge on the checkout screen and proceeds to payment at the hotel reception.

[0153] It should be noted that the checkout screen includes an option to select whether to provide biometric authentication information. Biometric authentication information encompasses various types of data related to biometrics. In the Fig. In the illustrated example 12, a checkbox or tick box can be used to select whether biometric authentication information should be retained. If the user selects to retain their biometric authentication information, the process for registering the authenticator 330 in server 102 (S403 to S408) can be initiated in the process for starting the use of hotel service 310, which is described in Fig. As illustrated in section 6, it will be skipped or omitted during his or her next stay.

[0154] The next time a user who has chosen to retain their biometric authentication information stays at the same hotel, they can use the user ID issued during their previous check-in and the password they set on the check-in screen. Fig. Enter 9 during check-in. The user ID obtained in step S402 of [section number] can be used. Fig. 4 was issued at the previous check-in.

[0155] Accordingly, the registration processing unit 311 of hotel service 310 performs a merge or aggregation of the user ID with existing user information, referencing the user information management table (Table B), and determines that the user ID belongs to the same person as the user of the record with the corresponding user ID and password. Then, the registration processing unit 311 of hotel service 310 determines whether a record with the user ID exists in the authenticator information management table (Table G).

[0156] If a record with the user ID exists, the registration processing unit 311 allows the processes from steps S403 to S408 to proceed. Fig.4. When the "OK" button is pressed on the checkout screen, an instruction to execute the process for ending the use of hotel service 310 (checkout process) is given to application 320, and the execution of the in Fig. The process shown in section 8 has started.

[0157] The description now returns to Fig. Back to step 8. In step S601, application 320, upon receiving the instruction to execute the check-out process from the user, transmits a check-out request to hotel service 310. The request includes the selection result regarding whether to retain his or her biometric authentication information, which was selected by the user on the check-out screen.

[0158] In the following steps S602 and S603, registration information regarding the user of mobile device 103, stored in server 102, is updated. First, in step S602, the registration processing unit 311 of hotel service 310 removes the link between the voice assistant 105, installed in the room where the user stayed, and the authenticator 330 of mobile device 103. This means that the record stored in the linking information management table (table E), in which the voice assistant 105 is linked to the authenticator ID specifying the authenticator 330, is deleted.

[0159] If the option to not retain biometric authentication information was selected on the checkout screen, Registration Processing Unit 311 deletes the following record in step S603. This means that corresponding user records in the Attestation Request Management Table (Table F) and the Authentication Information Management Table (Table G) are deleted. It should be noted that, for the purpose of improving the service that can be provided the next time the user stays there, corresponding user records in the User Information Management Table (Table B), the Accommodation History Management Table (Table C), and the Service Information Management Table (Table D) are configured to be retained without being deleted.

[0160] In step S604, the registration processing unit 311 responds to the mobile device 103 application 320 with information indicating that the checkout process has been completed. It should be noted that the information indicating that the checkout process has been completed includes the selection result as to whether the biometric authentication information should be retained, as selected by the user on the checkout screen.

[0161] If the option to not retain biometric authentication information is selected, application 320 requests in step S605 that the record relating to hotel service 310 be deleted from the authentication information management table (Table A) by authenticator 330. Upon receiving the record deletion request from application 320, authenticator 330's authentication registration processing unit 331 deletes the record. This means that the record relating to hotel service 310 is deleted from the authentication information management table (Table A) stored in TPM 226 via authentication information storage unit 333.

[0162] According to the present embodiment, a secure authentication method as described above can be provided without registering biometric authentication information in a device located in a place used by many unspecified people. [Second embodiment]

[0163] The first embodiment described various processes that are executed when a hotel guest uses a hotel-provided service, such as room service, via the voice assistant. In contrast, the present embodiment describes a case in which a guest uses the voice assistant to access a service provided by an external system other than Server 102.

[0164] It should be noted that in the present embodiment, the same reference numerals are assigned to the same configurations of the devices and the sequence of the various processes as in the first embodiment, and a description of these is omitted. In the present embodiment, a case is described in which a music distribution service 107 is used as an example of a service provided by someone other than a hotel. The voice assistant 105 connects to the music distribution service 107 via the network 101. The mobile device 103 also connects to the music distribution service 107 via the network 106.

[0165] It should be noted that it is assumed a user enters into a contract with the music distribution service 107 in advance to access the service via a voice assistant from their home and receives an ID and password from the service to register as a user. This means that the service is intended for authenticated users. Furthermore, it is assumed that the music distribution service 107 supports an authentication procedure similar to that of the hotel service 310, as described in the first embodiment.

[0166] This means that the music distribution service 107 is assumed to have a mechanism in which biometric authentication is performed on a device held by the user to authenticate the user, and the service authenticates the user based on the result. It is also assumed that the user pre-registers information related to biometric authentication, such as authentication identification information, a public key, and the like, with the music distribution service 107 using the mobile device 103.

[0167] Fig. Figure 13 is a representation to describe a process that is carried out to use the music distribution service 107 via the voice assistant 105 in a room where a guest (user) of a hotel is staying.

[0168] The user makes a request to use the music distribution service 107 to the voice assistant 105 via voice. For example, if music distribution is desired, a request is made by saying "Play music in the music distribution service".

[0169] In step S1001, the speech receiving unit 341 of the speech service 340 of the voice assistant 105 receives a request for the provision of the service from a user via speech or voice. In step S1002, the speech analysis unit 342 analyzes the received speech or voice and determines the details of the request. In step S1003, the communication unit 345 transmits a processing request analyzed in step S1002 to the music distribution service 107.

[0170] Upon receiving the request from voice assistant 105, music distribution service 107 performs the processing according to the received request in step S1004. It is assumed here that user authentication is necessary when a service is provided in the music distribution service. Therefore, in step S1005, music distribution service 107 makes a user authentication request to voice assistant 105.

[0171] It should be noted that the user authentication mentioned here is assumed to be the authentication mechanism ( Fig.7) used, which is used by the hotel service 310 in the first embodiment. Specifically, biometric authentication is performed on a device in the user's hand, and the user is authenticated based on the result. That is, in step S1005, the music distribution service 107 makes a biometric authentication request to the voice assistant 105.

[0172] At this time, the music distribution service 107 includes a generated biometric authentication parameter in the request, as described in the processing of step S511 of Fig. 7 is the case. Furthermore, the music distribution service can include 107 other / additional information in the request. For example, any information such as advertising or promotional information, or pricing information, can be included.

[0173] It should be noted that in step S511 of Fig.7. When the hotel service 310 transmits the user authentication request, the authenticator ID to specify the authenticator 330 associated with the voice assistant 105 is transmitted along with the biometric authentication parameter. However, since the music distribution service 107 does not hold information such as the linking information management table (Table E), this information is not transmitted.

[0174] Therefore, in the present embodiment, the voice assistant 105 performs processing to specify the authenticator 330, which serves as a reporting or notification target for the biometric authentication request. In step S1006, the biometric authentication control unit 344 of the voice service 340 queries the authenticator 330 of the mobile device 103, which serves as a reporting or notification target for the biometric authentication request of the hotel service 310.

[0175] In step S1007, the service processing unit 316 of the hotel service 310 specifies the authenticator 330 of the mobile device 103, which is linked to the voice assistant 105 serving as a request source, in the linking information management table (Table E). Then, in step S1008, the service processing unit 316 responds with an authenticator ID that identifies the authenticator 330 specified by the voice assistant 105.

[0176] In step S1009, the biometric authentication control unit 344 of the voice service 340 specifies the authenticator 330, which serves as a reporting or notification target for the biometric authentication request, using the authenticator ID included in the result of the request received in step S1008. The biometric authentication control unit 344 then makes a biometric authentication request to the mobile device 103. Note that the biometric authentication request includes an Auth biometric authentication parameter as described in the first embodiment.

[0177] Since the biometric authentication processing performed in steps S1010 to S1013 is identical to the processing performed in steps S514 to S517 of the first embodiment, a description of it is omitted. If user authentication is successful as a result of verification of claim information performed in step S1013, the music distribution service 107 initiates a provision of the service to the voice assistant 105 in step S1014. That is, the music distribution service 107 distributes or disseminates music data to the voice assistant 105.

[0178] On the other hand, if user authentication fails as a result of verification of the claim information performed in step S1013, the music distribution service 107 responds to the voice assistant 105 with information indicating the user authentication failure and terminates the process. Upon receiving this information, the voice delivery unit 343 of the voice service 340 announces to the user, by voice, that the request received in step S1001 was not executed. In step S1015, the voice delivery unit 343 of the voice service 340 plays music according to the service provision from the music distribution service 107. <Abwandlungsbeispiel 1 von zweitem Ausführungsbeispiel>

[0179] Using Fig. 14 will be a modified example of the process ( Fig.13) described for the use of the music distribution service with the voice assistant 105 in a room where a guest (user) of a hotel is staying. In the Fig. In process 13 shown, the request to provide the service via the voice assistant 105 is made to the music distribution service 107 (S1003).

[0180] On the other hand, in the Fig. In the modified example 14, the mobile device 103 directly submits a request to the music distribution service 107, without going through the voice assistant 105. The request to provide the service is, for example, a request to specify the title of the music and receive music data from the music distribution service 107, or something similar.

[0181] It should be noted that the mobile device 103 installs an application provided by and cooperating with the music distribution service 107 and makes a request to provide the service using the application. Alternatively, the URL of the web service provided by the music distribution service 107 can be determined / set on the web browser of the mobile device 103, and the request to provide the service can be made via a service screen for using the music distribution service 107. An application provided by and cooperating with the music distribution service 107 is referred to below as a cooperating application.

[0182] In step S1021, the collaboration application of mobile device 103 makes a request to the music distribution service to provide the service, as instructed by the user. In step S1022, the music distribution service 107 receives a processing request from mobile device 103 and executes the processing according to the received request. It is assumed here that user authentication is necessary to receive the service provision from the music distribution service. Therefore, in step S1023, the music distribution service 107 makes a request for user authentication to the voice assistant 105.

[0183] It should be noted that it is assumed that the authentication mechanisms mentioned here ( Fig. 7 and Fig.13), which are used by the hotel service 310 and the music distribution service 107 in the first and second embodiments. Specifically, biometric authentication is performed on a device in the user's hand, and the user is authenticated based on the result. That is, in step S1023, the music distribution service 107 makes a biometric authentication request to the mobile device 103.

[0184] In step S1024, the mobile device 103 performs biometric authentication processing. It should be noted that, since the biometric authentication processing is identical to that described in the first and second embodiments, a description of it is omitted. In step S1025, the mobile device 103 responds with claim information to the music distribution service 107. In step S1026, the music distribution service 107 verifies the claim information received in step S1025.

[0185] If user authentication is successful as a result of verifying the claim information, the music distribution service 107 initiates a provision of the service to the mobile device 103 in step S1027. This means that the music distribution service 107 distributes or disseminates the music data requested in step S1021 to the mobile device 103.

[0186] On the other hand, if user authentication fails as a result of verifying the claim information, the music distribution service 107 responds to the mobile device 103 with information indicating that user authentication failed and terminates the process. Upon receiving information that user authentication was successful, the mobile device 103 transmits music data to the voice assistant 105, which is installed in the room where the user of the mobile device 103 is located, as described in step S1028. The user then makes a voice request to the voice assistant 105. For example, the user specifies the title of the music transmitted in step S1028 and makes a request to play the music.

[0187] In step S1029, the voice receiver 341 of the voice service 340 of the voice assistant 105 receives the voice request from the user. In step S1030, the speech analyzer 342 analyzes the received speech and determines the details of the request. In step S1031, the voice output unit 343 plays the music according to the analyzed details of the request. <Abwandlungsbeispiel 2 von zweitem Ausführungsbeispiel>

[0188] Another modified example of the process ( Fig. 13) to use the music distribution service in a room where a guest (user) of a hotel is staying, via the voice assistant 105, using Fig.15 described. In the first embodiment, when the music distribution service 107 authenticates the user, biometric authentication is performed on the mobile device 103, which serves as a device in the user's hand, and the user is authenticated based on the result. On the other hand, in the Fig. 15 illustrated a modified example of biometric authentication performed on a voice operating device, which is the voice assistant 105, serving as a device in the user's hand.

[0189] It should be noted that the music distribution service 107 and the hotel service 310 are assumed to cooperate, and the guest can use the music distribution service 107 in their hotel room. For example, it is assumed that music data is distributed from the music distribution service 107 to the voice assistant 105, and that the voice assistant 105 can play the distributed music.

[0190] The music distribution service 107 checks the details of a service request from the hotel's cooperating voice assistant 105 and verifies that the user requesting the service is a legitimate guest. It then distributes music data to the voice assistant 105. At this time, user authentication is performed using the authentication mechanism implemented in either the first or second embodiment. Specifically, biometric authentication is performed on the device held by the user, and the user is authenticated based on the result.

[0191] One difference compared to the first and second embodiments is that the voice assistant 105 is used as a handheld device by the user, instead of using the mobile device 103. It should be noted that information specifying the voice assistant 105, which is used within the hotel, is registered (stored) in advance in the music distribution service 107.

[0192] Upon checking into the hotel, the user registers their biometric authentication information with the voice assistant 105. The registration of biometric authentication information is carried out through the same process as the registration process (S403 to S408) of the authenticator 330 of the mobile device 103 with reference to the server 102 at the time of check-in in the first embodiment.

[0193] In the present modified example, the voice assistant 105 has the authenticator 330, and the authenticator 330 of the voice assistant 105 performs the process described above in steps S403 to S408, similar to the mobile device 103. Accordingly, biometric information of the user is stored in the voice assistant 105. It should be noted that the biometric information can be any type of information, as is the case in the other embodiments. For example, it is assumed here that the biometric information is voiceprint information. The guest (user) registers his or her voiceprint information in the voice assistant 105 by speaking to the voice assistant 105.

[0194] If the user wishes to receive the service from the music distribution service 107, the user makes a request to the voice assistant 105 to provide the service using voice. For example, the user specifies the title of the music and makes a request to play the music.

[0195] In step S1041, the speech receiving unit 341 of the speech service 340 of the voice assistant 105 receives a speech request from the user. In step S1042, the speech analysis unit 342 analyzes the received speech and determines the details of the request. In step S1043, the communication unit 345 transmits a processing request analyzed in step S1042 to the music distribution service 107.

[0196] Upon receiving a request from the voice assistant 105, the music distribution service 107 performs processing according to the received request in step S1044. Specifically, the music distribution service 107 first determines whether user authentication is necessary to execute the received request. It is assumed that the music distribution service 107 configures whether user authentication is required in advance. For example, user authentication is determined to be unnecessary if the request is to obtain a music list, and it is determined to be necessary if the request is to play music.

[0197] Since the request is for music playback, the music distribution service 107 determines that user authentication is necessary. Therefore, in step S1045, the music distribution service 107 makes a user authentication request, i.e., a biometric authentication request, to the voice assistant 105. At this time, the music distribution service 107 generates a biometric authentication parameter and includes it in the request, as in the first embodiment. The biometric authentication parameter includes a claim prompt, which represents verification data to be used to perform a challenge-response authentication, as described above.

[0198] Upon receiving the biometric authentication request, the voice assistant 105 performs biometric authentication processing in step S1046. In the biometric authentication processing performed by the voice assistant 105, the voice delivery unit 343 of the voice service 340 instructs the user to undergo biometric authentication by voice and requests the input of biometric information. For example, the voice delivery unit 343 instructs the user by saying, "Voiceprint authentication is being performed, so please say something," and prompts the user to enter their biometric information.

[0199] Upon receiving speech from the user in step S1046, the voice assistant 105 performs biometric authentication processing using the voiceprint information of the received speech or voice. It should be noted that the voice assistant 105 has the same function as the authenticator 330 of the mobile device 103, which is described in the first embodiment. Then, in step S1046, the same processing is performed as described in Fig. Figure 7 illustrates biometric authentication processing (S514) performed by the mobile device 103, in which voice assistant 105 is carried out.

[0200] If the authentication resulting from the biometric authentication processing of step S1046 is successful, the voice assistant 105 responds with generated claim information to the music distribution service 107 in step S1047. The claim information includes a signature generated using a secret key stored as a result of the biometric authentication processing in conjunction with the biometric information, and a claim request included in the biometric authentication parameter received in step S1045.

[0201] It should be noted that if authentication fails as a result of the biometric authentication processing in step S1046, or if the user does not enter biometric information for a certain period of time, the voice delivery unit 343 of the voice service 340 notifies the user that user authentication is not possible, and the process terminates. Then, in step S1047, information is returned indicating that the result of the biometric authentication processing is an authentication failure. Upon receiving this information, the music distribution service 107 terminates the process. Fig. 15.

[0202] In step S1048, the music distribution service 107 verifies the claim information received in step S1047. Since the verification of the claim is the same as the processing performed by the hotel service 310 in step S517 of Fig. Since the first embodiment is described in section 7, a description of it is omitted.

[0203] If user authentication is successful as a result of verifying the claim information performed in step S1048, the music distribution service 107 initiates a provision of the service to the voice assistant 105 in step S1049. This means that the music distribution service 107 distributes or disseminates music data to the voice assistant 105.

[0204] On the other hand, if user authentication fails as a result of the verification of the claim information performed in step S1048, the music distribution service 107 responds to the voice assistant 105 with information indicating that user authentication failed and terminates the process. Upon receiving the information indicating that user authentication failed, the voice delivery unit 343 of the voice service 340 informs the user by speech or voice that the request received in step S1041 was not executed.

[0205] In step S1050, the voice delivery unit 343 of the voice service 340 plays the music according to the service provision from the music distribution service 107. It should be noted that, although the example in which biometric information is registered in the voice assistant 105 has been described in the present modified example, the present invention is not limited thereto. For example, the server 102 can include the authenticator 330, and the user's biometric information can be stored in the server 102.

[0206] In this case, when the voice assistant 105 receives speech or voice from the user in step S1046, voiceprint information of the received speech or voice is transmitted to the hotel service 310. The hotel service 310 then transmits the received voiceprint information to its own authenticator, and biometric authentication processing is performed by the authenticator. The result of the biometric authentication processing is then sent by the hotel service 310 back to the voice assistant 105.

[0207] Furthermore, the present modified example describes a case in which the music distribution service 107 performs biometric user authentication as a user authentication method, although the present invention is not limited to this. For example, the method can be a method using a keyword or tag. In this case, a user sets any keyword or tag related to the voice assistant 105 at the time of check-in. The registration of the keyword or tag is carried out by, for example, the user speaking the keyword or tag to the voice assistant 105.

[0208] The voice assistant 105 receives the user authentication request from the music distribution service in step S1045 and requests the user's keyword / keyword registered at the time of check-in. Upon receiving the user's voice input of the keyword / keyword, the voice assistant 105 analyzes the speech / voice and, if the entered keyword / keyword matches the keyword / keyword set at the time of check-in, determines that the user authentication process was successful. (Further examples)

[0209] One or more embodiments of the present invention can also be implemented by a computer of a system or device that reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more fully described as a "non-temporary computer-readable storage medium") in order to perform the functions of one or more of the embodiments described above, and / or one or more circuits (e.g.,The system comprises an application-specific integrated circuit (ASIC) for performing the functions of one or more of the embodiments described above, and a method performed by the computer of the system or device, for example, by reading and executing the computer-executable instructions from the storage medium to perform the functions of one or more of the embodiments described above, and / or by controlling the one or more circuits to perform the functions of one or more of the embodiments described above. The computer may have one or more processors (e.g., central processing unit (CPU), microprocessing unit (MPU)) and may comprise a network of separate computers or separate processors for reading and executing the computer-executable instructions.The computer-executable instructions can be provided to the computer, for example, from a network or the storage medium. The storage medium can include, for example, one or more hard drives, random access memory (RAM), read-only memory (ROM), distributed computing system memory, optical discs (such as a compact disc (CD), a digital versatile disc (DVD), or a Blu-ray disc (BD)™), flash memory devices, memory cards, and the like.

[0210] While the present invention has been described with reference to exemplary embodiments, it is understood that the invention is not limited to these disclosed exemplary embodiments. The scope of the following claims is to be interpreted in the broadest possible way, so that all such modifications and equivalent structures and functions are included.

[0211] A system comprising a mobile device (103) with an authenticator (330), a TPM (226) with tamper and sabotage protection, and a voice assistant (105) is disclosed. The voice assistant (105) makes a processing request to a server (102) in accordance with a user's voice input, receives a biometric authentication request from the server (102), makes a request for biometric authentication processing to the user's mobile device (103) in accordance with the request for biometric authentication via wireless communication (106), and transmits an authentication result from the mobile device (103) to a server (102).The mobile terminal (103) performs the biometric authentication processing using biometric information stored in the authenticator and the TPM (226) according to the biometric authentication processing request from the voice assistant and transmits an authentication result to the voice assistant (105).

Claims

The system comprises an information processing terminal (103) with an authentication module (330) for biometric authentication and a tamper-proof storage unit (226) that stores biometric information of a user necessary when authentication processing is performed using the authentication module (330), and a voice operating device (105) that receives voice input and performs processing according to the input, wherein the voice operating device (105) is configured to: make a processing request according to a user's voice input to an external system (102) according to the input; receive an authentication request from the external system (102); transmit, via wireless communication (106), a request for authentication processing to the user's information processing terminal (103) according to the received authentication request;and transmitting an authentication result from the information processing terminal (103) to the external system (102), wherein the information processing terminal (103) is configured to: perform biometric authentication processing using the authentication module (330) and the biometric information stored in the storage unit (226) according to the authentication processing request from the voice operating device (105);and transmitting an authentication result of the biometric authentication processing to the voice operating device (105), wherein the authentication result of the biometric authentication processing comprises a signature generated by using a secret key stored in the storage unit (226) in association with biometric information, and verification data issued by the external system (102) in which a public key paired with the secret key is registered. System according to claim 1, wherein the authentication request received by the external system (102) comprises identification information to specify the authentication module (330) of the information processing terminal (103) of the user who has made a voice input to the voice operating device (105), and wherein the voice operating device (105) makes a request for authentication processing to the specified authentication module (330) of the information processing terminal (103) based on the identification information of the authentication module (330). System according to claim 1 or 2, wherein the information processing terminal (103) displays a screen for reading biometric information using a biometric information sensor (228) to register user registration information comprising a public key generated in connection with the biometric information in the external system (102). System according to claim 3, wherein the information processing terminal (103) makes a request to the external system (102) to register the registration information, and wherein the external system (102) manages the authentication module (330) of the information processing terminal (103) and the voice operating device (105) used by the user of the information processing terminal (103) in relation to each other according to a registration request from the information processing terminal (103). System according to claim 4, wherein an authentication request received from an external system (102) other than the external system (102) in which the registration information is registered does not include identification information for specifying the authentication module (330) of the information processing terminal (103) of the user who has made a voice input to the voice operating device (105), and wherein the voice operating device (105) acquires the identification information of the authentication module (330) of the information processing terminal (103) associated with the voice operating device (105) from the external system (102) in which the registration information is registered when authentication processing is requested with respect to the information processing terminal (103). System according to one of claims 3 to 5, wherein the information processing terminal (103) makes a request to the external system (102) to deregister the registration information, and wherein the external system (102) deletes the registration information of a corresponding user from the information processing terminal (103) in accordance with the deregistration request. System according to any one of claims 1 to 6, wherein the information processing terminal (103) displays a screen for reading biometric information using a biometric information sensor (228) when the biometric authentication processing is performed by the voice operating device (105) according to the authentication processing requirement. System according to any one of claims 1 to 7, wherein the voice operating device (105) executes a service provided by the external system (102) as intended for the authenticated user in the voice operating device (105) according to a success of a verification of the authentication result. Control method in a system comprising an information processing terminal (103) with an authentication module (330) for biometric authentication and a tamper-proof storage unit (226) that stores biometric information of a user necessary when authentication processing is performed using the authentication module (330), and a voice operating device (105) that receives voice input and performs processing according to the input, wherein the method comprises: making a processing request according to a voice input of a user to an external system (102) according to the input by the voice operating device (105); receiving an authentication request from the external system (102) by the voice operating device (105);Transmitting, via wireless communication (106), a request for authentication processing to the user's information processing terminal (103) in accordance with the authentication processing received by the voice operating device (105); Performing biometric authentication processing using the authentication module (330) and the biometric information stored in the storage unit (226) in accordance with the authentication processing request from the voice operating device (105) by the information processing terminal (103); Transmitting an authentication result of the biometric authentication processing to the voice operating device (105) by the information processing terminal (103);and transmission of the authentication result from the information processing terminal (103) to the external system (102) by the information processing terminal (103), wherein the authentication result of the biometric authentication processing comprises a signature generated by using a secret key stored in the storage unit (226) in association with biometric information, and verification data issued by the external system (102) in which a public key paired with the secret key is registered. A voice operating device (105) that receives voice input and performs processing according to the input, wherein the voice operating device (105) is configured to: make a processing request according to a user's voice input to an external system (102) according to the input; receive an authentication request from the external system (102); transmit, via wireless communication (106), an authentication processing request to an information processing device that is a user information processing terminal (103) and has an authentication module (330) for biometric authentication and a tamper-proof storage unit (226) that stores the user's biometric information necessary when authentication processing is performed using the authentication module (330) according to the received authentication request;and transmitting an authentication result obtained by performing biometric authentication processing using the authentication module (330) and the biometric information stored in the storage unit (226) according to a request for authentication processing from the information processing terminal device (103), wherein the authentication result of the biometric authentication processing includes a signature generated by using a secret key stored in the storage unit (226) in association with biometric information, and verification data issued by the external system (102) in which a public key paired with the secret key is registered. Control method for a voice operating device (105) that receives a voice input and performs processing according to the input, the method comprising: making a processing request according to a voice input from a user to an external system (102) according to the input; receiving an authentication request from the external system (102); transmitting, via wireless communication (106), an authentication processing request to an information processing device that is an information processing terminal device (103) of the user and has an authentication module (330) for biometric authentication and a tamper-proof storage unit (226) that stores biometric information of the user that is necessary when authentication processing is performed using the authentication module (330) according to the received authentication request;and transmitting an authentication result obtained by performing biometric authentication processing using the authentication module (330) and the biometric information stored in the storage unit (226) according to a request for authentication processing from the information processing terminal device (103), wherein the authentication result of the biometric authentication processing includes a signature generated by using a secret key stored in the storage unit (226) in association with biometric information, and verification data issued by the external system (102) in which a public key paired with the secret key is registered. Computer program for causing a computer to execute a method for a speech operating device that receives speech input and performs processing according to the input, wherein the method comprises: making a processing request according to a user's speech input to an external system (102) according to the input; receiving an authentication request from the external system (102);Transmitted, via wireless communication (106), an authentication processing request to an information processing device, which is a user information processing terminal device (103) and includes an authentication module (330) for biometric authentication and a tamper-proof storage unit (226) that stores the user's biometric information necessary when performing authentication processing using the authentication module (330), in accordance with the received authentication request;and transmitting an authentication result obtained by performing biometric authentication processing using the authentication module (330) and the biometric information stored in the storage unit (226) according to a request for authentication processing from the information processing terminal device (103), wherein the authentication result of the biometric authentication processing includes a signature generated by using a secret key stored in the storage unit (226) in association with biometric information, and verification data issued by the external system (102) in which a public key paired with the secret key is registered.

Images