Information Processing Apparatus, Information Processing Method, and Program

Abstract

To obtain an information processing device and the like capable of improving user convenience when performing biometric authentication using sound.SOLUTION: An information processing device is a device for controlling another device. The device includes: a measuring unit that measures the distance between the information processing device and the other device; an authentication control unit that executes selectively either a series of biometric authentication processing of a user of the other device using audible sounds or biometric authentication processing of the user using inaudible sounds based on the measured distance; and an other device control unit that controls the other device based on the biometric processing results.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, in order to prevent a third party from operating another device, a system has been developed that performs biometric authentication every time an operation is performed.

[0003] For example, it has been proposed to prevent a third party from unlocking a vehicle door by combining operation (authentication) using an electronic key with biometric authentication of the user (for example, fingerprint authentication on the door handle) (see Patent Document 1).

[0004] As a form of biometric authentication, we consider outputting sound into the user's ear canal from a device that can be worn on the user's ear, extracting features from the acquired reflected sound, and comparing them with features of authorized users of other devices that have been registered in advance, thereby performing biometric authentication of the user (based on the shape of the ear canal). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-115439 Summary of the Invention [Problem to be solved by the invention]

[0006] In this case, if the user hears the biometric authentication sound (audible sound) every time biometric authentication is performed, it is annoying for the user. On the other hand, if biometric authentication is performed using inaudible sound, the user cannot recognize operations on other devices at all. In other words, if biometric authentication using sound is performed using either audible sound or inaudible sound, it is inconvenient for the user.

[0007] In view of the above facts, an object of the present invention is to provide an information processing apparatus, an information processing method, and a program that improve the convenience for a user when performing biometric authentication by sound.

Means for Solving the Problems

[0008] An information processing apparatus according to a first aspect is an information processing apparatus that controls another apparatus, and includes a measurement unit that measures a distance between the information processing apparatus and the other apparatus, and based on the measured distance, selectively executes either biometric authentication processing of a user of the other apparatus using sound in the audible range or biometric authentication processing of the user using sound in the inaudible range, and an other apparatus control unit that controls the other apparatus based on the result of the biometric authentication processing.

[0009] In this information processing apparatus, for example, when the other apparatus is operated, the authentication control unit executes biometric authentication processing of the user using sound, and the other apparatus control unit controls the other apparatus based on the result of this biometric authentication. For example, when the biometric authentication is OK, the other apparatus control unit performs control to permit the operation of the other apparatus. On the other hand, when the biometric authentication is NG, the other apparatus control unit performs control to disallow the operation of the other apparatus. In this way, when the biometric authentication is NG, by disallowing the operation of the other apparatus, it is possible to prevent a third party from operating the other apparatus.

[0010] Also, in this information processing apparatus, for example, when the other apparatus is operated, the measurement unit measures the distance between the information processing apparatus owned by the user and the other apparatus. Based on the distance between the information processing apparatus and the other apparatus measured by the measurement unit, the authentication control unit selectively uses sound in the audible range or sound in the inaudible range to execute biometric authentication processing.

[0011] For example, when the information processing apparatus (owned by the user) is separated from the other apparatus, biometric authentication processing of the user is executed using sound in the audible range, so that the user can surely recognize the operation on the other apparatus.

[0012] When a user who owns an information processing device approaches another device, biometric authentication of the user is performed using inaudible sound. This is because when the user who owns the information processing device is located near another device, it is highly likely that the user is operating the other device, and even if a third party operates the other device, the user can likely confirm (visually recognize) the state of the other device. Therefore, authentication is performed using inaudible sound to reduce the annoyance of the user.

[0013] In the information processing device according to the second aspect, in the information processing device according to the first aspect, when the distance is equal to or greater than a predetermined distance, the authentication control unit causes the biometric authentication process of the user to be executed using audible sound, and when the distance is less than the predetermined distance, the biometric authentication process of the user is executed using inaudible sound.

[0014] In this information processing device, when the distance between the information processing device and another device acquired by the measurement unit is equal to or greater than a predetermined distance, the biometric authentication process is executed using audible sound. Thereby, a user who owns an information processing device separated from another device by a predetermined distance or more and has difficulty confirming the state of the other device can be surely made aware that an operation has been performed on the other device.

[0015] On the other hand, when the distance between the information processing device and another device measured by the measurement unit is less than the predetermined distance, that is, when the user who owns the information processing device is located within a range less than the predetermined distance from the other device, the biometric authentication process is executed using inaudible sound. This is because when the user who owns the information processing device is located near another device, it is highly likely that the user is operating the other device, and even if a third party operates the other device, the user can likely confirm (visually recognize) the state of the other device. Therefore, authentication is performed using inaudible sound to reduce the annoyance of the user.

[0016] The information processing apparatus according to the third aspect is an information processing apparatus that controls another apparatus, and includes an acquisition unit that acquires the operation content for the other apparatus, an authentication control unit that selectively executes either biometric authentication processing of the user of the other apparatus using sound in the audible range or biometric authentication processing of the user using sound in the inaudible range based on the acquired operation content, and another apparatus control unit that controls the other apparatus based on the result of the biometric authentication processing.

[0017] In this information processing apparatus, for example, when the other apparatus is operated, the authentication control unit executes biometric authentication processing of the user using sound, and the other apparatus control unit controls the other apparatus based on the result of this biometric authentication. For example, when the biometric authentication is OK, the other apparatus control unit performs control to permit the operation of the other apparatus. On the other hand, when the biometric authentication is NG, the other apparatus control unit performs control to disallow the operation of the other apparatus. Thereby, it is possible to prevent a third party from operating the other apparatus.

[0018] Also, in this information processing apparatus, for example, when the other apparatus is operated, the acquisition unit acquires the operation content for the other apparatus. Based on this operation content, the authentication control unit selectively uses sound in the audible range or sound in the inaudible range to execute biometric authentication processing of the user.

[0019] For example, when the operation content is an operation that enables entry into the other apparatus, the authentication control unit causes the user's biometric authentication processing to be performed using sound in the audible range. That is, when an operation that permits entry into the other apparatus is performed, the authentication control unit executes biometric authentication with sound in the audible range, so that the user (owning the information processing apparatus) can recognize that an operation that enables entry into the other apparatus has been performed on the other apparatus.

[0020] On the other hand, when the operation content is not an operation that enables entry into the other apparatus, the authentication control unit causes the user's biometric authentication processing to be performed using sound in the inaudible range. Thereby, it is possible to suppress the user from feeling bothered by sound in the audible range every time biometric authentication is performed, and to ensure the convenience of the user.

[0021] The information processing apparatus according to the fourth aspect is the information processing apparatus according to the third aspect, wherein when the operation content is a security release operation of the other device, the authentication control unit executes the biometric authentication process of the user using a sound in the audible range, and when the operation content of the other device is not a security release operation of the other device, the authentication control unit executes the biometric authentication process of the user using a sound in the inaudible range.

[0022] The authentication control unit of this information processing apparatus causes the biometric authentication process of the user to be executed using a sound in the audible range when the operation content for the other device is a security release operation for the other device. That is, when a security release operation is performed on the other device, the authentication control unit can cause the user (owning the information processing apparatus) to recognize that a security release operation has been performed on the other device by executing the biometric authentication process of the user with a sound in the audible range.

[0023] On the other hand, when the operation content is not a security release operation of the other device, the authentication control unit causes the biometric authentication process of the user to be performed using a sound in the inaudible range. Thereby, it is possible to suppress the user from feeling annoyed by a sound in the audible range every time biometric authentication is performed, and to ensure the convenience of the user.

[0024] Note that the "security release operation" is an operation that leads to theft of the whole or part of the other device, and an operation that enables entry into the inside of the other device (an operation that leads to theft of valuables (such as the user's personal belongings) inside the other device, etc.).

[0025] The information processing apparatus according to the fifth aspect is the information processing apparatus according to any one of the first aspect to the fourth aspect, wherein the authentication control unit selectively executes either the biometric authentication process of the user using a sound in the audible range or the biometric authentication process of the user using a sound in the inaudible range on an authentication device different from the information processing apparatus.

[0026] In this information processing apparatus, the authentication control unit can cause a biometric authentication process using a sound in the audible range or a sound in the inaudible range to be executed on an authentication device provided separately from the information processing apparatus.

[0027] The information processing apparatus according to the sixth aspect is the information processing apparatus according to the fifth aspect, wherein the authentication device can be worn on the user's ear, selectively outputs sound in the audible range or the inaudible range, acquires the reverberant sound of the sound, extracts a feature amount from the reverberant sound, and collates the feature amount with the feature amount of a legitimate user of the other device registered in advance to perform biometric authentication processing of the user.

[0028] Another authentication device different from this information processing apparatus can be worn on the user's ear. Therefore, the authentication device outputs sound in the audible range or the inaudible range to the user's ear canal in a state of being worn on the user's ear, extracts a feature amount from the acquired reverberant sound, and collates the feature amount with the feature amount of a legitimate user of the other device that is registered to perform biometric authentication.

[0029] In this way, since the authentication device is worn on the user's ear, biometric authentication processing of the user by sound can be performed with high accuracy.

[0030] The information processing apparatus according to the seventh aspect is the information processing apparatus according to any one of the first aspect to the fourth aspect, further including an authentication unit capable of performing biometric authentication processing using sound in the audible range and biometric authentication processing using sound in the inaudible range, and the authentication control unit selectively causes the authentication unit to perform either biometric authentication processing using sound in the audible range or biometric authentication processing using sound in the inaudible range.

[0031] In this information processing apparatus, since it includes an authentication unit capable of performing biometric authentication processing of the user using sound in the audible range or sound in the inaudible range, the authentication control unit can selectively cause the authentication unit to perform either biometric authentication processing of the user using sound in the audible range or biometric authentication processing of the user using sound in the inaudible range.

[0032] The information processing apparatus according to the eighth aspect is the information processing apparatus according to the seventh aspect, wherein the information processing apparatus is wearable on the user's ear, the authentication unit selectively outputs sounds in the audible range or the inaudible range, acquires the reverberation sound of the sound, extracts a feature amount from the reverberation sound, and collates the feature amount with the feature amount of the legitimate user of the other device registered in advance to execute the biometric authentication process of the user.

[0033] This information processing apparatus is wearable on the user's ear. Therefore, in a state where the information processing apparatus is worn on the user's ear, the authentication unit outputs a sound in the audible range or the inaudible range to the user's ear canal, extracts a feature amount from the acquired reverberation sound, and collates the feature amount with the feature amount of the legitimate user of the other registered device to execute the biometric authentication process.

[0034] Thus, since the information processing apparatus is worn on the user's ear, the authentication unit can accurately perform the biometric authentication process of the user by sound.

[0035] The information processing apparatus according to the ninth aspect is the information processing apparatus according to any one of the first to eighth aspects, further comprising an operation reception unit that receives the user's operation when the biometric authentication process of the user by the sound in the audible range is performed, and the other device control unit controls the other device based on the result of the biometric authentication process and the user's operation received by the operation reception unit.

[0036] In this information processing apparatus, when the biometric authentication process of the user by audible sound is executed, the operation reception unit receives the user's operation. Further, the other device control unit controls the other device based not only on the result of the user's biometric authentication process but also on the user's operation received by the operation reception unit.

[0037] Therefore, when a user who has recognized an operation on another device by the biometric authentication process of the user by audible sound operates, the operation reception unit receives the operation. Based on the user's operation received by the operation reception unit and the result of biometric authentication, the other device control unit controls the other device.

[0038] For example, through the biometric authentication process of the user using audible sound, the user recognizes an operation by a third party on another device, and the operation reception unit receives the user's operation to prevent that operation, and based on the content of the user's operation, the other device control unit can control the other device so as not to execute the operation content.

[0039] The information processing method according to the tenth aspect is a process in which a computer measures the distance between an information processing device and another device, and based on the measured distance, selectively executes either the biometric authentication process of the user of the other device using sound in the audible range or the biometric authentication process of the user using sound in the inaudible range, and controls the other device based on the result of the biometric authentication process.

[0040] This information processing method has the same operational effects as the first aspect.

[0041] The information processing method according to the eleventh aspect is a process in which a computer acquires the content of an operation on another device, and based on the acquired operation content, selectively executes either the biometric authentication process of the user of the other device using sound in the audible range or the biometric authentication process of the user using sound in the inaudible range, and controls the other device based on the result of the biometric authentication process.

[0042] This information processing method has the same operational effects as the third aspect.

[0043] The program according to the twelfth aspect causes a computer to measure the distance between an information processing device and another device, and based on the measured distance, selectively execute either the biometric authentication process of the user of the other device using sound in the audible range or the biometric authentication process of the user using sound in the inaudible range, and execute a process of controlling the other device based on the result of the biometric authentication process.

[0044] This program has the same operational effects as the first aspect.

[0045] The program according to the 13th aspect causes a computer to acquire the operation content for another device, and based on the acquired operation content, selectively execute either biometric authentication processing of the user of the other device using sound in the audible range or biometric authentication processing of the user using sound in the inaudible range, and control the other device based on the result of the biometric authentication processing.

[0046] This program has the same operational effects as the 3rd aspect.

Effects of the Invention

[0047] The present disclosure can improve the convenience of the user when performing biometric authentication by sound.

Brief Description of the Drawings

[0048]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Mode for Carrying Out the Invention

[0049] [Embodiment] An information processing system including a vehicle according to the first embodiment will be described.

[0050] As shown in FIG. 1, the information processing system 10 includes a vehicle 12, a smartphone 14 which is a portable terminal, and a wearable device 16.

[0051] The vehicle 12 corresponds to the "other device". Also, the smartphone 14 corresponds to the "information processing device". Further, the wearable device 16 corresponds to the "authentication device".

[0052] (Vehicle) As shown in FIG. 1, the vehicle 12 includes an authentication ECU 20, a door lock ECU 22, an actuator ECU 24, and a communication unit 26.

[0053] When the authentication ECU 20 detects an operation on the vehicle 12, it requests authentication from the smartphone 14. Also, when an operation permission signal is input from the smartphone 14 as a result of the authentication request, the authentication ECU 20 outputs the operation permission signal to the corresponding ECU to control the vehicle 12 corresponding to the operation. For example, driving an actuator.

[0054] Here, the "operation" means that an operation switch (not shown) provided on the vehicle 12 is operated, or an operation signal is input to the vehicle 12 from the outside of the vehicle 12. For example, when a door unlock operation signal is input to the vehicle 12 from an electronic key (not shown) of the vehicle 12.

[0055] When the door lock ECU 22 receives a door unlock signal or a door lock signal, which is a kind of operation signal, from the electronic key, and an operation permission signal is input from the authentication ECU 20, it outputs a drive signal to the actuator of the door lock mechanism to unlock (open the door) or lock (lock the door) the door.

[0056] The actuator ECU 24 generally represents other drive system ECUs and includes, for example, the engine ECU. Even when an operation signal is input to the actuator ECU 24, each actuator is driven (controlled) on the condition that an operation permission signal from the authentication ECU 20 is input.

[0057] The communication unit 26 can communicate with a first communication unit 52 (to be described later) of a smartphone 14 owned by a (legitimate) user of the vehicle 12 via BLUETOOTH (registered trademark).

[0058] Next, the hardware configuration of the authentication ECU 20 will be described with reference to FIG. 2.

[0059] The authentication ECU 20 includes a CPU (Central Processing Unit: processor) 20A, a ROM (Read Only Memory) 20B, a RAM (Random Access Memory) 20C, a storage 20D, and an input / output interface (input / output I / F) 20E. Each component is communicably connected to each other via a bus 20F.

[0060] The CPU 20A is a central processing unit that executes various programs and controls each part. That is, the CPU 20A reads a program from the ROM 20B or the storage 20D and executes the program using the RAM 20C as a work area. The CPU 20A performs control of the above components and various arithmetic processes according to the programs recorded in the ROM 20B or the storage 20D.

[0061] The ROM 20B stores various programs and various data. The RAM 20C temporarily stores programs or data as a working area.

[0062] The storage 20D is composed of an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various programs including an operating system and various data. In the storage 20D of the present embodiment, a program is stored. This program may be stored in the ROM 20B.

[0063] The input / output interface (hereinafter referred to as "input / output I / F") 20E is an interface for communicating with other devices. Specifically, the authentication ECU 20 is connected to the door lock ECU 22, the actuator ECU 24, and the communication unit 26 via the input / output I / F 20E and an in-vehicle bus (not shown).

[0064] Next, the functional configuration of the authentication ECU 20 will be described with reference to FIG. 3.

[0065] As shown in FIG. 3, the authentication ECU 20 includes an operation detection unit 40, a request unit 42, a signal acquisition unit 44, and a permission unit 46.

[0066] The operation detection unit 40 detects an operation signal input to the vehicle 12 from the outside of the vehicle 12 or an operation signal generated by operating an operation switch provided in the vehicle 12, that is, it detects an operation on the vehicle 12.

[0067] When the operation detection unit 40 detects an operation on the vehicle 12, the request unit 42 transmits an authentication request signal to the smartphone 14 via the communication unit 26 and transmits information on the operation content of the operation on the vehicle 12 (hereinafter referred to as "operation content information").

[0068] When the authentication on the smartphone 14 side (specifically, the wearable device 16) is successful, the signal acquisition unit 44 acquires the operation permission signal transmitted from the smartphone 14 to the vehicle 12.

[0069] When the signal acquisition unit 44 acquires the operation permission signal, the permission unit 46 outputs the operation permission signal to the ECU that controls the operation target, for example, the door lock ECU 22. As a result, the door lock ECU 22 drives (controls) the actuator of the door lock mechanism that is the operation target.

[0070] (Smartphone) Subsequently, the smartphone 14 will be described.

[0071] As shown in FIG. 1, the smartphone 14 includes a main control unit 50, a first communication unit 52, a second communication unit 53, and a display unit 54.

[0072] Based on the authentication request from the vehicle 12 side, the main control unit 50 measures the distance between the vehicle 12 and the smartphone 14, and determines the notification level based on the operation content for the vehicle 12 and the measured distance. Further, based on this determination result, a high-level or low-level authentication request signal is transmitted to the wearable device 16.

[0073] The first communication unit 52 can communicate with the communication unit 26 of the vehicle 12 via BLUETOOTH (registered trademark).

[0074] The second communication unit 53 can communicate with the communication unit 82 (to be described later) of the wearable device 16 via BLUETOOTH (registered trademark).

[0075] The display unit 54 is the monitor of the smartphone 14 and can display the occurrence event display, user operation guidance display, reinstallation caution display, etc. to be described later.

[0076] Next, the hardware configuration of the main control unit 50 will be described. Since the hardware configuration of the main control unit 50 is the same as that of the authentication ECU 20, in FIG. 2, reference numerals of the CPU 50A to the bus 50F are attached, and detailed description thereof will be omitted.

[0077] Subsequently, the functional configuration of the main control unit 50 will be described with reference to FIG. 4.

[0078] The main control unit 50 includes an acquisition unit 60, a measurement unit 62, a level determination unit 64, a request unit 66, a display control unit 68, and a transmission unit 70. The level determination unit 64 and the request unit 66 correspond to the "authentication control unit". Also, the transmission unit 70 corresponds to the "other device control unit".

[0079] When the acquisition unit 60 receives an authentication request signal from the vehicle 12, it acquires operation content information for the vehicle 12.

[0080] When the measurement unit 62 receives an authentication request signal from the vehicle 12, it measures (estimates) the distance between the smartphone 14 and the vehicle 12. For example, the Bluetooth Low Energy (registered trademark) radio wave transmitted from the communication unit 26 of the vehicle 12 is received by the first communication unit 52 of the smartphone 14, and the distance between the smartphone 14 and the vehicle 12 is measured (estimated) based on the radio wave intensity.

[0081] As another example of the radio wave, ultra-wideband wireless communication (UWB (Ultra Wide Band)), etc. can be considered.

[0082] Also, when the smartphone 14 has acquired the position information of the vehicle 12, the distance between the vehicle 12 and the smartphone 14 may be measured (calculated) based on the position information acquired from the GPS (Global Positioning System).

[0083] The level determination unit 64 determines the notification level of the authentication request signal to be notified to the wearable device 16 based on the operation content information acquired by the acquisition unit 60 and the distance between the smartphone 14 and the vehicle 12 measured by the measurement unit 62. Specifically, when the operation (content) on the vehicle 12 is a security release operation of the vehicle 12 and the distance between the smartphone 14 and the vehicle 12 is equal to or greater than a predetermined distance (threshold value), it is determined as a high level, and in other cases, it is determined as a low level.

[0084] Here, the "security release operation" is an operation in which all or part of the vehicle 12 is stolen or there is a risk of entering the vehicle 12 (leading to theft of valuables in the vehicle interior).

[0085] For example, the "door unlock operation" that enables entry into the vehicle interior of the vehicle 12 and the "engine start operation" that enables the vehicle 12 to move correspond to the security release operation.

[0086] On the other hand, examples of "operations that do not correspond to the security release operation" include operations such as audio operation and air conditioning operation on the vehicle 12.

[0087] The request unit 66 transmits a high-level authentication request signal or a low-level authentication request signal from the second communication unit 53 to the wearable device 16 based on the notification level determination result in the level determination unit 64.

[0088] When the display control unit 68 transmits a high-level authentication request signal to the wearable device 16, it causes the display unit 54 to display an event occurrence display and a user operation guidance display. As a result, when an authentication NG signal is received from the wearable device 16 to the smartphone 14, it causes a reinstallation caution display to be displayed.

[0089] When the authentication in the wearable device 16 is OK (an authentication OK signal is received from the wearable device 16), the transmission unit 70 transmits an operation permission signal to the vehicle 12.

[0090] (Wearable device) Next, the wearable device 16 will be described.

[0091] As shown in FIG. 1, the wearable device 16 includes a main control unit 80, a communication unit 82, a speaker 84, a microphone 86, a wearing sensor 88, and an authentication stop button 94.

[0092] The wearable device 16 is a wearable device that can be worn on the user's ear. When the user wears it, the speaker 84 and the microphone 86 are arranged facing the user's ear canal.

[0093] The main control unit 80 performs biometric authentication (ear acoustic authentication) of the user using sound based on an authentication request signal from the smartphone 14. In the case of a high-level authentication request, an audible sound is output from the speaker 84 toward the ear canal of the user wearing the wearable device 16, the reverberant sound is acquired by the microphone 86, a feature amount is extracted from the reverberant sound, and the feature amount is collated with the feature amount of a registered regular user to perform biometric authentication of the user.

[0094] On the other hand, in the case of a low-level authentication request, a non-audible sound is output from the speaker 84 toward the ear canal of the user, the reverberant sound is acquired by the microphone 86, a feature amount is extracted from the reverberant sound, and the feature amount is collated with the feature amount of a registered regular user to perform biometric authentication of the user.

[0095] The communication unit 82 is capable of transmitting and receiving data via BLUETOOTH (registered trademark) to and from the second communication unit 53 of the smartphone 14.

[0096] The wearing sensor 88 is a sensor that detects whether the wearable device 16 is worn on the user's ear.

[0097] The authentication stop button 94 is a button that stops biometric authentication in the wearable device 16 when this button is pressed. When the biometric authentication by the wearable device 16 is stopped, the wearable device 16 is configured to automatically output an authentication NG signal when an authentication request is made. That is, it is configured such that all operations on the vehicle 12 are not executed. Note that instead of stopping the biometric authentication by the authentication stop button 94, the biometric authentication may be stopped by a user's utterance such as "cancel authentication" to the microphone 86.

[0098] Next, the functional configuration of the main control unit 80 will be described. Since the hardware configuration of the main control unit 80 is the same as that of the authentication ECU 20, in FIG. 2, reference numerals CPU80A to bus 80F are attached, and except for the storage 80D, a detailed description thereof is omitted.

[0099] The storage 80D stores audible and inaudible voice data used for performing ear acoustic authentication by the wearable device 16, and voice data of an authentication start message to be played when performing ear acoustic authentication with audible sound. Further, data of the feature amount of the (regular) user of the vehicle 12 for collation during ear acoustic authentication (biometric authentication) is also stored.

[0100] These voice data and the like may be stored in the storage 50D of the main control unit 50 of the smartphone 14 and transmitted to the wearable device 16 at a predetermined timing.

[0101] Subsequently, the functional configuration of the main control unit 80 will be described with reference to FIG. 5.

[0102] As shown in FIG. 5, the main control unit 80 includes a request detection unit 100, a voice playback unit 101, a collation unit 102, a removal detection unit 104, a determination unit 106, and a result transmission unit 108.

[0103] When the request detection unit 100 receives an authentication request signal transmitted from the smartphone 14, it determines whether the level thereof is high (high-level authentication request signal) or low (low-level authentication request signal).

[0104] When the audio playback unit 101 receives a high-level authentication request signal from the smartphone 14, it plays back the authentication start audio data read from the storage 80D and outputs an authentication start message as audible sound from the speaker 84. Subsequently, the audio playback unit 101 plays back the audible sound authentication audio data read from the storage 80D and outputs the audible sound in the audible range for earprint authentication from the speaker 84. In addition, when the audio playback unit 101 has been playing back audio until the start of earprint authentication, it stops or mutes the playback of that audio (for example, music) at the start of ear authentication.

[0105] Also, when the audio playback unit 101 receives a low-level authentication request signal from the smartphone 14, it plays back the inaudible sound authentication audio data read from the storage 80D and outputs the inaudible sound in the inaudible range for earprint authentication from the speaker 84. In addition, when the audio playback unit 101 has been playing back audio (for example, music) until the start of earprint authentication, it continues the playback of that audio (for example, music).

[0106] Furthermore, the audio playback unit 101 can play back audio data (such as music) transmitted from the smartphone 14 except during earprint authentication using audible sound. That is, the wearable device 16 can function as a wireless earphone of the smartphone 14.

[0107] When an audible sound or an inaudible sound for earprint authentication is selectively output from the speaker 84, the collation unit 102 acquires the reverberation sound of that sound with the microphone 86 and extracts a feature amount from the reverberation sound.

[0108] Furthermore, by collating the feature amount of the registered user stored (pre-registered) in the storage 80D with the extracted feature amount, it is determined whether the user wearing the wearable device 16 is a registered user of the vehicle 12. That is, earprint authentication (biometric authentication) of the user is performed.

[0109] When the notification level is high (when a high-level authentication request signal is received), the removal detection unit 104 detects whether the wearable device 16 has been removed from the user based on the detection signal of the wearing sensor 88 while an audible range sound for earprint authentication is being output from the speaker 84.

[0110] When the notification level is high, the determination unit 106 determines that the authentication is successful if the earprint authentication (biometric authentication) by the matching unit 102 is successful and the removal detection unit 104 does not detect the removal of the wearable device 16 during the earprint authentication. On the other hand, when the biometric authentication in the matching unit 102 fails, or when the removal detection unit 104 detects the removal of the wearable device 16 during the earprint authentication, the determination unit 106 determines that the authentication fails.

[0111] Also, when the notification level is low, the determination unit 106 determines that the authentication is successful if the earprint authentication (biometric authentication) by the matching unit 102 is successful, and determines that the authentication fails when the earprint authentication (biometric authentication) in the matching unit 102 fails.

[0112] Based on the determination result of the determination unit 106, the result transmission unit 108 transmits an authentication success signal or an authentication failure signal to the smartphone 14.

[0113] [Operation] Next, the authentication process in the information processing system 10 will be described with reference to the flowcharts shown in FIGS. 6 to 9. First, the process in the vehicle 12 (authentication ECU 20) will be described, then the process in the smartphone 14 (main control unit 50), and finally the process in the wearable device 16 (main control unit 80).

[0114] [Processing of Authentication ECU] First, the process in the authentication ECU 20 of the vehicle 12 will be described with reference to the flowchart shown in FIG. 6.

[0115] First, in step S100 of FIG. 6 (hereinafter, "of FIG. 6" is omitted), the CPU 20A of the authentication ECU 20 determines whether the vehicle 12 has been operated.

[0116] If a negative determination is made in step S100, the process waits in step S100 until the vehicle 12 is operated. On the other hand, if an affirmative determination is made in step S100, the process proceeds to step S102.

[0117] In step S102, the CPU 20A of the authentication ECU 20 transmits an authentication request signal to the smartphone 14 of the (legitimate) user via the communication unit 26.

[0118] As will be described later, by transmitting this authentication request signal, authentication processing is performed by the smartphone 14 and the wearable device 16. If the authentication is successful, an operation permission signal is transmitted from the smartphone 14 to the vehicle 12.

[0119] In step S104, the CPU 20A of the authentication ECU 20 determines whether an operation permission signal has been received from the smartphone 14.

[0120] If a negative determination is made in step S104, the process proceeds to step S106. If an affirmative determination is made, the process proceeds to step S108.

[0121] In step S106, the CPU 20A of the authentication ECU 20 determines whether a predetermined time has elapsed since the transmission of the authentication request signal in step S102.

[0122] If a negative determination is made in step S106, that is, if the predetermined time has not elapsed, the process returns to step S104. On the other hand, if the predetermined time has elapsed, it is determined that the authentication has failed on the smartphone 14 and the wearable device 16, and the process ends. That is, the control of the vehicle 12 based on the operation signal transmitted to the vehicle 12 is rejected (cancelled) (not performed).

[0123] On the other hand, in step S108, the CPU 20A of the authentication ECU 20 outputs an operation permission signal to the ECU of the actuator corresponding to the operation content. As a result, the actuator is driven and controlled (the operation is executed) by that ECU. For example, if a door unlock operation signal is input, an operation permission signal is input from the authentication ECU 20 to the door lock ECU 22, whereby the actuator is driven and controlled and the door lock is released (unlocked).

[0124] (Processing of the main control unit 50) Next, the processing of the main control unit 50 of the smartphone 14 will be described with reference to FIGS. 7 and 8.

[0125] First, in step S200 of FIG. 7 (hereinafter, "of FIG. 7" is omitted), the CPU 50A of the main control unit 50 determines whether an authentication request signal has been received from the vehicle 12.

[0126] If the determination in step S200 is negative, it waits in step S200 until an authentication request signal is received. On the other hand, if the determination in step S200 is positive, it proceeds to step S202.

[0127] In step S202, the CPU 50A of the main control unit 50 acquires the operation content information transmitted together with the authentication request signal.

[0128] Next, in step S204, the CPU 50A of the main control unit 50 measures the distance L between the smartphone 14 and the vehicle 12. For example, the radio wave transmitted from the communication unit 26 of the vehicle 12 is received by the first communication unit 52 of the smartphone 14, and the distance L between the smartphone 14 and the vehicle 12 is measured (estimated) based on the radio wave intensity.

[0129] Subsequently, in step S206, the CPU 50A of the main control unit 50 determines whether the measured distance L is equal to or greater than a predetermined distance, which is a threshold value, for example, 10 m.

[0130] If an affirmative determination is made in step S206, the process proceeds to step S208; if a negative determination is made, the process proceeds to step S214.

[0131] In step S208, the CPU 50A of the main control unit 50 determines whether the operation content (information) is a security release operation.

[0132] If an affirmative determination is made in step S208, the process proceeds to step S210; if a negative determination is made, the process proceeds to step S214.

[0133] In step S210, the CPU 50A of the main control unit 50 transmits a high-level authentication request signal to the wearable device 16.

[0134] Next, in step S212, the CPU 50A of the main control unit 50 performs a process of causing the display unit 54 to display an event occurrence display process and a user operation guidance display process, that is, a guidance regarding a user operation for preventing the execution of the operation when the vehicle 12 is operated and the operation is by a third party. For example, "There is an access to the vehicle. If it is not your operation, please remove the wearable device." is displayed on the display unit 54.

[0135] On the other hand, in step S214, the CPU 50A of the main control unit 50 transmits a low-level authentication request signal to the wearable device 16.

[0136] When the process of step S212 or step S214 ends, the process proceeds to step S216 in FIG. 8 (hereinafter, "in FIG. 8" is omitted).

[0137] In step S216, the CPU 50A of the main control unit 50 determines whether an authentication result notification has been received from the wearable device 16.

[0138] If an affirmative determination is made in step S216, the process proceeds to step S218; if a negative determination is made, the process waits at step S216.

[0139] In step S218, the CPU 50A of the main control unit 50 determines whether the received authentication result is authentication OK (authentication OK signal) or not (authentication NG (authentication NG signal)).

[0140] If an affirmative determination is made in step S218, the process proceeds to step S220; if a negative determination is made, the process proceeds to step S222.

[0141] In step S220, the CPU 50A of the main control unit 50 transmits an operation permission signal to the vehicle 12 (authentication ECU 20).

[0142] On the other hand, in step S222, the CPU 50A of the main control unit 50 determines whether this authentication result is the authentication result for the high-level authentication request signal or not (the authentication result for the low-level authentication request signal).

[0143] If an affirmative determination is made in step S222, the process proceeds to step S224; if a negative determination is made in step S222, the process ends.

[0144] In step S224, the CPU 50A of the main control unit 50 performs a reattachment caution display process. That is, the display unit 54 displays a caution when the user reattaches the wearable device 16. For example, "If you want to use the wearable device 16 immediately, either disable the authentication of the wearable device 16 (operate the authentication stop button 94) and then attach it, or attach it at a position where the vehicle can be seen." is displayed on the display unit 54.

[0145] (Main control unit 80) Next, the process of the main control unit 80 of the wearable device 16 will be described with reference to FIG. 9.

[0146] First, in step S300 of FIG. 9 (hereinafter, "of FIG. 9" is omitted), the CPU 80A of the main control unit 80 determines whether it has received an authentication request signal from the smartphone 14.

[0147] If an affirmative determination is made in step S300, the process proceeds to step S302. If a negative determination is made, the process waits in step S300.

[0148] In step S302, the CPU 80A of the main control unit 80 determines whether the authentication request signal is at a high level (high-level authentication request signal) or not (low-level authentication request signal).

[0149] If an affirmative determination is made in step S302 (the signal is a high-level authentication request signal), the process proceeds to step S304. If a negative determination is made (the signal is a low-level authentication request signal), the process proceeds to step S308.

[0150] In step S304, the CPU 80A of the main control unit 80 plays the authentication start voice data read from the storage 80D and outputs an authentication start message (starting ear acoustic authentication (biometric authentication)) as an audible sound from the speaker 84. For example, "Now, ear acoustic authentication will start."

[0151] At this time, if another sound, such as music, is being output from the speaker 84 of the wearable device 16, the playback of the other sound is stopped or muted.

[0152] Next, in step S306, the CPU 80A of the main control unit 80 plays the audible sound authentication voice data read from the storage 80D and outputs an audible sound for ear acoustic authentication from the speaker 84 to the ear canal of the user wearing the wearable device 16.

[0153] On the other hand, if a negative determination is made in step S302 (the signal was a low-level authentication request signal), in step S308, the CPU 80A of the main control unit 80 plays the inaudible sound authentication voice data read from the storage 80D and outputs an inaudible sound for ear acoustic authentication from the speaker 84 to the ear canal of the user wearing the wearable device 16.

[0154] Next, in step S310, the CPU 80A of the main control unit 80 acquires the reverberation sound from the ear canal of the user wearing the wearable device 16 by the microphone 86, and extracts a feature amount from this reverberation sound.

[0155] Subsequently, in step S312, the CPU 80A of the main control unit 80 determines whether the user wearing the wearable device 16 is a legitimate user. That is, the CPU 80A of the main control unit 80 reads out the feature amounts of legitimate users pre-stored in the wearable device 16 from the storage 80D, and by comparing them with the feature amounts extracted from the reverberation sound, determines whether the user wearing the wearable device 16 is a legitimate user (performs biometric authentication).

[0156] If an affirmative determination is made in step S312, the process proceeds to step S313, and if a negative determination is made, the process proceeds to step S318.

[0157] In step S313, the CPU 80A of the main control unit 80 determines whether the result of this biometric authentication is the result of biometric authentication for a high-level authentication request signal (the result of biometric authentication for a low-level authentication request signal).

[0158] If an affirmative determination is made in step S313, the process proceeds to step S314, and if a negative determination is made, the process proceeds to step S316.

[0159] In step S314, the CPU 80A of the main control unit 80 determines whether the wearable device 16 has been removed from the user while an audible-range sound for biometric authentication is being output from the speaker 84. Specifically, the CPU 80A of the main control unit 80 determines whether the user has removed the wearable device 16 based on the detection signal of the wearing sensor 88.

[0160] If a negative determination is made in step S314, the process proceeds to step S316, and if an affirmative determination is made, the process proceeds to step S318.

[0161] If a negative determination is made in step S313, or if a negative determination is made in step S314, then in step S316, the CPU 80A of the main control unit 80 transmits an authentication OK signal to the smartphone 14 and ends the process.

[0162] On the other hand, if a negative determination is made in step S312, or if an affirmative determination is made in step S314, then in step S318, the CPU 80A of the main control unit 80 transmits an authentication NG signal to the smartphone 14 and ends the process.

[0163] (Effect)

[0164] In this way, in the information processing system 10, when the vehicle 12 is operated (an operation signal for the vehicle 12 is input), by making an authentication request for the user to the wearable device 16 via the smartphone 14 of the (legitimate) user of the vehicle 12 from the vehicle 12, biometric authentication can be accurately performed by ear acoustic authentication of the wearable device 16.

[0165] That is, when the user is not wearing the wearable device 16 or when a third party is wearing the wearable device 16, it is possible to surely prevent a third party other than the user from operating the vehicle 12.

[0166] Also, when the smartphone 14 (owned by the user) is separated from the vehicle 12 by a predetermined distance (threshold) or more and the operation on the vehicle 12 is a security release operation, by performing ear acoustic authentication by the wearable device 16 with audible sound (audible sound) in the audible range, it is possible to make the user recognize that there has been an operation on the vehicle 12. As a result, it is possible to make the user who is separated from the vehicle 12 confirm that his or her own operation has been performed on the vehicle 12. Alternatively, if this operation is not his or her own operation (it is a third party's operation), the user can take measures to prevent the vehicle 12 from being stolen or can go to check the vehicle 12.

[0167] In particular, by displaying the occurrence event (the vehicle 12 has been operated) on the display unit 54 of the smartphone 14 owned by the user of the vehicle 12 at the start of the ear acoustic authentication, the user can be surely made to recognize it.

[0168] Also, when the operation on the vehicle 12 is not by the user, since the user operation guidance is displayed on the display unit 54 of the smartphone 14, the user can simply follow this operation guidance to make the authentication of the wearable device 16 NG and make the operation of the vehicle 12 by a third party impossible (prevent the operation from being executed).

[0169] For example, even when a door unlock operation signal is input to the vehicle 12 by a relay attack of a third party when the user is listening to music with the wearable device 16 indoors at home (when the ear acoustic (biological) authentication is OK), if the user removes the wearable device 16 while the audible range sound for ear acoustic authentication can be heard, it is possible to surely prevent the door unlock operation of the vehicle ¹² from being carried out just by that.

[0170] Furthermore, when the smartphone 14 (the user who owns it) is located within a range less than a predetermined distance L from the vehicle 12, or when the operation on the vehicle ¹² is not a security release operation, by performing the ear acoustic authentication by the wearable device 16 with non-audible range sounds (inaudible sounds), it is possible to suppress the user wearing the wearable device 16 from feeling bothered by hearing the authentication sound every time there is an ear acoustic authentication.

[0171] That is, when the user of the vehicle 12 is located in the vicinity of the vehicle 12, the possibility that the operation is the user's operation is high. Even if it is an operation by a third party, the user located in the vicinity of the vehicle 12 can check (visually recognize) the state of the vehicle 12, and it is considered that theft of the vehicle 12 etc. can be prevented.

[0172] Further, when the operation is not a security release operation, even if the authentication by the wearable device 16 is successful and an operation of the vehicle 12 is performed by a third party, it is considered that theft of the vehicle 12 or entry into the vehicle interior can be prevented.

[0173] As described above, in the information processing system 10, only when there are some operations with a high risk of theft of the vehicle 12 or the like, biometric authentication is performed using sound in the audible range, so that the user recognizes the operation on the vehicle 12. On the other hand, in other cases, biometric authentication is performed using sound in the inaudible range, thereby preventing the user from feeling bothered by hearing the biometric authentication sound every time biometric authentication is performed. That is, when performing biometric authentication by sound, the convenience of the user can be improved.

[0174] Furthermore, in this information processing system 1, ear acoustic authentication using sound in the audible range is executed by the wearable device 16. When the wearable device 16 is removed at that time (the operation on the vehicle 12 is an operation by someone other than the user), a reinstallation notice is displayed on the display unit 54 of the smartphone 14.

[0175] That is, after the user takes a measure to stop the ear acoustic authentication of the wearable device 16 (press the authentication stop button 94), or after the user wearing the wearable device 16 moves to a position where the vehicle 12 can be seen, a message prompting the user to wear the wearable device 16 is displayed on the display unit 54 of the smartphone 14.

[0176] When the user who sees this display presses the authentication stop button 94 to stop the ear acoustic authentication, even if a third party continuously performs a security release operation on the vehicle 12, ear acoustic authentication using sound in the audible range (interruption of music being listened to, etc.) is repeated by the wearable device 16 that the user has reinstalled, preventing the user from feeling bothered. When the authentication stop button 94 is pressed, the wearable device 16 automatically returns an authentication NG signal every time an authentication request is made, so that no operation on the vehicle 12 is performed.

[0177] On the other hand, when the ear sound authentication by the wearable device 16 is stopped, there is a high possibility that a third party's operation to unlock the vehicle 12 again cannot be recognized. Therefore, after the user moves to a position where the vehicle 12 can be visually recognized, it is recommended to wear the wearable device 16 (such as wearing it and enjoying music) to confirm the state of the vehicle 12 (that there is no suspicious person (third party) near the vehicle 12).

[0178] In the description of this information processing system 10, the vehicle 12 and the smartphone 14 were made capable of transmitting and receiving via BLUETOOTH (registered trademark), which is short-range wireless communication. However, as in the third embodiment described later, if they are made capable of transmitting and receiving via a network, biometric authentication is possible even when the smartphone 14 (the user who owns it) is located at a long distance from the vehicle 12.

[0179] Also, in this embodiment, when an authentication NG signal is received from the wearable device 16, no signal is transmitted from the smartphone 14 to the vehicle 12 (only an operation permission signal is transmitted (FIG. 8, step S220)), but an operation prohibition signal may be transmitted to the vehicle 12 so as not to actively execute an operation on the vehicle 12.

[0180] [Second Embodiment]

[0181] The information processing system 200 according to the second embodiment will be described. Components having the same functions as those of the information processing system 10 according to the first embodiment are denoted by the same reference numerals, and detailed descriptions thereof are omitted. Note that components having functions slightly different from those of the information processing system 10 according to the first embodiment are denoted by reference numerals obtained by adding 200 to the same reference numerals (numbers) as those in the first embodiment.

[0182] As shown in FIG. 10, the information processing system 200 includes a vehicle 12 and a wearable device 216. Here, the vehicle 12 corresponds to the "other device", and the wearable device 216 corresponds to the "information processing device".

[0183] That is, the wearable device 216 undertakes all the functions that the smartphone 14 and the wearable device 16 undertook in the first embodiment.

[0184] As shown in FIG. 10, the communication unit 26 of the vehicle 12 and the communication unit 82 of the wearable device 216 are capable of communicating via BLUETOOTH (registered trademark).

[0185] Next, the hardware configuration of the main control unit 280 will be described. Since the hardware configuration of the main control unit 280 is the same as that of the main control unit 80 in the first embodiment, reference numerals of the CPU 280A to the bus 280F are given in FIG. 2, and detailed description thereof will be omitted.

[0186] The functional configuration of the main control unit 280 of the wearable device 216 will be described with reference to FIG. 11.

[0187] The main control unit 280 includes an acquisition unit 60, a measurement unit 262, a level determination unit 64, an audio playback unit 101, a collation unit 102, a removal detection unit 104, a determination unit 106, and a transmission unit 270.

[0188] In the main control unit 280 of the wearable device 216, the acquisition unit 60 receives an authentication request signal from the vehicle 12 and acquires operation content information for the vehicle 12.

[0189] Also, the measurement unit 262 receives the radio wave output from the vehicle 12 by the communication unit 82 and measures (estimates) the distance L between the vehicle 12 and the wearable device 216 from the radio wave intensity.

[0190] Furthermore, the audio playback unit 101 outputs an audible range sound or an inaudible range sound for ear acoustic authentication based on the determination result (high-level authentication request signal or low-level authentication request signal) in the level determination unit 64.

[0191] Also, the transmission unit 270 is configured to transmit an operation permission signal to the vehicle 12 only when the determination unit 106 determines that authentication is OK.

[0192] As described above, in the information processing system 200, the same operational effects as those of the information processing system 10 are achieved, and since the configuration is such that the vehicle 12 and the wearable device 216 are directly communicated with each other for authentication, the configuration is simplified.

[0193] Note that, in the wearable device 216, the voice playback unit 101 may guide the content of the occurrence event display and the user operation guidance display that were displayed on the display unit 54 of the smartphone 14 in the first embodiment by voice (sound in the audible range).

[0194] [Third Embodiment]

[0195] The information processing system 300 according to the third embodiment will be described. Components having the same functions as those of the information processing system 10 according to the first embodiment are denoted by the same reference numerals, and detailed descriptions thereof are omitted. Note that, although the information processing systems of the first and second embodiments controlled the vehicle 12, this system controls the smart home 302.

[0196] As shown in FIG. 12, the information processing system 300 includes a smart home 302, a smartphone 14, and a wearable device 16. The smart home 302 corresponds to the "other device".

[0197] The smart home 302 includes a locking / unlocking device 304 that locks and unlocks doors and the like of the smart home 302, an air conditioner 306 that conditions the air in the smart home 302, and a control device 308 that centrally controls these devices.

[0198] Note that the control device 308 is, for example, a HEMS (Home Energy Management System).

[0199] Also, the smart home 302 includes a communication unit 312 that can be connected to an external network 310.

[0200] On the other hand, the smartphone 14 also has a first communication unit 314 that can be connected to an external network 310.

[0201] Therefore, in the information processing system 300, the smart home 302 (its communication unit 312) and the smartphone 14 (its first communication unit 314) can communicate with each other via the network 310.

[0202] As a result, even when the user who owns the smartphone 14 is located at a place distant from the smart home 302, the smart home 302 can be operated from the smartphone 14. In addition, when the smart home 302 is operated, biometric authentication of the user of the smart home 302 who owns the smartphone 14 can be performed by the wearable device 16.

[0203] Also, unlike the vehicle 12, since the position of the smart home 302 is fixed, the distance L between the smart home 302 and the smartphone 14 can be measured (calculated) by obtaining the position information of the smartphone 14 from GPS and calculating the distance between the position information of the smartphone 14 and the position information of the smart home 302.

[0204] In this way, even when the user is at a place distant from the smart home 302, biometric authentication can be performed by the wearable device 16, so that unauthorized operation of the smart home 302 by a third party can be prevented. In addition, when the operation on the smart home 302 is not a security release operation, or when the distance between the smart home 302 and the smartphone 14 (the user who owns it) is less than a predetermined distance, ear acoustic authentication is performed with inaudible sound, preventing the user from feeling bothered. That is, the convenience of the user is improved when biometric authentication is performed by sound.

[0205] Note that, also in this embodiment, similar to the second embodiment, it can be composed of only the smart home 302 and the wearable device 16.

[0206] In addition, the security release operation in the smart home 302 is an operation that may compromise the security of the smart home 302. For example, it is an operation that may allow entry into the smart home 302. Specifically, it is an unlocking operation for doors, windows, etc. On the other hand, operations that do not correspond to the security release operation in the smart home 302 include lighting operations, etc.

[0207] (Others) Note that in the first to third embodiments, audible-range sound is used to perform ear-acoustic authentication (biometric authentication) only when the distance between the smartphone 14 or the wearable device 16 and the vehicle 12 or the smart home 302 is equal to or greater than a predetermined distance, and the operation on the vehicle 12 or the smart home 302 is a security release operation, but it is not limited thereto.

[0208] For example, when the distance between the smartphone 14 or the wearable device 16 and the vehicle 12 or the smart home 302 is equal to or greater than a predetermined distance, ear-acoustic authentication (biometric authentication) may be performed using audible-range sound regardless of the operation content.

[0209] Alternatively, when the operation on the vehicle 12 or the smart home 302 is a security release operation, ear-acoustic authentication (biometric authentication) may be performed using audible-range sound regardless of the distance between the smartphone 14 or the wearable device 16 and the vehicle 12 or the smart home 302.

[0210] Or, when an operation signal is input from an operation terminal to the vehicle 12 or the smart home 302, if the ID of the operation terminal does not match the ID of the operation terminal of a regular user, ear-acoustic authentication (biometric authentication) may be performed using audible-range sound, and if they match, ear-acoustic authentication (biometric authentication) may be performed using inaudible-range sound.

[0211] In this case, a configuration may be considered in which an ID acquisition unit that acquires the ID of the operation terminal is provided in the vehicle 12 (the authentication ECU 20 thereof) or the smart home 302 (the control device 308 thereof), and an ID determination unit is provided in the smartphone 14 (the main control unit 50 thereof) or the wearable device 16 (the main control unit 80 thereof).

[0212] In the above embodiment, in the smartphone 14, when it is determined to be a high level, in the wearable device 16, acoustic authentication (biometric authentication) is always performed with a sound in the audible range, but this is not the case. For example, once acoustic authentication (biometric authentication) has been performed with a sound in the audible range and the authentication has been successful, the wearable device 16 can perform acoustic authentication (biometric authentication) with a sound in the inaudible range until it is removed from the user's ear or the power is turned off. When acoustic authentication (biometric authentication) is performed with a sound in the audible range, the music playback stops or is muted each time authentication is performed, and an authentication start message is played. However, by performing acoustic authentication (biometric authentication) with a sound in the inaudible range once the authentication has been successful, it is possible to reduce the annoyance felt by the user each time authentication is performed, such as the music being interrupted, the authentication start message being played, or the audible authentication voice data being played.

[0213] Note that the classification between the case of performing biometric authentication with a sound in the audible range and the case of performing biometric authentication with a sound in the inaudible range is arbitrary and may be settable by the user.

[0214] Furthermore, in the first to third embodiments, when the user operates (removes the wearable device 16) during biometric authentication with a sound in the audible range, a configuration is adopted in which an unauthorized operation on the vehicle 12 is not allowed as an authentication failure, but the user's operation is not limited to this.

[0215] For example, an emergency stop button 96 (refer to FIG. 1, FIG. 10, FIG. 12, and the dashed-dotted line part) is provided on the wearable device 16. When the user presses the emergency stop button 96, an emergency stop signal is transmitted from the wearable device 16 to the vehicle 12 or the smart home 302 via the smartphone 14, or directly from the wearable device 16, and all operations in the vehicle 12 or the smart home 302 are stopped.

[0216] Alternatively, a similar emergency stop button may be displayed on the display unit 54 of the smartphone 14. When the user touches the emergency stop button, an emergency stop signal is transmitted from the smartphone 14 to the vehicle 12, and all operations in the vehicle 12 are stopped.

[0217] In addition, in the first to third embodiments, the distance between the vehicle 12 or the smart home 302 and the smartphone 14 or the wearable device 16 is measured from the radio wave intensity or the position information based on GPS. However, the method for measuring the distance is not limited to these.

[0218] Furthermore, in the first embodiment, the first communication unit 52 of the smartphone 14 is used for communication with the vehicle 12 (communication unit 26 thereof), and the second communication unit 53 is used for communication with the wearable device 16 (communication unit 82 thereof). However, it is also possible to make both communicable by dividing channels with a single communication unit.

[0219] In addition, in the first to third embodiments, short-range wireless communication is performed using BLUETOOTH (registered trademark), but other short-range wireless communications such as Wi-Fi (registered trademark) may also be used.

[0220] Furthermore, although the vehicle 12 and the smart home 302 have been described as other devices to be controlled, the control target is not particularly limited. For example, devices such as a payment terminal connected to the smartphone 14 and an electronic lock may be used as other devices.

[0221] Although the information processing system 10 according to the embodiment has been described above, it goes without saying that it can be implemented in various modes without departing from the gist of the present invention.

[0222] In addition, in the above embodiment, the processing implemented by the CPU by reading software (program) may be implemented by various processors other than the CPU. Examples of the processor in this case include a PLD (Programmable Logic Device) whose circuit configuration can be changed after manufacture, such as an FPGA (Field-Programmable Gate Array), and a dedicated electric circuit such as an ASIC (Application Specific Integrated Circuit) having a circuit configuration designed specifically to perform a specific process. Further, the processing may be implemented by one of these various processors, or may be implemented by a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs, and a combination of a CPU and an FPGA, etc.). More specifically, the hardware structure of these various processors is an electric circuit combining circuit elements such as semiconductor elements.

[0223] Furthermore, in the above embodiment, the configuration is such that various data are stored in the storage, but it is not limited thereto. For example, a recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), and a USB (Universal Serial Bus) memory may be used as the storage unit. In this case, various programs and data and the like are stored in these recording media.

Description of Reference Numerals

[0224] 12 Vehicle (Other Device) 14 Smartphone (Information Processing Device) 16 Wearable Device (Authentication Device) 60 Acquisition Unit 62 Measurement Unit 64 Determination Unit (Authentication Control Unit) 66 Request Unit (Authentication Control Unit) 70 Transmission unit (other device control unit) 88 Mounting sensor 101 Audio playback unit (authentication unit only in the second embodiment) 102 Matching unit (authentication unit only in the second embodiment) 104 Removal detection unit (operation reception unit) 216 Wearable device (information processing device) 262 Measurement unit 270 Transmission unit (other device control unit) 302 Smart home (other device)

Claims

1. An information processing apparatus for controlling another device, comprising: a measurement unit that measures the distance between the information processing apparatus and the other device; an authentication control unit that selectively executes either biometric authentication processing of a user of the other device using sound in the audible range or biometric authentication processing of the user using sound in the inaudible range based on the measured distance; an other device control unit that controls the other device based on the result of the biometric authentication processing; The information processing apparatus comprising the above.

2. The information processing apparatus according to claim 1, wherein the authentication control unit executes biometric authentication processing of the user using sound in the audible range when the distance is equal to or greater than a predetermined distance, and executes biometric authentication processing of the user using sound in the inaudible range when the distance is less than the predetermined distance.

3. An information processing apparatus for controlling another device, comprising: an acquisition unit that acquires the content of an operation on the other device; an authentication control unit that selectively executes either biometric authentication processing of a user of the other device using sound in the audible range or biometric authentication processing of the user using sound in the inaudible range based on the acquired operation content; an other device control unit that controls the other device based on the result of the biometric authentication processing; The information processing apparatus comprising the above.

4. The information processing apparatus according to claim 3, wherein the authentication control unit executes biometric authentication processing of the user using sound in the audible range when the operation content is a security release operation of the other device, and executes biometric authentication processing of the user using sound in the inaudible range when the operation content of the other device is not a security release operation of the other device.

5. The information processing apparatus according to any one of claims 1 to 4, wherein the authentication control unit selectively executes either biometric authentication processing of the user using sound in the audible range or biometric authentication processing of the user using sound in the inaudible range on an authentication device different from the information processing apparatus.

6. The authentication device is wearable on the user's ear, selectively outputs sound in the audible range or inaudible range, acquires the reverberation sound of the sound, extracts a feature amount from the reverberation sound, and collates the feature amount with the feature amount of a legitimate user of the other device registered in advance to execute biometric authentication processing of the user. The information processing apparatus according to claim 5.

7. The information processing apparatus further comprises an authentication unit capable of executing biometric authentication processing of the user using sound in the audible range and biometric authentication processing of the user using sound in the inaudible range. The authentication control unit selectively executes either the biometric authentication process of the user using sound in the audible range or the biometric authentication process of the user using sound in the inaudible range in the authentication unit. The information processing apparatus according to any one of claims 1 to 4.

8. The information processing apparatus is wearable on the user's ear, The authentication unit selectively outputs sound in the audible range or the inaudible range, acquires the reverberation sound of the sound, extracts a feature amount from the reverberation sound, and collates the feature amount with the feature amount of the legitimate user of the other apparatus registered in advance, thereby executing the biometric authentication process of the user. The information processing apparatus according to claim 7.

9. The information processing apparatus further includes an operation reception unit that receives an operation of the user when the biometric authentication process of the user using the sound in the audible range is performed, The other apparatus control unit controls the other apparatus based on the operation of the user received by the operation reception unit together with the result of the biometric authentication process. The information processing apparatus according to any one of claims 1 to 8.

10. A computer measures the distance between the information processing apparatus and another apparatus, Based on the measured distance, selectively executes either the biometric authentication process of the user of the other apparatus using sound in the audible range or the biometric authentication process of the user using sound in the inaudible range, Controls the other apparatus based on the result of the biometric authentication process, An information processing method for executing a process.

11. A computer acquires the operation content for another apparatus, Based on the acquired operation content, selectively executes either the biometric authentication process of the user of the other apparatus using sound in the audible range or the biometric authentication process of the user using sound in the inaudible range, Controls the other apparatus based on the result of the biometric authentication process, An information processing method for executing a process.

12. A computer measures the distance between the information processing apparatus and another apparatus, Based on the measured distance, selectively executes either the biometric authentication process of the user of the other apparatus using sound in the audible range or the biometric authentication process of the user using sound in the inaudible range, Controls the other apparatus based on the result of the biometric authentication process, A program for causing a process to be executed.

13. A computer acquires the operation content for another apparatus, Based on the acquired operation content, selectively executes either the biometric authentication process of the user of the other apparatus using sound in the audible range or the biometric authentication process of the user using sound in the inaudible range, A program for causing execution of a process of controlling the other device based on the result of the biometric authentication process. ​

Images