Authentication Management Device, Estimation Method, and Program

Abstract

This authentication management device comprises: a first position acquisition means for acquiring first position information indicating a change in position of a user's earphone equipped with a first authentication means based on otoacoustic authentication; an estimation means for, on the basis of the acquired first position information, estimating the motion of the user wearing the earphone by generating motion information indicating the motion of the user; and a second authentication means for executing authentication of the user on an appliance connected to the earphone on the basis of the authentication result by the otoacoustic authentication and the motion information.　

Description

Technical Field

[0001] This disclosure relates to an authentication management device, an estimation method, and Program the like.

Background Art

[0002] In Patent Document 1, an invention is described in which the reproduction of content is controlled based on the prediction result of a user's movement operation. In Patent Document 2, an invention is described in which an earphone includes a gyro sensor and a geomagnetic sensor, and by grasping the orientation of the user's head, content corresponding to the orientation of the user's head is reproduced.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the inventions described in Patent Documents 1 and 2, only content corresponding to the user's operation or body orientation is provided.

[0005] In view of the above circumstances, the purpose of this disclosure is to provide an authentication management device, an estimation method, and Program the like that solve the above problems.

Means for Solving the Problems

[0006] One aspect of this disclosure is a authentication management device including: a first position acquisition means for acquiring first position information indicating a change in the position of a first earphone equipped with a first authentication means for user by ear acoustic authentication; an estimation means for estimating the movement of the user by generating movement information indicating the movement of the user wearing the first earphone based on the acquired first position information; and a second authentication means for performing authentication of the user in a device connected to the earphone based on the authentication result by the ear acoustic authentication and the movement information.

Brief Description of Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Embodiments for Carrying Out the Invention

[0008] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims, and not all combinations of the features described in the embodiments are essential for the invention. Two or more of the features described in the embodiments may be arbitrarily combined. Also, the same or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0009] (First Embodiment) FIG. 1 is a diagram showing a configuration example of the estimation system S in the first embodiment. The estimation system S includes an information communication device 1 and earphones 2. The information communication device 1 and the earphones 2 may be referred to as an authentication management device. The user H is wearing the earphones 2 on the ears. The user H is using the information communication device 1. The information communication device 1 is an electronic device having a communication function. The information communication device 1 may be, for example, a smartphone, a tablet computer, a wristwatch-type portable terminal, or a personal computer (PC).

[0010] In FIG. 1, music is being played by the information communication device 1, and user H is listening to the music using the earphone 2. The information communication device 1 and the earphone 2 are connected to each other by wireless communication. Although not shown, the earphone 2 may be connected to the information communication device 1 by wire. The information communication device 1 and the earphone 2 may be configured as an integrated device, and another device may be further included in the estimation system S. Also, in this specification, "sound" such as sound waves and voices includes inaudible sounds whose frequency or sound pressure level is outside the audible range.

[0011] The information communication device 1 is communicably connected to the earphone 2. The information communication device 1 performs control of the operation of the earphone 2, transmission of voice data for generating sound waves emitted from the earphone 2, reception of voice data obtained from the sound waves received by the earphone 2, etc. Specifically, when user H enjoys music using the earphone 2, the information communication device 1 transmits compressed data of the music to the earphone 2.

[0012] Also, when the earphone 2 is connected to and used with a business-use mobile terminal at an event venue, a hospital, etc., the information communication device 1 may transmit voice data of a business instruction to the earphone 2. In this case, the earphone 2 may transmit voice data of user H's speech to the information communication device 1. The information communication device 1 or the earphone 2 may have a function of ear-acoustic authentication using the sound waves received by the earphone 2. In this specification, "sound" such as sound waves and voices includes inaudible sounds whose frequency or sound pressure level is outside the audible range of humans.

[0013] FIG. 2 is a block diagram showing the hardware configuration of the information communication device 1 in the first embodiment. The information communication device 1 includes a central processing unit (CPU) 101, a random access memory (RAM) 102, a read only memory (ROM) 103, and a hard disc drive (HDD) 104.

[0014] In addition, the information communication device 1 includes a communication interface (IF) 105, an input device 106, and an output device 107. The CPU 101, RAM 102, ROM 103, HDD 104, communication IF 105, input device 106, and output device 107 are interconnected via buses, wirings, driving devices, etc. not shown in FIG. 2.

[0015] The CPU 101 performs predetermined calculations according to programs stored in the ROM 103, HDD 104, etc. The CPU 101 is a processing device having a function of controlling each part of the information communication device 1. The RAM 102 is composed of a volatile storage medium. The RAM 102 provides a temporary memory area. The temporary memory area is necessary for the operation of the CPU 101.

[0016] The ROM 103 is composed of a non-volatile storage medium. The ROM 103 stores necessary information such as programs used for the operation of the information communication device 1. The HDD 104 is a storage device composed of a non-volatile storage medium, which performs temporary storage of data transmitted and received with the earphone 2, storage of operation programs of the information communication device 1, etc. The HDD 104 may be a Solid state drive (SSD) instead of an HDD. When the information communication device 1 is a smartphone or a wristwatch-type portable terminal, the information communication device 1 may not include the HDD 104.

[0017] The communication IF 105 is a communication interface that enables transmission and reception of data, control information, etc. with other devices. The communication IF 105 is based on standards such as Bluetooth (registered trademark), Wi-Fi (registered trademark), etc.

[0018] The input device 106 is a device used for the user H to operate the information communication device 1. The input device 106 may be, for example, a touch screen panel, or a keyboard, mouse, trackball, pen-type input device.

[0019] The output device 107 is a display device used for displaying information, such as a graphical user interface (GUI) for operation input. The output device 107 is a liquid crystal display, an organic electro-luminescence (EL) display, or the like. The input device 106 and the output device 107 may be integrally formed as a touch panel.

[0020] Note that the hardware configuration shown in FIG. 2 is an example. Devices other than those shown in FIG. 2 may be added, or some devices may not be provided. Also, among the devices shown in FIG. 2, some devices may be replaced by other devices having the same function. Furthermore, some functions of this embodiment may be provided by other devices via a network. The functions of this embodiment may be realized by being distributed among a plurality of devices. The hardware configuration shown in FIG. 2 can be changed as appropriate.

[0021] FIG. 3 is a block diagram showing the hardware configuration of the earphone 2 in the first embodiment. The earphone 2 includes an earphone control device 20, a speaker 23, a microphone 24, and a motion sensor 25.

[0022] The earphone 2 is an acoustic device that can be worn on the ear of user H, and is typically a wireless communication-enabled device such as a wireless earphone or a wireless headset. The speaker 23 functions as a sound wave generation unit that emits sound waves toward the external auditory canal of user H when worn, and is arranged on the wearing surface side of the earphone 2. The microphone 24 is arranged on the wearing surface side of the earphone 2 so as to be able to receive sound waves reverberated in the external auditory canal or the like of user H when worn.

[0023] The motion sensor 25 is a sensor element that detects changes in the position of the earphone 2. The motion sensor 25 may be a 9-axis sensor. A 9-axis sensor is a sensor having the functions of a 3-axis acceleration sensor, a 3-axis angular velocity sensor, and a 3-axis orientation sensor. The 3 axes are the X-axis, Y-axis, and Z-axis in a three-dimensional coordinate system. The motion sensor 25 is built into the earphone 2. The earphone control device 20 controls the speaker 23, the microphone 24, and the motion sensor 25, and communicates with the information communication device 1.

[0024] FIG. 4 is a block diagram showing the hardware configuration of the earphone control device 20 in the first embodiment. The earphone control device 20 includes a CPU 201, a RAM 202, a ROM 203, a flash memory 204, a speaker IF 205, a microphone IF 206, a communication IF 207, a battery 208, and a motion sensor IF 209. Note that each part of the earphone control device 20 is connected to each other via a bus, wiring, a driving device, etc. (not shown).

[0025] The CPU 201 is an arithmetic device that performs a predetermined calculation according to a program stored in the ROM 203, the flash memory 204, etc. The CPU 201 controls each part of the earphone control device 20. The RAM 202 is composed of a volatile storage medium. The RAM 202 provides a temporary memory area necessary for the operation of the CPU 201. The ROM 203 is composed of a non-volatile storage medium. The ROM 203 stores necessary information such as a program used for the operation of the earphone control device 20. The flash memory 204 is a storage device composed of a non-volatile storage medium. The flash memory 204 performs temporary storage of data, storage of an operation program for the earphone control device 20, etc.

[0026] The speaker IF 205 is an interface for driving the speaker 23. The speaker IF 205 includes a digital-to-analog conversion circuit, an amplifier, etc. The speaker IF 205 converts audio data into an analog signal and supplies it to the speaker 23. Thereby, the speaker 23 emits a sound wave based on the audio data.

[0027] The microphone IF 206 is an interface for acquiring signals from the microphone 24. The microphone IF 206 includes an analog-to-digital conversion circuit, an amplifier, and the like. The microphone IF 206 converts the analog signal generated by the sound wave received by the microphone 24 into a digital signal. Thereby, the earphone control device 20 acquires voice data based on the received sound wave.

[0028] The communication IF 207 is a communication interface that enables transmission and reception of data, control information, etc. with other devices. The communication IF 207 is based on standards such as Bluetooth (registered trademark), Wi-Fi (registered trademark), etc. When the two earphones 2 are used on both ears of the user H as a pair, the two paired earphones 2 may be able to communicate with each other using the communication IF 207.

[0029] The battery 208 supplies the electric power necessary for the operation of the earphone 2. The battery 208 is, for example, a secondary battery. Since the battery 208 is built into the earphone 2, the earphone 2 can operate wirelessly without being wired to an external power source. The motion sensor IF 209 is an interface for acquiring signals from the motion sensor 25. The motion sensor IF 209 includes an analog-to-digital conversion circuit, an amplifier, and the like.

[0030] Note that the hardware configuration shown in FIG. 4 is an example, and other devices may be added, or some of the hardware shown in FIG. 4 may not be provided. Also, some devices may be replaced with other devices having similar functions. For example, the earphone 2 may further include an input device such as a button, and such an input device may be able to receive operations by the user H. The earphone 2 may further include a display device such as a display and an indicator light for providing information to the user H. Thus, the hardware configuration shown in FIG. 2 can be changed as appropriate.

[0031] FIG. 5 is a functional block diagram of the information communication device 1 in the first embodiment. The information communication device 1 includes an authentication unit 111, an estimation unit 112, and a communication unit 113. The CPU 101 realizes the functions of the authentication unit 111 and the estimation unit 112 by loading and executing the programs stored in the ROM 103, HDD 104, etc. into the RAM 102. The estimation unit 112 may generate information to be estimated based on the information acquired by the communication unit 113 from the earphone 2 through the communication IF 105.

[0032] The communication IF 105 acquires information indicating a change in the position of the earphone 2 from the earphone 2 for the estimation unit 112. The communication IF 105 may acquire the authentication result by the authentication unit 221 of the earphone 2 from the earphone 2. Thereby, the communication IF 105 realizes the function of the communication unit 113.

[0033] Specific processes performed in the authentication unit 111, the estimation unit 112, and the communication unit 113 will be described later. These functions in the information communication device 1 may be realized by the earphone control device 20, or may be realized by the cooperation of the information communication device 1 and the earphone control device 20.

[0034] FIG. 6 is a functional block diagram of the earphone control device 20 in the first embodiment. The earphone control device 20 includes an authentication unit 221, an acquisition unit 222, and a communication unit 223. The CPU 201 loads and executes the programs stored in the ROM 203, flash memory 204, etc. into the RAM 202. Thereby, the CPU 201 realizes the functions of the authentication unit 221 and the acquisition unit 222. The communication IF 207 realizes the processes performed by the communication unit 223.

[0035] The communication IF 207 outputs the authentication result of the user H by the authentication unit 221 and / or information indicating a change in the position of the earphone 2 to the information communication device 1. Note that the information indicating a change in the position of the earphone 2 is acquired by the acquisition unit 222.

[0036] The authentication unit 221 performs authentication of user H (authentication by ear acoustic authentication). The acquisition unit 222 acquires information indicating a change in the position of the earphone 2 by controlling the motion sensor 25 with the motion sensor IF 209. Specific processing performed in the authentication unit 221, the acquisition unit 222, and the communication unit 223 will be described later. These functions in the earphone 2 may be realized by the information communication device 1, or may be realized by the cooperation of the information communication device 1 and the earphone control device 20.

[0037] Figure 7 is a flowchart showing the processing flow of the estimation system S in the first embodiment. First, it is assumed that the earphone 2 is pre-registered in the information communication device 1. For example, when the earphone 2 is connected to the information communication device 1 via Bluetooth (registered trademark), it is assumed that the earphone 2 is paired with the information communication device 1. Also, it is assumed that the information communication device 1 is activated but the screen is locked.

[0038] In step S101, the authentication unit 221 uses at least one of the CPU 201 and the RAM 202, ROM 203, flash memory 204, speaker IF 205, speaker 23, microphone IF 206, microphone 24, etc. to execute authentication of user H. In other words, the authentication unit 221 determines whether user H is a registered user by ear acoustic authentication.

[0039] Ear acoustic authentication is biometric authentication that collates the acoustic characteristics of the external auditory canal of user H. By emitting inspection sound waves into the external auditory canal of user H with the speaker 23 and receiving the sound waves reverberated in the external auditory canal etc. of user H with the microphone 24, the earphone 2 can acquire the acoustic characteristics of the external auditory canal of user H.

[0040] The authentication unit 221 can determine whether the user H is the registered user by comparing the feature amount extracted from the acquired acoustic characteristics of the external auditory canal with the feature amount extracted from the acoustic characteristics of the external auditory canal of the registered user. The registered user is a person whose acoustic characteristics or feature amounts of the external auditory canal are registered as a legitimate user of the earphone 2. By performing this authentication, the functions of the earphone 2 can be restricted for unauthorized persons, and the unauthorized use of the earphone 2 by unauthorized persons can be prevented.

[0041] In the present embodiment, the acoustic characteristics of the external auditory canal of the registered user are assumed to be stored in advance in the ROM 203 or the like, but the acoustic characteristics of the external auditory canal of the registered user may be acquired from another device such as the information communication device 1 at the time of authentication.

[0042] The acoustic characteristics acquired in the otoacoustic emission authentication are typically acoustic characteristics caused by resonance in the external auditory canal. The acoustic characteristics acquired in the otoacoustic emission authentication may also include features of acoustic characteristics caused by reverberation in tissues around the external auditory canal such as the skull. The test sound wave does not have to be emitted directly toward the external auditory canal. The test sound wave may be emitted to a part of the user H's head by a bone conduction speaker. The communication unit 223 outputs the authentication result by the otoacoustic emission authentication to the information communication device 1. The communication unit 113 acquires the authentication result using the communication IF 105. The authentication result by the otoacoustic emission authentication indicates whether the authentication of the user H by the otoacoustic emission authentication has succeeded or failed. After performing the otoacoustic emission authentication, the authentication unit 221 proceeds to step S102.

[0043] In step S102, the acquisition unit 222 uses at least one of the CPU 201, the RAM 202, the ROM 203, the flash memory 204, the motion sensor IF 209, and the motion sensor 25 to acquire information indicating a change in the position of the earphone 2 (earphone position information). When the earphone 2 is worn on the ear of the user H or held by the user H, the earphone position information corresponds to information indicating the movement of the user H. The communication unit 223 outputs the earphone position information to the information communication device 1 using the communication IF 207. The communication IF 105 acquires the earphone position information. The communication IF 105 advances the process to step S103.

[0044] In step S103, the estimation unit 112 generates information indicating the movement of the user H (movement information) based on the acquired earphone position information. That is, the estimation unit 112 estimates the operation by the user H who wears or holds the earphone. The estimation unit 112 advances the process to step S104.

[0045] In step S104, when the acquired authentication result indicates that the ear acoustic authentication has succeeded, the estimation unit 112 advances the process to step S105. When the acquired authentication result indicates that the ear acoustic authentication has failed, the estimation unit 112 advances the process to step S101.

[0046] In step S105, the estimation unit 112 estimates whether the generated movement information corresponds to a predetermined operation. When the movement information corresponds to a predetermined operation, the estimation unit 112 advances the process to step S106. When the movement information does not correspond to a predetermined operation, the estimation unit 112 advances the process to step S101. In this case, the communication unit 113 may output information instructing ear acoustic authentication (ear acoustic authentication instruction information) to the earphone 2 using the communication IF 207.

[0047] In step S106, the authentication unit 111 executes authentication of user H in the information communication device 1. The authentication unit 111 may generate information indicating that the authentication of user H has been successful (authentication success information). The authentication unit 111 may output the authentication success information by the output device 107. The authentication unit 111 may output the authentication success information by a predetermined sound or voice, or may display the authentication success information as characters or an image on the screen of the information communication device 1. The authentication unit 111 finishes the process. As a result, the locked screen of the information communication device 1 is released, and user H can use the information communication device 1.

[0048] As described above, the authentication management device according to the first embodiment of this disclosure includes a first position acquisition means (for example, the communication unit 113) that acquires first position information indicating a change in the position of a first earphone (for example, earphone 2) having a first authentication means for user authentication by ear acoustic authentication, and based on the acquired first position information, generates movement information indicating the movement of the user wearing the first earphone, thereby estimating the movement of the user (for example, the estimation unit 112), and a second authentication means (for example, the authentication unit 111) that executes authentication of the user in a device (for example, the information communication device 1) connected to the earphone based on the authentication result by ear acoustic authentication and the movement information.

[0049] Thereby, not only can the movement of the user be estimated, but also based on the authentication result by ear acoustic authentication and the estimated movement of the user, it becomes possible to perform authentication of the user in other devices connected to the earphone.

[0050] Also, the first earphone is used for one ear of the user, and the ear acoustic authentication is an authentication method that sends an inspection sound in the direction of the user's external auditory canal and authenticates the user based on the reflected sound with respect to the inspection sound. Thereby, it becomes possible to easily perform user authentication.

[0051] (Second Embodiment) The estimation system S according to the second embodiment of this disclosure will be described with reference to the drawings.

[0052] FIG. 8 is a block diagram showing the hardware configuration of the earphone 2A in the second embodiment. The earphone 2A further includes a proximity sensor 26 in addition to the earphone 2 in the first embodiment. The proximity sensor 26 is an element that detects the degree of proximity or contact with an object. The proximity sensor 26 may be an infrared sensor. In this case, the proximity sensor 26 is composed of a photodiode or the like. The proximity sensor 26 functions as a wearing detection unit that detects infrared rays emitted from the user H when the earphone 2 is worn. The proximity sensor 26 is disposed on the wearing surface side of the earphone 2.

[0053] FIG. 9 is a block diagram showing the hardware configuration of the earphone control device 20A in the second embodiment. In the present embodiment, the earphone control device 20A further includes a proximity sensor IF210.

[0054] FIG. 10 is a functional block diagram of the information communication device 1A in the second embodiment. The information communication device 1A further includes a storage unit 114 in addition to the information communication device 1 in the first embodiment. The storage unit 114 is realized by at least one of the RAM 102, the ROM 103, and the HDD 104.

[0055] FIG. 11 is a table showing the correspondence between the acquired data of the motion sensor 25 and the motion information in the second embodiment. The storage unit 114 stores the correspondence shown in this table in advance in at least one of the RAM 102, the ROM 103, and the ROM 103.

[0056] In FIG. 11, the wearing states of the right and left earphones are shown, which are determined based on the acquisition data acquired by the proximity sensors 26 of the right earphone 2R and the left earphone 2L, respectively. Also shown are the acquisition data of acceleration, angular velocity, and azimuth acquired by the motion sensors 25 of the right earphone 2R and the left earphone 2L. And a specific motion corresponding to those acquisition data is shown. The specific motion is the motion of the right earphone 2R and the left earphone 2L, but corresponds to the motion of the user H who wears or holds the right earphone 2R and the left earphone 2L.

[0057] For example, in Pattern 1 of FIG. 11, it is determined that the left and right earphones are worn, and the measurement results of the acceleration sensors are both within the range from a to b (m / s 2 ), the measurement results of the angular velocity sensors are both within the range from A to B (deg. / s), and the measurement results of the azimuth sensors are both from K to L for both the left and right. The corresponding operation is the walking of the user H. The other patterns are as shown in FIG. 11. The table in FIG. 11 is an example, and the present embodiment is not limited thereto.

[0058] FIG. 12 is a flowchart showing the processing flow of the estimation system S in the second embodiment. In Figure 12 At the beginning of the shown flowchart, step S1101 is added to the flowchart shown in FIG. 7.

[0059] In step S1101, the acquisition unit 222 measures the intensity of infrared rays using the proximity sensor IF210 and the proximity sensor 26 (infrared sensor). The acquisition unit 222 uses at least one of the CPU 201 and the RAM 202, ROM 203, flash memory 204, etc., and acquires information (earphone wearing state information) indicating whether the user H is wearing the earphone 2 based on the intensity of infrared rays measured by the proximity sensor 26.

[0060] When user H wears the earphone 2, infrared rays emitted from user H enter the proximity sensor 26, so the intensity of the infrared rays received by the proximity sensor 26 increases. Therefore, the acquisition unit 222 can acquire information on whether the earphone is worn or not based on the digital signal indicating the intensity of the infrared rays received by the proximity sensor 26.

[0061] At this time, the determination criterion may be, for example, that it is determined that user H is wearing the earphone 2 when the intensity of the infrared rays is equal to or greater than a threshold value. Alternatively, the determination criterion may be to calculate a wearing score based on the intensity of the infrared rays or a change thereof, and determine that user H is wearing the earphone 2 when the wearing score is equal to or greater than a threshold value. The acquisition unit 222 proceeds with the process to step S1102.

[0062] The process of step S1102 is the same as the process of step S101 in FIG. 7, but in step S1102, the storage unit 114 may store the authentication result.

[0063] Regarding the process of step S1103, in addition to the process of step S102, the communication unit 223 outputs earphone wearing state information to the information communication device 1 using the communication IF207. The communication IF105 acquires the earphone wearing state information. The communication IF105 proceeds with the process to step S1104.

[0064] In step S1104, the estimation unit 112 estimates the operation of the earphone 2 or user H based on the acquired earphone position information and earphone wearing state information and In Figure 11 the described correspondence relationship. The estimation unit proceeds with the process to step S1105.

[0065] The processes from step S1105 to step S1107 are basically the same as the processes from step S104 to step S106 in FIG. 7.

[0066] As described above, the authentication management device according to the second embodiment of this disclosure includes a wearing state acquisition unit (for example, the communication unit 113) that acquires wearing state information indicating the wearing state of the user's ear and the first earphone, and a first position information (for example, earphone position information), wearing state information, and information indicating the movement of the user H (movement information) (for example, the correspondence relationship shown in FIG. 11) is stored in advance in a storage unit (for example, the storage unit 114). The estimation unit generates movement information based on the acquired first position information, the acquired wearing state information, and the correspondence relationship.

[0067] Thereby, not only can the movement of the user be estimated, but also based on the authentication result by ear acoustic authentication and the estimated movement of the user, it is possible to authenticate the user in other devices connected to the earphone. In addition, regarding the correspondence relationship among the earphone position information, the wearing state information, and the movement information, by using a learned model obtained by machine learning using a large amount of teacher data, the estimation accuracy of the movement of the earphone 2 or the user H can be improved.

[0068] Further, the communication unit 113 of the information communication device 1 (for example, a smartphone) may acquire a request (authentication request) for authenticating the user H in another device from the other device. In this case, the communication unit 113 may read the authentication result from the storage unit 114 and output it to the other device. When the authentication result indicates that the authentication of the user H has been successful, the other device may authenticate the user.

[0069] Here, the other device may be, for example, an authentication device installed at the entrance and exit management device of a building or at the gates of the baggage inspection area or the immigration inspection gate of an airport. Note that the authentication request may be directly input to the earphone 2 from the other device without passing through the information communication device 1.

[0070] Thereby, if the user H is authenticated in the information communication device 1, the other device can authenticate the user H without performing further authentication processing, so that the entry and exit management or authentication of the user by the other device can be realized smoothly.

[0071] (Third Embodiment) The estimation system S according to the third embodiment of this disclosure will be described with reference to the drawings.

[0072] FIG. 13 is a diagram showing a configuration example of the estimation system S in the third embodiment. In this embodiment, the user H uses the right earphone 2R and the left earphone 2L. The earphone 2R is used for the right ear of the user H, and the earphone 2L is used for the left ear of the user H.

[0073] FIG. 14 is a functional block diagram of the information communication device 1B, the earphone control device 20R, and the earphone control device 20L in the third embodiment. The configurations of the earphone control device 20R and the earphone control device 20L are the same as those in the first and second embodiments. The information communication device 1B includes an authentication unit 111, an estimation unit 112, a communication unit 113, an output unit 115, and an acquisition unit 116. Details of the operations of the output unit 115 and the acquisition unit 116 will be described later.

[0074] The configurations of the earphone control device 20R and the earphone control device 20L are the same as those in the first and second embodiments. In this embodiment, a component with a suffix of "R" represents a component of the right earphone. A component with a suffix of "L" represents a component of the left earphone 2L. When no suffix of "R" or "L" is attached, it shall represent that it is not limited to the right earphone 2R and the left earphone 2L.

[0075] The earphones 2R and 2L perform two-way communication with each other through the communication unit 223R, the communication unit 223L, and the communication IF 207. The left earphone 2L and the information communication device 1B perform two-way communication with each other using the communication unit 223L and the communication unit 113, respectively. The right earphone 2R and the information communication device 1B may perform two-way communication with each other using the communication unit 223R and the communication unit 113, respectively.

[0076] FIG. 15 is a flowchart showing the processing flow of the estimation system S in the third embodiment.

[0077] In step S2101, the authentication units 221R and 221L execute an authentication process by earprint authentication. The communication unit 223R outputs the authentication result of the right earphone 2R to the left earphone 2L using the communication IF207R. The communication unit 223L acquires the authentication result of the right earphone 2R. The authentication units 221R and 221L proceed with the process to step S2102.

[0078] In step S2102, the authentication unit 221L determines whether the authentication of user H by earprint authentication has been successful in at least one of the right earphone 2R and the left earphone 2L. If the authentication is successful in at least one of the two earphones, the authentication unit 221L proceeds with the process to step S2103. If the authentication fails in both of the two earphones, the authentication unit 221L proceeds with the process to step S2101.

[0079] In step S2103, the communication unit 223L outputs the authentication result of the right earphone 2R and the authentication result of the left earphone 2L to the information communication device 1B using the communication IF207L. The acquisition unit 116 acquires the authentication result of the right earphone 2R and the authentication result of the left earphone 2L from the earphone 2L using at least one of the CPU 101, the RAM 102, the ROM 103, the HDD 104, the communication IF 105, and the input device 106. The acquisition unit 116 proceeds with the process to step S2104.

[0080] In step S2104, the output unit 115 outputs instruction information for user H to the output device 107 using at least one of the CPU 101, the RAM 102, the ROM 103, and the HDD 104. The output device 107 may be the display screen of the information communication device 1B. The display screen of the information communication device 1B may be a touch screen panel. The output unit 115 may output the instruction information by voice.

[0081] The instruction information for user H is information (operation instruction information) that instructs the user to hold the earphone and perform a predetermined operation. The predetermined operation may be, for example, an operation performed by the user who holds the earphone that failed authentication among the two earphones. When the authentication of both of the two earphones is successful, the predetermined operation may be performed by the user while holding either one of the earphones. In the present embodiment, it is assumed that the authentication of both earphones is successful. The operation instruction information is information that instructs user H to perform a predetermined operation using the right earphone 2R. In this way, by inferring the movement of user H in real time and live based on biometric detection, it is possible to prevent the hijacking of the device by a malicious third party and further improve the authentication accuracy. The output unit 115 proceeds with the process to step S2105.

[0082] In step S2105, based on the operation instruction information, user H performs a predetermined operation while holding the right earphone 2R. The acquisition unit 222R acquires information (earphone position information) indicating the change in the position of the right earphone 2R. The communication unit 223R outputs the acquired earphone position information to the left earphone 2L. The communication unit 223L acquires the earphone position information and outputs it to the information communication device 1B. The communication unit 113 acquires the earphone position information. The communication unit 223L and the communication unit 113 proceed with the process to step S2106.

[0083] The process of step S2106 is the same as the process of step S103. The process of step S2106 may be performed based on the correspondence shown in FIG. 11, like the process in step S1104. The estimation unit 112 proceeds with the process to step S2107.

[0084] The processes of step S2107 and step S2108 are the same as the processes of step S105 and step S106.

[0085] As described above, the authentication management device according to the third embodiment of this disclosure includes an output means (for example, the communication unit 113) that outputs operation instruction information for instructing the user to change the position of the second earphone (for example, the right earphone 2R) used for the other ear of the user, and a second position acquisition means (for example, the communication unit 113) that acquires second position information (for example, information indicating the change in the position of the right earphone 2R) indicating the change in the position of the second earphone. Further, the estimation means (for example, the estimation unit 112) estimates the operation by the user H based on the operation instruction information and the second position information, and estimates whether the authentication result by the first authentication means for the user is correct.

[0086] Thereby, not only can the movement of the user be estimated, but also based on the authentication result by ear acoustic authentication and the estimated movement of the user, it becomes possible to authenticate the user on other devices connected to the earphone. Also, in authentication, by estimating the movement of the user H based on the change in the position of the earphone, the authentication of the user on other devices connected to the earphone can be performed more securely.

[0087] Further, the output unit 115 may output the operation instruction information to the display screen as the output device 107. For example, the operation instruction information may be image information (contact instruction information) for instructing to trace a predetermined position or trajectory (pattern) on the display screen with a finger. The acquisition unit 116 may acquire contact state information indicating the contact state of a specific position by the user according to the contact instruction information. The estimation unit 112 may estimate whether the authentication by ear acoustic authentication is correct based on the contact instruction information and the contact state information. When the estimation unit 112 determines that the authentication by ear acoustic authentication is correct, the authentication unit 111 may authenticate the user H. That is, in this case, the authentication unit 111 may determine that the user H is a registered person. The contact state information may include the strength of the contact by the user H, the trajectory of the contact, or the length of the time of contact.

[0088] This makes it possible not only to estimate the user's movement, but also to authenticate the user on other devices connected to the earphone based on the authentication result by ear acoustic authentication and the estimated movement of the user. Furthermore, by estimating the movement of user H based on the change in the position of the earphone, it is possible to securely authenticate the user on other devices connected to the earphone.

[0089] As described above, the embodiments of this disclosure have been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and designs and the like within the scope not departing from the gist of this disclosure are also included.

[0090] In the above embodiment, the earphone 2 is exemplified as an example of the wearable device. However, as long as it is possible to acquire the acoustic information necessary for the processing, it is not limited to what is worn on the ear. For example, the wearable device may be a bone conduction type acoustic device.

[0091] In the determination of the wearing of the earphone 2 by the proximity sensor 26, the proximity sensor 26 may include a light source such as an LED and a photodiode. The proximity sensor 26 may emit light from the light source and detect the reflected wave of the light by the photodiode. The acquisition unit 222 may acquire the presence or absence of the reflected wave of the light or the time until the reflected wave is received.

[0092] Also, in the above embodiment, an infrared sensor is exemplified as a means for determining the wearing of the earphone by the proximity sensor 26. However, it is not limited to this as long as the wearing can be determined. For example, the proximity sensor 26 may emit a sound wave to the external auditory canal of user H, and the acquisition unit 222 may acquire acoustic characteristics of the reverberant sound such as the intensity and reverberation time of the reverberant sound, and perform the wearing determination based on the acoustic characteristics of the reverberant sound. In this case, the speaker 23 and the microphone 24 function not only as devices for ear acoustic authentication but also as devices for wearing determination. Therefore, the device configuration can be simplified.

[0093] In the above-described first embodiment, it is assumed that the feature amount is transmitted from the earphone 2 to the information communication device 1, but data on the acoustic characteristics of the external auditory canal may be transmitted. In this case, the process of extracting the feature amount may be performed by the information communication device 1. In this example, the communication volume increases, but the calculation amount in the earphone 2 can be reduced.

[0094] A program that operates the configuration of the above-described embodiment to realize the functions of the above-described embodiment is recorded on a storage medium, the program recorded on the storage medium is read as code, and a processing method executed by a computer is also included in the scope of each embodiment. That is, a computer-readable storage medium is also included in the scope of each embodiment. In addition, not only the storage medium on which the above-described program is recorded, but also the program itself is included in each embodiment. Further, one or two or more constituent elements included in the above-described embodiment may be circuits such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) configured to realize the functions of each constituent element.

[0095] As the storage medium, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disk)-ROM, a magnetic tape, a non-volatile memory card, or a ROM can be used. In addition, not only the program recorded on the storage medium is used to execute the process, but also those that operate on an OS (Operating System) and execute the process in cooperation with the functions of other software and expansion boards are included in the scope of each embodiment.

[0096] The service realized by the functions of the above-described embodiments can also be provided to users in the form of SaaS (Software as a Service).

[0097] Note that the above-described embodiments are merely examples of implementation in carrying out this disclosure, and the technical scope of this disclosure should not be construed in a limited manner by these. That is, this disclosure can be implemented in various forms without departing from its technical idea or its main features.

[0098] FIG. 16 is a diagram showing the minimum configuration of the authentication management apparatus in this disclosure. The authentication management apparatus according to this embodiment may include an authentication unit 111, an estimation unit 112, and a communication unit 113. The communication unit 113 (acquisition means) acquires first position information indicating a change in the position of an earphone (for example, either the right earphone 2R or the left earphone 2L). Based on the acquired first position information, the estimation unit 112 estimates the movement of the user by generating movement information indicating the movement of the user wearing the first earphone. The authentication unit 111 executes authentication of the user in the apparatus connected to the earphone based on the authentication result by ear acoustic authentication and the movement information.

[0099] FIG. 17 is a flowchart showing the processing flow in the embodiment of the minimum configuration of the estimation system S in this disclosure.

[0100] In step S3101, the communication unit 113 acquires the earphone position information and the authentication result of ear acoustic authentication using the communication IF105. The communication unit 113 advances the process to step S3102.

[0101] In step S3102, the estimation unit 112 generates information (movement information) indicating the movement of the user H based on the acquired earphone position information. That is, the estimation unit 112 estimates the operation by the user H wearing or holding the earphone. The estimation unit 112 advances the process to step S3103.

[0102] In step S3103, when the obtained authentication result indicates that the ear acoustic authentication has succeeded, the estimation unit 112 advances the process to step S3104. When the obtained authentication result indicates that the ear acoustic authentication has failed, the estimation unit 112 advances the process to step S3101.

[0103] In step S3104, the estimation unit 112 estimates whether the generated movement information corresponds to a predetermined movement. When the movement information corresponds to a predetermined movement, the estimation unit 112 advances the process to step S3105. When the movement information does not correspond to a predetermined movement, the estimation unit 112 advances the process to step S3101. In this case, the communication unit 113 may output information for instructing ear acoustic authentication (ear acoustic authentication instruction information) to the earphone 2 using the communication IF207.

[0104] In step S3105, the authentication unit 111 executes authentication of user H in the information communication device 1. The authentication unit 111 may generate information indicating that the authentication of user H has succeeded (authentication success information). The authentication unit 111 may output the authentication success information by the output device 107. The authentication unit 111 may output the authentication success information by a predetermined sound or voice, or may display the authentication success information as characters or an image on the screen of the information communication device 1. The authentication unit 111 ends the process. As a result, the locked screen of the information communication device 1 is released, and user H can use the information communication device 1.

[0105] Some or all of the above-described embodiments may be described as follows in the following supplementary notes, but are not limited thereto.

[0106] (Supplementary Note 1) First position acquisition means for acquiring first position information indicating a change in the position of a first earphone provided with first authentication means for a user by ear acoustic authentication; Estimation means for estimating the movement of the user by generating movement information indicating the movement of the user wearing the first earphone based on the acquired first position information; Second authentication means for performing authentication of the user in the device connected to the first earphone based on the authentication result by the ear sound authentication and the movement information. Authentication management device.

[0107] (Appendix 2) Wearing state acquisition means for acquiring wearing state information indicating the wearing state of the user's ear and the first earphone, Storage means for storing in advance the correspondence relationship among the first position information, the wearing state information, and the movement information, The estimation means generates the movement information based on the acquired first position information, the acquired wearing state information, and the correspondence relationship. The authentication management device according to Appendix 1.

[0108] (Appendix 3) Output means for outputting earphone operation instruction information for instructing the user to change the position of the second earphone used for the other ear of the user, Further comprising second position acquisition means for acquiring second position information indicating the change in the position of the second earphone, In the previous estimation means, based on the earphone operation instruction information and the second position information, it is estimated whether the authentication result by the first authentication means for the user is correct. The authentication management device according to Appendix 1 or 2.

[0109] (Appendix 4) The output means outputs contact instruction information for instructing the user to contact a specific position on the display element, Further comprising third acquisition means for acquiring contact state information indicating the contact state of the specific position by the user in response to the contact instruction information, The previous estimation means estimates whether the authentication result by the first authentication means for the user is correct based on the contact instruction information and the contact state information, The contact state information includes the strength of the contact, the trajectory of the contact, or the time of the contact. The authentication management device according to Appendix 3.

[0110] (Appendix 5) An estimation method used in a computer, a first authentication instruction step for instructing user authentication by ear acoustic authentication, a position information acquisition instruction step for instructing acquisition of position information indicating a change in the position of an earphone provided with means for performing the authentication by ear acoustic authentication, an estimation step of estimating the movement of the user by generating movement information indicating the movement of the user wearing the earphone based on the acquired position information, and a second authentication step of performing authentication of the user in a device connected to the earphone based on the authentication result by ear acoustic authentication and the movement information. Estimation method.

[0111] (Appendix 6) On a computer, an authentication instruction step for instructing user authentication by ear acoustic authentication, a position acquisition instruction step for instructing acquisition of a position signal indicating a change in the position of an earphone provided with means for performing the authentication, an estimation step of estimating the movement of the user by generating movement information indicating the movement of the user wearing the earphone based on the acquired position signal, an output step of outputting control information based on the authentication result by ear acoustic authentication and the movement information, and a second authentication means for performing a second authentication of the user in a device connected to the earphone based on the control information. A program for executing the above is stored in a recording medium.

Explanation of Signs

[0112] 1 Information communication device 2 Earphone 101, 201 CPU 102, 202 RAM 103, 203 ROM 104 HDD 105, 207 Communication IF 106 Input device 107 Output device 23 Speaker 24 Microphone 25 Motion sensor 26 Proximity sensor 204 Flash memory 205 Speaker IF 206 Microphone IF 208 Battery 209 Motion sensor IF 111, 221 Authentication unit 112 Estimation unit 113, 223 Communication unit 114 Memory unit 222 Acquisition unit 115 Output unit 116 Acquisition unit

Claims

1. A first position acquisition means for acquiring first position information indicating a change in the position of a first earphone equipped with a first authentication means for user authentication by ear acoustic authentication; An estimation means for estimating the movement of the user by generating movement information indicating the movement of the user wearing the first earphone based on the acquired first position information; A second authentication means for performing authentication of the user in a device connected to the first earphone based on the authentication result by the ear acoustic authentication and the movement information; An output means for outputting earphone operation instruction information for instructing the user to hold a second earphone used for the other ear of the user and perform a predetermined operation; A second position acquisition means for acquiring second position information indicating a change in the position of the second earphone; In the previous estimation means, means for estimating whether or not the authentication result by the first authentication means for the user is correct based on the earphone operation instruction information and the second position information. An authentication management device.

2. A wearing state acquisition means for acquiring wearing state information indicating a wearing state between the user's ear and the first earphone; A storage means for storing in advance a correspondence relationship among the first position information, the wearing state information, and the movement information; The estimation means generates the movement information based on the acquired first position information, the acquired wearing state information, and the correspondence relationship. The authentication management device according to claim 1.

3. The output means outputs contact instruction information for instructing the user to contact a specific position on a display element, Further comprising a third acquisition means for acquiring contact state information indicating a contact state of the specific position by the user in response to the contact instruction information; The previous estimation means estimates whether or not the authentication result by the first authentication means for the user is correct based on the contact instruction information and the contact state information; The contact state information includes the strength of the contact, the trajectory of the contact, or the time of the contact. The authentication management device according to claim 1.

4. An estimation method used for a computer, A first authentication instruction step for instructing authentication of a user by ear acoustic authentication; A position information acquisition instruction step for instructing acquisition of position information indicating a change in the position of an earphone provided with means for performing the authentication by ear acoustic authentication; An estimating step of estimating the movement of the user by generating movement information indicating the movement of the user wearing the earphone based on the acquired position information; A second authentication step of performing authentication of the user in the device connected to the earphone based on the authentication result by ear acoustic authentication and the movement information; A step of outputting earphone operation instruction information for instructing the user to hold a second earphone used for the other ear of the user and perform a predetermined operation; A step of acquiring second position information indicating a change in the position of the second earphone; In the previous estimating step, based on the earphone operation instruction information and the second position information, a step of estimating whether the authentication result based on the instruction in the first authentication instruction step for the user is correct; and An estimating method.

5. On a computer, A first authentication instruction step of instructing authentication of the user by ear acoustic authentication; A position acquisition instruction step of instructing acquisition of a position signal indicating a change in the position of an earphone provided with means for performing the authentication; An estimating step of estimating the movement of the user by generating movement information indicating the movement of the user wearing the earphone based on the acquired position signal; An output step of outputting control information based on the authentication result by ear acoustic authentication and the movement information; A second authentication step of performing second authentication of the user in the device connected to the earphone based on the control information; A step of outputting earphone operation instruction information for instructing the user to hold a second earphone used for the other ear of the user and perform a predetermined operation; A step of acquiring second position information indicating a change in the position of the second earphone; A program for causing the computer to execute, in the previous estimating step, a step of estimating whether the authentication result based on the instruction in the first authentication instruction step for the user is correct based on the earphone operation instruction information and the second position information.

Images