Information processing system, information processing method, and recording medium

Abstract

An information processing system (10) comprises: a first authentication means (210) that executes a first authentication using echo sounds that echo within the ear of a target; a second authentication means (220) that executes a second authentication different from the first authentication with respect to the target; and a change means (230) that changes the execution mode of the second authentication in accordance with the continuous duration for which the first authentication is determined to be successful. According to such an information processing system, the second authentication can be appropriately executed in accordance with the authentication result from the first authentication.

Description

Information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium.

[0002] There is known a technology for performing authentication processing of a target (so-called ear acoustic authentication) based on characteristics of the ear canal acquired by utilizing sound reverberation. Ear acoustic authentication may be used in combination with other authentication methods. For example, Patent Literature 1 discloses a technology for calculating an integrated authentication result based on an ear authentication score and a voice authentication score.

[0003] International Publication No. 2020 / 045204

[0004] The present disclosure aims to provide an information processing system, an information processing method, and a recording medium that aim to improve upon the techniques disclosed in prior art documents.

[0005] One aspect of the information processing system disclosed herein comprises a first authentication means for performing a first authentication using reverberation sound reverberating in the ear of a subject, a second authentication means for performing a second authentication on the subject that is different from the first authentication, and a change means for changing the mode of execution of the second authentication depending on the duration for which the first authentication is determined to be successful.

[0006] One aspect of the information processing method of this disclosure involves performing, by at least one computer, a first authentication using reverberation sound that reverberates in a subject's ear, performing a second authentication on the subject that is different from the first authentication, and changing the manner in which the second authentication is performed depending on the duration for which the first authentication is determined to be successful.

[0007] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which performs a first authentication using reverberation sound that reverberates in a subject's ear, performs a second authentication on the subject that is different from the first authentication, and changes the execution mode of the second authentication depending on the duration for which the first authentication is determined to be successful.

[0008] 1 is a block diagram showing the hardware configuration of a first information processing system. 2 is a block diagram showing the terminal configuration of the first information processing system. 3 is a flowchart showing the flow of a first authentication operation in the first information processing system. 4 is a flowchart showing the flow of a second authentication operation in the first information processing system. 5 is a flowchart showing the flow of a second authentication operation in the second information processing system. 6 is a graph showing an example of changing the authentication threshold in the second information processing system. 7 is a flowchart showing the flow of a second authentication operation in the third information processing system. 8 is a time chart showing an example of changing the modal number in the third information processing system. 9 is a block diagram showing the terminal configuration of a fourth information processing system. 10 is a flowchart showing the flow of a first authentication operation in the fourth information processing system. 11 is a block diagram showing the terminal configuration of a fifth information processing system. 12 is a block diagram showing the terminal configuration of a sixth information processing system. 13 is a flowchart showing the flow of a second authentication operation in the sixth information processing system. 14 is a block diagram showing the terminal configuration of a seventh information processing system. 15 is a flowchart showing the flow of a terminal determination operation in the seventh information processing system. 16 is a flowchart showing the flow of a terminal determination operation in the seventh information processing system. 17 is a flowchart showing the flow of a terminal determination operation in the seventh information processing system. 18 is a flowchart showing the flow of a terminal determination operation in the seventh information processing system. 19 ...

[0009] Hereinafter, embodiments of an information processing system, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment A first information processing system will be described with reference to FIGS. 1 to 4. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the first information processing system will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the first information processing system.

[0012] 1, a first information processing system 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected to each other via a data bus 17. The data bus 17 may be an interface other than a data bus (for example, a LAN, a USB, etc.).

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks for executing processing related to ear acoustic authentication are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing system 10.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device may store computer programs executed by the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as part of a smartphone, a tablet terminal, an earphone terminal, a watch terminal, or the like. The input device 15 may be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as part of a smartphone, a tablet terminal, an earphone-type terminal, a watch-type terminal, or the like.

[0020] The first information processing system 10 is configured to include a first terminal and a second terminal, as described below. Each of the components described in Fig. 1 may be configured to be included in at least one of the first terminal and the third terminal included in the first information processing system 10. Furthermore, some of the components described in Fig. 1 may be configured to be included in an external device (e.g., an external server, a cloud, etc.) different from the first terminal and the second terminal.

[0021] (Terminal Configuration) Next, the terminal configuration of the first information processing system 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the terminal configuration of the first information processing system.

[0022] 2, the first information processing system 10 is configured to include a first terminal 100 and a second terminal 200. The first terminal 100 and the second terminal 300 are connected, for example, by wireless communication, and are configured to be able to transmit and receive information to and from each other. In addition to the first terminal 100 and the second terminal 200, the first information processing system 10 may be configured to include other terminals (for example, a third terminal, a fourth terminal, etc.).

[0023] The first terminal 100 is configured as an earphone-type hearable terminal. The first terminal 100 may be configured as a terminal worn on one ear. Alternatively, the first terminal 100 may be configured as a terminal worn on both ears. That is, the first terminal 100 may be configured to include a right-ear terminal and a left-ear terminal. The first terminal 100 is configured to be able to acquire echo information indicating echoes echoed inside the ear of the target. More specifically, the first terminal 100 transmits sound waves into the ear of the target and acquires an echo signal based on the echoes of the transmitted sound waves.

[0024] The reverberation information acquired by the first terminal 100 may be data indicating the reverberation itself (for example, waveform data). Alternatively, the reverberation information may be data indicating features extracted from the reverberation. In this case, the first terminal 100 may have a function for extracting features from the reverberation. Alternatively, the second terminal 200 that has acquired the reverberation from the first terminal 100 may have a function for extracting features from the reverberation.

[0025] The second terminal 200 is configured as, for example, a mobile terminal such as a smartphone, a tablet terminal, or a watch-type terminal, or as a terminal such as a personal computer or a server. The second terminal 200 includes a first authentication unit 210, a second authentication unit 220, and a change unit 230 as processing blocks for realizing its functions.

[0026] The first authentication unit 210 is configured to be able to perform first authentication using echo sound reverberating in the ears of the target (i.e., ear acoustic authentication). The first authentication unit 210 performs the first authentication using echo sound information acquired by the first terminal 100. For example, the first authentication unit 210 authenticates whether the target is a registered user by comparing the echo sound information acquired by the first terminal 100 with echo sound information of a registered user who has been registered in advance. The first authentication unit 210 may perform the first authentication using echo sound information from either the right ear or the left ear. Alternatively, the first authentication unit 210 may perform the first authentication using echo sound information from both ears.

[0027] The first authentication unit 210 may execute a predetermined process depending on the authentication result of the first authentication. For example, if the first authentication is successful, the first authentication unit 210 may permit the target to operate the first terminal 100 or the second terminal 200 (for example, release an operation lock). On the other hand, if the first authentication fails, the first authentication unit 210 may not permit the target to operate the first terminal 100 or the second terminal 200.

[0028] The first authentication unit 210 according to this embodiment is particularly configured to be able to count the duration for which the first authentication is determined to be successful. For example, the first authentication unit 210 periodically performs the first authentication even after the first authentication is successful. The first authentication unit 210 then counts the duration for which the first authentication continues as the duration.

[0029] The second authentication unit 220 is configured to be able to perform second authentication different from the first authentication performed by the first authentication unit 210. That is, the second authentication unit 220 is configured to be able to perform a type of authentication process different from ear acoustic authentication. The authentication method of the second authentication is not particularly limited, and may be, for example, face authentication, iris authentication, eye peripheral authentication, fingerprint authentication, palm print authentication, etc. Furthermore, the second authentication may be multimodal authentication using multiple modalities. For example, the second authentication may be multimodal authentication using face information and iris information.

[0030] The second authentication unit 220 may execute a predetermined process depending on the authentication result of the second authentication. For example, if the second authentication is successful, the second authentication unit 220 may permit the target to perform a specific operation on the first terminal 100 or the second terminal 200 (e.g., permit the use of a specific application). On the other hand, if the second authentication fails, the second authentication unit 220 may not permit the target to perform a specific operation on the first terminal 100 or the second terminal 200.

[0031] The change unit 230 is configured to change the execution mode of the second authentication depending on the duration for which the first authentication is determined to be successful. For example, the change unit 230 may change various parameters of the second authentication depending on the length of the duration. Alternatively, the change unit 230 may cause the second authentication to be executed in the first execution mode when the duration is equal to or longer than a predetermined time, and may cause the second authentication to be executed in the second execution mode when the duration is shorter than the predetermined time. The change of the execution mode of the second authentication by the change unit 230 will be described in more detail in other embodiments described later.

[0032] The functions of the above-described first authentication unit 210, second authentication unit 220, and change unit 230 may be provided in the first terminal 100. That is, some or all of the first authentication unit 210, second authentication unit 220, and change unit 230 may be provided in the first terminal 100. In this case, the first information processing system 10 may be configured without including the second terminal 200.

[0033] (First Authentication Operation) Next, the flow of the first authentication operation in the first information processing system 10 (i.e., the operation related to the first authentication by the first authentication unit 210) will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of the first authentication operation in the first information processing system.

[0034] 3, when the first authentication operation in the first information processing system 10 is started, the first terminal 100 first transmits a sound wave into the ear of the target (step S101). Then, the first terminal 100 acquires echo information indicating the echo echoed in the ear of the target (step S102). The first terminal 100 transmits the acquired echo information to the second terminal.

[0035] Next, the first authentication unit 210 performs the first authentication based on the echo information received from the first terminal 100 (step S103). If the first authentication is successful (step S104: YES), the first authentication unit 210 starts or continues counting the duration (step S105). Specifically, if the first authentication is successful for the first time, the first authentication unit 210 starts counting the duration at that timing. On the other hand, if the first authentication has been successful in the past, the first authentication unit 210 continues counting the duration.

[0036] On the other hand, if the first authentication fails (step S104: NO), the first authentication unit 210 stops counting the duration. In this case, the first authentication unit 210 may reset the duration to zero. Note that if the first authentication is successful again after stopping counting the duration, the first authentication unit 210 may start counting the duration again at that timing.

[0037] (Second Authentication Operation) Next, the flow of the second authentication operation in the first information processing system 10 (i.e., the operation related to the second authentication by the second authentication unit 220) will be described with reference to Fig. 4. Fig. 2 is a flowchart showing the flow of the second authentication operation in the first information processing system.

[0038] 4, when the second authentication operation in the first information processing system 10 is started, the change unit 230 first acquires the duration counted by the first authentication unit 210 (step S151). Then, the change unit 230 changes the execution mode of the second authentication in the second authentication unit 220 according to the duration (step S152).

[0039] Next, the second authentication unit 220 executes the second authentication in the execution mode changed by the change unit 230 (step S153). The second authentication unit 220 may acquire various modals used for the second authentication and execute the second authentication. For example, if the second authentication is face authentication, the second authentication unit 220 acquires a face image of the target and executes face authentication. Also, if the second authentication is iris authentication, the second authentication unit 220 acquires an iris image of the target and executes iris authentication. If the second authentication uses an image of the target, the second authentication unit 220 may acquire an image of the target using, for example, a camera provided in the second terminal 200.

[0040] (Technical Effects) Next, technical effects obtained by the first information processing system 10 will be described.

[0041] As described with reference to Figures 1 to 3, in the first information processing system 10, the execution mode of the second authentication is changed depending on the duration for which the first authentication is determined to be successful. In this way, it is possible to appropriately execute the second authentication depending on the authentication result of the first authentication. For example, if the duration for which the first authentication is determined to be successful is long, it can be determined that there is a high possibility that the target is the registered user (i.e., the reliability of the authentication result of the first authentication is high). Therefore, by changing the execution mode of the second authentication depending on the duration, it is possible to more appropriately execute the second authentication.

[0042] Second Embodiment A second information processing system 10 will be described with reference to Figures 5 and 6. The second information processing system 10 only differs in some of its operations from the first information processing system 10 described above, and other parts may be the same as the first information processing system 10. Therefore, the following will describe in detail the parts that differ from the first embodiment, and will omit explanations of other overlapping parts as appropriate.

[0043] (Second Authentication Operation) First, the flow of the second authentication operation in the second information processing system 10 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of the second authentication operation in the second information processing system. Note that in Fig. 5, the same processes as those shown in Fig. 4 are denoted by the same reference numerals.

[0044] 5, when the second authentication operation by the second information processing system 10 is started, the change unit 230 first acquires the duration counted by the first authentication unit 210 (step S151). Then, the change unit 230 changes the authentication threshold in the second authentication unit 220 according to the duration (step S252). Specifically, the change unit 230 changes the authentication threshold so that the longer the duration, the lower the authentication threshold becomes.

[0045] Next, the second authentication unit 220 performs second authentication using the authentication threshold changed by the change unit 230 (step S253). For example, the second authentication unit 220 compares the target facial image with a facial image of a pre-registered user to calculate a matching score (i.e., a score indicating the degree of match). The second authentication unit 220 then determines that authentication is successful if the matching score is equal to or greater than the authentication threshold. On the other hand, the second authentication unit 220 determines that authentication is unsuccessful if the matching score is less than the authentication threshold.

[0046] (Changing the Authentication Threshold) Next, changing the authentication threshold for the second authentication in the second information processing system 10 will be specifically described with reference to Fig. 6. Fig. 6 is a graph showing an example of changing the authentication threshold in the second information processing system.

[0047] As shown in Fig. 6, an initial value is set in advance as the authentication threshold for the second authentication in the second information processing system 10. The authentication threshold for the second authentication remains constant at the initial value until the first authentication is successful. On the other hand, once the first authentication is successful, the authentication threshold for the second authentication decreases depending on the duration from that point onward. Therefore, the longer the duration, the more likely the second authentication is to succeed.

[0048] In the example shown in FIG. 6 , the authentication threshold for the second authentication decreases linearly, but the manner in which the authentication threshold decreases is not particularly limited. For example, the authentication threshold for the second authentication may decrease stepwise, so that the graph resembles a staircase. Alternatively, the authentication threshold for the second authentication may decrease in a curved manner. Furthermore, the authentication threshold for the second authentication may not start decreasing immediately after the first authentication is successful, but may start decreasing after a certain period of time has passed (i.e., after the first authentication has continued for a certain period of time). Furthermore, a lower limit may be set for the authentication threshold for the second authentication. If the second authentication threshold reaches the lower limit, the second authentication may be skipped (effectively determining that the second authentication is successful every time).

[0049] (Technical Effects) Next, technical effects obtained by the second information processing system 10 will be described.

[0050] As described with reference to Figures 5 and 6, in the second information processing system 10, the authentication threshold for the second authentication is changed so that the longer the duration for which the first authentication is determined to be successful, the lower the authentication threshold for the second authentication. In this way, the longer the duration, the more likely the second authentication is to be successful, and the more appropriately the second authentication can be performed based on the authentication result of the first authentication. For example, if the duration for which the first authentication is determined to be successful is long, there is a high possibility that the target is a registered user. In such a case, lowering the authentication threshold to make the second authentication easier can prevent the second authentication from failing even when the target is a registered user.

[0051] Third Embodiment A third information processing system 10 will be described with reference to Figures 7 and 8. The third information processing system 10 only differs in some of its operations from the first and second information processing systems 10 described above, and other parts may be similar to the first and second information processing systems 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0052] (Second Authentication Operation) First, the flow of the second authentication operation in the third information processing system 10 will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of the second authentication operation in the third information processing system. Note that in Fig. 7, the same processes as those shown in Fig. 4 are denoted by the same reference numerals.

[0053] 7 , when the second authentication operation by the third information processing system 10 is started, the change unit 230 first acquires the duration counted by the first authentication unit 210 (step S151). Then, the change unit 230 changes the number of modals used by the second authentication unit 220 according to the duration (step S352). Specifically, the change unit 230 changes the number of modals so that the longer the duration, the smaller the number of modals.

[0054] Next, the second authentication unit 220 performs the second authentication using the number of modals changed by the change unit 230 (step S353). For example, if the original second authentication was an authentication process using two types of modals, the second authentication after the number of modals has been reduced may be an authentication process using only one type of modal.

[0055] Note that the second authentication unit 220 may reduce the number of modals required for successful authentication without reducing the number of modals used in the second authentication. For example, suppose the original second authentication is an authentication process in which authentication processing using two types of modals is performed, and if authentication is successful in both types of modals, the final authentication result is successful. In this case, the second authentication after the number of modals is reduced may be an authentication process in which authentication processing using two types of modals is performed, and if authentication is successful in either type of modal, the final authentication result is successful.

[0056] (Change in the number of modals) Next, a change in the number of modals for the second authentication in the third information processing system 10 will be specifically described with reference to Fig. 8. Fig. 8 is a time chart showing an example of a change in the number of modals in the third information processing system.

[0057] As shown in FIG. 8 , in the third information processing system 10, the second authentication includes face authentication, iris authentication, and fingerprint authentication. That is, the second authentication is an authentication process that uses the target's face, iris, and fingerprint as modals. If the first authentication is not successful, the second authentication requires that the target's face authentication, iris authentication, and fingerprint authentication all be successful. On the other hand, if the first authentication is successful, the target's authentication is determined to be successful if both face authentication and iris authentication are successful. That is, the success of fingerprint authentication is no longer required. If the duration is further extended, the target's authentication is determined to be successful if only face authentication is successful. That is, the success of iris authentication is no longer required in addition to fingerprint authentication. Therefore, the longer the duration, the more likely the second authentication is to be successful.

[0058] (Technical Effects) Next, technical effects obtained by the third information processing system 10 will be described.

[0059] As described with reference to Figures 7 and 8, in the third information processing system 10, the number of modals for the second authentication is changed to decrease as the duration for which the first authentication is determined to be successful increases. In this way, the longer the duration, the more likely the second authentication is to be successful, and the second authentication can be more appropriately performed based on the authentication result of the first authentication. For example, if the duration for which the first authentication is determined to be successful is long, there is a high possibility that the target is a registered user. In such a case, by reducing the number of modals to make the second authentication easier to authenticate, it is possible to prevent the second authentication from failing even when the target is a registered user.

[0060] <Fourth Embodiment> A fourth information processing system 10 will be described with reference to Figures 9 and 10. Note that the fourth information processing system 10 differs only in part of the configuration and operation from the first to third information processing systems 10 described above, and other parts may be similar to the first to third information processing systems 10. Therefore, hereinafter, only the parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0061] (Terminal Configuration) First, the terminal configuration of the fourth information processing system 10 will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the terminal configuration of the fourth information processing system. Note that in Fig. 9, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0062] 9, the fourth information processing system 10 is configured to include a first terminal 100 and a second terminal 200. In particular, the first terminal 100 in the fifth information processing system 10 includes an attachment determination unit 110 as a processing block for realizing its functions.

[0063] The wearing determination unit 110 is configured to be able to determine whether or not the first terminal 100 is worn on the target ear. More specifically, the wearing determination unit 110 is configured to be able to determine whether or not the first terminal 100 continues to be worn on the target ear (i.e., whether or not the first terminal 100 worn on the target ear remains worn without being removed thereafter).

[0064] The wearing assessment unit 110 may perform wearing assessment by, for example, sending an inaudible sound to the ear of the subject and performing authentication using the reverberation sound. That is, the wearing assessment unit 110 may perform wearing assessment by intermittently performing a process similar to the first authentication. However, the assessment threshold in this case may be a lower value than the authentication threshold in the first authentication. Alternatively, the wearing assessment unit 110 may perform wearing assessment using an acceleration sensor or the like. That is, the wearing assessment unit 110 may perform wearing assessment based on the movement of the first terminal 100.

[0065] 9 illustrates a configuration in which the first terminal 100 includes the wearing assessment unit 110, but the wearing assessment unit 110 may be included in the second terminal 200. The wearing assessment unit 110 included in the second terminal 200 may receive various information from the first terminal 100 and perform wearing assessment using the received information, for example.

[0066] (First Authentication Operation) Next, the flow of the first authentication operation in the fourth information processing system 10 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of the first authentication operation in the fourth information processing system. Note that in Fig. 10, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0067] 10 , when the first authentication operation is started in the fourth information processing system 10, the first authentication unit 210 first determines whether the first authentication has been successful immediately before (step S401). If the first authentication has not been successful immediately before (step S401: NO), the processes of steps S101 to S106 described in the first embodiment are executed.

[0068] On the other hand, if the first authentication was successful immediately before (step S401: YES), the wearing determination unit 110 determines whether the first terminal 100 is still being worn on the target ear (step S402). If the first terminal 100 is not still being worn on the target ear (step S402: NO), the processing of steps S101 to S106 described in the first embodiment is executed.

[0069] If the first terminal 100 continues to be worn on the ear of the subject (step S402: YES), the first authentication unit 210 omits the processes of steps S101 to S104 and continues counting the duration (step S105). In other words, if the first terminal 100 continues to be worn on the ear of the subject, it is determined that the first authentication continues to be successful regardless of the actual result of the first authentication, and the first authentication unit 210 continues counting the duration.

[0070] Note that if the first terminal 100 continues to be worn on the ear of the target, the first authentication unit 210 may not perform the first authentication. However, if the period during which the first authentication is not performed exceeds a preset period, the first authentication may be performed. In other words, even if the first terminal 100 continues to be worn on the ear of the target, the first authentication may be performed for confirmation after a certain period of time has passed.

[0071] (Technical Effects) Next, technical effects obtained by the fourth information processing system 10 will be described.

[0072] As described with reference to Figures 9 and 10, in the fourth information processing system 10, if the first terminal 100 continues to be worn on the ear of the target after the first authentication is successful, the first authentication is treated as continuing to be successful. This makes it possible to reduce the number of times the first authentication is performed while changing the execution mode of the second authentication to an appropriate one. For example, if the first terminal 100 is not removed from the ear of the target after the first authentication is successful, it is possible to ensure that the person wearing the first terminal 100 is the authenticated person. Therefore, even if the execution mode of the second authentication is changed without performing the first authentication, the same technical effect as when the first authentication is performed can be obtained.

[0073] Fifth Embodiment A fifth information processing system 10 will be described with reference to Fig. 11. The fifth information processing system 10 differs only in part of the configuration and operation from the first to fourth information processing systems 10 described above, and other parts may be similar to the first to fourth information processing systems 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0074] (Terminal Configuration) First, the terminal configuration of the fifth information processing system 10 will be described with reference to Fig. 11. Fig. 11 is a block diagram showing the terminal configuration in the fifth information processing system. Note that in Fig. 11, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0075] 11 , the fifth information processing system 10 is configured to include a first terminal 100 and a second terminal 200. The second terminal 200 in the fifth information processing system 10 includes, as processing blocks for realizing its functions, a first authentication unit 210, a second authentication unit 220, a change unit 230, and an output unit 240. That is, the second terminal 200 in the fifth information processing system 10 further includes an output unit 240 in addition to the configuration described in the first embodiment (see FIG. 2 ).

[0076] The output unit 240 is configured to be able to output the authentication result of the target based on the result of the first authentication and the result of the second authentication. For example, the output unit 240 may display the authentication result of the target on a display. In this case, the output unit 240 may output a message or an image indicating success or failure of authentication to a display or the like provided in the second terminal 200. Alternatively, the output unit 240 may output the authentication result of the target as audio through a speaker. In this case, the output unit 240 may output a message or a mechanical sound indicating success or failure of authentication from the first terminal 100 or the like. Furthermore, the output unit 240 may output the authentication result of the target to a device external to the system. In this case, the output destination device may be configured to execute a predetermined process depending on the authentication result of the target.

[0077] If the wearing determination unit (see FIG. 9 ) described in the fourth embodiment determines that the first terminal 100 is not being worn, the output unit 240 may notify the subject for whom the second authentication was successful that the earphones are not being worn. For example, the output unit 240 may send an email containing a message such as "Earphones are not being worn" to the subject for whom the second authentication was successful. The output unit 240 may also detect the location of the earphones and notify the subject for whom the second authentication was successful of the location of the earphones.

[0078] Furthermore, if the first authentication is successful but the second authentication is not, there is a possibility that there is a problem with the registration information used for the second authentication. Therefore, in such a case, the user may be prompted to re-register the registration information to be used for the second authentication. Note that, if a modal (e.g., a face image or an iris image) to be used for the second authentication has already been acquired, the image may be registered (updated) as the registration information. When updating the registration information, the first authentication may be performed again to confirm the identity of the user.

[0079] (Technical Effects) Next, technical effects obtained by the fifth information processing system 10 will be described.

[0080] 11 , in the fifth information processing system 10, the authentication result of the target is output based on the results of the first authentication and the second authentication. In this way, it becomes possible for the target or the like to appropriately understand information regarding the authentication result of the target.

[0081] Sixth Embodiment A sixth information processing system 10 will be described with reference to Figures 12 and 13. The sixth information processing system 10 differs only in part of the configuration and operation from the first to fifth information processing systems 10 described above, and other parts may be similar to the first to fifth information processing systems 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0082] (Terminal Configuration) First, the terminal configuration of the sixth information processing system 10 will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the terminal configuration in the sixth information processing system. Note that in Fig. 12, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0083] 12 , the sixth information processing system 10 is configured to include a first terminal 100 and a second terminal 200. The second terminal 300 in the sixth information processing system 10 includes, as processing blocks for realizing its functions, a first authentication unit 210, a second authentication unit 220, a change unit 230, an identification unit 250, and an authorization unit 260. That is, the second terminal 200 in the sixth information processing system 10 further includes the identification unit 250 and the authorization unit 260 in addition to the configuration described in the first embodiment (see FIG. 2 ).

[0084] The identification unit 250 is configured to be able to identify the user of the second terminal 200 based on the result of the first authentication by the first authentication unit 210. For example, assume that a target wears the first terminal 100 on their ear and holds the second terminal 200 in their hand. In this case, the identification unit 250 identifies the user identified in the first authentication as the user of the second terminal 200. The identification unit 250 may determine whether the target is a specific user by, for example, 1:1 matching. Alternatively, the identification unit 250 may identify which user among multiple registered users the target is by, for example, 1:N matching.

[0085] The permission unit 260 is configured to be able to permit the use of a predetermined service on the second terminal 200 based on the result of the second authentication by the second authentication unit 220. The predetermined service may be, for example, all or part of the services available on the second terminal 200. For example, the predetermined service may be an app installed on the second terminal 200. In this case, the permission unit 260 may permit the subject for whom the second authentication is successful to use the app. Alternatively, the permission unit 260 may permit the subject for whom the second authentication is successful to perform some operations within the app (for example, payment processing, etc.).

[0086] The change unit 230 in the sixth information processing system 10 is configured to lower the authentication threshold for the second authentication or skip the second authentication depending on the duration for which the first authentication by the first authentication unit 210 is determined to be successful (in other words, the duration for which the user of the second terminal 200 is identified by the identification unit 250). The change unit 230 may determine whether to lower the authentication threshold for the second authentication or skip the second authentication depending on, for example, the duration. For example, the change unit 230 may skip the second authentication if the duration is longer than a predetermined value, and may lower the authentication threshold for the second authentication if the duration is shorter than the predetermined value.

[0087] When the authentication threshold for the second authentication is lowered by the change unit 230, the second authentication is more likely to succeed. Therefore, the permission unit 260 is more likely to permit the target to use the predetermined service. Furthermore, when the change unit 230 skips the second authentication, the second authentication is essentially always treated as successful. Therefore, the permission unit 260 permits the target to use the predetermined service without performing the second authentication.

[0088] (Second Authentication Operation) Next, the flow of the second authentication operation in the sixth information processing system 10 will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of the second authentication operation in the sixth information processing system. Note that in Fig. 13, the same processes as those shown in Fig. 4 are denoted by the same reference numerals.

[0089] 13 , when the second authentication operation by the sixth information processing system 10 is started, the change unit 230 first acquires the duration counted by the first authentication unit 210 (step S151). Then, the change unit 230 determines whether the acquired duration is longer than a predetermined value (step S601).

[0090] If the duration is longer than the predetermined value (step S601: YES), the change unit 230 skips the second authentication. Specifically, the subsequent processes of steps S602 to S604 are omitted. In this case, the permission unit 260 permits the target to use the predetermined service without performing the second authentication (step S605).

[0091] On the other hand, if the duration is shorter than the predetermined value (step S601: NO), the change unit 230 changes the authentication threshold in the second authentication unit 220 according to the duration (step S602). For example, the change unit 230 changes the authentication threshold so that the longer the duration is, the lower the authentication threshold becomes.

[0092] Next, the second authentication unit 220 performs second authentication using the authentication threshold changed by the change unit 230 (step S603). If the second authentication is successful (step S604: YES), the permission unit 260 permits the target to use the predetermined service (step S605). On the other hand, if the second authentication fails (step S604: NO), the processing of step S605 is omitted. In other words, the permission unit 260 does not permit the target to use the predetermined service.

[0093] (Technical Effects) Next, technical effects obtained by the sixth information processing system 10 will be described.

[0094] As described with reference to FIGS. 12 and 13 , in the sixth information processing system 10, the first authentication identifies the user of the second terminal 200, and the second authentication permits the target to use a predetermined service on the second terminal 200. This makes it possible to appropriately determine whether the target can use the predetermined service on the second terminal 200. For example, for a target whose duration is relatively long, the second authentication is skipped and the target is permitted to use the predetermined service. Therefore, a target who is likely to be a registered user can be permitted to use the predetermined service quickly and without hassle. Furthermore, even for a target whose duration is relatively long, the second authentication is made more likely to succeed depending on the duration, and the target is then permitted to use the predetermined service. Therefore, the target can be appropriately permitted to use the predetermined service depending on the reliability based on the duration.

[0095] Seventh Embodiment A seventh information processing system 10 will be described with reference to Figures 14 to 17. The seventh information processing system 10 differs only in part of the configuration and operation from the first to sixth information processing systems 10 described above, and other parts may be similar to the first to sixth information processing systems 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0096] (Terminal Configuration) First, the terminal configuration of the seventh information processing system 10 will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the terminal configuration in the seventh information processing system.

[0097] 14 , the seventh information processing system 10 includes earphones 310, a smartphone 320, and a smartwatch 330. The earphones 310, the smartphone 320, and the smartwatch 330 are connected to each other via wireless communication or the like. For example, the earphones 310, the smartphone 320, and the smartwatch 330 may be connected to each other via a Bluetooth multipoint connection or a multi-pairing connection.

[0098] The earphone 310 is a terminal provided as a specific example of the first terminal 100 in each of the above-described embodiments. The smartphone 320 and the smartwatch 330 are terminals provided as specific examples of the second terminal 200 in each of the above-described embodiments. Either the smartphone 320 or the smartwatch 330 may function as the second terminal 200. That is, while the smartphone 320 functions as the second terminal 200, the smartwatch 330 may not function as the second terminal 200. Alternatively, while the smartwatch 330 functions as the second terminal 200, the smartphone 320 may not function as the second terminal 200.

[0099] Which of the smartphone 320 and the smartwatch 330 functions as the second terminal 200 may be determined based on, for example, the user's actions or the state of each terminal. The following describes the operation for determining the terminal that functions as the second terminal 200 (hereinafter, appropriately referred to as the "terminal determination operation").

[0100] (Terminal Determination Operation) The flow of the terminal determination operation in the seventh information processing system 10 will be described with reference to Fig. 15 to Fig. 17. Fig. 15 is a flowchart (part 1) showing the flow of the terminal determination operation in the seventh information processing system. Fig. 16 is a flowchart (part 2) showing the flow of the terminal determination operation in the seventh information processing system. Fig. 17 is a flowchart (part 3) showing the flow of the terminal determination operation in the seventh information processing system.

[0101] In the example shown in Fig. 15, after the first authentication is successful, the terminal touched by the user is determined as the second terminal 200. Specifically, when the terminal determination operation is started, the seventh information processing system 10 first performs the first authentication using echo sound information acquired from the earphones 310 (step S701). The first authentication may be performed as 1:N authentication. Note that if the first authentication fails (step S702: NO), the subsequent processing may be omitted. In that case, the processing may be resumed from step S701 after a predetermined period of time.

[0102] On the other hand, if the first authentication is successful (step S702: YES), the seventh information processing system 10 detects the device that the user first touched after the first authentication was successful (step S703). Specifically, the seventh information processing system 10 detects whether the user touched the smartphone 320 or the smartwatch 330 first. The seventh information processing system 10 may detect that the user has touched the device when, for example, the user presses the power button of the device, the user taps the screen of the smartphone, or the movement of the device is detected.

[0103] Thereafter, the seventh information processing system 10 determines the terminal that the user touches for the first time after the first authentication is successful as the second terminal 200 (step S704). For example, if the user touches the smartphone 320 for the first time, the smartphone 320 is determined as the second terminal 200. On the other hand, if the user touches the smartwatch 330 for the first time, the smartwatch 330 is determined as the second terminal 200.

[0104] 16 , after detecting that the earphones 310 are being worn, the device touched by the user is determined to be the second device 200. Specifically, when the device determination operation starts, the seventh information processing system 10 first detects whether the user is wearing the earphones 310 (step S711). Whether the earphones 310 are being worn may be detected by the wearing determination unit 110 (see FIG. 9 ) described in the fourth embodiment. Note that if wearing of the earphones 310 is not detected (step S712: NO), the subsequent processing may be omitted. In that case, processing may be resumed from step S711 after a predetermined period of time.

[0105] On the other hand, if the seventh information processing system 10 detects that the earphones 310 are being worn (step S712: YES), the seventh information processing system 10 detects the terminal that the user first touched after detecting that the earphones 310 are being worn (step S713).Then, the seventh information processing system 10 determines that the terminal that the user first touched after detecting that the earphones 310 are being worn is the second terminal 200 (step S714).

[0106] 17 , the terminal that is active when the first authentication is successful is determined as the second terminal 200. Specifically, when the terminal determination operation is started, the seventh information processing system 10 first performs the first authentication using the reverberation information acquired from the earphone 310 (step S701). Note that if the first authentication fails (step S702: NO), the subsequent processing may be omitted. In that case, the processing may be resumed from step S701 after a predetermined period of time.

[0107] On the other hand, if the first authentication is successful (step S702: YES), the seventh information processing system 10 detects the terminal that was active when the first authentication was successful (step S723). Specifically, the seventh information processing system 10 detects whether the smartphone 320 or the smartwatch 330 was active when the first authentication was successful.

[0108] Thereafter, the seventh information processing system 10 determines the terminal that is active when the first authentication is successful as the second terminal 200 (step S724). For example, if the smartphone 320 is active when the first authentication is successful, the smartphone 320 is determined as the second terminal 200. On the other hand, if the smartwatch 330 is active when the first authentication is successful, the smartwatch 330 is determined as the second terminal 200.

[0109] The series of processes shown in FIG. 17 may be executed repeatedly. In this case, the second terminal 200 may be determined each time the first authentication is executed. That is, the second terminal 200 may be changed each time the first authentication is executed. For example, assume that the user is using the smartphone 320. In this case, when the first authentication is executed, the smartphone 320 is first determined as the second terminal. Thereafter, assume that the user stops using the smartphone 320 and starts using the smartwatch 330. In this case, when the first authentication is executed, the smartwatch 330 is determined as the second terminal. That is, the second terminal 200 is switched from the smartphone 320 to the smartwatch.

[0110] 17, the wearing of the earphones 310 may also be detected as described in FIG. 16. That is, instead of the first authentication (step S701), the wearing of the earphones 310 may be detected (step S711). In this case, the seventh information processing system 10 may determine, as the second terminal 200, the terminal that is running when the wearing of the earphones 310 is detected.

[0111] In the terminal determined as the second terminal 200 in the terminal determination operation, the processing of the second terminal 200 described in each of the above-described embodiments is executed. For example, if the smartphone 320 is determined as the second terminal 200, the second authentication may be executed using biometric information acquired by the smartphone 320. Furthermore, if the smartwatch 330 is determined as the second terminal 200, the second authentication may be executed using biometric information acquired by the smartwatch 330. The second authentication may be executed as one-to-one authentication based on the user identified by the first authentication.

[0112] (Technical Effects) Next, technical effects obtained by the seventh information processing system 10 will be described.

[0113] 14 to 17, in the seventh information processing system 10, a terminal that functions as the second terminal 200 is determined from among a plurality of terminals. In this way, even if there are a plurality of terminals that can be connected to the first terminal 100, it is possible to appropriately perform the second authentication.

[0114] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0115] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0116] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0117] (Supplementary Note 1) The information processing system described in Supplementary Note 1 is an information processing system including: a first authentication means for performing a first authentication using a reverberant sound reverberating in the ear of a subject; a second authentication means for performing a second authentication on the subject that is different from the first authentication; and a change means for changing the execution mode of the second authentication depending on the duration for which the first authentication is determined to be successful.

[0118] (Supplementary Note 2) The information processing system according to Supplementary Note 2 is the information processing system according to Supplementary Note 1, wherein the change unit lowers the authentication threshold for the second authentication as the duration becomes longer.

[0119] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 1 or 2, wherein the second authentication is authentication using multiple modals, and the change means reduces the number of modals used for the second authentication as the duration becomes longer.

[0120] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in any one of Appendices 1 to 3, further comprising a wearing determination means for determining whether a terminal that acquires the reverberant sound is worn on the ear of the target, and the first authentication means determines that the success of the first authentication continues if the terminal continues to be worn after the first authentication using the reverberant sound is successful.

[0121] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in any one of Appendices 1 to 4, further comprising an output means for outputting an authentication result of the target based on the result of the first authentication and the result of the second authentication.

[0122] (Appendix 6) The information processing system described in Appendix 6 is the information processing system described in any one of Appendices 1 to 5, further comprising an identification means for identifying a user of the mobile terminal based on a result of the first authentication, and an authorization means for authorizing use of a predetermined service on the mobile terminal based on a result of the second authentication, wherein the change means lowers the authentication threshold for the second authentication or skips the second authentication depending on the duration for which the first authentication is determined to be successful.

[0123] (Appendix 7) The information processing system described in Appendix 7 is the information processing system described in any one of claims 1 to 3, further comprising a terminal identification means that, when the attachment of the first terminal is detected or when the first authentication is successful, identifies the terminal touched by the user from among multiple terminals as the second terminal.

[0124] (Appendix 8) The information processing method described in Appendix 8 is an information processing method that, by at least one computer, performs a first authentication using reverberant sound that reverberates in a target's ear, performs a second authentication on the target that is different from the first authentication, and changes the execution mode of the second authentication depending on the duration for which the first authentication is determined to be successful.

[0125] (Appendix 9) The recording medium described in Appendix 9 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises performing a first authentication using reverberant sounds reverberating in the ears of a subject, performing a second authentication on the subject that is different from the first authentication, and changing the manner in which the second authentication is executed depending on the duration for which the first authentication is determined to be successful.

[0126] (Supplementary Note 10) The computer program described in Supplementary Note 10 is a computer program that causes at least one computer to execute an information processing method that performs a first authentication using reverberant sounds that reverberate in a target's ear, performs a second authentication on the target that is different from the first authentication, and changes the execution mode of the second authentication depending on the duration for which the first authentication is determined to be successful.

[0127] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0128] REFERENCE SIGNS LIST 10 Information processing system 11 Processor 100 First terminal 110 Wearing determination unit 200 Second terminal 210 First authentication unit 220 Second authentication unit 230 Change unit 240 Output unit 250 Identification unit 260 Permission unit 310 Earphone 320 Smartphone 330 Smartwatch

Claims

1. An information processing system comprising: a first authentication means for performing a first authentication using a sound reflected in a target's ear; a second authentication means for performing a second authentication on the target which is different from the first authentication; and a change means for changing a mode of execution of the second authentication depending on a duration during which the first authentication is determined to be successful.

2. The information processing system according to claim 1, wherein the change means lowers the authentication threshold for the second authentication as the duration becomes longer.

3. The information processing system according to claim 1, wherein the second authentication is an authentication using a plurality of modals, and the change means reduces the number of modals used in the second authentication as the duration becomes longer.

4. An information processing system as described in any one of claims 1 to 3, further comprising a wearing determination means for determining whether or not a terminal that acquires the reverberation sound is worn on the ear of the target, wherein the first authentication means determines that the success of the first authentication continues if the terminal continues to be worn after the first authentication using the reverberation sound is successful.

5. An information processing system according to any one of claims 1 to 3, further comprising an output means for outputting an authentication result of the target based on a result of the first authentication and a result of the second authentication.

6. The information processing system of claim 1, further comprising: an identification means for identifying a user of the mobile terminal based on the result of the first authentication; and an authorization means for authorizing the use of a specified service on the mobile terminal based on the result of the second authentication, wherein the change means lowers the authentication threshold for the second authentication or skips the second authentication depending on the duration for which the first authentication is determined to be successful.

7. An information processing system according to any one of claims 1 to 3, further comprising a terminal identification means for identifying a terminal touched by the user from among a plurality of terminals as a second terminal when attachment of a first terminal is detected or when the first authentication is successful.

8. An information processing method comprising: performing, by at least one computer, a first authentication using a sound reverberating in a target's ear; performing a second authentication on the target that is different from the first authentication; and changing an execution mode of the second authentication depending on a duration for which the first authentication is determined to be successful.

9. A recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises: executing a first authentication using sound reverberating in the ear of a subject; executing a second authentication different from the first authentication on the subject; and changing the execution mode of the second authentication depending on the duration for which the first authentication is determined to be successful.

Images