Information processing system, portable terminal, information processing method, and recording medium

Abstract

An information processing system (10) comprises: a first authentication means (210) that executes a first authentication using a reverberating sound reverberating in an ear of a subject; a second authentication means (220) that executes a second authentication different from the first authentication with respect to the subject; an authentication result integration means (230) that outputs an integrated authentication result integrating a result of the first authentication and a result of the second authentication; and a weighting modification means (240) that modifies a weighting of the first authentication in the integration of the result of the first authentication and the result of the second authentication, the modification being based on authentication situation information, which is information related to at least one from among the time, location, and environment in which the first authentication and the second authentication are performed. According to such an information processing system, authentication processing for a subject can be executed appropriately.

Description

Information processing system, mobile terminal, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, a mobile terminal, an information processing method, and a recording medium.

[0002] There is known a technology for performing authentication processing of a target (so-called ear acoustic authentication) based on characteristics of the ear canal acquired by utilizing sound reverberation. For example, Patent Literature 1 discloses that an individual can be identified by comparing a response signal collected by outputting an incident signal to the ear with pre-registered acoustic characteristics of the ear.

[0003] Japanese Patent Application Laid-Open No. 2004-065363

[0004] The present disclosure aims to provide an information processing system, a mobile terminal, an information processing method, and a recording medium that aim to improve upon the techniques disclosed in prior art documents.

[0005] One aspect of the information processing system disclosed herein includes a first authentication means that performs a first authentication using reverberation sound that reverberates in the ear of a subject; a second authentication means that performs a second authentication on the subject that is different from the first authentication; an authentication result integrating means that outputs an integrated authentication result that integrates a result of the first authentication and a result of the second authentication; and a weight changing means that changes a weight of the first authentication when integrating a result of the first authentication and a result of the second authentication, based on authentication status information that is information regarding at least one of a time, a location, and an environment in which the first authentication and the second authentication are performed.

[0006] One aspect of the mobile terminal of this disclosure includes an authentication result integration means that outputs an integrated authentication result that integrates a result of a first authentication using reverberation sound that has reverberated in the ear of a subject and a result of a second authentication that is different from the first authentication, and a weight change means that changes the weight of the first authentication when integrating the result of the first authentication and the result of the second authentication based on authentication status information that is information regarding at least one of the time, location, and environment in which the first authentication and the second authentication are performed.

[0007] One aspect of the information processing method of this disclosure involves using at least one computer to perform a first authentication using reverberation sound that reverberates in a target's ear, perform a second authentication on the target that is different from the first authentication, output an integrated authentication result that integrates the result of the first authentication and the result of the second authentication, and change the weight of the first authentication when integrating the result of the first authentication and the result of the second authentication based on authentication status information that is information regarding at least one of the time, location, and environment in which the first authentication and the second authentication are performed.

[0008] One aspect of a recording medium of this disclosure has recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes performing a first authentication using reverberation sound that reverberates in a target's ear, performing a second authentication on the target that is different from the first authentication, outputting an integrated authentication result that integrates a result of the first authentication and a result of the second authentication, and changing a weight of the first authentication when integrating a result of the first authentication and a result of the second authentication, based on authentication status information that is information regarding at least one of a time, a location, and an environment in which the first authentication and the second authentication are performed.

[0009] 1 is a block diagram showing the hardware configuration of a first information processing system. FIG. 2 is a block diagram showing the terminal configuration of the first information processing system. FIG. 3 is a flowchart showing the operation flow of the first information processing system. FIG. 4 is a block diagram showing the terminal configuration of a second information processing system. FIG. 5 is a flowchart showing the operation flow of a third information processing system. FIG. 6 is a block diagram showing the terminal configuration of a fourth information processing system. FIG. 7 is a block diagram showing the terminal configuration of a fifth information processing system. FIG. 8 is a block diagram showing the functional configuration of a mobile terminal. FIG. 9 is a flowchart showing the operation flow of a mobile terminal.

[0010] Hereinafter, embodiments of an information processing system, a mobile terminal, an information processing method, and a recording medium will be described with reference to the drawings.

[0011] First Embodiment A first information processing system will be described with reference to FIGS. 1 to 3. FIG.

[0012] (Hardware Configuration) First, the hardware configuration of the first information processing system will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the first information processing system.

[0013] 1, a first information processing system 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected to each other via a data bus 17. The data bus 17 may be an interface other than a data bus (for example, a LAN, a USB, etc.).

[0014] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks for executing processing related to ear acoustic authentication are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing system 10.

[0015] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0016] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0017] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0018] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device may store computer programs executed by the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0019] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as part of a smartphone, a tablet terminal, an earphone-type terminal, a watch-type terminal, an HMD (Head Mounted Display) terminal, or the like. The input device 15 may be, for example, a device that includes a microphone and is capable of voice input.

[0020] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as part of a smartphone, a tablet terminal, an earphone-type terminal, a watch-type terminal, an HMD terminal, or the like.

[0021] The first information processing system 10 is configured to include a first terminal and a second terminal, as described below. Each of the components described in Fig. 1 may be configured to be included in at least one of the first terminal and the second terminal included in the first information processing system 10. Furthermore, some of the components described in Fig. 1 may be configured to be included in an external device (e.g., an external server, a cloud, etc.) different from the first terminal and the second terminal.

[0022] (Terminal Configuration) Next, the terminal configuration of the first information processing system 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the terminal configuration of the first information processing system.

[0023] 2, the first information processing system 10 is configured to include a first terminal 100 and a second terminal 200. The first terminal 100 and the second terminal 200 are connected, for example, by wireless communication, and are configured to be able to transmit and receive information to and from each other. In addition to the first terminal 100 and the second terminal 200, the first information processing system 10 may be configured to include other terminals (for example, a third terminal, a fourth terminal, etc.).

[0024] The first terminal 100 is configured as an earphone-type hearable terminal. The first terminal 100 may be configured as a terminal worn on one ear. Alternatively, the first terminal 100 may be configured as a terminal worn on both ears. That is, the first terminal 100 may be configured to include a right-ear terminal and a left-ear terminal. The first terminal 100 is configured to be able to acquire echo information indicating echoes echoed inside the ear of the target. More specifically, the first terminal 100 transmits sound waves into the ear of the target and acquires an echo signal based on the echoes of the transmitted sound waves.

[0025] The reverberation information acquired by the first terminal 100 may be data indicating the reverberation itself (for example, waveform data). Alternatively, the reverberation information may be data indicating features extracted from the reverberation. In this case, the first terminal 100 may have a function for extracting features from the reverberation. Alternatively, the second terminal 200 that has acquired the reverberation from the first terminal 100 may have a function for extracting features from the reverberation.

[0026] The second terminal 200 is configured as, for example, a mobile terminal such as a smartphone, a tablet terminal, a watch-type terminal, or an HMD terminal, or as a terminal such as a personal computer or a server. The second terminal 200 includes, as processing blocks for realizing its functions, a first authentication unit 210, a second authentication unit 220, an authentication result integrating unit 230, and a weight changing unit 240.

[0027] The first authentication unit 210 is configured to be able to perform first authentication using echo sound reverberating in the ears of the target (i.e., ear acoustic authentication). The first authentication unit 210 performs the first authentication using echo sound information acquired by the first terminal 100. For example, the first authentication unit 210 authenticates whether the target is a registered user by comparing the echo sound information acquired by the first terminal 100 with echo sound information of a registered user who has been registered in advance. The first authentication unit 210 may perform the first authentication using echo sound information from either the right ear or the left ear. Alternatively, the first authentication unit 210 may perform the first authentication using echo sound information from both ears.

[0028] The second authentication unit 220 is configured to be able to perform second authentication different from the first authentication performed by the first authentication unit 210. That is, the second authentication unit 220 is configured to be able to perform a type of authentication process different from ear acoustic authentication. The authentication method of the second authentication is not particularly limited, and may be, for example, face authentication, iris authentication, eye peripheral authentication, fingerprint authentication, palm print authentication, etc. The second authentication may also be multimodal authentication using multiple modals. For example, the second authentication may be multimodal authentication using face information and iris information. The second authentication unit 220 may acquire the modal used for the second authentication using, for example, a camera provided in the second terminal 200. Alternatively, the second authentication unit 220 may acquire the modal used for the second authentication from another terminal (for example, a third terminal not shown).

[0029] The authentication result integrating unit 230 is configured to output an integrated authentication result obtained by integrating the result of the first authentication performed by the first authentication unit 210 and the result of the second authentication performed by the second authentication unit 220. The authentication result integrating unit 230 integrates the first authentication result and the second authentication result using a predetermined weight. The "weight" here refers to a parameter that determines the magnitude of influence that each of the first and second authentication results has on the integrated authentication result. For example, if the weight of the first authentication is greater than the weight of the second authentication, the result of the first authentication has a greater influence on the integrated authentication result than the result of the second authentication. Conversely, if the weight of the first authentication is smaller than the weight of the second authentication, the result of the second authentication has a greater influence on the integrated authentication result than the result of the first authentication. More specifically, for example, if the weight of the first authentication is greater than the weight of the second authentication, the integrated authentication result may be determined to be successful even if the second authentication fails, as long as the first authentication is successful. Furthermore, if the first authentication fails, the integrated authentication result may be determined to be a failure even if the second authentication is successful.

[0030] The integrated authentication result output by the authentication result integrating unit 230 may be used to execute a predetermined process. For example, if the integrated authentication result is successful, the first authentication system 10 may permit the target to operate the first terminal 100 or the second terminal 200 (e.g., release the operation lock). On the other hand, if the integrated authentication result is unsuccessful, the first authentication system 10 may not permit the target to operate the first terminal 100 or the second terminal 200. Alternatively, the integrated authentication result may be output to an external device of the first authentication system 10. In this case, the external device may execute a process using the integrated authentication result.

[0031] The weight modification unit 240 is configured to be able to modify the weights used by the authentication result integration unit 230. The weight modification unit 240 modifies the weights based on authentication status information. The authentication status information is information regarding at least one of the time, location, and environment in which the first authentication and the second authentication are performed. For example, the weight modification unit 240 may acquire time information, which is the authentication status information, using a clock function provided in the first terminal 100 or the second terminal 200. The weight modification unit 240 may acquire location information, which is the authentication status information, using a GPS (Global Positioning System) function provided in the first terminal 100 or the second terminal 200. The weight modification unit 240 may acquire brightness information, temperature information, humidity information, barometric pressure information, weather information, acceleration information, and the like, which are the authentication status information, using various sensors provided in the first terminal 100 or the second terminal 200. The weight modification unit 240 modifies the weights used by the authentication result integration unit 230 so that authentication can be performed appropriate for the time, location, and environment indicated by the authentication status information.

[0032] If the time, location, and environment indicated by the authentication status information are suitable for the first authentication or are not suitable for the second authentication, the weight modification unit 240 may increase the weight of the first authentication to increase the influence of the first authentication on the integrated authentication result. Conversely, if the time, location, and environment indicated by the authentication status information are not suitable for the first authentication or are suitable for the second authentication, the weight modification unit 240 may decrease the weight of the first authentication to decrease the influence of the first authentication on the integrated authentication result. Note that the weight modification unit 240 may change the weight of the second authentication in addition to or instead of the weight of the first authentication. That is, the weight modification unit 240 may change the relative relationship between the weight of the first authentication and the weight of the second authentication.

[0033] When either the first authentication or the second authentication cannot be performed, the weight modification unit 240 may increase the weight of the other authentication. For example, when the first terminal is not worn on the target's ear, reverberation information cannot be acquired from the target's ear, and the first authentication cannot be performed. In this case, the weight modification unit 240 may decrease the weight of the first authentication or increase the weight of the second authentication. Furthermore, when an image (e.g., a face image or an iris image) used for the second authentication cannot be captured, the second authentication cannot be performed. In this case, the weight modification unit 240 may increase the weight of the first authentication or decrease the weight of the second authentication.

[0034] The functions of the above-described first authentication unit 210, second authentication unit 220, authentication result integrating unit 230, and weight changing unit 240 may be provided in the first terminal 100. That is, some or all of the first authentication unit 210, second authentication unit 220, authentication result integrating unit 230, and weight changing unit 240 may be provided in the first terminal 100. In this case, the first information processing system 10 may be configured without including the second terminal 200.

[0035] (Operational Flow) Next, the operational flow in the first information processing system 10 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the operational flow of the first information processing system.

[0036] 3, when the operation of the first information processing system 10 is started, the weight change unit 240 first acquires authentication status information (step S101). Then, the weight change unit 240 changes the weights used by the authentication result integrating unit 230 based on the acquired authentication status information (step S102). Note that if it is determined based on the authentication status information that the weights do not need to be changed, the weight change unit 240 may maintain the current weights without changing them.

[0037] Next, the first authentication unit 210 performs the first authentication using the echo sound information (step S103). The second authentication unit 220 performs the second authentication (step S104). If the authentication is not successful, the first authentication unit 210 and the second authentication unit 220 may notify the target or the like of this. For example, a message such as "Authentication was not successful. Please try again from the beginning" may be displayed on the display of the second terminal 200. The processing of step S103 and the processing of step S104 may be performed one after the other, or may be performed simultaneously in parallel. In other words, the order in which the first authentication and the second authentication are performed is not particularly limited.

[0038] Next, the authentication result integrating unit 230 integrates the authentication result of the first authentication and the authentication result of the second authentication using the weights changed by the weight changing unit 240 (step S105). The authentication result integrating unit 230 then outputs the integrated integrated authentication result (step S106). Note that, until the integrated authentication result is output, the first information processing system 10 may output information indicating that authentication is currently in progress. For example, the first information processing system 10 may display a message such as "Authentication in progress" on the display of the second terminal 200. Thereafter, the first authentication processing system 10 may display a message such as "Authentication successful" or "Authentication failed" in conjunction with the output of the integrated authentication result.

[0039] (Technical Effects) Next, technical effects obtained by the first information processing system 10 will be described.

[0040] As described with reference to FIGS. 1 to 3 , in the first information processing system 10, the weighting used when integrating the authentication results of the first authentication and the second authentication is changed according to the authentication status information. This allows the target authentication process to be executed appropriately according to the circumstances when the authentication is executed. For example, if the circumstances require the first authentication to be prioritized over the second authentication, a more appropriate integrated authentication result can be obtained by increasing the weighting of the first authentication. Furthermore, if the circumstances require the second authentication to be prioritized over the first authentication, a more appropriate integrated authentication result can be obtained by decreasing the weighting of the first authentication. More specific examples of circumstances requiring weighting changes will be described in detail in the following embodiments.

[0041] Second Embodiment A second information processing system 10 will be described with reference to Fig. 4. The second information processing system 10 differs only in part of the configuration and operation from the first information processing system 10 described above, and other parts may be similar to the first information processing system 10. Therefore, the following will describe in detail the parts that differ from the first embodiment, and will omit a description of other overlapping parts as appropriate.

[0042] (Terminal Configuration) First, the terminal configuration of the second information processing system 10 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the terminal configuration of the second information processing system. Note that in Fig. 4, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0043] 4, the second information processing system 10 is configured to include a first terminal 100 and a second terminal 200. The second terminal 200 includes, as processing blocks for realizing its functions, a first authentication unit 210, a second authentication unit 220, an authentication result integrating unit 230, and a weight modification unit 240. In particular, in the second information processing system 10, the weight modification unit 240 in the second terminal 200 includes a security value estimation unit 241.

[0044] The security value estimation unit 241 is configured to estimate a security value based on authentication status information. The security value indicates the level of security required for the integrated authentication result. The security value may be calculated, for example, as a score out of 100, or as a two-level value such as "high" or "low." The security value estimation unit 241 may estimate the current situation from the authentication status information and estimate a security value according to the estimated situation. For example, if it can be estimated based on the authentication status information that the target is attempting to perform a high-value payment transaction using the integrated authentication result, the security value estimation unit 241 may estimate a security value higher than the security value for performing a normal payment transaction. Note that whether or not a payment transaction is a high-value transaction may be determined, for example, based on a preset threshold. For example, a payment transaction exceeding 30,000 yen may be treated as a high-value payment transaction, and a payment transaction of 30,000 yen or less may be treated as a normal payment transaction. Furthermore, the security value may be gradually increased as the payment amount increases. For example, the security value may be estimated as "1" for payment transactions of less than 1,000 yen, "2" for payment transactions of 1,000 yen to 10,000 yen, "3" for payment transactions of 10,000 yen to 50,000 yen, "4" for payment transactions of 50,000 yen to 100,000 yen, and "5" for payment transactions of 100,000 yen or more. Alternatively, if it can be estimated based on the authentication status information that the target is requesting permission to use a device that does not store personal information, the security value estimation unit 241 may estimate the security value as a value lower than the security value when permission to use a device that stores personal information is being requested. Furthermore, the security value may vary depending on the amount and type of personal information stored in the device. For example, the security value may be estimated as "10" if only a name is stored, "15" if a name and address are stored, and "30" if a name, address, and age are stored.

[0045] The weight modification unit 240 in the second information processing system 10 modifies the weights used by the authentication result integration unit 230 based on the security value estimated by the security value estimation unit 241. Specifically, the weight modification unit 240 modifies the weight so that the higher the security value, the greater the weight of the first authentication. In other words, the weight modification unit 240 modifies the weight so that the lower the security value, the greater the weight of the second authentication. The weight modification unit 240 may calculate the weights from the security values ​​using a calculation formula prepared in advance. Alternatively, the weight modification unit 240 may store weight values ​​corresponding to each security value as a map.

[0046] (Technical Effects) Next, technical effects obtained by the second information processing system 10 will be described.

[0047] As described in FIG. 4 , in the second information processing system 10, the weighting used when integrating the authentication results of the first authentication and the second authentication is changed based on the security value. In this way, it is possible to appropriately authenticate the target according to the level of security required for the integrated authentication result. Ear acoustic authentication has higher security than authentication using other modals (e.g., it is less likely to commit fraud such as impersonation). Therefore, by increasing the weighting of the first authentication according to the level of security required, it is possible to appropriately perform authentication.

[0048] <Third Embodiment> A third information processing system 10 will be described with reference to Fig. 5. Note that the third information processing system 10 only differs in some operations from the first and second information processing systems 10 described above, and other parts may be similar to the first and second information processing systems 10. Therefore, hereinafter, only parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0049] (Operation Flow) First, the operation flow in the third information processing system 10 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the operation flow of the third information processing system. Note that in Fig. 5, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0050] 5, when the operation of the third information processing system 10 is started, the weight modification unit 240 first acquires authentication status information (step S101). Then, the weight modification unit 240 changes the weight used by the authentication result integrating unit 230 based on the acquired authentication status information (step S102).

[0051] Next, the first authentication unit 210 performs the first authentication using the echo information (step S103). After that, the second authentication unit 220 determines whether the weight of the first authentication is equal to or greater than a predetermined value (step S301). The predetermined value is a threshold value that is set in advance to determine whether or not the second authentication needs to be performed. For example, the predetermined value is set as a value that causes the weight of the first authentication to be equal to or greater than the predetermined value in a situation where the second authentication does not need to be performed.

[0052] If the weight of the first authentication is not equal to or greater than the predetermined value (step S301: NO), the second authentication unit 220 executes the second authentication (step S104). Then, the authentication result integrating unit 230 integrates the authentication result of the first authentication and the authentication result of the second authentication using the weight changed by the weight changing unit 240 (step S105). Thereafter, the authentication result integrating unit 230 outputs the integrated authentication result (step S106).

[0053] On the other hand, if the weight of the first authentication is equal to or greater than the predetermined value (step S301: YES), the second authentication unit 220 omits the execution of the second authentication. That is, the processing of step S104 is skipped. In this case, the authentication result of the first authentication may be treated as the final authentication result (i.e., the integrated authentication result). Therefore, the processing of step S105 for integrating the authentication results may also be skipped. The third information processing system 10 may output information indicating that the execution of the second authentication will be omitted. For example, the third information processing system 10 may display a message such as "Second authentication has been skipped." On the other hand, even if the execution of the second authentication is omitted, the third information processing system 10 may not display information indicating this. That is, the third information processing system 10 may intentionally not inform the target that the second authentication process has been skipped.

[0054] Instead of omitting the second authentication described above, the second authentication unit 220 may execute the second authentication in a state where it is always determined to be successful. For example, the second authentication may be executed after setting the authentication threshold for the second authentication to a minimum value. In this case, the result of the second authentication will be successful, but the result of the integrated authentication will depend on the result of the first authentication, which has a higher weighting. Therefore, the same result as when the execution of the second authentication is essentially omitted can be obtained.

[0055] (Technical Effects) Next, technical effects obtained by the third information processing system 10 will be described.

[0056] As described in FIG. 5 , in the third information processing system 10, when the weight of the first authentication is equal to or greater than a predetermined value, the execution of the second authentication is omitted. That is, in a situation where the influence of the authentication result of the first authentication should be strongly reflected in the integrated authentication result, the execution of the second authentication, which should have a small influence, is omitted. In this way, the execution of the second authentication can be omitted without significantly changing the integrated authentication result. Therefore, it is possible to reduce the processing load on the system and shorten the time required for authentication without compromising the reliability of the authentication.

[0057] <Fourth Embodiment> A fourth information processing system 10 will be described with reference to Fig. 6. Note that the fourth information processing system 10 differs only in part of the configuration and operation from the first to third information processing systems 10 described above, and other parts may be similar to the first to third information processing systems 10. Therefore, hereinafter, only the parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0058] (Terminal Configuration) First, the terminal configuration of the fourth information processing system 10 will be described with reference to Fig. 6. Fig. 6 is a block diagram showing the terminal configuration of the fourth information processing system. Note that in Fig. 6, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0059] 6 , the fourth information processing system 10 is configured to include a first terminal 100 and a second terminal 200. The second terminal 200 includes, as processing blocks for realizing its functions, a first authentication unit 210, a second authentication unit 220, an authentication result integrating unit 230, and a weight changing unit 240. In particular, in the fourth information processing system 10, the weight changing unit 240 in the second terminal 200 includes a driving determination unit 242.

[0060] The driving determination unit 242 is configured to be able to determine whether the subject is driving a mobile object based on the authentication status information. Note that the mobile object in this embodiment is a broad concept that includes not only general vehicles such as automobiles and bicycles, but also ships, aircraft, etc. The authentication status information includes information for determining whether the subject is driving a mobile object. The authentication status information may include, for example, information indicating that the position of the subject and the position of the mobile object are the same. The authentication status information may include, for example, information indicating that the moving speed of the subject has reached a predetermined speed (for example, the moving speed of the mobile object). The fourth information processing system 10 may acquire the authentication status information, for example, in cooperation with a system installed in the mobile object driven by the subject.

[0061] The weight modification unit 240 in the fourth information processing system 10 is configured to be able to modify the weight based on the determination result of the driving determination unit 242. Specifically, when the subject is driving a mobile object, the weight modification unit 240 modifies the weight of the first authentication so as to be larger than when the subject is not driving a mobile object. Furthermore, when the subject is driving a mobile object, as described in the third embodiment above, the second authentication unit 220 may omit execution of the second authentication process. Note that the weight modification unit 240 may modify the weight based not only on whether the subject is driving a mobile object but also on other information included in the authentication status information.

[0062] (Technical Effects) Next, technical effects obtained by the fourth information processing system 10 will be described.

[0063] As described in FIG. 6 , in the fourth information processing system 10, when the subject is driving a mobile object, the weight of the first authentication is increased. When the subject is driving, it is difficult for the subject to perform any action other than driving. For example, it is not easy to capture an image while driving and obtain the modal used for the second authentication. On the other hand, the reverberation information used for the first authentication can be obtained without any special operation as long as the first terminal 100 is worn on the ear. Therefore, when the subject is driving, it is possible to perform appropriate authentication by increasing the weight of the first authentication, which allows for reliable authentication even while driving.

[0064] Fifth Embodiment A fifth information processing system 10 will be described with reference to Fig. 7. The fifth information processing system 10 differs only in part of the configuration and operation from the first to fourth information processing systems 10 described above, and other parts may be similar to the first to fourth information processing systems 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0065] (Terminal Configuration) First, the terminal configuration of the fifth information processing system 10 will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the terminal configuration of the fifth information processing system. Note that in Fig. 7, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0066] 7 , the fifth information processing system 10 is configured to include a first terminal 100 and a second terminal 200. The second terminal 200 includes, as processing blocks for realizing its functions, a first authentication unit 210, a second authentication unit 220, an authentication result integrating unit 230, and a weight modification unit 240. In particular, in the fifth information processing system 10, the weight modification unit 240 in the second terminal 200 includes a swimming determination unit 243.

[0067] The swimming determination unit 243 is configured to be able to determine whether the subject is swimming based on the authentication status information. The authentication status information includes information for determining whether the subject is swimming. The authentication status information may include, for example, information indicating that the subject's location coincides with the location of a swimming facility (e.g., the ocean, a pool, etc.). The authentication status information may include, for example, information indicating that water has been detected around the subject.

[0068] The weight change unit 240 in the fifth information processing system 10 is configured to be able to change the weight based on the determination result of the swimming determination unit 243. Specifically, when the subject is swimming, the weight change unit 240 changes the weight of the first authentication so that it is larger than when the subject is not swimming. Furthermore, when the subject is swimming, as described in the third embodiment above, the second authentication unit 220 may omit execution of the second authentication process. Note that the weight change unit 240 may change the weight based not only on whether the subject is swimming but also on other information included in the authentication status information.

[0069] (Technical Effects) Next, technical effects obtained by the fifth information processing system 10 will be described.

[0070] As described with reference to FIG. 7 , in the fifth information processing system 10, the weight of the first authentication is increased when the subject is swimming. When the subject is swimming, it is difficult for the subject to perform any action other than swimming. For example, it is not easy to capture an image while swimming and obtain a modal to be used for the second authentication. On the other hand, the reverberation information to be used for the first authentication can be obtained without any special operation as long as the first terminal 100 is worn on the ear. Therefore, when the subject is swimming, it is possible to perform appropriate authentication by increasing the weight of the first authentication, which allows for reliable authentication even while swimming.

[0071] In the fourth and fifth embodiments described above, examples of configurations for determining when the user is driving or swimming have been given, but similar operations may be performed when determining other situations. Specifically, when it is determined that the user is in a situation in which the user's movements are restricted (for example, when the user is unable to move their hands or face freely), the weight change unit 240 may increase the weight of the first authentication process, which can be performed even when the user's movements are restricted.

[0072] Sixth Embodiment A mobile terminal will be described with reference to Figures 8 and 9. The mobile terminal 500 may be configured as one of the terminals included in the first to fifth information processing systems 10 described above, and its configuration and operation may be similar to those described in the first to fifth information processing systems 10. Therefore, the following will describe in detail the parts that are different from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0073] (Terminal Configuration) First, the configuration of the mobile terminal will be described with reference to Fig. 8. Fig. 8 is a block diagram showing the functional configuration of the mobile terminal. Note that in Fig. 8, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0074] 8, the mobile terminal 500 is configured as a terminal such as a smartphone, a tablet terminal, a watch-type terminal, an HMD terminal, etc. The mobile terminal 500 includes an authentication result integrating unit 230 and a weight changing unit 240 as processing blocks for realizing its functions.

[0075] The authentication result integrating unit 230 and the weight changing unit 240 may be the same as those included in the information processing system 10 described in the first to fifth embodiments. Furthermore, the portable terminal 500 may include at least one of the first authentication unit 210 and the second authentication unit 220. When the portable terminal 500 includes the first authentication unit 210 and the second authentication unit 220, the authentication result integrating unit 230 may acquire the authentication results from the first authentication unit 210 and the second authentication unit 220. When the portable terminal 500 does not include the first authentication unit 210 and the second authentication unit 220, the authentication result integrating unit 230 may acquire the authentication results from another terminal that can perform the first authentication and the second authentication.

[0076] (Operation Flow) Next, the operation flow in the mobile terminal 500 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the operation flow of the mobile terminal. Note that in Fig. 9, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0077] 9 , when the operation of the mobile terminal 500 is started, the weight change unit 240 first acquires authentication status information (step S601). Then, the weight change unit 240 changes the weight used by the authentication result integrating unit 230 based on the acquired authentication status information (step S602).

[0078] Next, the authentication result integrating unit 230 acquires the authentication result of the first authentication using the echo sound information (step S603). The authentication result integrating unit 230 also acquires the authentication result of the second authentication using information other than the echo sound information (step S604). Note that the processing of step S603 and the processing of step S604 may be executed one after the other, or may be executed simultaneously in parallel. That is, the order in which the authentication results of the first authentication and the second authentication are acquired is not particularly limited.

[0079] Next, the authentication result integrating unit 230 integrates the authentication result of the first authentication and the authentication result of the second authentication using the weights changed by the weight changing unit 240 (step S605), and outputs the integrated authentication result (step S606).

[0080] (Technical Effects) Next, technical effects obtained by the mobile terminal 500 will be described.

[0081] As described with reference to Figures 8 and 9, the portable terminal 500 changes the weighting when integrating the authentication results of the first authentication and the second authentication, depending on the authentication status information. This makes it possible to appropriately execute the target authentication process depending on the situation when performing authentication. For example, if the situation is such that the first authentication should be prioritized over the second authentication, a more appropriate integrated authentication result can be obtained by increasing the weighting of the first authentication. Also, if the situation is such that the second authentication should be prioritized over the first authentication, a more appropriate integrated authentication result can be obtained by decreasing the weighting of the first authentication.

[0082] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0083] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0084] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0085] (Supplementary Note 1) The information processing system described in Supplementary Note 1 is an information processing system including: first authentication means that performs a first authentication using reverberation sound that reverberates in the ear of a target; second authentication means that performs a second authentication on the target that is different from the first authentication; authentication result integrating means that outputs an integrated authentication result that integrates a result of the first authentication and a result of the second authentication; and weight changing means that changes a weight when integrating a result of the first authentication and a result of the second authentication based on authentication status information that is information on at least one of a time, a location, and an environment in which the first authentication and the second authentication are performed.

[0086] (Appendix 2) The information processing system described in Appendix 2 is the information processing system described in Appendix 1, wherein the weight change means estimates a security value indicating the level of security required for the integrated authentication result based on the authentication status information, and changes the weight of the first authentication so that the higher the security value is, the larger the weight of the first authentication.

[0087] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 1 or 2, in which the second authentication means omits execution of the second authentication when the weight of the first authentication is changed by the weight change means to a predetermined value or greater.

[0088] (Supplementary Note 4) The information processing system described in Supplementary Note 4 is the information processing system described in Supplementary Note 1 or 2, wherein the authentication status information includes information indicating whether the subject is driving a mobile object, and the weight change means changes the weight of the first authentication to be larger when the subject is driving compared to when the subject is not driving.

[0089] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in Appendix 1 or 2, wherein the authentication status information includes information indicating whether the subject is swimming or not, and the weight change means changes the weight of the first authentication to be larger when the subject is swimming compared to when the subject is not swimming.

[0090] (Supplementary Note 6) The mobile terminal described in Supplementary Note 6 is a mobile terminal including: an authentication result integrating means that outputs an integrated authentication result that integrates a result of a first authentication using reverberation sound that has reverberated in the ear of a target person and a result of a second authentication that is different from the first authentication; and a weight changing means that changes a weight when integrating the result of the first authentication and the result of the second authentication, based on authentication status information that is information on at least one of the time, location, and environment in which the first authentication and the second authentication are performed.

[0091] (Supplementary Note 7) The information processing method described in Supplementary Note 7 is an information processing method that, by at least one computer, performs a first authentication using reverberation sounds that reverberate in a target's ear, performs a second authentication on the target that is different from the first authentication, outputs an integrated authentication result that integrates a result of the first authentication and a result of the second authentication, and changes weights when integrating a result of the first authentication and a result of the second authentication based on authentication status information that is information on at least one of a time, a location, and an environment in which the first authentication and the second authentication are performed.

[0092] (Supplementary Note 8) The recording medium described in Supplementary Note 8 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises: performing a first authentication using reverberant sounds reverberating in the ears of a target; performing a second authentication on the target that is different from the first authentication; outputting an integrated authentication result that integrates a result of the first authentication and a result of the second authentication; and changing weights when integrating a result of the first authentication and a result of the second authentication, based on authentication status information that is information on at least one of a time, a location, and an environment in which the first authentication and the second authentication are performed.

[0093] (Supplementary Note 9) The computer program described in Supplementary Note 9 is a computer program that causes at least one computer to execute an information processing method, which includes performing a first authentication using reverberant sounds that reverberate in a target's ears, performing a second authentication on the target that is different from the first authentication, outputting an integrated authentication result that integrates a result of the first authentication and a result of the second authentication, and changing a weight when integrating a result of the first authentication and a result of the second authentication, based on authentication status information that is information on at least one of a time, a location, and an environment in which the first authentication and the second authentication are performed.

[0094] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, mobile terminals, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0095] REFERENCE SIGNS LIST 10 Information processing system 11 Processor 100 First terminal 200 Second terminal 210 First authentication unit 220 Second authentication unit 230 Authentication result integration unit 240 Weight change unit 241 Security value estimation unit 242 Driving determination unit 243 Swimming determination unit 500 Portable terminal

Claims

1. An information processing system comprising: a first authentication means for performing a first authentication using a sound reverberating in a target's ear; a second authentication means for performing a second authentication on the target which is different from the first authentication; an authentication result integrating means for outputting an integrated authentication result which integrates a result of the first authentication and a result of the second authentication; and a weight changing means for changing a weight when integrating a result of the first authentication and a result of the second authentication based on authentication status information which is information on at least one of a time, a location, and an environment in which the first authentication and the second authentication are performed.

2. The information processing system according to claim 1, wherein the weight change means estimates a security value indicating the level of security required for the integrated authentication result based on the authentication status information, and changes the weight of the first authentication to be larger as the security value becomes higher.

3. The information processing system according to claim 1 or 2, wherein the second authentication means omits execution of the second authentication when the weight of the first authentication is changed by the weight changing means to a predetermined value or more.

4. An information processing system as described in claim 1 or 2, wherein the authentication status information includes information indicating whether or not the subject is driving a mobile object, and the weight change means changes the weight of the first authentication to be larger when the subject is driving compared to when the subject is not driving.

5. An information processing system as described in claim 1 or 2, wherein the authentication status information includes information indicating whether the subject is swimming or not, and the weight change means changes the weight of the first authentication to be larger when the subject is swimming compared to when the subject is not swimming.

6. A mobile terminal comprising: an authentication result integrating means for outputting an integrated authentication result obtained by integrating a result of a first authentication using a sound reflected in a target's ear and a result of a second authentication different from the first authentication; and a weight changing means for changing a weight when integrating the result of the first authentication and the result of the second authentication based on authentication status information which is information related to at least one of the time, location, and environment in which the first authentication and the second authentication are performed.

7. An information processing method comprising: performing, by at least one computer, a first authentication using sound reverberating in a target's ear; performing a second authentication on the target that is different from the first authentication; outputting an integrated authentication result that integrates the result of the first authentication and the result of the second authentication; and changing weights when integrating the result of the first authentication and the result of the second authentication based on authentication status information that is information regarding at least one of the time, location, and environment in which the first authentication and the second authentication are performed.

8. A recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, the method comprising: performing a first authentication using sound reverberating in the ears of a target; performing a second authentication on the target that is different from the first authentication; outputting an integrated authentication result that integrates the results of the first authentication and the second authentication; and changing weights when integrating the results of the first authentication and the second authentication based on authentication status information that is information on at least one of the time, location, and environment in which the first authentication and the second authentication are performed.

Images