Information processing system, information processing method, and recording medium

Abstract

This information processing system comprises: a control means for controlling a first terminal, worn on the ear of a user in a second region that includes a first region, to cause a sound wave to be transmitted from the first terminal, and to output an echo sound signal based on an echo sound resulting from the sound wave being echoed in the user's ear; and an output means for outputting information indicating whether or not it is acceptable for the user to enter or exit the first region, on the basis of the result of biometric authentication using the echo sound signal. According to such an information processing system, entry to and exit from the first region can be appropriately managed.

Description

Information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium.

[0002] There are known techniques for performing authentication processing using reverberation sounds inside the ear. For example, Patent Document 1 discloses a technique for emitting a predetermined reference sound into the ear and performing user authentication using the frequency characteristics of the reflected sound. Patent Document 2 discloses a technique for comparing the characteristics of acquired ear canal reverberation sounds with the characteristics of ear canal reverberation sounds of a pre-registered authorized user, and successfully authenticating the user if the degree of similarity is above a certain level.

[0003] JP 2010-086328 A JP 2019-113947 A

[0004] This disclosure aims to improve upon the techniques disclosed in the prior art documents.

[0005] One aspect of the information processing system disclosed herein comprises a control means for controlling a first terminal worn on the ear of a user in a second area including a first area to emit sound waves from the first terminal and output an echo signal based on the echo sound that reverberates in the user's ear from the sound waves, and an output means for outputting information indicating whether the user can enter or exit the first area based on the result of biometric authentication using the echo signal.

[0006] One aspect of the information processing method disclosed herein involves using at least one computer to send out sound waves from a first terminal worn on the ear of a user in a second area including a first area, control the first terminal to output an echo signal based on the echo sound that reverberates in the user's ear from the sound waves, and output information indicating whether the user can enter or exit the first area based on the results of biometric authentication using the echo signal.

[0007] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes transmitting sound waves from a first terminal worn on the ear of a user in a second area including a first area, controlling the first terminal to output an echo signal based on the echo sound that reverberates in the user's ear from the sound waves, and outputting information indicating whether the user can enter or exit the first area based on the results of biometric authentication using the echo signal.

[0008] 1 is a block diagram showing the hardware configuration of an information processing system according to a first embodiment. FIG. 2 is a block diagram showing the functional configuration of an information processing system according to a first embodiment. FIG. 3 is a flowchart showing the flow of operation of an information processing system according to a first embodiment. FIG. 4 is a block diagram showing the functional configuration of an information processing system according to a second embodiment. FIG. 5 is a flowchart showing the flow of operation of an information processing system according to a second embodiment. FIG. 6 is a block diagram showing the functional configuration of an information processing system according to a third embodiment. FIG. 7 is a flowchart showing the flow of operation of an information processing system according to a third embodiment. FIG. 8 is a block diagram showing the functional configuration of an information processing system according to a fourth embodiment. FIG. 9 is a flowchart showing the flow of operation of an information processing system according to a fourth embodiment. FIG. 10 is a block diagram showing the functional configuration of an information processing system according to a fifth embodiment. FIG. 11 is a flowchart showing the flow of operation of an information processing system according to a fifth embodiment. FIG. 12 is a block diagram showing the functional configuration of an information processing system according to a sixth embodiment. FIG. 13 is a plan view showing an example of an area where entry and exit are managed by an information processing system according to a sixth embodiment.

[0009] Hereinafter, embodiments of an information processing system, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 3. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0012] 1 , an information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, and a ROM (Read Only Memory) 13. The information processing system 10 may further include a storage device 14, an input device 15, and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected via a data bus 17.

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks for performing ear acoustic authentication processing and user entry / exit management are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing system 10.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing system 10 as audio.

[0020] 1 may be provided as an external device of the information processing system 10. For example, the information processing system 10 may be configured to include only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., the storage device 14, the input device 15, and the output device 16) may be provided in an external device connected to the information processing system 10. Furthermore, some of the calculation functions of the information processing system 10 may be realized by an external device (e.g., an external server, a cloud, etc.).

[0021] (Functional Configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0022] In FIG. 2 , the information processing system 10 according to the first embodiment is configured as a system for managing entry and exit of a user in a second area to and from the first area. The first area is included in the second area and is accessible from the second area. For example, the first and second areas may be connected by a door (entrance / exit). The first area may be defined as an area within a predetermined distance from the second area. The first area is an area from which only pre-registered users are permitted to enter. An example of the first area is a warehouse where confidential information is stored. Alternatively, the second area may be an area from which only pre-registered users are permitted to exit. When a user attempts to enter or exit the first area from the second area, the information processing system 10 according to the first embodiment performs earacoustic authentication to determine whether the user is permitted to enter or exit. Earacoustic authentication is biometric authentication that uses reverberation in the user's ear. Existing technologies can be appropriately adopted for specific earacoustic authentication techniques, and therefore detailed description thereof will be omitted here.

[0023] 2, the information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, a control unit 110 and an information output unit 120. Each of the control unit 110 and the information output unit 120 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0024] The control unit 110 controls a first terminal worn on the ear of a user in a second area including the first area. The control unit 110 may control the first terminal 210, for example, when an authentication instruction is received. The authentication instruction is an instruction output when ear acoustic authentication is performed. The authentication instruction may be output, for example, when the user approaches an entrance / exit of the first area. Alternatively, the authentication instruction may be output based on a user operation, etc. The authentication instruction may include, for example, information indicating the location the user is attempting to enter (e.g., a door key ID). The specific configuration of the device that outputs the authentication instruction will be described in detail in another embodiment described later.

[0025] The control unit 110 is configured to be able to acquire a reverberant sound signal including characteristics of the user's ear (specifically, characteristics of the internal shape of the ear) by controlling the first terminal 210. Here, the first terminal 210 may be, for example, an earphone-type hearable device. The first terminal 210 sends sound waves into the user's ear and outputs a reverberant sound signal based on the reverberant sound (i.e., a signal used for ear acoustic authentication). The reverberant sound signal is acquired by the control unit 110 and output to an authentication device 250 outside the system.

[0026] The authentication device 250 is configured to be able to perform earacoustic authentication using a reverberant sound signal. The authentication device 250 may perform earacoustic authentication, for example, by comparing features extracted from the reverberant sound signal with features of a pre-registered user. The authentication device 250 may perform earacoustic authentication as a cloud service. The authentication device 250 is configured to output the authentication result of the earacoustic authentication to the information output unit 120.

[0027] The information output unit 120 is configured to output information indicating whether the user is permitted to enter or exit the first area (hereinafter referred to as "entry / exit information") based on the authentication result of the authentication device 250. When it is determined through ear acoustic authentication that the user has authority to enter the first area or to exit the second area, the information output unit 120 may output entry / exit information permitting the user to enter the first area. Furthermore, when it is determined through ear acoustic authentication that the user does not have authority to enter the first area, the information output unit 120 may output entry / exit information prohibiting the user from entering the first area. The entry / exit information may include, for example, key information for unlocking a door leading to the first area. Alternatively, the entry / exit information may include, for example, control information for controlling the opening and closing of a door or gate leading to the first area.

[0028] (Operation Flow) Next, the operation flow of the information processing system 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the operation flow of the information processing system according to the first embodiment.

[0029] 3, when the information processing system 10 according to the first embodiment starts operating, the control unit 110 first determines whether an authentication instruction has been received (step S101). If an authentication instruction has not been received (step S101: NO), the subsequent processing may be omitted. In this case, the processing of step S101 may be executed again after a predetermined period of time.

[0030] If an authentication instruction has been received (step S101: YES), the control unit 110 controls the first terminal 210 to emit sound waves into the user's ear (step S102), and then acquires a reverberant sound signal from the first terminal 210 (step S103).

[0031] Next, the control unit 110 outputs information about the reverberant sound signal to the authentication device 250 and instructs it to perform earacoustic authentication (step S104). As a result, the authentication device 250 performs earacoustic authentication of the user.

[0032] Thereafter, the information output unit 120 acquires the authentication result of the ear acoustic authentication from the authentication device 250 (step S105). Then, the information output unit 120 outputs entry / exit permission information indicating whether the user is permitted to enter or exit the first area based on the authentication result (step S106).

[0033] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0034] As described with reference to FIGS. 1 to 3 , in the information processing system 10 according to the first embodiment, earacoustic authentication is performed when a user attempts to enter the first area. Then, based on the result of the earacoustic authentication, entry / exit permission information indicating whether the user is permitted to enter or exit the first area is output. In this manner, earacoustic authentication can be used to appropriately manage user entry and exit into the first area. For example, if earacoustic authentication identifies a user as having permission to enter the first area, the user can be quickly permitted to enter. In particular, in this embodiment, there is no need to use a physical key to manage user entry and exit, which can prevent key management from becoming complicated, for example, when multiple people use the same key.

[0035] Second Embodiment An information processing system 10 according to a second embodiment will be described with reference to Figures 4 and 5. Note that the second embodiment differs from the first embodiment described above only in some of its operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit a description of other overlapping parts as appropriate.

[0036] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the second embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the functional configuration of the information processing system according to the second embodiment. Note that in Fig. 4, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0037] As shown in Fig. 4, the information processing system 10 according to the second embodiment is configured to include, as components for realizing its functions, a control unit 110, an information output unit 120, and an authentication unit 130. That is, the information processing system 10 according to the second embodiment further includes the authentication unit 130 in addition to the configuration of the first embodiment (see Fig. 2). The authentication unit 130 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0038] The authentication unit 130 is configured to be able to perform earacoustic authentication using the reverberant sound signal input from the control unit 110. That is, the authentication unit 130 has the same functions as the authentication device 250 (see FIG. 2 ) described in the first embodiment. The authentication unit 130 may perform earacoustic authentication, for example, by comparing features extracted from the reverberant sound signal with features of pre-registered users. The authentication unit 130 may include a storage unit that stores the features of registered users. Alternatively, the authentication unit 130 may be configured to appropriately read out features of registered users stored externally and perform earacoustic authentication. The authentication result of the earacoustic authentication in the authentication unit 130 is configured to be output to the information output unit 120.

[0039] (Operation Flow) Next, the operation flow of the information processing system 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the operation flow of the information processing system according to the second embodiment. Note that in Fig. 5, the same processes as those described in Fig. 3 are denoted by the same reference numerals.

[0040] 5, when the information processing system 10 according to the second embodiment starts operating, the control unit 110 first determines whether an authentication instruction has been received (step S101). If an authentication instruction has not been received (step S101: NO), the subsequent processing may be omitted. In this case, the processing of step S101 may be executed again after a predetermined period of time.

[0041] If an authentication instruction has been received (step S101: YES), the control unit 110 controls the first terminal 210 to emit sound waves into the user's ear (step S102), and then acquires a reverberant sound signal from the first terminal 210 (step S103).

[0042] Next, the authentication unit 130 performs ear acoustic authentication using the reverberant sound signal acquired from the first terminal 210 (step S201). Then, the information output unit 120 outputs entry / exit permission information indicating whether the user is permitted to enter or exit the first area based on the authentication result of the authentication unit 130 (step S106).

[0043] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0044] 4 and 5, in the information processing system 10 according to the second embodiment, earacoustic authentication is performed by the authentication unit 130. In this way, it is possible to properly perform earacoustic authentication using the reverberant sound signal acquired from the first terminal. In the first embodiment described above, earacoustic authentication is performed by an authentication device 250 external to the system, but in the second embodiment, processing related to earacoustic authentication is completed by the authentication unit 130 inside the system.

[0045] Third Embodiment An information processing system 10 according to a third embodiment will be described with reference to Figures 6 and 7. The third embodiment differs from the first and second embodiments only in part of the configuration and operation, and other parts may be the same as the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0046] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the third embodiment will be described with reference to Fig. 6. Fig. 6 is a block diagram showing the functional configuration of the information processing system according to the third embodiment. Note that in Fig. 6, the same elements as those described in Fig. 4 are denoted by the same reference numerals.

[0047] As shown in Fig. 6, the information processing system 10 according to the third embodiment is configured to include, as components for realizing its functions, a control unit 110, an information output unit 120, an authentication unit 130, and an instruction output unit 140. That is, the information processing system 10 according to the third embodiment further includes, in addition to the configuration of the second embodiment (see Fig. 4), an instruction output unit 140. The instruction output unit 140 may be a processing block realized by, for example, the above-described processor 11 (see Fig. 1).

[0048] The instruction output unit 140 is configured to be able to output an authentication instruction to the control unit 110. Specifically, the instruction output unit 140 is configured to output the authentication instruction when the user approaches within a predetermined distance from the entrance / exit of the first area. Note that the "predetermined distance" here is a distance that is set in advance for determining whether or not the user intends to enter the first area or whether or not the user intends to exit the second area.

[0049] Whether the user has approached within a predetermined distance may be determined, for example, by transmitting radio waves (e.g., Bluetooth) that can be received within a predetermined distance from near the entrance / exit of the first area. Specifically, a Bluetooth Low Energy (BLE) beacon may be installed near the entrance / exit of the first area, and an authentication instruction may be output when a terminal carried by the user receives the radio waves transmitted by the BLE beacon. In this way, it is possible to appropriately determine whether the user has approached within a predetermined distance. However, the method for determining the user's approach is not limited to the above example. For example, the user's approach may be determined by acquiring user location information using a GPS (Global Positioning System) or various sensors.

[0050] (Operation Flow) Next, the operation flow of the information processing system 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the operation flow of the information processing system according to the third embodiment. Note that in Fig. 7, the same processes as those described in Fig. 5 are denoted by the same reference numerals.

[0051] 7 , when the information processing system 10 according to the third embodiment starts operating, the instruction output unit 140 first determines whether the user is approaching within a predetermined distance from the entrance / exit of the first area (step S301). If the user is not approaching within the predetermined distance (step S301: NO), the subsequent processing may be omitted. In this case, the processing of step S301 may be executed again after a predetermined period of time.

[0052] If the user is approaching within the predetermined distance (step S301: YES), the instruction output unit 140 outputs an authentication instruction to the control unit 110 (step S302). The control unit 110 receives this authentication instruction and controls the first terminal 210 to emit sound waves into the user's ear (step S102). The control unit 110 then acquires a reverberant sound signal from the first terminal 210 (step S103).

[0053] Next, the authentication unit 130 performs ear acoustic authentication using the reverberant sound signal acquired from the first terminal 210 (step S201). Then, the information output unit 120 outputs entry / exit permission information indicating whether the user is permitted to enter or exit the first area based on the authentication result of the authentication unit 130 (step S106).

[0054] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0055] 6 and 7, in the information processing system 10 according to the third embodiment, an authentication instruction is output when the user approaches within a predetermined distance from the entrance / exit of the first area. In this way, the user's intention to enter the first area can be determined using the distance to the user, and the authentication instruction can be output at an appropriate time.

[0056] Fourth Embodiment An information processing system 10 according to a fourth embodiment will be described with reference to Figures 8 and 9. The fourth embodiment differs only in part of the configuration and operation from the first to third embodiments described above, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0057] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram showing the functional configuration of the information processing system according to the fourth embodiment. Note that in Fig. 8, the same elements as those described in Fig. 6 are denoted by the same reference numerals.

[0058] As shown in Fig. 8, the information processing system 10 according to the fourth embodiment is configured to include, as components for realizing its functions, a control unit 110, an information output unit 120, an authentication unit 130, an instruction output unit 140, and a storage unit 150. That is, the information processing system 10 according to the fourth embodiment further includes a storage unit 150 in addition to the configuration of the third embodiment (see Fig. 6). The storage unit 150 may be realized by, for example, the above-mentioned storage device 14 (see Fig. 1).

[0059] The storage unit 150 is configured to be able to store a user ID, which is information set for each user, and a key ID, which is information set for each electronic lock (in other words, for each door), in association with each other. The storage unit 150 stores a user ID in association with an ID corresponding to an electronic lock that the user has authority to unlock. For example, if user A has authority to unlock electronic lock a, the storage unit 150 stores the user ID of user A in association with the key ID of electronic lock a. Note that a user ID may be stored in association with multiple key IDs. For example, if user B has authority to unlock electronic locks b and c, the storage unit 150 may store the user ID of user B in association with the key IDs of electronic locks b and c.

[0060] The information stored in the storage unit 150 can be read out as needed by the information output unit 120. The information output unit 120 according to the fourth embodiment is configured to be able to output information for unlocking an electronic lock associated with a user identified by ear acoustic authentication (hereinafter referred to as "electronic lock information" as needed). For example, the information output unit 120 identifies a user ID from the authentication result of the ear acoustic authentication. Then, the information output unit 120 reads out a key ID stored in association with the identified user ID from the storage unit 150, and outputs the electronic lock information corresponding to the read key ID.

[0061] (Operation Flow) Next, the operation flow of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the operation flow of the information processing system according to the fourth embodiment. Note that in Fig. 9, the same processes as those described in Fig. 7 are denoted by the same reference numerals.

[0062] 9 , when the information processing system 10 according to the fourth embodiment starts operating, the instruction output unit 140 first determines whether the user is approaching within a predetermined distance from the entrance / exit of the first area (step S301). If the user is not approaching within the predetermined distance (step S301: NO), the subsequent processing may be omitted. In this case, the processing of step S301 may be executed again after a predetermined period of time.

[0063] If the user is approaching within the predetermined distance (step S301: YES), the instruction output unit 140 outputs an authentication instruction to the control unit 110 (step S302). The control unit 110 receives this authentication instruction and controls the first terminal 210 to emit sound waves into the user's ear (step S102). The control unit 110 then acquires a reverberant sound signal from the first terminal 210 (step S103).

[0064] Next, the authentication unit 130 performs earacoustic authentication using the echo signal acquired from the first terminal 210 (step S201). The information output unit 120 then determines whether the user identified through earacoustic authentication has the authority to unlock the electronic lock (step S401). For example, the information output unit 120 determines whether the user ID identified through earacoustic authentication and the key ID of the door through which the user is attempting to enter are associated and stored in the storage unit 150. If the user ID and key ID are associated and stored, the information output unit 120 determines that the user has the authority to unlock the door (step S401: YES) and outputs the electronic lock information (step S402). On the other hand, if the user ID and key ID are not associated and stored, the information output unit 120 determines that the user does not have the authority to unlock the door (step S401: NO) and does not output the electronic lock information (i.e., step S402 is omitted).

[0065] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0066] 8 and 9, in the information processing system 10 according to the fourth embodiment, a user ID and a key ID are stored in association with each other according to the user's unlocking authority. This allows the unlocking authority of each user to be appropriately managed. When a user is determined to have unlocking authority through ear acoustic authentication, information for unlocking the electronic lock is output, thereby appropriately permitting the user to enter.

[0067] Fifth Embodiment An information processing system 10 according to a fifth embodiment will be described with reference to Figures 10 and 11. The fifth embodiment differs only in part of the configuration and operation from the first to fourth embodiments described above, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0068] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the information processing system according to the fifth embodiment. Note that in Fig. 10, the same elements as those described in Fig. 8 are denoted by the same reference numerals.

[0069] 10 , the information processing system 10 according to the fifth embodiment is configured to include a second terminal 220 and a server terminal 230. The second terminal 220 includes, as components for realizing its functions, a control unit 110 and an information output unit 120. The server terminal 230 includes, as components for realizing its functions, an authentication unit 130, an instruction output unit 140, and a storage unit 150.

[0070] The second terminal 220 is a terminal held by a user. Examples of the second terminal 220 include a mobile terminal such as a smartphone or a smartwatch. In this case, each component of the second terminal 220 (i.e., the control unit 110 and the information output unit 120) may be realized by an app installed on the mobile terminal.

[0071] The server terminal 230 is a terminal configured to be able to communicate with the second terminal 220. The server terminal 230 may be composed of multiple terminals. For example, the server terminal 230 may include multiple terminals installed in remote locations. The server terminal 230 is configured to perform ear acoustic authentication using information related to the reverberant sound signal received from the second terminal 220, and to output electronic lock information for unlocking the electronic lock.

[0072] The information output unit 120 according to this embodiment is configured to output electronic lock information when the second terminal 220 is a terminal owned by the user. That is, the information output unit 120 outputs electronic lock information when the second terminal 220 is a terminal owned by the user (in other words, when it is not a terminal owned by another person). To prove that the second terminal 220 is the user's own terminal, the terminal ID can be stored in the second terminal 220 and sent to the cloud to link the terminal ID to the terminal owner. In this way, only the terminal ID is stored in the second terminal 220, thereby reducing the risk of, for example, losing the second terminal 220. That is, even if the second terminal 220 is lost, this does not directly result in the leakage of the key, thereby improving the security of key management.

[0073] (Operation Flow) Next, the operation flow of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the operation flow of the information processing system according to the fifth embodiment. Note that in Fig. 11, the same processes as those described in Fig. 9 are denoted by the same reference numerals.

[0074] 11 , when the information processing system 10 according to the fifth embodiment starts operating, the instruction output unit 140 first determines whether the user is approaching within a predetermined distance from the entrance / exit of the first area (step S301). If the user is not approaching within the predetermined distance (step S301: NO), the subsequent processing may be omitted. In this case, the processing of step S301 may be executed again after a predetermined period of time.

[0075] If the user is approaching within a predetermined distance (step S301: YES), the instruction output unit 140 determines whether the second terminal 220 is the user's terminal (step S501). If the second terminal 220 is not the user's terminal (step S501: NO), the subsequent processing is omitted. Therefore, if the second terminal 220 is someone else's terminal, the electronic lock information is not output.

[0076] On the other hand, if the second terminal 220 is not the user's terminal (step S501: NO), the instruction output unit 140 outputs an authentication instruction to the control unit 110 (step S302). The control unit 110, having received this authentication instruction, controls the first terminal 210 to emit sound waves into the user's ear (step S102). The control unit 110 then acquires a reverberant sound signal from the first terminal 210 (step S103).

[0077] Next, the authentication unit 130 performs earacoustic authentication using the echo signal acquired from the first terminal 210 (step S201). The information output unit 120 then determines whether the user identified through earacoustic authentication has the authority to unlock the electronic lock (step S401). For example, the information output unit 120 determines whether the user ID identified through earacoustic authentication and the key ID of the door through which the user is attempting to enter are associated and stored in the storage unit 150. If the user ID and key ID are associated and stored, the information output unit 120 determines that the user has the authority to unlock the door (step S401: YES) and outputs the electronic lock information (step S402). On the other hand, if the user ID and key ID are not associated and stored, the information output unit 120 determines that the user does not have the authority to unlock the door (step S401: NO) and does not output the electronic lock information (i.e., step S402 is omitted).

[0078] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the fifth embodiment will be described.

[0079] 10 and 11 , in the information processing system 10 according to the fifth embodiment, electronic lock information is output when the second terminal 220 belongs to the user, but is not output when the second terminal 220 does not belong to the user. In this way, the condition for outputting electronic lock information is that the user holding the second terminal 220 is near the door, as well as that the second terminal 220 belongs to the user, thereby achieving higher security.

[0080] Sixth Embodiment An information processing system 10 according to a sixth embodiment will be described with reference to Figures 12 and 13. Note that the sixth embodiment differs only in part of the configuration and operation from the first to fifth embodiments described above, and other parts may be the same as the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0081] (Functional Configuration) First, the functional configuration of the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the functional configuration of the information processing system according to the sixth embodiment. Note that in Fig. 12, the same elements as those described in Fig. 10 are denoted by the same reference numerals.

[0082] 12 , the information processing system 10 according to the sixth embodiment is configured to include a second terminal 220 and a server terminal 230. That is, the information processing system 10 according to the sixth embodiment has the same configuration as the configuration of the fifth embodiment (see FIG. 10 ). On the other hand, the first terminal 210 according to the sixth embodiment is configured to include a right ear terminal 211 and a left ear terminal 212.

[0083] The right ear terminal 211 is a terminal worn on the user's right ear. The right ear terminal 211 is configured to be able to output a reverberation sound signal based on the reverberation sound reverberating in the user's right ear by sending sound waves to the user's right ear. The left ear terminal 212 is a terminal worn on the user's left ear. The left ear terminal 211 is configured to be able to output a reverberation sound signal based on the reverberation sound reverberating in the user's left ear by sending sound waves to the user's left ear. In this way, the first terminal 210 according to the sixth embodiment is configured to output reverberation sound signals for each of the user's right and left ears.

[0084] The information processing system 10 according to the sixth embodiment is configured to output electronic lock information using echo signals from the user's right and left ears. Specifically, the authentication unit 130 according to the sixth embodiment is configured to be able to separately perform an authentication process using an echo signal from the right ear (hereinafter referred to as "right ear authentication") and an authentication process using an echo signal from the left ear (hereinafter referred to as "left ear authentication"). The information output unit 120 according to the sixth embodiment is configured to be able to output electronic lock information depending on the results of the right ear authentication and the left ear authentication.

[0085] (Operation Example) Next, a specific operation example of the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 13. Fig. 13 is a plan view showing an example of an area where entry and exit are managed by the information processing system according to the sixth embodiment.

[0086] As shown in Fig. 13, in the information processing system 10 according to the sixth embodiment, a first predetermined area and a second predetermined area are set as areas into which a user may enter. The second predetermined area is an area requiring higher security than the first predetermined area. For example, the second predetermined area is an area where more confidential materials are stored than in the first predetermined area. The first predetermined area can be entered from the outside through door A. The second predetermined area can be entered from the first predetermined area through door B.

[0087] In particular, the first predetermined area is set as an area that can be entered if at least one of right ear authentication and left ear authentication is successful. Therefore, a user attempting to enter the first predetermined area through door A can enter the first predetermined area if either right ear authentication or left ear authentication is successful. On the other hand, the second predetermined area is set as an area that can be entered if both right ear authentication and left ear authentication are successful. Therefore, a user attempting to enter the second predetermined area through door B cannot enter the second predetermined area unless both right ear authentication and left ear authentication are successful.

[0088] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the sixth embodiment will be described.

[0089] 12 and 13 , in the information processing system 10 according to the sixth embodiment, if either the right ear authentication or the left ear authentication is successful, the door to the first predetermined area is unlocked, and if both the right ear authentication and the left ear authentication are successful, the door to the second predetermined area is unlocked. In this manner, multiple areas with different security levels can be set, and access to each area can be appropriately managed. While the present embodiment illustrates an example in which only ear acoustic authentication is used, ear acoustic authentication may also be combined with other biometric authentication (e.g., face authentication, iris authentication, fingerprint authentication, palm print authentication, voice authentication, etc.) to set more levels of security.

[0090] The scope of each embodiment also includes a method of recording a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments on a recording medium, reading the program recorded on the recording medium as code, and executing it on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0091] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0092] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0093] (Supplementary Note 1) The information processing system described in Supplementary Note 1 is an information processing system that includes a control means that controls a first terminal that is worn on the ear of a user in a second area that includes a first area to emit sound waves from the first terminal and output an echo signal based on the echo sound that reverberates in the user's ear from the sound waves, and an output means that outputs information indicating whether the user can enter or leave the first area based on the result of biometric authentication using the echo signal.

[0094] (Supplementary Note 2) The information processing system according to Supplementary Note 2 is the information processing system according to Supplementary Note 1, further comprising an authentication unit that performs biometric authentication using the feature amount of the reverberant sound signal.

[0095] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 1 or 2, further comprising an instruction output means for outputting an authentication instruction to cause the first terminal to emit sound waves when the user approaches within a predetermined distance of an entrance / exit of the first area.

[0096] (Supplementary Note 4) The information processing system described in Supplementary Note 4 is the information processing system described in Supplementary Note 3, wherein the instruction output means outputs the authentication instruction when receiving radio waves that can be received within the specified distance range.

[0097] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in any one of Appendices 1 to 4, in which the information indicating whether entry or exit is possible is information for unlocking an electronic lock at the entrance / exit of the first area.

[0098] (Appendix 6) The information processing system described in Appendix 6 is the information processing system described in Appendix 5, further comprising a storage means for storing a user ID, which is information set for each user, and a key ID, which is information set for each electronic lock, in association with each other, and the output means outputs information for unlocking the electronic lock corresponding to the key ID when the user ID of the user identified by the biometric authentication and the key ID of the entrance / exit used by the user are stored in association with each other.

[0099] (Appendix 7) The information processing system described in Appendix 7 is the information processing system described in any one of Appendices 1 to 6, wherein the control means is installed in a second terminal held by the user, and the output means outputs information indicating whether or not entry and exit are possible when the second terminal is a terminal owned by the user himself / herself.

[0100] (Appendix 8) The information processing system described in Appendix 8 is the information processing system described in any one of Appendices 1 to 7, wherein the first terminal comprises a right ear terminal that outputs a reverberation sound signal sound for the right ear and a left ear terminal that outputs a reverberation sound signal for the left ear, and the first area includes a first predetermined area that is permitted to enter if biometric authentication is successful for at least one of the reverberation sound signal acquired by the right ear terminal and the reverberation sound signal acquired by the left ear terminal, and a second predetermined area that is permitted to enter if biometric authentication is successful for both the reverberation sound signal acquired by the right ear terminal and the reverberation sound signal acquired by the left ear terminal.

[0101] (Supplementary Note 9) The information processing method described in Supplementary Note 9 is an information processing method in which at least one computer controls a first terminal worn on the ear of a user in a second area including a first area to transmit sound waves, the first terminal to output an echo signal based on the echo sound that reverberates in the user's ear from the sound waves, and outputs information indicating whether the user can enter or leave the first area based on the result of biometric authentication using the echo signal.

[0102] (Supplementary Note 10) The computer program described in Supplementary Note 10 is a computer program that causes at least one computer to execute an information processing method, which includes transmitting sound waves from a first terminal worn on the ear of a user in a second area including a first area, controlling the first terminal to output an echo signal based on the echo sound produced by the sound waves echoing in the user's ear, and outputting information indicating whether the user can enter or exit the first area based on the result of biometric authentication using the echo signal.

[0103] (Appendix 11) The recording medium described in Appendix 11 is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes transmitting sound waves from a first terminal worn on the ear of a user in a second area including a first area, controlling the first terminal to output an echo signal based on the echo sound produced by the sound waves echoing in the user's ear, and outputting information indicating whether the user can enter or exit the first area based on the result of biometric authentication using the echo signal.

[0104] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0105] To the extent permitted by law, this application claims priority based on Japanese Patent Application No. 2023-043385, filed March 17, 2023, the disclosure of which is incorporated herein in its entirety. Furthermore, to the extent permitted by law, all publications and papers mentioned in this specification are incorporated herein by reference.

[0106] REFERENCE SIGNS LIST 10 Information processing system 11 Processor 14 Storage device 110 Control unit 120 Information output unit 130 Authentication unit 140 Instruction output unit 150 Storage unit 210 First terminal 211 Right ear terminal 212 Left ear terminal 220 Second terminal 230 Server terminal 250 Authentication device

Claims

1. a control means for controlling a first terminal to transmit sound waves from the first terminal worn on an ear of a user in a second area including the first area, and to output an echo signal based on the echo sound generated by the sound waves echoing in the ear of the user; an output means for outputting information indicating whether the user is permitted to enter or leave the first area based on a result of the biometric authentication using the echo signal; An information processing system comprising:

2. further comprising an authentication means for performing biometric authentication using the feature of the reverberation signal; The information processing system according to claim 1 .

3. further comprising an instruction output means for outputting an authentication instruction to cause the first terminal to transmit a sound wave when the user approaches within a predetermined distance from an entrance / exit of the first area; 3. The information processing system according to claim 1 or 2.

4. the instruction output means outputs the authentication instruction when receiving a radio wave that can be received within the predetermined distance. The information processing system according to claim 3 .

5. The information indicating whether or not entry and exit is permitted is information for unlocking an electronic lock at an entrance and exit of the first area.

3. The information processing system according to claim 1 or 2.

6. The electronic lock system further includes a storage unit for storing a user ID, which is information set for each user, and a key ID, which is information set for each electronic lock, in association with each other; The output means outputs information for unlocking the electronic lock corresponding to the key ID when the user ID of the user identified by the biometric authentication and the key ID of the entrance / exit used by the user are stored in association with each other. The information processing system according to claim 5 .

7. the control means is mounted on a second terminal held by the user, the output means outputs information indicating whether or not the second terminal is permitted to enter or exit when the second terminal is a terminal owned by the user himself / herself.

3. The information processing system according to claim 1 or 2.

8. the first terminal includes a right-ear terminal for outputting a right-ear reverberation signal sound and a left-ear terminal for outputting a left-ear reverberation signal sound; The first area includes a first predetermined area into which entry is permitted when biometric authentication is successful for at least one of the reverberation sound signal acquired by the right ear terminal and the reverberation sound signal acquired by the left ear terminal, and a second predetermined area into which entry is permitted when biometric authentication is successful for both the reverberation sound signal acquired by the right ear terminal and the reverberation sound signal acquired by the left ear terminal.

3. The information processing system according to claim 1 or 2.

9. by at least one computer, controlling a first terminal to be worn on an ear of a user in a second area including the first area to emit a sound wave from the first terminal and to output an echo signal based on an echo of the sound wave echoed in the ear of the user; outputting information indicating whether the user is permitted to enter or leave the first area based on a result of the biometric authentication using the echo signal; Information processing methods.

10. At least one computer controlling a first terminal to be worn on an ear of a user in a second area including the first area to emit a sound wave from the first terminal and to output an echo signal based on an echo of the sound wave echoed in the ear of the user; outputting information indicating whether the user is permitted to enter or leave the first area based on a result of the biometric authentication using the echo signal; A computer program that executes an information processing method.