Information processing device, information processing system, and program

Abstract

An information processing device according to an embodiment of the present disclosure comprises: a first electrode and second electrode that can come into contact with a living body; and a processing unit that can generate first information used for authentication on the basis of the potential of the first electrode and the potential of the second electrode.

Description

Information Processing Apparatus, Information Processing System, and Program

[0001] The present disclosure relates to an information processing apparatus, an information processing system, and a program.

[0002] A control device has been proposed that performs personal authentication using electroencephalograms when eye closure is detected as a trigger action (Patent Document 1).

[0003] International Publication No. 2021 / 215266

[0004] In an apparatus that performs personal authentication, it is desirable to be able to execute appropriate authentication processing.

[0005] It is desired to provide an information processing apparatus that enables suitable authentication processing.

[0006] An information processing apparatus according to an embodiment of the present disclosure includes a first electrode and a second electrode that can contact a living body, and a processing unit that can generate first information for authentication based on the potential of the first electrode and the potential of the second electrode. An information processing system according to an embodiment of the present disclosure includes a measurement unit having a first electrode and a second electrode that can contact a living body, and an information processing apparatus having a processing unit that can generate first information for authentication based on the potential of the first electrode and the potential of the second electrode. A program according to an embodiment of the present disclosure causes a computer to execute processing including acquiring the potential of each of the first electrode and the second electrode that contacts a living body, and generating first information for authentication based on the potential of the first electrode and the potential of the second electrode.

[0007] Figure 1 is a diagram showing an example of the schematic configuration of an information processing device according to an embodiment of the present disclosure. Figure 2 is a diagram illustrating an example of the configuration of a measurement unit according to an embodiment of the present disclosure. Figure 3 is a diagram illustrating an example of the configuration of an information processing device according to an embodiment of the present disclosure. Figure 4A is a diagram illustrating an example of the configuration of an information processing device according to an embodiment of the present disclosure. Figure 4B is a diagram illustrating an example of the configuration of an information processing device according to an embodiment of the present disclosure. Figure 5 is a diagram showing an example of a biosignal obtained by an information processing device according to an embodiment of the present disclosure. Figure 6 is a diagram showing an example of a biosignal obtained by an information processing device according to an embodiment of the present disclosure. Figure 7A is a diagram illustrating an example of a presentation method by an information processing device according to an embodiment of the present disclosure. Figure 7B is a diagram illustrating an example of a presentation method by an information processing device according to an embodiment of the present disclosure. Figure 8A is a diagram illustrating an example of a presentation method by an information processing device according to an embodiment of the present disclosure. Figure 8B is a diagram illustrating an example of a presentation method by an information processing device according to an embodiment of the present disclosure. Figure 9 is a flowchart illustrating an example of the operation of an information processing device according to an embodiment of the present disclosure. Figure 10 is a flowchart illustrating an example of the operation of an information processing device according to an embodiment of the present disclosure. Figure 11 is a flowchart illustrating another example of operation of the information processing device according to an embodiment of the present disclosure. Figure 12 is a flowchart illustrating another example of operation of the information processing device according to an embodiment of the present disclosure. Figure 13 is a diagram illustrating an example of the configuration of the information processing device according to an embodiment of the present disclosure. Figure 14 is a diagram illustrating an example of the configuration of the information processing device according to an embodiment of the present disclosure. Figure 15 is a diagram illustrating an example of the configuration of the information processing device according to an embodiment of the present disclosure.

[0008] The embodiments of this disclosure will be described in detail below with reference to the drawings. The description will be in the following order: 0. Background 1. Embodiments 2. Modified Examples

[0009] <0. Background> While some encryption technologies utilize biometric information, encryption using fingerprints or irises carries the risk of becoming unusable if leaked, and it may be difficult for users to easily change their registered fingerprints or irises. Furthermore, authentication using voice or finger movements is susceptible to eavesdropping and unauthorized access. There is a need for authentication technology that is simple yet provides robust security.

[0010] <1. Embodiments> Figure 1 is a diagram showing an example of the schematic configuration of an information processing device according to an embodiment of the present disclosure. The information processing device 1 is configured to perform authentication using signals related to living organisms (hereinafter referred to as biosignals). Biosignals are, for example, signals related to the potential (voltage) generated in conjunction with the activity of living organisms, and are electrical signals corresponding to the state of living organisms.

[0011] The information processing device 1, for example, has a measurement unit 100 having multiple electrodes that can come into contact with a living body, and is configured to measure biological signals (i.e., bioelectric potentials). The information processing device 1 is configured as an authentication device and can perform authentication processing using biological signals. Biological signals can also be called signals based on bioelectric potentials, i.e., bioelectric potential signals.

[0012] The information processing device 1 is configured to acquire biosignals that change in accordance with the movement of a part of the head (i.e., the part of the user above the neck, such as the eyes, mouth, tongue, or jaw) as biosignals to be used for authentication. For example, the information processing device 1 measures electrical potential using electrodes in contact with the user's skin and detects biosignals related to eye movements (direction of eye movement, blinking, etc.). The information processing device 1 can perform personal authentication using biosignals corresponding to eye (eyeball) movements.

[0013] The information processing device 1 can be used, for example, in electronic devices worn by a user. The information processing device 1 may be applied to electronic devices that can be worn on the body, such as the ears, head, face, or neck, and may be implemented as a device mounted on a wearable device. The information processing device 1 may be configured as a wearable device such as earphones, headphones, or eyewear.

[0014] The information processing device and information processing system relating to this disclosure are applicable to various devices having authentication functions. The authentication technology relating to this disclosure can be applied to various cases of authentication, such as unlocking the doors of a vehicle (e.g., an automobile), starting the engine of a vehicle, unlocking the doors of a house (or room), and authenticating the identity of a person during payment.

[0015] The information processing device 1 includes a measurement unit 100 and a processing unit 110. In the example shown in Figure 1, the information processing device 1 also includes a storage unit 120 and a display unit 130. The display unit 130 may be provided within the information processing device 1 or separately. The information processing device 1 (or the measurement unit 100) is configured as an electronic device such as earphones or headphones.

[0016] The measurement unit 100 is a measurement circuit and is configured to generate biological signals. The measurement unit 100 (measurement circuit) has multiple electrodes for detecting electric potential, as will be described later. The measurement unit 100 is configured to measure electric potential that changes in accordance with the movement of a part of the user's head (e.g., eyes). The measurement unit 100 can acquire the user's biological signals and output the biological signals to the processing unit 110.

[0017] The processing unit 110 is a signal processing circuit and is configured to perform signal processing. The processing unit 110 has, for example, a processor and memory (ROM, RAM, etc.) and is configured to perform various signal processing. The processing unit 110 can read and execute programs built into it and perform signal processing (information processing).

[0018] The processing unit 110 is configured to acquire biological signals and perform signal processing. The processing unit 110 (signal processing circuit) is, for example, composed of circuits that perform various signal processing on biological signals. The processing unit 110 can perform various signal processing on biological signals output from the measurement unit 100, such as noise reduction processing and frequency analysis processing.

[0019] The storage unit 120 is configured to include, for example, one or more memories (e.g., non-volatile memory) and stores programs and data. Various types of information, such as information used for authentication processing, can be stored in the storage unit 120. The storage unit 120 (storage circuit) is, for example, a recording medium such as semiconductor memory. The processing unit 110 can control the writing of data to the storage unit 120 and the reading of data from the storage unit 120.

[0020] The processing unit 110 is configured to execute authentication processing using authentication information. Authentication information is information generated based on biosignals and is stored (recorded) in advance in the storage unit 120 or the internal memory of the processing unit 110. For example, the processing unit 110 generates authentication information based on information regarding the movement of a part of the head indicated by biosignals and stores the generated authentication information in the storage unit 120 (or the internal memory of the processing unit 110).

[0021] The processing unit 110 is configured to determine whether or not authentication is possible. The processing unit 110 determines (judges) whether or not authentication is possible based on, for example, pre-stored authentication information and newly acquired biometric signals. The authentication information is encrypted information and is, for example, predetermined and registered (set) by the user. The authentication information (i.e., encrypted information) is used, for example, for personal authentication and can also be called personal authentication information.

[0022] For example, the processing unit 110 compares (verifies) the newly acquired biosignal by the measurement unit 100 with predetermined authentication information stored in the storage unit 120, etc., and performs authentication according to the comparison result. For example, when authentication is required, if the user performs the same action as the action indicated by the authentication information as encrypted information, the processing unit 110 grants authentication permission (i.e., authentication is successful).

[0023] The presentation unit 130 is configured to present (provide) images and sounds to the user. The presentation unit 130 includes a display unit capable of displaying images, a sound output unit capable of outputting sounds, etc. The processing unit 110 is also a control unit (controller) and is configured to control each part of the information processing device 1. For example, the processing unit 110 (control circuit) is configured to control the presentation unit 130 by supplying signals to the presentation unit 130 to control the presentation unit 130.

[0024] Figure 2 is a diagram illustrating an example of the configuration of a measurement unit according to an embodiment. The measurement unit 100 has electrodes used for detecting potential and is configured to measure biopotential. The measurement unit 100 (measurement circuit) includes, for example, a plurality of electrodes 10 (in Figure 2, signal electrode 10a, reference electrode 10b), an amplification circuit 30, and an AD conversion circuit 40.

[0025] The signal electrode 10a and the reference electrode 10b are each configured to be attachable to a living body. The signal electrode 10a and the reference electrode 10b are provided apart from each other and contact each other at different positions. Each of the signal electrode 10a and the reference electrode 10b can be placed at any position to which a biological signal is to be acquired.

[0026] The measurement unit 100 detects the potential (voltage) of the biological surface using a signal electrode 10a and a reference electrode 10b. For example, due to electricity generated within the body, a potential difference is created between the signal electrode 10a and the reference electrode 10b that are in contact with the skin of the body. The magnitude of the potential difference between the signal electrode 10a and the reference electrode 10b changes, for example, with the movement of a part of the user's head (eyes, mouth, or jaw, etc.).

[0027] The signal electrode 10a and the reference electrode 10b are each made of a conductive material. For example, the signal electrode 10a and the reference electrode 10b are made using silver chloride (Ag / AgCl), aluminum (Al), gold (Au), copper (Cu), etc. However, the signal electrode 10a and the reference electrode 10b may be formed using other materials.

[0028] Each of the signal electrode 10a and the reference electrode 10b may be made of, for example, a conductive and elastic resin material. The shape of each of the signal electrode 10a and the reference electrode 10b is not particularly limited and may be circular, elliptical, polygonal, or other shapes. The measuring unit 100 may have three or more electrodes 10 (for example, three or four or more electrodes 10 including the signal electrode 10a and the reference electrode 10b).

[0029] As schematically shown in Figure 2, the signal electrode 10a comes into contact with the measurement site (the area to be measured) during actual use, and the potential of the contacted area is applied. The signal electrode 10a is electrically connected to, for example, an amplification circuit 30, and supplies a signal Sig1, which is a signal corresponding to the potential (biopotential) of the biological area it is in contact with, to the amplification circuit 30.

[0030] As shown in the example in Figure 2, the reference electrode 10b contacts the living body at a different position than the signal electrode 10a during actual use, and the potential of the contacted area is applied. The reference electrode 10b is electrically connected to, for example, an amplification circuit 30, and outputs a signal Sig2 to the amplification circuit 30 corresponding to the potential of the part of the living body it is in contact with.

[0031] The amplification circuit 30 is configured to amplify the input signal. The amplification circuit 30 is configured, for example, using a differential amplifier capable of amplifying signals. The amplification circuit 30 (i.e., the differential amplifier) ​​is configured to generate a biological signal S1 based, for example, the signal obtained by the signal electrode 10a and the signal obtained by the reference electrode 10b. The biological signal S1 is a signal based on the potential of the signal electrode 10a and the potential of the reference electrode 10b.

[0032] In the example shown in Figure 2, the signal Sig1 is input to the amplification circuit 30 via the signal electrode 10a. The signal Sig2 is also input to the amplification circuit 30 via the reference electrode 10b. The amplification circuit 30 generates a biological signal S1 based on the difference between the signals Sig1 and Sig2. The amplification circuit 30 generates a biological signal S1 corresponding to the difference between the potentials of the signals Sig1 and Sig2 and can output it to the AD conversion circuit 40.

[0033] The AD conversion circuit 40 is configured to perform AD (Analog to Digital) conversion and converts the input analog signal into a digital signal. The AD conversion circuit 40 is an ADC (Analog to Digital Converter). For example, the AD conversion circuit 40 receives a biological signal S1 from the amplification circuit 30, which is based on the difference between the potentials of signal Sig1 and signal Sig2. The AD conversion circuit 40 performs AD conversion processing on the biological signal S1, which is an analog signal input from the amplification circuit 30.

[0034] The AD conversion circuit 40 converts the biosignal S1 output by the amplification circuit 30 into a digital signal. The AD conversion circuit 40 (AD conversion unit) can output the biosignal S1 converted into a digital signal to the processing unit 110 (see Figures 1 and 3). The processing unit 110 can acquire the biosignal S1 from the measurement unit 100 and perform processing such as generating authentication information using the biosignal S1.

[0035] Figure 3 is a diagram illustrating an example of the configuration of an information processing device according to an embodiment. The information processing device 1 includes the measurement unit 100, the processing unit 110, and the storage unit 120 described above. The information processing device 1 may also include, for example, a presentation unit 130 and a detection unit 140, as shown in Figure 3.

[0036] As described above, the measurement unit 100 has a plurality of electrodes 10 that can be attached to a living body and is configured to acquire a biological signal S1 based on the potential of the electrodes 10. The measurement unit 100 generates a biological signal S1 based on the potential difference between a signal electrode 10a and a reference electrode 10b, for example, and outputs the biological signal S1 to the processing unit 110.

[0037] The presentation unit 130 is configured to present audio to the user, for example, by having a sound output unit 131 capable of outputting sound. The sound output unit 131 is configured to output sound based on audio data. The sound output unit 131 is a speaker or the like, and can also be described as a conversion unit that converts audio data, which is an electrical signal, into sound (sound waves). The sound output unit 131 can output sound corresponding to the audio data.

[0038] Furthermore, in the example shown in Figure 3, the presentation unit 130 has a display unit 132 capable of displaying images, and is configured to present images to the user. The display unit 132 is configured to display images based on image data. The display unit 132 is an organic EL display, a liquid crystal display, etc. The display unit 132 may also include a touch panel.

[0039] The sound output unit 131 and the display unit 132 may be configured as a single unit, either partially or entirely. The information processing device 1 may have only one of the sound output unit 131 and the display unit 132 as the presentation unit 130. At least one of the sound output unit 131 and the display unit 132 may be provided within the information processing device 1 or separately from the information processing device 1.

[0040] The detection unit 140 is configured to detect the attachment of the electrodes 10 to a living body. The detection unit 140 is configured to detect the attachment of the electrodes 10 to a living body based on the output signal of a sensor (such as an IR sensor (infrared sensor), an acceleration sensor, an ultrasonic sensor, a temperature sensor, or a sound sensor (microphone)) that can detect contact (or proximity) of the electrodes 10 to a living body.

[0041] The detection unit 140 may have, for example, a sensor capable of measuring the resistance value, i.e., impedance (contact impedance), between the living body and the electrode 10. The detection unit 140 may be configured to detect that the electrode 10 has been attached to the living body in response to a signal (operation signal) based on the operation of an operating member (not shown) by the user. The processing unit 110 may be configured to include the detection unit 140.

[0042] The detection unit 140 may, for example, include a part of an operating member (operating button (switch), touch panel, etc.), a sensor (accelerometer, optical sensor, etc.) that detects contact (or proximity) of the electrode 10, etc. The detection unit 140 can generate a signal (detection signal) indicating that the electrode 10 is attached to a living body and output it to the processing unit 110.

[0043] The processing unit 110 is configured to generate authentication information based on biological signals. For example, the processing unit 110 is configured to generate authentication information S2 based on the potential of the signal electrode 10a and the potential of the reference electrode 10b using a biological signal S1 measured by the measurement unit 100. The authentication information S2 is information based on the difference between the potential of the signal electrode 10a and the potential of the reference electrode 10b.

[0044] The processing unit 110 generates authentication information S2 regarding the movement of the head part based on the biological signal S1 corresponding to the potential difference between the signal electrode 10a and the reference electrode 10b that changes according to the movement of a specific part on the user's head, for example, as the authentication information S2. The processing unit 110 stores the authentication information S2 in the storage unit 120 (or the memory inside the processing unit 110).

[0045] Note that at least a part of the processing unit 110, the storage unit 120, the sound output unit 131, and the display unit 132 may be provided in a device external to the information processing device 1. Examples of the external device include an electronic device which is a terminal device (terminal) used by the user, a server (such as a cloud server), and the like. The electronic device is, for example, a smartphone, an output device (such as an audio device, a display (monitor), etc.) inside a vehicle. The electronic device may be a tablet terminal, a wearable terminal, a computer, or other information processing device.

[0046] The information processing device 1 and the external device together can also be referred to as an information processing device. The information processing device 1 and the external device can transmit and receive information (signals) by wireless communication or wired communication. For example, the information processing device 1 can be connected to a network and is configured to be communicable with an external device. The information processing device 1 and the external device connected via the network together can also be referred to as an information processing device or an information processing system.

[0047] FIGS. 4A and 4B are diagrams for explaining a configuration example of the information processing device according to the embodiment. FIGS. 4A and 4B schematically show an example when the measurement unit 100 of the information processing device 1 is mounted on an earphone device. For example, the signal electrode 10a and the reference electrode 10b may be worn on the left ear and the right ear. In the example shown in FIG. 4A, the signal electrode 10a is worn on the left ear and the reference electrode 10b is worn on the right ear.

[0048] Also, for example, the signal electrode 10a and the reference electrode 10b of the measurement unit 100 may be worn on the left ear and the left cheek. In the example shown in FIG. 4B, the signal electrode 10a is worn on the left ear and the reference electrode 10b is worn on the left cheek. Note that the signal electrode 10a and the reference electrode 10b may be worn on the right ear and the right cheek.

[0049] Figure 5 shows an example of a biological signal obtained by the information processing device according to the embodiment. Figure 5 shows an example of the waveform of the biological signal S1 measured by the measurement unit 100 in the example shown in Figure 4A or Figure 4B. In Figure 5, the vertical axis represents the signal level of the biological signal S1, and the horizontal axis represents time.

[0050] When registering authentication information S2, the user performs, for example, any movement of any part of the head, that is, any movement that involves a change in the potential difference between the signal electrode 10a and the reference electrode 10b. The period during which the movement involving the change in potential difference is performed may be set by the user or may be set automatically by the information processing device 1.

[0051] The measurement unit 100 detects a biosignal S1 corresponding to the potential difference between the signal electrode 10a and the reference electrode 10b, which is generated by eye movements in any part of the user's head, as shown in the example in Figure 5. The magnitude (signal value) of the biosignal S1 increases or decreases with the user's eye movements (direction of eye movement, blinking, etc.), as shown in the example in Figure 5.

[0052] In the example shown in Figure 5, after blinking, the eye (eyeball) moves sequentially to "upper left," "center," "up," "center," "upper right," "center," "right," and "center," followed by two more blinks. Depending on the direction of eye movement (i.e., the direction the eyeball is facing, the direction of gaze) or blinking, a potential difference is generated between the signal electrode 10a and the reference electrode 10b, and the amplitude (signal level) of the biological signal S1 changes.

[0053] The processing unit 110 can generate authentication information S2 related to eye movements based on the biological signal S1. The processing unit 110 generates authentication information S2, which includes information about the magnitude of the biological signal S1 that changes in accordance with eye movements (eyeball movements), such as the amplitude V1 of the biological signal S1 in the case of blinking, and the amplitude V2 of the biological signal S1 in the case of the eyeball turning to the upper right.

[0054] Furthermore, the processing unit 110 can generate authentication information S2, which includes information about the period during which a potential difference occurs between the signal electrode 10a and the reference electrode 10b, that is, the period during which the magnitude (amplitude) of the biosignal S1 increases or decreases. For example, the processing unit 110 generates authentication information S2, which includes information about the period T1 during which the biosignal S1 changes in the case of a "blinking" motion, and the period T2 during which the biosignal S1 changes in the case of an eyeball turning "upper right".

[0055] For example, in the case shown in Figure 5, the processing unit 110 may generate authentication information S2 that includes information about the amplitude of the biosignal S1 during each operation, which is performed in the order of "blink", "upper left", "center", "up", "center", "upper right", "center", "right", "center", "blink", and "blink", as well as information about the period during which the biosignal S1 changes during each operation. Alternatively, for example, the processing unit 110 may generate authentication information S2 that includes information about the timing of the change in the biosignal S1 (i.e., the transition timing).

[0056] As described above, the information processing device 1 acquires authentication information S2 related to biological movement accompanied by a change in the potential difference between the signal electrode 10a and the reference electrode 10b, and stores and registers it in the storage unit 120 or the like. The processing unit 110 may also register and use the signal waveform of the biological signal S1 acquired for the purpose of registering the authentication information as the authentication information S2.

[0057] The processing unit 110 may use information regarding a series of consecutive movements of a part of the living body (for example, a series of consecutive movements including the aforementioned "blinking" movement, the movement of the eyeball turning "upper right", the movement of the eyeball turning "upper left", etc.) as authentication information S2. Alternatively, for example, the processing unit 110 may register and use authentication information S2 for each movement of a part of the living body.

[0058] If authentication is required, the processing unit 110 compares (verifies) the newly acquired biosignal S1 (also referred to as biosignal S1') with the pre-registered authentication information S2 and determines (decides) whether authentication is possible. For example, the processing unit 110 checks whether the movement of the body part indicated by the authentication information S2 matches the movement of the body part indicated by the biosignal S1' acquired when authentication is requested.

[0059] Furthermore, for example, the processing unit 110 checks whether the information regarding the movement of a biological part indicated by the authentication information S2 (such as the amplitudes V1 and V2 of the biological signals and the periods T1 and T2 during which the biological signals change) matches or nearly matches the information indicated by the biological signal S1'. The processing unit 110 analyzes the correlation between the biological signal S1' and the authentication information S2 and determines whether authentication is successful or not.

[0060] The processing unit 110 may determine the degree of agreement (i.e., similarity) between the biometric signal S1' and the authentication information S2, and then determine whether authentication is successful or not by comparing the degree of agreement with a predetermined threshold. For example, if the degree of agreement between the biometric signal S1' and the authentication information S2 is greater than or equal to the predetermined threshold, the processing unit 110 determines that authentication is permitted and performs authentication (authentication successful). If the degree of agreement between the biometric signal S1' and the authentication information S2 is less than the predetermined threshold, the processing unit 110 determines that authentication is not possible and does not perform authentication (authentication failed).

[0061] The processing unit 110 may perform authentication if the difference between the signal waveform indicated by the authentication information S2 and the signal waveform of the biometric signal S1' is within an acceptable value. As described above, the processing unit 110 can determine whether or not to perform authentication based on whether conditions (permission conditions) are met, such as whether the degree of agreement between the biometric signal S1' and the authentication information S2 is above a predetermined threshold, or whether the difference between the signal waveform represented by the authentication information S2 and the signal waveform of the biometric signal S1' is within an acceptable value.

[0062] Figure 6 shows an example of a biosignal obtained by the information processing device according to the embodiment. In Figure 6, the biosignal S1 for user A (referred to as biosignal S1a), the biosignal S1 for user B (referred to as biosignal S1b), and the biosignal S1 for user C (referred to as biosignal S1c) are shown, respectively.

[0063] Individual differences arise in the biosignals that change with the movement of different parts of the head (e.g., eyes, tongue, or jaw), the movement of the muscles associated with those parts, the structure of each part (muscles, skeleton, fat, etc.), and the conductivity of each part. As shown in the example in Figure 6, when users A, B, and C perform actions such as blinking or turning their eyes to the upper right, differences occur in the biosignals S1a, S1b, and S1c.

[0064] In the example shown in Figure 6, for example, the amplitudes of each user's biosignals in the case of a "blinking" motion, i.e., the amplitude V1a of biosignal S1a, the amplitude V1b of biosignal S1b, and the amplitude V1c of biosignal S1c are all different from each other. Also, in the case of a motion where the eyeball turns "upper right", i.e., the amplitude V2a of biosignal S1a, the amplitude V2b of biosignal S1b, and the amplitude V2c of biosignal S1c are all different from each other.

[0065] Furthermore, in the case of a "blinking" motion, the periods during which each user's biosignals change, namely the period T1a during which biosignal S1a changes, the period T1b during which biosignal S1b changes, and the period T1c during which biosignal S1c changes, are all different from each other. Also, in the case of an eye movement where the eyeball turns "upper right", the periods during which biosignals change, namely the period T2a during which biosignal S1a changes, the period T2b during which biosignal S1b changes, and the period T2c during which biosignal S1c changes, are all different from each other.

[0066] As shown in the example in Figure 6, the amplitude of the biosignal S1 (e.g., amplitudes V1a to V1c, amplitudes V2a to V2c), the period during which the biosignal S1 changes (e.g., period T1a to T1c, period T2a to T2c), and the timing of the change in the biosignal S1 (transition timing) are all personal characteristics of each user. The authentication information S2 is information that indicates the personal characteristics of the biosignal S1 (i.e., information that identifies an individual) and can be used as cryptography.

[0067] As described above, the information processing device 1 according to this embodiment has a processing unit 110 capable of generating authentication information S2 based on the potential of the signal electrode 10a and the potential of the reference electrode 10b. The information processing device 1 can perform authentication using the authentication information S2 related to the movement of parts of the head (eyes, tongue, jaw, etc.). This makes it possible to realize a wearable device (e.g., earphones) capable of suitable authentication processing.

[0068] According to the information processing device 1, with the signal electrode 10a and the reference electrode 10b in contact with the user's ear, it becomes possible to register authentication information S2 and determine whether authentication is successful or not. Encryption registration and encryption input (i.e., registration of authentication information S2 and acquisition of biometric signals S1 (or biometric signals S1')) can be performed without using hands. For example, encryption input can be performed using the movement of the eyeballs while the eyelids are closed, making it possible to prevent eavesdropping and spying.

[0069] The information processing device 1 can set and register information indicating the movement of the eyes, tongue, or jaw as authentication information S2, and the authentication information S2, which is encrypted information, can be changed relatively easily. Furthermore, in this embodiment, authentication information S2 indicating personal characteristics can be used, making it possible to achieve a higher level of security.

[0070] The processing unit 110 is configured to perform processing that prompts movement involving a change in potential difference. The processing unit 110 is configured to perform processing that presents at least one of sound and / or images that prompts movement involving a change in potential difference. For example, the processing unit 110 controls the presentation unit 130 to present sound or images to the user that prompt movement involving a change in potential difference between electrodes 10. By controlling the presentation unit 130, the processing unit 110 can output sound, images, etc. that prompt movement involving a change in potential difference.

[0071] The processing unit 110 is configured to perform, for example, the processing of presenting at least one of an audio or image that indicates the start timing of biological movement accompanied by a change in potential difference. The processing unit 110 may output the audio or image that indicates the start timing of biological movement accompanied by a change in potential difference using the presentation unit 130 (sound output unit 131, display unit 132).

[0072] Furthermore, the processing unit 110 may perform a process to present at least one of an audio or image indicating the timing of the end of a biological movement accompanied by a change in potential difference. The processing unit 110 may also have the presentation unit 130 output the audio or image indicating the timing of the end of a biological movement accompanied by a change in potential difference.

[0073] The processing unit 110 of the information processing device 1 may, for example, output an audio message via the sound output unit 131 to prompt movement of a specific body part (e.g., the eyes), or display an image on the display unit 132 to prompt movement of a specific body part. The period during which movement involving a change in potential difference is performed may be set by the user or by the processing unit 110.

[0074] For example, after the detection unit 140 detects the attachment of the electrodes 10, the processing unit 110 performs a process to prompt the user to make a movement that involves a change in the potential difference between the electrodes 10 when registering authentication information S2. Based on the biosignal S1 during the period in which the movement involving the change in potential difference is performed, the processing unit 110 generates and registers the authentication information S2.

[0075] After registering authentication information S2, if authentication is required, the processing unit 110 prompts the user to perform an action that causes a change in the potential difference between the electrodes 10. Based on the biosignal S1 (i.e., biosignal S1') during the period in which the action causing the change in potential difference is performed, the processing unit 110 determines whether authentication is possible and may perform authentication.

[0076] The information processing device 1 may, for example, use information indicating eye movements (responses) made in accordance with voice or images presented to the user to register authentication information S2 indicating personal characteristics, determine whether authentication is possible or not, etc. In this case, the user does not need to remember encrypted information (such as how to move parts of the head), and authentication can be performed using the user's response actions to instructions given by voice, etc.

[0077] According to the information processing device 1, information regarding the user's responsiveness to visual and auditory presentations (such as tracking to the indicated location and reaction time) can be extracted from the biosignal S1 and used as authentication information S2, thereby achieving higher security. Furthermore, liveness detection, that is, detection of the presence of the person performing the encrypted input, can also be performed.

[0078] Figures 7A, 7B, 8A, and 8B are diagrams illustrating an example of a presentation method by an information processing device according to an embodiment. The information processing device 1 can present motion accompanied by a change in potential difference using at least one of sound and / or images. The processing unit 110 may output sound or images using the presentation unit 130 or an external electronic device (for example, a smartphone display, a vehicle display, etc.) of the information processing device 1.

[0079] The processing unit 110 may output voice messages such as "Please move your eyes," "Please move your eyes from side to side in time with the sound," or "Keep your eyes closed and move your eyes from side to side in time with the sound" via the sound output unit 131. The processing unit 110 may also output sound effects (such as beeps) via the sound output unit 131 that instruct (request) the timing of moving a specific part of the head.

[0080] The processing unit 110 may display an image on the display unit 132 that prompts movement accompanied by a change in potential difference. The processing unit 110 may also indicate the direction of eye movement (i.e., the direction the eyeballs are facing) by displaying an image showing the movement of a dot (circle), as in the example shown in Figure 8A. The processing unit 110 may also indicate the movement of parts of the head by displaying images of dots, other marks, etc., that move according to time.

[0081] The processing unit 110 may display an image on the display unit 132, which is a monitor (display), that shows the text "The yellow dot on the monitor is moving. Follow it with your eyes" and a dot (circle), as shown in the example in Figure 8B. The processing unit 110 may also output the audio "The dot on the monitor is moving. Follow it with your eyes" from the sound output unit 131.

[0082] Figures 9 and 10 are flowcharts illustrating examples of operation of an information processing device according to an embodiment. An example of operation of the information processing device 1 will be described with reference to the flowcharts in Figures 9 and 10. Figure 9 is a flowchart illustrating an example of the registration process for authentication information S2. For example, after the application of the information processing device 1 is started, the flowchart in Figure 9 begins.

[0083] In step S11, the processing unit 110 of the information processing device 1 checks whether or not it has been able to acquire the biological signal S1, and detects, for example, that the signal electrode 10a and the reference electrode 10b have been attached to the ear. Alternatively, for example, the processing unit 110 can determine that the signal electrode 10a and the reference electrode 10b have been attached to the ear based on the detection signal output from the detection unit 140.

[0084] In step S12, the processing unit 110 causes the presentation unit 130 to present an audio, image, or the like that instructs the user on the timing to start an action (movement) involving a potential difference. After receiving the instruction to start the action, the user, of their own volition, performs, for example, any multiple eye movements (for example, blinking, turning the eyeballs to the upper right, turning the eyeballs to the upper left, etc.).

[0085] In step S13, the processing unit 110 acquires a biosignal S1 corresponding to the potential difference generated when the eye is moved. In step S14, the processing unit 110 generates authentication information S2 based on the acquired biosignal S1. The processing unit 110 stores and registers the generated authentication information S2 in the storage unit 120 (or the internal memory of the processing unit 110). After that, the process shown in the flowchart of Figure 9 is terminated.

[0086] Figure 10 is a flowchart showing an example of an authentication process using authentication information S2. In step S21, the processing unit 110 checks whether or not the biosignal S1 has been acquired, and detects, for example, that the signal electrode 10a and the reference electrode 10b have been attached to the ear based on the detection signal output from the detection unit 140.

[0087] In step S22, the processing unit 110 causes the presentation unit 130 to present audio, images, etc., indicating the start timing of an operation involving a potential difference. After receiving the instruction to start the operation, the user performs the same operation as indicated by the authentication information S2 registered as encrypted information, for example, multiple eye movements.

[0088] In step S23, the processing unit 110 acquires a biosignal S1' corresponding to the potential difference generated by the eye movement. In step S24, the processing unit 110 determines whether the permission conditions are met based on the acquired biosignal S1' and the authentication information S2 stored in the storage unit 120, etc.

[0089] If the result of the determination in step S24 is negative ("No" in step S24), that is, if it is determined that the permission conditions are not met, authentication is not performed (authentication failure). Note that if the result of step S24 is "No", the process may return to step S21 or step S22.

[0090] If the determination result in step S24 is positive ("Yes" in step S24), that is, if it is determined that the permission conditions are met, the process proceeds to step S25 and authentication is performed (authentication successful). After that, the process shown in the flowchart of Figure 10 is terminated. The processing unit 110 may also perform a process to display audio or images indicating that authentication was successful or failed, depending on the determination result in step S24.

[0091] Figures 11 and 12 are flowcharts illustrating another example of operation of the information processing device according to the embodiment. Another example of operation of the information processing device 1 will be described with reference to the flowcharts in Figures 11 and 12. Figure 11 is a flowchart illustrating another example of the registration process of authentication information S2. For example, after the application of the information processing device 1 is started, the flowchart in Figure 11 is initiated.

[0092] In step S31, the processing unit 110 of the information processing device 1 detects, for example, that the signal electrode 10a and the reference electrode 10b have been attached to the ear by checking whether or not the biological signal S1 has been acquired. Alternatively, for example, the processing unit 110 can determine that the signal electrode 10a and the reference electrode 10b have been attached to the ear based on the detection signal output from the detection unit 140.

[0093] In step S32, the processing unit 110 causes the presentation unit 130 to present audio, images, etc., that instruct the user on the start timing of an action (movement) involving a potential difference and the content of the action (i.e., the content of the movement, such as how to move the eyes). The user performs the action instructed (specified) by the audio or images, such as multiple eye movements.

[0094] In step S33, the processing unit 110 acquires a biological signal S1 corresponding to the potential difference associated with eye movement, etc. In step S34, the processing unit 110 generates authentication information S2 based on the acquired biological signal S1. The processing unit 110 stores and registers the generated authentication information S2 in the storage unit 120, etc. After that, the process shown in the flowchart of Figure 11 is terminated.

[0095] Figure 12 is a flowchart showing another example of authentication processing using authentication information S2. In step S41, the processing unit 110 checks whether or not the biosignal S1 has been acquired, and detects, for example, that the signal electrode 10a and the reference electrode 10b have been attached to the ear based on the detection signal output from the detection unit 140.

[0096] In step S42, the processing unit 110, for example, based on authentication information S2, causes the presentation unit 130 to present audio, images, etc., that instruct the start timing of an operation involving a potential difference and the content of the operation (movement content). The user performs the actions instructed by the audio or images, such as multiple eye movements, according to the presented audio or images.

[0097] In step S43, the processing unit 110 acquires a biosignal S1' corresponding to the potential difference generated by the eye movement. In step S44, the processing unit 110 determines whether or not the permission conditions are met based on the acquired biosignal S1' and the authentication information S2 stored in the storage unit 120, etc.

[0098] If the result of the determination in step S44 is negative ("No" in step S44), that is, if it is determined that the permission conditions are not met, authentication is not performed (authentication failure). Note that if the result of step S44 is "No", the process may return to step S41 or step S42.

[0099] If the determination result in step S44 is positive ("Yes" in step S44), that is, if it is determined that the permission conditions are met, the process proceeds to step S45 and authentication is performed (authentication successful). After that, the process shown in the flowchart of Figure 12 is terminated. The processing unit 110 may also perform a process to display audio or images indicating that authentication was successful or failed, depending on the determination result in step S44.

[0100] The technology described herein can be applied to a variety of products. For example, the information processing device described herein can be used in various electronic devices that have authentication functions. The information processing device 1 and measurement unit 100 described herein can be applied to wearable devices such as earphone devices and headphone devices.

[0101] As shown in the example in Figure 13, the information processing device 1 may be implemented in an earphone device such as a TWS (True Wireless Stereo) device. One of the signal electrode 10a and the reference electrode 10b, for example the signal electrode 10a, may be molded as an earpiece-type dry electrode and positioned to contact the ear canal during actual use. The other of the signal electrode 10a and the reference electrode 10b, for example the reference electrode 10b, may be positioned to contact another part of the ear during actual use.

[0102] As shown in the example in Figure 14, the information processing device 1 may be applied to a headphone device. For example, in the case of overhead headphones, the signal electrode 10a and the reference electrode 10b may be mounted on the surface of the ear pad. Of the two ear pads, the signal electrode 10a may be provided on one ear pad and the reference electrode 10b may be provided on the other ear pad.

[0103] The information processing device 1 may be applied to a head-mounted display (HMD), as shown in the example in Figure 15. For example, electrodes 10 (signal electrode 10a, reference electrode 10b, etc.) may be provided on the pad portion 201 and the band portion 202 of the head-mounted display.

[0104] The processing unit 110 (see also Figures 1 and 3) may be implemented, for example, within a wearable device (earphone device, headphone device, etc.), or the processing unit 110 may be provided in an electronic device 200, as shown in the example in Figure 13. The electronic device 200 is, for example, a terminal device used by a user. The electronic device 200 may be a smartphone, tablet device, wearable device, computer, or other information processing device.

[0105] The information processing device 1 may be configured as an information processing system 300 including an electronic device 200 having a measurement unit 100 and a processing unit 110, as shown in the example in Figure 13. The information processing system 300 may be configured to include, for example, the storage unit 120, sound output unit 131, display unit 132, etc.

[0106] [Function and Effects] The information processing device (information processing device 1) according to this embodiment includes a first electrode and a second electrode (signal electrode 10a and reference electrode 10b) that can come into contact with a living body, and a processing unit (processing unit 110) that can generate first authentication information (authentication information S2) based on the potential of the first electrode and the potential of the second electrode.

[0107] The information processing device 1 according to this embodiment has a processing unit 110 capable of generating authentication information S2 based on the potential of the signal electrode 10a and the potential of the reference electrode 10b. Therefore, it is possible to realize an information processing device that enables suitable authentication processing.

[0108] Next, modified examples of the present disclosure will be described. In the following, components similar to those in the above embodiments will be denoted by the same reference numerals, and their descriptions will be omitted as appropriate.

[0109] <2. Modified Examples> (2-1. Modified Example 1) The information processing device 1 may use authentication information related to tongue movement, authentication information related to jaw movement, authentication information related to the movement of multiple parts of the head, etc., as authentication information S2. The processing unit 110 is configured to generate, for example, authentication information S2 related to eye movement, authentication information S2 related to tongue movement, authentication information S2 related to jaw movement, or authentication information S2 related to the movement of multiple parts of the head (e.g., facial expressions) based on a biological signal S1.

[0110] The processing unit 110 may, for example, generate information regarding the movement of the tongue while the mouth is closed as authentication information S2. Examples of tongue movements include the tongue tip moving to the "center", the tongue tip moving "up", and the tongue tip moving to the "left". As an example, the processing unit 110 may generate and register information regarding the movement of the tongue tip sequentially from "center", "up", "left", and "center" as authentication information S2.

[0111] The processing unit 110 may generate information regarding jaw movements as authentication information S2. Examples of jaw movements include the action of "chewing" once or multiple times, and the action of moving the jaw "left and right" once or multiple times. The processing unit 110 may also generate information regarding the movements of multiple parts of the head as authentication information S2. Examples of movements of multiple parts of the head may be movements related to facial expressions, such as "laughing," "being surprised," or "pursing the lips."

[0112] (2-2. Modification 2) The series of processes described in the above embodiments and modifications can be executed in hardware, software, or a combination of both. When executing the process using software, for example, a program recording the processing sequence can be installed and executed in the memory of a computer incorporated into dedicated hardware.

[0113] Furthermore, it is possible to install and run programs on general-purpose computers capable of performing various processes. For example, programs can be pre-recorded on a storage medium. In addition to installing programs from the storage medium to the computer, programs can also be received via networks such as LANs (Local Area Networks) and the Internet, and installed on storage mediums such as the built-in hard disk.

[0114] Thus, it is possible to have a computer (processor) execute a program that performs the processing related to this disclosure. The technology related to this disclosure can also be implemented as a computer program product. One aspect of this disclosure is a non-temporary recording medium.

[0115] Although the present disclosure has been described above with reference to embodiments and modifications, this technology is not limited to the above embodiments, and various modifications are possible. For example, although the above-described modifications were explained as modifications of the above embodiments, the configurations of each modification can be combined as appropriate. Furthermore, this disclosure is applicable not only to the human body but also to other living organisms, such as animals such as pets and livestock.

[0116] An information processing apparatus in one embodiment of the present disclosure comprises a first electrode and a second electrode that can come into contact with a living body, and a processing unit capable of generating first authentication information based on the potential of the first electrode and the potential of the second electrode. This makes it possible to realize an information processing apparatus that enables suitable authentication processing.

[0117] An information processing system in one embodiment of the present disclosure comprises a measurement unit having a first electrode and a second electrode that can come into contact with a living body, and an information processing device having a processing unit capable of generating first authentication information based on the potential of the first electrode and the potential of the second electrode. Therefore, it is possible to realize an information processing system that enables suitable authentication processing.

[0118] The effects described herein are merely examples and are not limited to those described herein; other effects may also exist. Furthermore, this disclosure may take the following configurations: (1) An information processing apparatus comprising a first electrode and a second electrode that can come into contact with a living body, and a processing unit capable of generating first information used for authentication based on the potential of the first electrode and the potential of the second electrode. (2) The information processing apparatus according to (1), wherein the processing unit is capable of generating information based on the difference between the potential of the first electrode and the potential of the second electrode as the first information. (3) The information processing apparatus according to (1) or (2), wherein the processing unit is capable of generating information relating to the movement of a part of the head as the first information. (4) The information processing apparatus according to (3), wherein the processing unit is capable of generating information relating to a first movement of the part of the head and a second movement of the part of the head that is different from the first movement as the first information. (5) The information processing apparatus according to (3) or (4), wherein the part of the head is an eye, and the processing unit is capable of generating information relating to multiple movements of the eye as the first information. (6) The part of the head is the tongue or the jaw, and the processing unit is capable of generating information relating to the movement of the tongue or the movement of the jaw as first information, according to any one of (3) to (5). (7) The processing unit is capable of generating information relating to the movement of multiple parts of the head as first information, according to any one of (1) to (6). (8) The processing unit is capable of generating information relating to at least one of the magnitude of the potential difference between the first electrode and the second electrode and the period during which the potential difference between the first electrode and the second electrode occurs, according to any one of (1) to (7). (9) The processing unit is capable of performing a process to promote the movement of the living organism accompanied by a change in the potential difference between the first electrode and the second electrode, according to any one of (1) to (8). (10) The processing unit is capable of performing a process to present at least one of an image and a sound indicating the start timing of the movement of the living organism accompanied by a change in the potential difference between the first electrode and the second electrode, according to any one of (1) to (9).(11) The information processing apparatus according to any one of (1) to (10), further comprising a display unit capable of displaying an image, wherein the display unit is capable of displaying an image relating to movement accompanied by a change in the potential difference between the first electrode and the second electrode. (12) The information processing apparatus according to any one of (1) to (11), further comprising a sound output unit capable of outputting sound, wherein the sound output unit is capable of outputting sound relating to movement accompanied by a change in the potential difference between the first electrode and the second electrode. (13) The information processing apparatus according to any one of (1) to (12), wherein the processing unit is capable of generating information relating to eye movement as first information, and the processing unit is capable of performing a process to present at least one of an image and sound relating to the direction in which the eyes move. (14) The information processing apparatus according to any one of (1) to (13), wherein the first electrode is capable of contacting one of the left ear and the right ear, and the second electrode is capable of contacting the other of the left ear and the right ear. (15) The information processing apparatus according to any one of (1) to (13), wherein the first electrode is contactable to one ear, and the second electrode is contactable to the one ear at a position different from that of the first electrode. (16) The information processing apparatus according to any one of (1) to (15), further comprising a storage unit capable of storing the first information as authentication information. (17) The information processing apparatus according to any one of (1) to (16), wherein the processing unit is capable of performing authentication based on the first information stored as authentication information, the potential of the first electrode, and the potential of the second electrode. (18) The information processing apparatus according to any one of (1) to (17), wherein the processing unit is capable of performing a process that promotes the movement of the living body accompanied by a change in the potential difference between the first electrode and the second electrode, based on the first information stored as authentication information. (19) An information processing system comprising a measurement unit having a first electrode and a second electrode that are contactable to a living body, and an information processing apparatus having a processing unit capable of generating first information for authentication based on the potential of the first electrode and the potential of the second electrode.(20) A program that causes a computer to perform a process including acquiring the potential of a first electrode and a second electrode that are in contact with a living body, and generating first authentication information based on the potential of the first electrode and the potential of the second electrode.

[0119] This application claims priority based on Japanese Patent Application No. 2024-186038, filed with the Japan Patent Office on 22 October 2024, and all contents of that application are incorporated herein by reference.

[0120] Those skilled in the art will understand that various modifications, combinations, subcombinations, and changes can be conceived depending on design requirements and other factors, and that these fall within the scope of the attached claims and their equivalents.

Claims

1. An information processing device comprising a first electrode and a second electrode that can come into contact with a living organism, and a processing unit capable of generating first authentication information based on the potential of the first electrode and the potential of the second electrode.

2. The information processing apparatus according to claim 1, wherein the processing unit is capable of generating information based on the difference between the potential of the first electrode and the potential of the second electrode as the first information.

3. The information processing apparatus according to claim 1, wherein the processing unit is capable of generating information relating to the movement of a part of the head as the first information.

4. The information processing apparatus according to claim 3, wherein the processing unit is capable of generating information relating to a first movement of the head portion and a second movement of the head portion that is different from the first movement, as the first information.

5. The information processing apparatus according to claim 3, wherein the head portion is an eye, and the processing unit is capable of generating information relating to a plurality of eye movements as first information.

6. The information processing apparatus according to claim 3, wherein the head portion is the tongue or the jaw, and the processing unit is capable of generating information relating to the movement of the tongue or information relating to the movement of the jaw as the first information.

7. The information processing apparatus according to claim 1, wherein the processing unit is capable of generating information relating to the movement of multiple parts of the head as the first information.

8. The information processing apparatus according to claim 1, wherein the processing unit is capable of generating, as first information, information relating to at least one of the magnitude of the potential difference between the first electrode and the second electrode and the period during which the potential difference between the first electrode and the second electrode occurs.

9. The information processing apparatus according to claim 1, wherein the processing unit is capable of performing a process that promotes the movement of the living organism, which involves a change in the potential difference between the first electrode and the second electrode.

10. The information processing apparatus according to claim 1, wherein the processing unit is capable of performing a process to present at least one of an image and an audio signal indicating the start timing of the biological movement accompanied by a change in the potential difference between the first electrode and the second electrode.

11. The information processing apparatus according to claim 1, further comprising a display unit capable of displaying an image, wherein the display unit is capable of displaying an image relating to movement accompanied by a change in the potential difference between the first electrode and the second electrode.

12. The information processing apparatus according to claim 1, further comprising a sound output unit capable of outputting sound, wherein the sound output unit is capable of outputting sound relating to movement accompanied by a change in the potential difference between the first electrode and the second electrode.

13. The information processing apparatus according to claim 1, wherein the processing unit is capable of generating information relating to eye movements as first information, and the processing unit is capable of performing a process of presenting at least one of an image and an audio related to the direction in which the eyes move.

14. The information processing apparatus according to claim 1, wherein the first electrode is capable of contacting one of the left and right ears, and the second electrode is capable of contacting the other of the left and right ears.

15. The information processing apparatus according to claim 1, wherein the first electrode is contactable to one ear, and the second electrode is contactable to the one ear at a position different from that of the first electrode.

16. The information processing apparatus according to claim 1, further comprising a storage unit capable of storing the first information as authentication information.

17. The information processing apparatus according to claim 1, wherein the processing unit is capable of performing authentication based on the first information stored as authentication information, the potential of the first electrode, and the potential of the second electrode.

18. The information processing apparatus according to claim 1, wherein the processing unit is capable of performing a process that promotes the movement of the living organism, which involves a change in the potential difference between the first electrode and the second electrode, based on the first information stored as authentication information.

19. An information processing system comprising a measurement unit having a first electrode and a second electrode that can come into contact with a living organism, and an information processing device having a processing unit capable of generating first authentication information based on the potential of the first electrode and the potential of the second electrode.

20. A program that causes a computer to perform a process including acquiring the potential of a first electrode and a second electrode that are in contact with a living body, and generating first authentication information based on the potentials of the first electrode and the second electrode.

Images