Information processing device

Abstract

Have them present their brainwave state. [Solution] A computer measures brain waves by placing electrodes in contact with a specific area around the user's ear, and outputs information about light of a different color according to the measured brain waves of the user.

Description

Technical Field

[0001] The present invention relates to an information processing method and an electroencephalogram measuring device.

Background Art

[0002] As a technology for measuring a person's state, there is an electroencephalogram measuring technology. Usually, an electroencephalogram is measured by measuring a potential with electrodes installed on the head (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present invention is to present the state of an electroencephalogram.

Means for Solving the Problems

[0005] In the information processing method of the present invention, a computer measures an electroencephalogram by bringing an electrode into contact with a specific part around a user's ear, and outputs information on light of different colors according to the measured electroencephalogram of the user. Further, the electroencephalogram measuring device of the present invention has a processor, and the processor measures an electroencephalogram by bringing an electrode into contact with a specific part around a user's ear, and outputs information on light of different colors according to the measured electroencephalogram of the user. Further, the electroencephalogram measuring device according to the first aspect is an electroencephalogram measuring device used by contacting an ear, and has an electrode group including a plurality of electrodes arranged at different positions on a surface contacting the ear, and an electrode that satisfies a predetermined condition related to noise among the electrode group is selected as any one of an electroencephalogram sensor electrode, a reference electrode, and a ground electrode.

[0006] In the second embodiment of the electroencephalogram measuring device, the predetermined conditions relating to the noise are conditions determined based on the calibration results, in the electroencephalogram measuring device according to the first embodiment.

[0007] In the third embodiment of the electroencephalogram measuring device, if there are multiple electrodes that satisfy predetermined conditions related to noise, the electrode that detects the potential with the least amount of noise waveform is selected, or a predetermined number of electrodes are automatically and randomly selected.

[0008] The fourth embodiment of the electroencephalogram (EEG) measuring device is an EEG measuring device according to any one of the first to third embodiments, wherein an EEG sensor and a reference electrode are selectively selected from the group of electrodes on the EEG measuring device that are separated by a predetermined distance.

[0009] The fifth embodiment of the electroencephalogram (EEG) measuring device is an EEG measuring device according to any one of the first to fourth embodiments, wherein, when two electrodes, the EEG sensor electrode and the reference electrode, are selected in the electrode group, the EEG is measured in a first measurement mode in which the EEG is measured using the two electrodes, and when three electrodes, the EEG sensor electrode, the reference electrode, and the ground electrode, are selected, the EEG is measured in a second measurement mode in which the EEG is measured using the three electrodes.

[0010] The electroencephalogram measuring device of the sixth embodiment is an electroencephalogram measuring device according to the fifth embodiment, wherein the measurement mode for measuring electroencephalograms is selected based on the remaining capacity of a battery provided in the electroencephalogram measuring device, the first measurement mode is selected when the remaining capacity is less than a certain threshold, and the second measurement mode is selected when the remaining capacity is equal to or greater than a certain threshold.

[0011] The electroencephalogram measuring device of the seventh embodiment is an electroencephalogram measuring device according to the fifth embodiment, wherein the measurement mode is selected from either the first measurement mode or the second measurement mode depending on the electroencephalogram measurement conditions.

[0012] The electroencephalogram measuring device according to the eighth aspect is the electroencephalogram measuring device according to any one of the first aspect to the seventh aspect, wherein the electrode group is linearly arranged on a non-planar surface or densely arranged with a predetermined regularity.

Effect of the Invention

[0013] According to the present invention, the state of the electroencephalogram can be presented.

Brief Description of the Drawings

[0014] [Figure 1] It is a block diagram showing an information processing system according to the present embodiment. [Figure 2] It is a perspective view showing the overall configuration of the earphone device. [Figure 3] It is a perspective view showing a part of the configuration of the earphone device. [Figure 4] It is a perspective view showing the left earphone unit. [Figure 5] It is a plan view showing the left earphone unit. [Figure 6] It is a view of the ear pad seen from the side. [Figure 7] It is a view of the ear pad seen from above. [Figure 8] It is a view of the ear pad seen from the side. [Figure 9] It is a view of the ear pad seen from the side. [Figure 10] It is a view of the ear pad seen from the side. [Figure 11] It is a view of the ear pad seen from above. [Figure 12] It is a view of the ear pad seen from the side. [Figure 13] It is a view of the ear pad seen from the side. [Figure 14] It is a perspective view showing a part of the configuration of the earphone device. [Figure 15] It is a perspective view showing a part of the configuration of the earphone device. [Figure 16] It is a perspective view showing a part of the configuration of the earphone device. [Figure 17] It is a perspective view showing a partial configuration of the earphone device. [Figure 18] It is a functional block diagram of the earphone device. [Figure 19] It is a functional block diagram of the terminal device. [Figure 20] It is a diagram showing an electroencephalogram display screen. [Figure 21] It is a diagram showing a music playback screen. [Figure 22] It is a diagram showing a music playback screen. [Figure 23] It is a diagram showing a playlist screen. [Figure 24] It is a diagram showing a playlist screen. [Figure 25] It is a diagram showing a condition input screen. [Figure 26] It is a diagram showing a music playback screen. [Figure 27] It is a diagram showing a list selection screen. [Figure 28] It is a diagram showing an electroencephalogram display screen. [Figure 29] It is a diagram showing an electroencephalogram display screen. [Figure 30] It is a diagram showing an electroencephalogram measurement result. [Figure 31] It is a diagram showing a music display screen. [Figure 32] It is a diagram showing a playlist screen. [Figure 33] It is a perspective view showing the overall configuration of the earphone device. [Figure 34] It is a diagram showing the waveform of the potential. [Figure 35] It is a diagram showing the waveform of the potential. [Figure 36] It is a diagram showing the waveform of the potential. [Figure 37] It is a diagram showing the waveform of the potential. [Figure 38] It is a diagram showing the screen during calibration. [Figure 39] It is a diagram showing the screen during calibration. [Figure 40] It is a diagram showing the screen during calibration. [Figure 41] This is a diagram showing the screen during calibration. [Figure 42] This is a diagram showing the screen for electrode settings. [Figure 43] This is a diagram showing the screen for electrode settings. [Figure 44] This is a diagram showing the confirmation screen. [Figure 45] This is a diagram showing the setup completion screen. [Figure 46] This is a diagram showing a warning screen. [Figure 47] This is a diagram showing a warning screen. [Figure 48] This is a diagram showing the screen for making an inquiry. [Figure 49] This is a diagram showing the confirmation screen. [Figure 50] This is a diagram showing the confirmation screen. [Figure 51] This is a block diagram of an information processing system according to a different embodiment. [Modes for carrying out the invention]

[0015] The following describes an electroencephalogram (EEG) measuring device according to an embodiment of the present invention. The EEG measuring device according to this embodiment is a device that measures brain waves by measuring electrical potential while being worn on a person's ear. The EEG measuring device according to this embodiment may be a so-called hearable device. The EEG measuring device according to this embodiment may be worn on one ear to measure brain waves, or it may be worn on both ears to measure brain waves. For example, the first EEG measuring device according to this embodiment may be worn on the left ear, and the second EEG measuring device according to this embodiment may be worn on the right ear, and the EEG measuring system may be formed by the first EEG measuring device and the second EEG measuring device, and brain waves may be measured by this EEG measuring system. As another example, the EEG measuring device according to this embodiment may be worn on either the left or right ear, and brain waves may be measured by that EEG measuring device.

[0016] The electroencephalogram (EEG) measuring device according to this embodiment includes a plurality of EEG measuring means. The EEG measuring means are electrodes that detect electrical potential. The plurality of electrodes are provided in contact with the user's ears, and the user's brainwaves are measured using at least two of the plurality of electrodes. The user's brainwaves may be measured using at least two electrodes selected from a plurality of electrodes provided on one ear of the user, or the brainwaves may be measured using at least two electrodes selected from a plurality of electrodes provided on both ears. Alternatively, the user's brainwaves may be measured using at least three electrodes from the plurality of electrodes. By using more electrodes, the accuracy of the EEG measurement can be improved. Furthermore, by switching the electrodes used for EEG measurement among the plurality of electrodes, the brainwaves may be measured using at least three electrodes. For example, the electrodes used for EEG measurement may be switched depending on the measurement conditions such as the sensitivity of electrical potential detection and noise. For example, at least three electrodes may include a first electrode used as an electroencephalogram (EEG) detection electrode (sensor electrode), a second electrode used as a reference electrode, and a third electrode used as a ground electrode, and the EEG may be measured using the first, second, and third electrodes. At least one of the first, second, and third electrodes may be switched.

[0017] For example, the electroencephalogram (EEG) measuring device according to this embodiment includes a first EEG measuring means that is inserted into the ear canal (external auditory canal) and contacts the biological surface inside the external auditory canal to detect electrical potential. The first EEG measuring means is an electrode that detects electrical potential. The electrode is provided on the surface of an elastic member such as rubber. The elastic member is inserted into the external auditory canal to measure electrical potential. As the elastic member inserted into the external auditory canal deforms inside the canal, the degree of contact with the biological surface is improved, and the accuracy of electrical potential measurement is improved. The elastic member itself may be a conductive material. For example, conductive rubber may be used as the first EEG detection means.

[0018] Furthermore, the electroencephalogram (EEG) measuring device according to this embodiment further includes a second EEG measuring means (electrode) that is provided on a part of the human body other than the external auditory canal (for example, the auricle, the back of the auricle, the earlobe, etc.) and detects the potential by contacting the biological surface of that part. The first EEG measuring means and the second EEG measuring means have an integrated structure connected to each other, and when the EEG measuring device is attached to the ear, the first EEG measuring means and the second EEG measuring means have a structure that sandwiches the ear. With the ear sandwiched between the first EEG measuring means and the second EEG measuring means, the first EEG measuring means is inserted into the external auditory canal of the ear and contacts the biological surface, and the second EEG measuring means contacts the auricle, the back of the ear, or the earlobe, etc., and contacts the biological surface. With an EEG measuring device having such a structure, since brain waves can be measured with the ear sandwiched, the installation position of the EEG measuring device is less likely to shift compared to when brain waves are measured using only one electrode inserted into the external auditory canal. In other words, when using only one electrode inserted into the ear canal, there is no support for that electrode, making it prone to coming loose due to the person's movements. However, in this embodiment, the ear is held in place by the integrated first and second electroencephalogram (EEG) measurement means, making it difficult for the EEG measurement device to shift position and for the electrodes to come loose from the ear. As an example of a configuration using multiple electrodes, one electrode could be placed, for example, on the person's forehead, and the other electrodes inserted into the ear canal. However, such a device does not have a structure that holds onto a living body part as in this embodiment, so each electrode is prone to coming loose from the living body due to the person's movements. In contrast, in this embodiment, since it has a structure that holds onto the ear, it is less likely to come loose from the ear compared to when each electrode is placed individually.

[0019] Furthermore, since the electroencephalogram (EEG) measuring device according to this embodiment measures EEG using at least two electrodes (a first EEG measuring means and a second EEG measuring means), the measurement accuracy is improved compared to the case where EEG is measured using only one electrode inserted into the external auditory canal. In other words, when using only one electrode, it is not possible to measure reference information or ground the brain, for example, but by using multiple electrodes as in this embodiment, it becomes possible to measure reference information and ground the brain, thus improving the measurement accuracy.

[0020] The electroencephalogram (EEG) measuring device may be attached to a component, device, or apparatus that is worn on the ear, such as an earphone, hearing aid, eyeglasses, earring, or clip-type component, or it may be a device that serves a dual purpose with such components, devices, or apparatus. Of course, the EEG measuring device may be composed of a component that does not have any function other than EEG measurement (for example, an elastic component). For example, electrodes may be provided on an earphone inserted into the external auditory canal to measure the potential within the external auditory canal, and electrodes may be provided on the ear hook that holds the earphone and rests on the auricle to measure the potential on the back of the auricle, and the EEG may be measured based on the results of these potential measurements. Alternatively, electrodes may be provided on the frame of eyeglasses to measure the potential on the back of the auricle, and the EEG may be measured based on the results of these potential measurements. In this case, an electrode component may be inserted into the external auditory canal to measure the potential within the external auditory canal, and the EEG may be measured using the results of this measurement and the potential measurement results from the electrodes provided on the eyeglass frame.

[0021] As described above, the electroencephalogram (EEG) measuring device according to this embodiment is a device that measures brain waves while being worn on the ear. Therefore, compared to conventional EEG measuring devices that measure brain waves by placing multiple electrodes on the head (scalp or forehead), it causes less inconvenience in daily life. In other words, conventional EEG measuring devices that measure brain waves by placing multiple electrodes on the scalp or forehead are not designed with the assumption that a person will move, so it is difficult for a person to move with multiple electrodes on their scalp or forehead, and it is not practical for a person to move. In contrast, the EEG measuring device according to this embodiment is equivalent to a so-called hearable device, so a person can move easily even while wearing the EEG measuring device according to this embodiment. That is, it is not practical and is actually difficult to move the body (for example, walking, running, working, etc.) with multiple electrodes on the scalp or forehead. In contrast, it is easy to move the body even when wearing the EEG measuring device according to this embodiment on the ear. Therefore, compared to the conventional EEG measuring device described above, it is possible to wear the EEG measuring device according to this embodiment for a long period of time. As an example of application of this embodiment, for example, an office worker may wear the EEG measuring device according to this embodiment. This allows for the measurement of brainwaves during work. Of course, the brainwave measuring device according to this embodiment may also be applied to situations other than work. For example, brainwaves may be measured while walking or jogging, or while sleeping, or while receiving content (e.g., videos, still images (photographs), movies, dramas, television programs, music, paintings, lectures, etc.).

[0022] In the following section, we will describe, as an example, the case in which the electroencephalogram (EEG) measurement device according to this embodiment is applied to earphones. Of course, as mentioned above, the application examples of this embodiment are not limited to earphones.

[0023] An information processing system according to an embodiment of the present invention will be described with reference to Figure 1. Figure 1 shows an example of the information processing system according to this embodiment.

[0024] The information processing system according to this embodiment includes, as an example, an earphone device 10, a terminal device 12, and a music distribution server 14.

[0025] The earphone device 10 is, for example, a canal-type earphone, a type of headphone (a device that converts electrical signals output from a playback device into sound waves using a speaker) that is inserted into the ear canal. The earphone device 10 also functions as an electroencephalogram (EEG) measurement system. Specifically, the earphone device 10 measures the electrical potential of the user's head and outputs information indicating the measurement result (for example, a signal representing the electrical potential) as information indicating the EEG measurement result.

[0026] The earphone device 10 is equipped with wireless communication capabilities. The communication methods include, for example, short-range wireless communication (e.g., Bluetooth®, RFID (Radio Frequency Identifier), etc.), infrared communication, visible light communication, Wi-Fi® communication, etc. The earphone device 10 receives a sound signal (such as an audio signal) from the terminal device 12 via wireless communication and generates sound according to that signal. The earphone device 10 also transmits information indicating the results of the electroencephalogram (EEG) measurement to the terminal device 12 via wireless communication. Of course, the earphone device 10 may also have a wired communication function using a cable. In this case, the earphone device 10 may receive an audio signal via wired communication, generate sound, and transmit information indicating the results of the EEG measurement to an external device via wired communication.

[0027] The terminal device 12 is, for example, a mobile device such as a smartphone, mobile phone, or tablet PC (personal computer), a PC, a music player, a video playback device, etc., and is an example of an information processing device. The terminal device 12 is equipped with wireless communication capabilities. The terminal device 12 functions as a playback device (music playback device or video playback device). For example, the terminal device 12 plays music and transmits the sound signal to the earphone device 10 via wireless communication. The terminal device 12 may also play a video and transmit the sound signal to the earphone device 10 via wireless communication. Furthermore, the terminal device 12 receives information indicating the electroencephalogram (EEG) measurement results from the earphone device 10 via wireless communication and evaluates the user's EEG state by analyzing the EEG measurement results. The EEG measurement results may be analyzed by the earphone device 10 and information indicating the analysis results may be transmitted from the earphone device 10 to the terminal device 12, or the EEG measurement results may be analyzed by a device other than the earphone device 10 and the terminal device 12 and information indicating the analysis results may be transmitted to the terminal device 12. The terminal device 12 may transmit sound signals to the earphone device 10 via wired communication using a cable and receive information indicating the results of electroencephalogram (EEG) measurement from the earphone device 10. The terminal device 12 also has the function of communicating with other devices via a communication path N such as a network. This communication method may be wireless communication such as Wi-Fi, or it may be wired communication. The terminal device 12 can acquire information, for example, by connecting to the internet.

[0028] The music distribution server 14 is a device that has the function of communicating with other devices via a communication path N and provides music distribution services via the communication path N. The music distribution server 14 distributes music data, for example, via the internet. The music distribution server 14 may provide music data to users in download format or by streaming. The music data is provided for a fee, for example. Charges may be made per song or per album, or a flat-rate system may be adopted (for example, a fixed fee is charged at predetermined intervals such as monthly, and the service can be used unlimitedly or with certain restrictions during that period). Of course, there may be music data provided for free. In addition, limits on the number of downloads, time limits, streaming time limits, etc. may be set. The music distribution service may be made available on devices on which an application (program) for the music distribution service is installed. The music distribution server 14 may provide music data for listening.

[0029] Furthermore, a device that provides video distribution services (e.g., a video distribution server) may be included in the information processing system. The music distribution server 14 may also function as a video distribution server and provide video distribution services, or a separate video distribution server may provide video distribution services. The video distribution server may provide video data to users in download format, or it may provide video data to users through streaming. The video data may be provided for a fee, for example. A fee may be set for each video, or a flat-rate system may be adopted. Of course, there may be video data provided for free. In addition, limits on the number of downloads, time limits, streaming time limits, etc., may be set. The video distribution service may be made available on a device on which an application for the video distribution service is installed. The video distribution server may provide video data for viewing.

[0030] Of course, a device that distributes both music and video may be included in the information processing system.

[0031] In this embodiment, the user's brainwaves are measured by the earphone device 10, and information indicating the measurement results is transmitted to the terminal device 12. The terminal device 12 analyzes the measurement results and evaluates the user's brainwave state. Also, an audio signal is transmitted from the terminal device 12 to the earphone device 10, and the earphone device 10 generates sound. For example, music is played on the terminal device 12, and a sound corresponding to that music is emitted from the earphone device 10. As a result, the user's brainwaves while listening to music are measured by the earphone device 10, and the brainwave state is analyzed by the terminal device 12. Music playback may be controlled according to the brainwave measurement results. For example, the music being played may be changed according to the brainwave state. The music data may be data provided to the terminal device 12 from the music distribution server 14, or it may be data stored in the terminal device 12 that is not distributed from the music distribution server 14.

[0032] Furthermore, the earphone device 10 may be used connected to a separate music or video playback device instead of being used with the terminal device 12, or it may be used as a standalone electroencephalogram (EEG) measuring device without generating sound (i.e., the earphone device 10 may be used as an EEG measuring device without playing music or videos). Also, the terminal device 12 may be used as a standalone EEG analysis device instead of being used with the earphone device 10, or earphones other than the earphone device 10 may be connected to it, or the playback of music or videos may be controlled based on the EEG measured by an EEG measuring device other than the earphone device 10.

[0033] The earphone device 10 will be described in detail below with reference to Figures 2 to 4. Figure 2 is a perspective view showing the overall configuration of the earphone device 10. Figure 3 is a perspective view showing a part of the configuration of the earphone device 10, and is a view of the earphone device 10 from a different direction than Figure 2. Figure 4 is a perspective view showing the configuration of the left earphone section.

[0034] For the sake of explanation, we define forward and backward as shown in Figure 2. Forward is the direction the user's face is facing, and backward is the opposite direction.

[0035] As shown in Figures 2 and 3, the earphone device 10 broadly includes a left earphone unit 16L worn on the user's left ear, a right earphone unit 16R worn on the user's right ear, and a cable 18 connecting the left earphone unit 16L and the right earphone unit 16R. The left earphone unit 16L corresponds to an example of a first electroencephalogram (EEG) measurement device, and the right earphone unit 16R corresponds to an example of a second electroencephalogram (EEG) measurement device.

[0036] The left earphone section 16L includes a left speaker section 20L that is inserted into the user's left ear canal, a left support section 22L (left base section) that supports the left speaker section 20L, and a left ear hook section 24L, one end of which is connected to the left support section 22L.

[0037] The left speaker unit 20L consists of a driver unit that generates sound, a sound conduit, an equalizer, a housing (frame, housing, etc.), and an ear pad (earpiece) that covers the part inserted into the ear. The left speaker unit 20L can be the speaker unit of a known in-ear earphone. The ear pad of the left speaker unit 20L is made of a resin such as rubber.

[0038] A first left electroencephalogram (EEG) sensor 26L is provided on the side of the left speaker unit 20L. More specifically, the first left EEG sensor 26L is provided on the side of the ear pad that constitutes the left speaker unit 20L. The first left EEG sensor 26L is an electrode that detects the electrical potential of the head together with the second left EEG sensor 28L, which will be described later. The first left EEG sensor 26L is made of conductive rubber, such as carbon. Note that the first left EEG sensor 26L corresponds to an example of the first EEG measurement means.

[0039] The left support portion 22L has, for example, a thin rectangular parallelepiped shape, and the left speaker portion 20L is installed on the side of the left support portion 22L that faces the user's left ear when the user wears the earphone device 10. The left support portion 22L is, for example, a case that houses components such as an electronic circuit board inside.

[0040] The left ear hook portion 24L has a curved shape overall and is a component that rests on the user's left ear when the user wears the earphone device 10. One end of the left ear hook portion 24L is connected to the front part of the left support portion 22L, and the left ear hook portion 24L has a curved shape from the connection portion to the rear side of the left support portion 22L, forming a curved section. This curved section rests on the left ear from the upper side. The other end of the left ear hook portion 24L is connected to one end of the cable 18.

[0041] A second left electroencephalogram (EEG) sensor 28L is provided along the left ear hook portion 24L. The second left EEG sensor 28L is provided on the surface of the left ear hook portion 24L facing the user's left ear, so that it contacts the left ear, more specifically the back of the left ear (closer to the skull), when the left ear hook portion 24L is worn over the left ear. By providing the second left EEG sensor 28L to contact the back of the left ear, the potential can be detected at a position closer to the brain, thereby improving the accuracy of EEG measurement. The second left EEG sensor 28L is an electrode that detects the potential of the head together with the first left EEG sensor 26L. The second left EEG sensor 28L is made of conductive rubber, for example, carbon. For example, the potential detected by the second left EEG sensor 28L is used as a reference potential, and the first left EEG sensor 26L measures the potential (potential difference) from that reference potential. The second left electroencephalogram sensor 28L is an example of a second electroencephalogram measurement means.

[0042] When the left ear hook portion 24L is placed over the left ear and the left speaker portion 20L is inserted into the left ear canal, the left ear is sandwiched between the first left electroencephalogram sensor 26L provided on the left speaker portion 20L and the second left electroencephalogram sensor 28L provided on the left ear hook portion 24L. In this state, the electroencephalogram is measured by the first left electroencephalogram sensor 26L and the second left electroencephalogram sensor 28L.

[0043] As described above, by sandwiching the left ear between the first left EEG sensor 26L and the second left EEG sensor 28L, the EEG sensor can be brought into close contact with the left ear, thereby improving the accuracy of EEG measurement. In addition, since the first left EEG sensor 26L is inserted into the left ear canal, the degree of contact between the first left EEG sensor 26L and the left ear is increased.

[0044] The right earphone unit 16R includes a right speaker unit 20R that is inserted into the user's right ear canal (external auditory canal), a right support unit 22R (right base unit) that supports the right speaker unit 20R, and a right ear hook unit 24R whose one end is connected to the right support unit 22R.

[0045] The right speaker unit 20R, like the left speaker unit 20L, is composed of a driver unit, sound conduit, equalizer, housing, and ear pads. Note that the speaker unit of a known in-ear earphone can be used as the right speaker unit 20R. The ear pads of the right speaker unit 20R are made of a resin such as rubber.

[0046] A first right electroencephalogram (EEG) sensor 26R is provided on the side of the right speaker unit 20R. More specifically, the first right EEG sensor 26R is provided on the side of the ear pad that constitutes the right speaker unit 20R. The first right EEG sensor 26R is an electrode that detects the electrical potential of the head together with the second right EEG sensor 28R, which will be described later. The first right EEG sensor 26R is made of conductive rubber, such as carbon. Note that the first right EEG sensor 26R corresponds to an example of the third EEG measurement means.

[0047] The right-side support portion 22R has, for example, a thin rectangular parallelepiped shape, and the right-side speaker portion 20R is installed on the surface of the right-side support portion 22R that faces the user's right ear when the user wears the earphone device 10. The right-side support portion 22R is, for example, a case that houses components such as an electronic circuit board inside.

[0048] The right ear hook portion 24R has a curved shape overall and is a component that rests on the user's right ear when the user wears the earphone device 10. One end of the right ear hook portion 24R is connected to the front part of the right support portion 22R, and the right ear hook portion 24R has a curved shape from the connection portion to the rear side of the right support portion 22R, forming a curved section. This curved section rests on the right ear from the upper side. The other end of the right ear hook portion 24R is connected to the other end of the cable 18.

[0049] A second right electroencephalogram (EEG) sensor 28R is provided along the right ear hook portion 24R. The second right EEG sensor 28R is provided on the surface of the right ear hook portion 24R facing the user's right ear, so that when the right ear hook portion 24R is worn over the right ear, it contacts the right ear, more specifically the back of the right ear (closer to the skull). By providing the second right EEG sensor 28R in contact with the back of the right ear, the potential can be detected at a position closer to the brain, thereby improving the accuracy of EEG measurement. The second right EEG sensor 28R is an electrode that detects the potential of the head together with the first right EEG sensor 26R. The second right EEG sensor 28R is made of, for example, conductive rubber made of carbon. For example, the potential detected by the second right EEG sensor 28R is used as a reference potential, and the first right EEG sensor 26R measures the potential (potential difference) from that reference potential. The second right electroencephalogram sensor 28R is an example of a fourth electroencephalogram measurement means.

[0050] When the right ear hook portion 24R is placed over the right ear and the right speaker portion 20R is inserted into the right ear canal, the right ear is sandwiched between the first right electroencephalogram sensor 26R provided on the right speaker portion 20R and the second right electroencephalogram sensor 28R provided on the right ear hook portion 24R. In this state, the electroencephalogram is measured by the first right electroencephalogram sensor 26R and the second right electroencephalogram sensor 28R.

[0051] As described above, by sandwiching the right ear between the first right EEG sensor 26R and the second right EEG sensor 28R, the EEG sensor can be brought into close contact with the right ear, thereby improving the accuracy of EEG measurement. In addition, since the first right EEG sensor 26R is inserted into the left ear canal, the degree of contact between the first right EEG sensor 26R and the right ear is increased.

[0052] The earphone device 10 is equipped with a wireless communication function (e.g., Bluetooth) and communicates wirelessly with the terminal device 12. The communication interface (communication chip) having this wireless communication function is built into, for example, the left and right earphone sections. For example, a communication chip for wireless communication (e.g., a Bluetooth communication chip) is built into the left support section 22L (case) of the left earphone section 16L, and similarly, a communication chip for wireless communication is built into the right support section 22R (case) of the right earphone section 16R. The left earphone section 16L receives the sound signal (left ear sound signal) transmitted from the terminal device 12 using the communication chip built into the left support section 22L and generates sound according to that sound signal. The right earphone section 16R receives the sound signal (right ear sound signal) transmitted from the terminal device 12 using the communication chip built into the right support section 22R and generates sound according to that sound signal.

[0053] Furthermore, information indicating the electroencephalogram (EEG) measurement results obtained from the left earphone unit 16L and the right earphone unit 16R is transmitted wirelessly (e.g., via Bluetooth) from the earphone device 10 to the terminal device 12.

[0054] The left earphone unit 16L and the right earphone unit 16R are physically connected by a cable 18, and they send and receive data to and from each other via the cable 18.

[0055] Information showing the electroencephalogram (EEG) measurement results from the left earphone unit 16L and information showing the EEG measurement results from the right earphone unit 16R may be transmitted separately from the earphone device 10 to the terminal device 12, or this information may be combined by statistical processing, for example, and then transmitted to the terminal device 12. As statistical processing, for example, a simple average or weighted average of the EEG measurement results from the left earphone unit 16L and the EEG measurement results from the right earphone unit 16R may be performed in the earphone device 10, and information showing the results of this processing may be transmitted from the earphone device 10 to the terminal device 12 by a communication chip installed in either the left earphone unit 16L or the right earphone unit 16R. Of course, the information before such processing is performed may be transmitted from the earphone device 10 to the terminal device 12, and such processing may be performed in the terminal device 12.

[0056] For example, if a malfunction occurs in the cable 18 and data transmission and reception between the left earphone unit 16L and the right earphone unit 16R becomes impossible, information indicating the electroencephalogram (EEG) measurement results from each earphone unit may be transmitted separately to the terminal device 12. In this case, information indicating the EEG measurement results from the left earphone unit 16L is transmitted from the left earphone unit 16L to the terminal device 12 by a communication chip installed in the left earphone unit 16L. Similarly, information indicating the EEG measurement results from the right earphone unit 16R is transmitted from the right earphone unit 16R to the terminal device 12 by a communication chip installed in the right earphone unit 16R. By transmitting the EEG measurement results in this manner, even if the cable 18 malfunctions, EEG measurement can be continued and the EEG measurement results can be transmitted to the terminal device 12.

[0057] Furthermore, if a communication chip installed in one earphone unit fails, the non-faulty communication chip may be used to transmit information indicating the electroencephalogram (EEG) measurement results to the terminal device 12. In this case, the information indicating the EEG measurement results from the left earphone unit 16L and the information indicating the EEG measurement results from the right earphone unit 16R may be transmitted separately to the terminal device 12, or information generated by applying statistical processing or other processing to both pieces of information may be transmitted to the terminal device 12. By transmitting the EEG measurement results in this way, even if one communication chip fails, the EEG measurement can be continued and the EEG measurement results can be transmitted to the terminal device 12.

[0058] Furthermore, if one earphone unit malfunctions, information indicating the brainwave measurement results from the other, functioning earphone unit may be transmitted to the terminal device 12. By transmitting the brainwave measurement results in this manner, even if one earphone unit malfunctions, brainwave measurement can be continued and the brainwave measurement results can be transmitted to the terminal device 12.

[0059] Failures in cable 18 or the communication chip are detected by checking sensors and ensuring continuity.

[0060] A battery that supplies power to drive the earphone device 10 is installed in either the left earphone section 16L or the right earphone section 16R. For example, the battery is built into the left support section 22L (case) of the left earphone section 16L, and the right earphone section 16R does not have a built-in battery. In this case, each part of the left earphone section 16L (e.g., the driver unit in the left speaker section 20L, the communication chip, components related to electroencephalogram measurement, etc.) is powered by the battery. Alternatively, power is supplied from the battery built into the left support section 22L to the right earphone section 16R via the cable 18, and each part of the right earphone section 16R (e.g., the driver unit in the right speaker section 20R, the communication chip, components related to electroencephalogram measurement, etc.) is powered by that power. It is also possible that the left earphone section 16L does not have a battery, and the right earphone section 16R does. In this case as well, power is supplied from the right earphone section 16R to the left earphone section 16L via the cable 18. Battery charging may be performed, for example, via a USB cable, or by wireless power supply when the earphone device 10 is placed in the case. Note that batteries may be provided in both the left earphone section 16L and the right earphone section 16R.

[0061] Furthermore, to prevent the battery charging from affecting the potential measurement, the potential measurement may be stopped when charging begins. As an alternative example, if shielding material (electromagnetic wave shielding material) is provided around the battery and charging components, the potential measurement may be performed even during charging.

[0062] The earphone device 10 may be equipped with an operating unit such as a remote control.

[0063] The shape of the ear hook portion will be explained in more detail below with reference to Figure 5. Figure 5 shows the left earphone portion 16L as viewed from the left support portion 22L side.

[0064] The left ear hook portion 24L includes a first curved portion 30 having a first curvature, a second curved portion 32 having a second curvature, and a third curved portion 34 having a third curvature. One end of the first curved portion 30 is connected to the left support portion 22L, and the first curved portion 30 is a member provided from the left support portion 22L to the second curved portion 32. One end of the second curved portion 32 is connected to the other end of the first curved portion 30, and the second curved portion 32 is a member provided from its connection point to the third curved portion 34. One end of the third curved portion 34 is connected to the other end of the second curved portion 32, and the third curved portion 34 is a member provided from its connection point to the cable 18, and the other end of the third curved portion 34 is connected to the cable 18. The first curved portion 30, the second curved portion 32, and the third curved portion 34 are integrated, thereby forming the left ear hook portion 24L. Of course, the first curved section 30, the second curved section 32, and the third curved section 34 may each be made of separate members and connected to one another.

[0065] The first curvature of the first curved section 30 is, for example, R12.5 to R14.5. The first curvature of the first curved section 30 may be R13.0 to R14.0 or R13.5. The second curvature of the second curved section 32 is, for example, R15.5 to R17.5. The second curvature of the second curved section 32 may be R16.0 to R17.0 or R16.5. The third curvature of the third curved section 34 is, for example, R106.5 to R108.5. The third curvature of the third curved section 34 may be R107.0 to R108.0 or R107.6.

[0066] Thus, the left ear hook portion 24L has a shape with different curvatures in each section, and is formed to cover the base of the left ear as a whole. By changing the curvature in different sections, the degree of contact of the left earphone portion 16L with the left ear is increased, and as a result, the accuracy of electroencephalogram (EEG) measurement can be improved. Of course, the curvature values ​​described above are merely examples, and the curvature values ​​may be determined to suit the shape of the user's ear.

[0067] Furthermore, if we define the horizontal direction as the direction perpendicular to the direction in which gravity acts (vertical direction), the left support part 22L is positioned so as to tilt at a predetermined angle θ from the horizontal direction when the left ear hook part 24L is placed over the user's left ear and the left earphone part 16L is fitted to the left ear. This angle θ is, for example, 37° to 43°. The angle θ may also be 39° to 41° or 40°. By adopting such an angle, the degree to which the left earphone part 16L fits snugly against the left ear can be improved.

[0068] Furthermore, the angle φ between the base of the first curved portion 30 and the side surface of the left support portion 22L is, for example, 30° to 40°. By providing the first curved portion 30 at such an angle, the degree to which the left earphone portion 16L adheres to the left ear can be improved.

[0069] The right earphone section 16R is the same as the left earphone section 16L. The right ear hook section 24R includes a first curved section having the first curvature described above, a second curved section having the second curvature described above, and a third curved section having the third curvature described above. The right support section 22R is positioned to be inclined with the angle θ described above, and the first curved section is positioned to be inclined with the angle φ described above.

[0070] According to the configuration shown in Figure 5, the left ear hook portion 24L of the left earphone portion 16L is placed on the left ear, and then the left earphone portion 16L is rotated by an angle θ (for example, by rotating it toward the back of the head) to attach the left earphone portion 16L to the left ear. By rotating the left earphone portion 16L to attach it to the left ear in this way, the degree of contact with the left earphone portion 16L to the left ear is increased, making it difficult for the left earphone portion 16L to fall out of the left ear. The method of attaching the right earphone portion 16R to the right ear is the same; by rotating the right earphone portion 16R to attach it to the right ear, the degree of contact with the right earphone portion 16R to the right ear is increased, making it difficult for the right earphone portion 16R to fall out of the right ear.

[0071] The following provides a detailed explanation of the electroencephalogram (EEG) sensors located on the ear pads that make up the left speaker unit 20L and the right speaker unit 20R.

[0072] Figures 6 and 7 show examples of ear pads. Figure 6 is a side view of the ear pad, and Figure 7 is a top view of the ear pad (the side inserted into the ear).

[0073] The ear pad 36 is used as an ear pad constituting the left speaker section 20L and the right speaker section 20R. The ear pad 36 itself can be a known ear pad. In the examples shown in Figures 6 and 7, the ear pad 36 has a circular cross-section and a columnar shape that narrows in width (diameter of the circle) towards the tip. The ear pad 36 has a through-hole 36a that penetrates in the height direction, and sound is transmitted to the outside through this through-hole 36a. The ear pad 36 is made of a resin such as rubber, for example.

[0074] An electroencephalogram (EEG) sensor 38, which serves as an electrode, is provided on the side of the ear pad 36. The EEG sensor 38 is composed of multiple linear sensors (electrodes) arranged in parallel in the height direction of the ear pad 36, and is positioned along the circumferential direction on the outer periphery of the ear pad 36.

[0075] When the ear pad 36 is provided on the left speaker unit 20L, the electroencephalogram (EEG) sensor 38 functions as a first left EEG sensor 26L. Similarly, when the ear pad 36 is provided on the right speaker unit 20R, the EEG sensor 38 functions as a first right EEG sensor 26R.

[0076] The electroencephalogram (EEG) sensor 38 is made of, for example, a conductive rubber made of carbon. To reduce electrical resistance, the EEG sensor 38 may contain silver paste to lower electrical resistance.

[0077] If the electroencephalogram (EEG) sensor 38 has a certain level of humidity, it may be easier to measure its electrical potential. Therefore, the surface of the EEG sensor 38 may be processed to maintain its humidity. Generally, the wettability of a solid surface depends on the roughness of the solid surface. For example, according to Wenzel's formula, the more the surface roughness increases, the smaller the contact angle becomes on a hydrophilic surface, making the surface easier to wet (i.e., easier to retain humidity). Therefore, the surface roughness of the EEG sensor 38 may be adjusted by processing the surface of the EEG sensor 38 so that the surface roughness is such that a humidity level suitable for easy measurement of electrical potential is obtained. As another example, by introducing oxygen-containing functional groups to the surface of the EEG sensor 38 through surface treatment with fluorine gas, hydrophilicity may be expressed on the surface of the EEG sensor 38, thereby maintaining the humidity of the EEG sensor 38. Of course, the humidity of the EEG sensor 38 may be maintained at a humidity level suitable for easy measurement of electrical potential by methods other than those mentioned above.

[0078] Figures 8 and 9 show other examples of electroencephalogram (EEG) sensors. Figures 8 and 9 are side views of the ear pad 36. The ear pad 36 itself has the same shape as the ear pad 36 shown in Figures 6 and 7. In the example shown in Figure 8, the EEG sensor 40, which serves as an electrode, is composed of multiple triangular sensors (electrodes) arranged circumferentially on the outer periphery of the ear pad 36. In the example shown in Figure 9, the EEG sensor 42, which serves as an electrode, is composed of multiple circular sensors (electrodes) arranged circumferentially on the outer periphery of the ear pad 36.

[0079] Figures 10 to 13 show yet another example of an electroencephalogram (EEG) sensor. Figures 10, 12, and 13 are side views of the ear pad 36, and Figure 11 is a top view of the ear pad 36 (the side inserted into the ear). The ear pad 36 itself has the same shape as the ear pad 36 shown in Figures 6 and 7. In the examples shown in Figures 10 and 11, the EEG sensor 44 as an electrode is composed of multiple linear sensors (electrodes) arranged in parallel in the circumferential direction of the ear pad 36, and is positioned along the height direction on the outer periphery of the ear pad 36. In the example shown in Figure 12, the EEG sensor 46 as an electrode is composed of multiple triangular sensors (electrodes), and is positioned along the height direction on the outer periphery of the ear pad 36. In the example shown in Figure 13, the EEG sensor 48 as an electrode is composed of multiple circular sensors (electrodes), and is positioned along the height direction on the outer periphery of the ear pad 36.

[0080] The shapes and arrangements of the electroencephalogram (EEG) sensors described above are merely examples, and other shapes and arrangements may be used. Furthermore, EEG sensors may be provided across the entire outer surface of the ear pad 36.

[0081] The following describes another example of EEG sensor installation with reference to Figures 14 to 17. Figures 14 to 17 are perspective views showing a portion of the configuration of the earphone device 10.

[0082] In the example shown in Figure 14, an electroencephalogram (EEG) sensor (electrode) is provided on the right earphone section 16R, while no EEG sensor (electrode) is provided on the left earphone section 16L. In other words, a first right EEG sensor 26R is provided on the side of the right speaker section 20R (the side of the earpad), and a second right EEG sensor 28R is provided on the right ear hook section 24R. In this case, the potential is measured by the first right EEG sensor 26R and the second right EEG sensor 28R provided on the right earphone section 16R, and information indicating the measurement result is transmitted from the earphone device 10 to the terminal device 12 as information indicating the EEG measurement result. Note that an EEG sensor may be provided on the left earphone section 16L, and an EEG sensor may not be provided on the right earphone section 16R.

[0083] In the example shown in Figure 15, similar to the example shown in Figure 14, an electroencephalogram (EEG) sensor (electrode) is provided on the right earphone section 16R, while no EEG sensor (electrode) is provided on the left earphone section 16L. The second right EEG sensor 28R, provided on the right ear hook section 24R of the right earphone section 16R, is a sensor that includes two EEG sensors 50 (electrodes) provided along the right ear hook section 24R. In this case, for example, the potential difference between one of the two EEG sensors 50 and the first right EEG sensor 26R is adopted as the potential difference measured by the right earphone section 16R. Of course, the second right EEG sensor 28R may include three or more EEG sensors 50. By configuring the second right EEG sensor 28R with multiple EEG sensors 50, the second right EEG sensor 28R can more easily come into contact with the right ear, making it easier for the potential to be reliably measured by the second right EEG sensor 28R. In other words, since the electrical potential is measured when one of the multiple electroencephalogram sensors 50 comes into contact with the right ear, the electrical potential is measured more reliably compared to using only one electroencephalogram sensor.

[0084] In the example shown in Figure 16, a first right EEG sensor 26R is provided on the side of the right speaker unit 20R (the side of the ear pad), a second right EEG sensor 28R is provided on the right ear hook unit 24R, and a second left EEG sensor 28L is provided on the left ear hook unit 24L. A first left EEG sensor 26L is not provided. In this case, for example, the potential difference between the first right EEG sensor 26R and the second right EEG sensor 28R, or the potential difference between the first right EEG sensor 26R and the second left EEG sensor 28L is measured, and the measured potential difference is adopted as the EEG measurement result. By using the second left EEG sensor 28L and the second right EEG sensor 28R in this way, EEG measurement becomes possible even if one of the EEG sensors is not in contact with the ear, or if the contact between one of the EEG sensors and the ear is not good.

[0085] In the example shown in Figure 17, a first right electroencephalogram (EEG) sensor 26R is provided on the side of the right speaker unit 20R (side of the ear pad), a second right EEG sensor 28R is provided on the right ear hook unit 24R, a first left EEG sensor 26L is provided on the side of the left speaker unit 20L (side of the ear pad), and a second left EEG sensor 28L is provided on the left ear hook unit 24L. Similar to the example shown in Figure 15, the second right EEG sensor 28R is a sensor that includes two EEG sensors 50 (electrodes) provided along the right ear hook unit 24R. Similarly, the second left EEG sensor 28L is a sensor that includes two EEG sensors 52 (electrodes) provided along the left ear hook unit 24L. In this case, for example, the potential difference between one of the two EEG sensors 50 and the first right EEG sensor 26R is adopted as the potential difference measured by the right earphone unit 16R, and the potential difference between one of the two EEG sensors 52 and the first left EEG sensor 26L is adopted as the potential difference measured by the left earphone unit 16L. Of course, three or more EEG sensors 50, 52 may be provided. By configuring the second right EEG sensor 28R and the second left EEG sensor 28L with multiple sensors in this way, the second right EEG sensor 28R is more likely to come into contact with the right ear, and the second left EEG sensor 28L is more likely to come into contact with the left ear, so that the potential can be measured more reliably by the second right EEG sensor 28R and the second left EEG sensor 28L.

[0086] According to the earphone device 10 of this embodiment, by sandwiching the ear with multiple electroencephalogram sensors, the electroencephalogram sensors can be brought into close contact with the ear, thereby improving the accuracy of potential measurement, and as a result, improving the accuracy of electroencephalogram measurement.

[0087] The functions of the earphone device 10 will be explained in detail below with reference to Figure 18. Figure 18 is a functional block diagram of the earphone device 10.

[0088] As described above, the earphone device 10 includes a left earphone section 16L, a right earphone section 16R, and a cable 18 connecting the left earphone section 16L and the right earphone section 16R.

[0089] The left earphone unit 16L includes a left speaker unit 20L, a first left electroencephalogram sensor 26L, a second left electroencephalogram sensor 28L, a communication unit 54L, a battery 56, and a control unit 58L.

[0090] The communication unit 54L is a communication interface (communication chip) and has the function of transmitting data to other devices and receiving data from other devices. The communication unit 54L has, for example, a wireless communication function. As mentioned above, the communication method used is short-range wireless communication such as Bluetooth, infrared communication, visible light communication, Wi-Fi communication, etc. Here, as an example, short-range wireless communication (for example, Bluetooth) is used. For example, the communication unit 54L receives a signal representing the sound emitted from the left speaker unit 20L from an external device (for example, terminal device 12) via short-range wireless communication. The left speaker unit 20L generates sound according to the signal received by the communication unit 54L. The communication unit 54L may also transmit information indicating the electroencephalogram measurement results to an external device (for example, terminal device 12) via short-range wireless communication. Furthermore, the earphone device 10 may be used in combination with external devices other than the terminal device 12 (for example, a playback device or a display device), and may communicate with external devices other than the terminal device 12 to receive sound signals from said external devices, or to transmit information indicating the results of electroencephalogram measurement to said external devices.

[0091] Battery 56 supplies power to each part of the left earphone unit 16L. For example, power is supplied from battery 56 to the left speaker unit 20L, the communication unit 54L, and the control unit 58L, and these units are driven by the power supplied from battery 56. Also, as will be described later, if there is no battery in the right earphone unit 16R, power is supplied from battery 56 to each part of the right earphone unit 16R via cable 18. For example, a rechargeable battery is used as battery 56. Of course, a non-rechargeable battery may also be used as battery 56. In addition, a shielding member (electromagnetic wave shielding member) may be provided around battery 56 and components related to charging. By providing a shielding member, noise caused by electromagnetic waves emitted during charging can be reduced, thereby improving the accuracy of electroencephalogram measurement.

[0092] The control unit 58L controls the operation of each part of the left earphone unit 16L. For example, the control unit 58L controls communication by the communication unit 54L, processes the electroencephalogram measurement results (e.g., statistical processing), detects malfunctions in each part of the left earphone unit 16L, and detects malfunctions in the cable 18.

[0093] The right earphone unit 16R includes a right speaker unit 20R, a first right electroencephalogram sensor 26R, a second right electroencephalogram sensor 28R, a communication unit 54R, and a control unit 58R.

[0094] The communication unit 54R, like the communication unit 54L, is a communication interface (communication chip) and has the function of transmitting data to other devices and receiving data from other devices. The communication unit 54R has, for example, a wireless communication function. The communication method is the same as the communication method adopted by the communication unit 54L (for example, Bluetooth). For example, the communication unit 54R receives a signal representing the sound emitted from the right speaker unit 20R from the terminal device 12 via short-range wireless communication. The right speaker unit 20R generates sound according to the signal received by the communication unit 54R. The communication unit 54R may also transmit information indicating the electroencephalogram measurement results to the terminal device 12 via short-range wireless communication.

[0095] The control unit 58R controls the operation of each part of the right earphone unit 16R. For example, the control unit 58R controls communication by the communication unit 54R, processes the electroencephalogram measurement results (e.g., statistical processing), detects malfunctions in each part of the right earphone unit 16R, and detects malfunctions in the cable 18.

[0096] Alternatively, either the control unit 58L or the control unit 58R may be provided in the earphone device 10, and one of the control units may control the operation of each part of the earphone device 10.

[0097] The right earphone unit 16R does not have a battery. As described above, power is supplied to the right earphone unit 16R from the battery 56 located in the left earphone unit 16L via the cable 18, and the right speaker unit 20R, communication unit 54R, and control unit 58R are driven by the power supplied by the battery 56. By providing a battery in only one earphone unit, the overall weight of the earphone device 10 can be reduced.

[0098] Of course, batteries may be provided in both the left earphone section 16L and the right earphone section 16R. In this case, power is supplied to each part of the right earphone section 16R from the battery installed in the right earphone section 16R. As another example, a battery may be provided in the right earphone section 16R, but not in the left earphone section 16L. In this case, power is supplied to the left earphone section 16L from the battery installed in the right earphone section 16R via the cable 18.

[0099] When the first potential difference is measured by the first left EEG sensor 26L and the second left EEG sensor 28L, and the second potential difference is measured by the first right EEG sensor 26R and the second right EEG sensor 28R, the control unit 58L or control unit 58R applies statistical processing (e.g., simple average or weighted average) to the first and second potential differences, and adopts the values ​​obtained by the statistical processing as the EEG measurement results. In this case, information indicating the EEG measurement results is transmitted from the earphone device 10 to the terminal device 12 by the communication unit 54L or communication unit 54R. Of course, the information before the statistical processing is performed may be transmitted from the earphone device 10 to the terminal device 12, where the statistical processing is performed. In this case, information indicating the first potential difference is transmitted from the earphone device 10 to the terminal device 12 by the communication unit 54L as information indicating the first electroencephalogram measurement result, and information indicating the second potential difference is transmitted from the earphone device 10 to the terminal device 12 by the communication unit 54R as information indicating the second electroencephalogram measurement result.

[0100] If a failure occurs in cable 18, information indicating the first electroencephalogram measurement result may be transmitted from earphone device 10 to terminal device 12 by communication unit 54L, and information indicating the second electroencephalogram measurement result may be transmitted from earphone device 10 to terminal device 12 by communication unit 54R.

[0101] If either the communication unit 54L or the communication unit 54R fails, the non-faulty communication unit (communication chip) may be used to transmit information indicating the electroencephalogram measurement results to the terminal device 12.

[0102] If either the left earphone unit 16L or the right earphone unit 16R malfunctions, the undamaged earphone unit may transmit information indicating the electroencephalogram measurement results obtained by that earphone unit to the terminal device 12.

[0103] While the battery 56 is being charged, the control unit 58L or control unit 58R does not need to transmit information indicating the electroencephalogram (EEG) measurement results to the terminal device 12, or it may stop the EEG measurement. As another example, while the battery 56 is being charged, the control unit 58L may stop the EEG measurement using the first left EEG sensor 26L and the second left EEG sensor 28L, and the control unit 58R may continue the EEG measurement using the first right EEG sensor 26R and the second right EEG sensor 28R. In this case, information indicating the EEG measurement results obtained by the right earphone unit 16R is transmitted from the earphone device 10 to the terminal device 12. While the battery 56 is being charged, the EEG measurement results obtained by the left earphone unit 16L, where the battery 56 is located, are susceptible to noise caused by the charging, but the EEG measurement results obtained by the right earphone unit 16R, where the battery is not located, are less susceptible to such noise. Therefore, by discontinuing electroencephalogram (EEG) measurement by the left earphone unit 16L and transmitting information indicating the EEG measurement results obtained by the right earphone unit 16R to the terminal device 12, the terminal device 12 is provided with EEG measurement results that are less affected by noise caused by charging. Of course, EEG measurement by the left earphone unit 16L may be continued even while the battery 56 is charging. In this case, the EEG can be obtained using the measurement results obtained by the right earphone unit 16R, without using the measurement results from the left earphone unit 16L. For example, information indicating the measurement results from the left earphone unit 16L does not need to be transmitted from the earphone device 10 to the terminal device 12, nor does it need to be used during EEG analysis.

[0104] The configuration of the terminal device 12 will be described in detail below with reference to Figure 19. Figure 19 is a functional block diagram of the terminal device 12.

[0105] The communication unit 60 is a communication interface and has the function of transmitting data to other devices and receiving data from other devices. The communication unit 60 has, for example, wireless communication capabilities. As a communication method, short-range wireless communication such as Bluetooth, infrared communication, visible light communication, Wi-Fi communication, etc., can be used. The communication unit 60 may also have wired communication capabilities.

[0106] The communication unit 60 communicates with the earphone device 10, for example, by short-range wireless communication (e.g., Bluetooth). More specifically, the communication unit 60 transmits a signal representing the sound emitted from the left speaker unit 20L to the communication unit 54L of the left speaker unit 20L, and transmits a signal representing the sound emitted from the right speaker unit 20R to the communication unit 54R of the right speaker unit 20R, using short-range wireless communication. The communication unit 60 also receives information indicating the electroencephalogram (EEG) measurement results from the earphone device 10 using short-range wireless communication. The terminal device 12 may be used in combination with earphones other than the earphone device 10 or with an EEG measuring device. In this case, the terminal device 12 may receive information indicating the EEG measurement results from the EEG measuring device and transmit sound signals to the earphone device 10 or other earphones.

[0107] Furthermore, the communication unit 60 communicates with other devices via the communication path N using wireless communication functions such as Wi-Fi or wired communication functions. The communication unit 60 sends and receives information, for example, via the Internet. The communication unit 60 may download music data from the music distribution server 14 via the communication path N, or it may receive music data in streaming format.

[0108] The storage unit 62 is a storage device such as a hard disk or memory (e.g., an SSD). The storage unit 62 stores, for example, various data, various programs, address information indicating the address of the music distribution server 14, etc. The storage unit 62 also includes a list storage unit 64.

[0109] The list storage unit 64 stores data for one or more content playlists. Content is, for example, music or video, and a content playlist is a list composed of content identification information for identifying content. One or more content items are registered in a content playlist, and the content playlist is composed of one or more content identification information corresponding to one or more content items.

[0110] The list storage unit 64 stores data for one or more music playlists as an example of a content playlist. A music playlist is a list composed of music identification information (e.g., song title, artist name, album name, etc.) for identifying music (songs). One or more songs are registered in a music playlist, and the music playlist is composed of one or more music identification information corresponding to one or more songs. Music playlists are created for each user, for example, and managed in association with the user. Specifically, user identification information (e.g., user ID, username, etc.) for identifying the user is associated with the music playlist data. In addition, an initial music playlist may be created in advance, or music playlists for each brainwave state may be created in advance, or music playlists for each brainwave state desired by the user may be created. The data for these music playlists may be stored in the list storage unit 64. An initial music playlist is a list composed of one or more music identification information corresponding to one or more songs that have been selected in advance. Of course, lists by genre, lists by artist, lists by year, etc., may also be created. The music data itself may be stored in the storage unit 62, or it may be stored in another device (for example, the music distribution server 14 or other servers).

[0111] The list storage unit 64 may store data for one or more video playlists as an example of a content list. A video playlist is a list composed of video identification information (e.g., video title, video creator, etc.) for identifying a video. One or more videos are registered in a video playlist, and the video playlist is composed of one or more video identification information corresponding to one or more videos. Video playlists are created for each user, for example, and managed in association with the user. Specifically, user identification information is associated with the data of the video playlist. In addition, an initial video playlist may be created in advance, or video playlists for each brainwave state may be created in advance. The data of these video playlists may be stored in the list storage unit 64. An initial video playlist is a list composed of one or more video identification information corresponding to one or more videos that have been selected in advance. Of course, lists by genre, lists by video creator, lists by year, etc. may also be created. The video data itself may be stored in the storage unit 62, or it may be stored in another device (e.g., a video distribution server or other server, etc.).

[0112] Furthermore, a content playlist containing both music and videos may be created and stored in the list storage unit 64.

[0113] The UI section 66 is a user interface section and includes a display section and an operation section. The display section is a display device such as a liquid crystal display. The operation section is an input device such as a touch panel, buttons, keyboard, or mouse. Of course, it may also be a user interface that combines the display section and the operation section (for example, a touch-type display or a device that electronically displays a keyboard etc. on a display).

[0114] The control unit 68 controls the operation of each part of the terminal device 12. The control unit 68 also includes an electroencephalogram state evaluation unit 70, a list creation unit 72, a display control unit 74, and a playback control unit 76.

[0115] The EEG state evaluation unit 70 receives information indicating the EEG measurement results and evaluates the user's EEG state by analyzing the EEG measurement results (e.g., potential difference). EEG states include, for example, focused, relaxed, sleepy, awake, etc. The EEG state evaluation unit 70 may also quantify the EEG state obtained by EEG analysis. In some cases, the user's EEG state may not be fixed to a single state, but rather a mixture of multiple EEG states. For example, if the EEG state includes both a "focused" state and a "relaxed" state, the EEG state evaluation unit 70 quantifies the "degree of focus" and the "degree of relaxation" respectively. Known techniques can be used as a method for evaluating the EEG state from the EEG measurement results (information indicating potential difference). For example, the EEG state can be evaluated by analyzing the delta waves, theta waves, alpha waves, and beta waves obtained from the EEG measurement results.

[0116] The electroencephalogram (EEG) state evaluation unit 70 may calculate a numerical value representing the EEG state for each unit of time (for example, every second), or it may calculate the average value (time average) of the numerical values ​​representing the EEG state over a predetermined period of time. The EEG state evaluation unit 70 may also generate a waveform that represents the time change of that numerical value (a waveform that represents the time change of the EEG state).

[0117] Furthermore, the EEG state evaluation unit 70 associates content with the EEG state. For example, during music playback, the EEG state evaluation unit 70 evaluates the user's EEG state based on information indicating the EEG measurement results and associates the music with the EEG state. Since the temporal changes in the EEG state are obtained, the EEG state at each individual point in time within a song is measured. This makes it possible to identify the EEG state at each individual point in time within a song.

[0118] The electroencephalogram (EEG) state evaluation unit 70 associates, for example, music identification information (e.g., title) that identifies music with EEG state information that indicates the user's EEG state. The music identification information is stored in the memory unit 62 in association with the EEG state information. The EEG state information is information that indicates the EEG state obtained while the song is being played, and includes, for example, a numerical value representing the EEG state per unit time, the average value of that value, and a waveform representing the time change of that value. The average value is, for example, the time average over the entire duration or a portion of the duration of a song (e.g., a specified duration). For example, if the EEG state corresponds to "concentration," the EEG state information includes the "degree of concentration" (numerical value) per unit time, its average value, a waveform representing the time change of the "degree of concentration," etc. Also, if multiple EEG states are present, the EEG state information includes a numerical value representing each EEG state per unit time, the average value (time average) of the numerical values ​​for each EEG state, and a waveform representing each EEG state. For example, if the brainwave state shows a mixture of "concentration" and "relaxation," the brainwave state information would include the "concentration level" (numerical value) per unit time, its average value, a waveform representing the change in "concentration level" over time, the "relaxation level" (numerical value) per unit time, its average value, and a waveform representing the change in "relaxation level" over time.

[0119] When brainwaves are measured during video playback, the process is similar to that for music: video identification information (e.g., title) that identifies the video is associated with brainwave state information that indicates the user's brainwave state.

[0120] The electroencephalogram (EEG) measurement results analyzed by the EEG state evaluation unit 70 may be results obtained by the earphone device 10 or results obtained by another EEG measurement device.

[0121] The electroencephalogram (EEG) state evaluation unit 70 may be provided in another device, rather than in the terminal device 12. For example, a management server may be included in the information processing system, and the EEG state evaluation unit 70 may be provided in that management server. In this case, the user's EEG state may be evaluated by the management server or other device, and information indicating that EEG state may be transmitted from the other device to the terminal device 12. Of course, the EEG state evaluation unit 70 may also be provided in the earphone device 10, and the EEG measurement results may be analyzed and the EEG state evaluated in the earphone device 10. In this case, EEG state information indicating that evaluation may be transmitted from the earphone device 10 to the terminal device 12.

[0122] The list creation unit 72 creates music playlists and video playlists as content playlists. The list creation unit 72 may create music playlists that include music identification information of music selected by the user, or video playlists that include video identification information of videos selected by the user, or it may automatically create music playlists and video playlists for each brainwave state. Of course, the list creation unit 72 may also create lists by genre, lists by artist or video creator, lists by era, etc.

[0123] As described above, if the user's brainwave state is evaluated while music is playing, the music is associated with the brainwave state. In this case, the list creation unit 72 creates a music playlist (a music playlist for that brainwave state) that is suitable for the brainwave state based on the evaluation results of the brainwave state. For example, if the average value of the numerical values ​​representing the brainwave state associated with a certain piece of music is above a threshold, the list creation unit 72 registers that music in a music playlist that is suitable for that brainwave state. For example, if a piece of music is associated with the brainwave states "concentration" and "relaxation," and the "concentration level" is above a threshold, and the "relaxation level" is below a threshold, the list creation unit 72 registers that music in a music playlist that is suitable for "concentration" (a music playlist for concentration). If the "relaxation level" is also above a threshold, the list creation unit 72 registers that music in a music playlist related to "concentration," as well as in a music playlist related to "relaxation" (a music playlist for relaxation). In this way, user-specific music playlists are created for each brainwave state.

[0124] If the user's brainwave state is evaluated during video playback, the processing is the same as for music, and a video playlist is created for each user-specific brainwave state.

[0125] The content list data may not be created by the list creation unit 72, but may be created by other devices (e.g., PCs, smartphones, music players, etc.), or by music distribution servers 14, video distribution servers, management servers, etc.

[0126] The display control unit 74 controls the display of various types of information. The display control unit 74 may display information indicating the brainwave state obtained by the brainwave state evaluation unit 70 (for example, numerical values ​​or waveforms) on the UI unit 66, or it may display a music playlist or a video playlist on the UI unit 66, or it may display information about the song or video currently being played on the UI unit 66.

[0127] The playback control unit 76 plays the content (music and videos) included in the content playlist.

[0128] For example, if a user specifies a music playlist from among the multiple music playlists stored in the list storage unit 64 and issues a playback command, the playback control unit 76 will play the music (songs) registered in the music playlist specified by the user. For example, if the music data registered in the music playlist is stored in the storage unit 62, the playback control unit 76 may retrieve the music data from the storage unit 62 and play it, or it may download the music data from the music distribution server 14 and play it, or it may play the music data that has been streamed by the music distribution server 14, or it may retrieve the music data from any other device and play it. Of course, if the user does not specify a music playlist and instead specifies the music (song) itself, the playback control unit 76 will play the specified music.

[0129] Furthermore, if the user specifies a desired brainwave state and instructs playback, the playback control unit 76 plays music (songs) to transition the user's brainwave state to or maintain that desired brainwave state. If music and brainwave states are associated, the playback control unit 76 plays music associated with the brainwave state desired by the user. For example, the playback control unit 76 plays music in which a numerical value (e.g., average value) representing the desired brainwave state is above a threshold. To give a specific example, if the desired brainwave state is "concentration," the playback control unit 76 plays music associated with a "concentration level" (e.g., average value) above a threshold. The playback control unit 76 may randomly play music associated with numerical values ​​above the threshold, or it may play music with high numerical values ​​before music with low numerical values, or if a genre or artist is specified, it may play music from that specified genre or artist that is associated with a numerical value above the threshold. The playback control unit 76 may also play music registered in a music playlist that matches the desired brainwave state. For example, if the desired brainwave state is "concentration," the playback control unit 76 plays music registered in a music playlist suitable for "concentration" (a music playlist for concentration).

[0130] Even while the music is playing, the earphone device 10 measures brainwaves, the brainwave state evaluation unit 70 evaluates the brainwave state, and that brainwave state is associated with the music. If music to which a brainwave state has already been associated is played, a new brainwave state is evaluated, and that new brainwave state is also associated with the music. In other words, both the previously obtained brainwave state and the newly obtained current brainwave state are associated with the same music. In this way, the brainwave state obtained with each playback is associated with the music as a history of brainwave states. This makes it possible for the user to compare past brainwave states with their current brainwave state when listening to the same music. Of course, the brainwave state obtained with the playback immediately preceding the current playback may be associated with the music, while brainwave states obtained in earlier times may not be associated with the music. In this example, brainwaves are measured by the earphone device 10 while music is playing, but of course, brainwaves can be measured by the earphone device 10 even without playing music or videos.

[0131] Furthermore, the playback control unit 76 may receive trial music data from the music distribution server 14 and play the trial music. This trial music data is, for example, data provided free of charge, its playback time is shorter than that of the paid version of the music data, and its sound quality is lower than that of the paid version of the music data. Even while the sample music is playing, the earphone device 10 measures brain waves, the brain wave state evaluation unit 70 evaluates the brain wave state, and the numerical values ​​and waveforms representing the brain wave state are displayed on the UI unit 66. The numerical values ​​representing the brain wave state obtained during the playback of the trial music may be presented to the user as a factor in deciding whether to purchase the music. As another example, a music playlist recommended by the music distribution server 14 may be displayed on the terminal device 12. Also, the trial music data may be data for one or more songs specified by the music distribution server 14, or music data selected from one or more genres.

[0132] The same processing is performed when playing videos as when playing music.

[0133] The content playlist data may not be stored in the list storage unit 64, but in another device (for example, a music distribution server 14, a video distribution server, or a management server). In this case, the playback control unit 76 retrieves the content playlist data from the other device where the content playlist data is stored, or refers to the content playlist stored in the other device, and plays the content included in that content playlist.

[0134] Furthermore, when measuring the brainwave state during playback of each piece of music, the playback control unit 76 plays a portion of the music (for example, a portion from the beginning to the middle of the song), and the brainwave state evaluation unit 70 evaluates the brainwave state based on the brainwave measurement results obtained during that playback. The playback control unit 76 and the brainwave state evaluation unit 70 may perform this playback and evaluation as a set for multiple pieces of music (songs). This allows each piece of music to be played partially, and the brainwave state during playback of each piece of music to be measured. The list creation unit 72 may use the information indicating the brainwave state obtained in this way to create a music playlist for each brainwave state. For example, if there are no existing music playlists for each brainwave state, performing the above set for multiple pieces of music will easily create music playlists for each brainwave state.

[0135] The following describes in detail the processing performed by terminal device 12.

[0136] When a user wears the earphone device 10 and their brainwaves are measured, information indicating the brainwave measurement results is transmitted from the earphone device 10 to the terminal device 12. The brainwave state evaluation unit 70 analyzes the information indicating the brainwave measurement results transmitted from the earphone device 10 to calculate a numerical value representing the user's brainwave state and generates a waveform that represents the time change of that numerical value. The display control unit 74 displays the brainwave display screen showing the evaluation and waveform on the UI unit 66.

[0137] Figure 20 shows an example of an EEG display screen. The EEG display screen 78 is a screen displayed on the UI unit 66. As an example, the EEG display screen 78 displays waveforms 80 and 82 and evaluation values ​​84 and 86. Waveform 80 is a waveform representing the time change of the user's "concentration level" as an example of an EEG state, and waveform 82 is a waveform representing the time change of the user's "relaxation level" as an example of an EEG state. Waveforms 80 and 82 are waveforms generated by the EEG state evaluation unit 70. Evaluation value 84 shows the time average of "concentration level" (for example, the average value over a predetermined period of time), and evaluation value 86 shows the time average of "relaxation level". Evaluation values ​​84 and 86 are values ​​calculated by the EEG state evaluation unit 70. In the example shown in Figure 20, the EEG states of "concentration" and "relaxation" are mixed, and each is quantified. Of course, only information indicating brainwave states specified by the user (e.g., numerical values) may be displayed, or only information indicating predetermined brainwave states may be displayed.

[0138] When music is played by the playback control unit 76, the user's brainwaves are measured by the earphone device 10 during playback, and information indicating the brainwave measurement results is transmitted from the earphone device 10 to the terminal device 12. The brainwave state evaluation unit 70 evaluates the user's brainwave state based on the information indicating the brainwave measurement results. The display control unit 74 displays a music playback screen on the UI unit 66 that displays the music selected for playback, and displays information indicating the brainwave state evaluation results on the music playback screen.

[0139] Figure 21 shows an example of a music playback screen. The music playback screen 88 is a screen displayed in the UI unit 66. The music playback screen 88 displays, for example, a playback operation button image, a seek bar, elapsed time, the song title "AAAAAAAAA", etc., as indicated by the arrow 90. The music playback screen 88 also displays an image 92 associated with the music being played, evaluation values ​​94 and 96, and arc-shaped evaluation bars 98 and 100. The data for image 92 may be stored in the terminal device 12 or in another device such as the music distribution server 14. Evaluation value 94 is a value indicating the user's "concentration level," and evaluation value 96 is a value indicating the user's "relaxation level." Evaluation values ​​94 and 96 may be instantaneous values ​​at the present time, or they may be average values ​​from the start of playback of the song being played to the present time. The evaluation bar 98 is an image representing the "concentration level." The length of the 98-point rating bar reflects the "concentration level" value; the higher the "concentration level" value, the longer the 98-point rating bar. The 100-point rating bar represents the "relaxation level." The length of the 100-point rating bar reflects the "relaxation level" value; the higher the "relaxation level" value, the longer the 100-point rating bar.

[0140] The electroencephalogram (EEG) state evaluation unit 70 associates music identification information for identifying the music being played with EEG state information indicating the EEG state obtained during playback, and stores the music identification information associated with the EEG state information in the memory unit 62. In this way, the EEG state evaluation unit 70 associates music identification information and EEG state information and stores them in the memory unit 62 for each piece of music that has been played. The list creation unit 72 creates a music playlist for each user's unique EEG state based on the EEG state information associated with the music identification information.

[0141] For example, suppose the threshold value for the brainwave state is set to "60". In the example shown in Figure 21, the average value of "concentration level" is "91", which is above the threshold of "60", so the list creation unit 72 registers the music shown in Figure 21 into a music playlist suitable for "concentration" (a music playlist for concentration). Note that the threshold value is just an example, and a different value may be used. Also, the user may be allowed to change the threshold value.

[0142] Figure 22 shows another example of a music playback screen. The music playback screen 102 is a screen displayed in the UI unit 66. As an example, the music playback screen 102 displays playback operation button images, song titles, etc., as indicated by arrow 104. The music playback screen 102 also displays waveforms 106, 108, evaluation value information 110, average value 112, and message 114 as information indicating the brainwave state associated with the music. The music may be, for example, music specified by the user, or music selected randomly. The brainwave state may be, for example, a brainwave state obtained in the past.

[0143] Waveform 106 represents the time-dependent change in the user's "concentration level" as an example of brainwave state, and waveform 108 represents the time-dependent change in the user's "relaxation level" as an example of brainwave state. Evaluation value information 110 is information that shows the evaluation value at a specified point in time within the song, indicating the "concentration level" and "relaxation level" at that point. In the example shown in Figure 22, the "concentration level" at that point is "71" and the "relaxation level" is "60". This display is possible because numerical values ​​representing the brainwave state are obtained for each unit of time. When the user specifies a time within the song, the evaluation value at that time is displayed. This shows the user what their brainwave state is at what time within a song. For example, the user can see when their "concentration level" is high (part of the song) or when their "relaxation level" is high. Average value 112 is the average value of the brainwave state numerical values ​​for the entire duration or a portion of the song. In the example shown in Figure 22, the average value of "Concentration Level" is greater than the average value of "Relaxation Level," so the average value of "Concentration Level" "77" is displayed. Furthermore, since this average value is above the threshold, it is evaluated as having concentrated well, and a message 114 to that effect is displayed. The average value of "Relaxation Level" may also be calculated and displayed.

[0144] A timer function may also be provided. For example, if the user specifies a desired brainwave state (e.g., concentration or relaxation) and a duration, the playback control unit 76 controls the playback of the music so that the user's brainwave state is maintained in the desired state for the specified duration. Multiple duration options are predetermined, and the user may specify a desired duration from among these options, or they may specify any duration they wish.

[0145] The following describes in detail the music playlists that match the brainwave state, with reference to Figure 23. Figure 23 shows an example of a playlist screen. The playlist screen 116 is a screen displayed on the UI unit 66. For example, when a user selects a music playlist from one or more music playlists, the display control unit 74 displays the playlist screen 116 on the UI unit 66 and displays information about the music included in the music playlist selected by the user on the playlist screen 116. If the user specifies a desired brainwave state, the display control unit 74 may display information about the music included in the music playlist that matches that desired brainwave state on the playlist screen 116.

[0146] In the example shown in Figure 23, information about music registered in a music playlist (concentration playlist) that matches the brainwave state of "concentration" is displayed. A concentration playlist is a list that contains one or more songs associated with a "concentration level" above a certain threshold.

[0147] The playlist screen 116 displays, for example, the rating 118 associated with the currently selected song (music) in the focus playlist, the rating 120 associated with the next song, and the rating 122 associated with the previous song. Ratings 118, 120, and 122 represent the "level of concentration." For example, the level of concentration associated with the selected song is "91," and a message is displayed indicating that the user was able to concentrate well on this song. An image with a shape corresponding to the level of concentration is also displayed. The title of the selected song, "AAAAAAAAA," is also displayed.

[0148] Waveforms 124, 126, and evaluation value information 128 are also displayed. These are pieces of information indicating the brainwave state associated with the selected song. Waveform 124 represents the time-dependent change in "concentration level," and waveform 126 represents the time-dependent change in "relaxation level." Evaluation value information 128 is information indicating the evaluation value at a specified point in time within the selected song, showing the "concentration level" and "relaxation level" at that point in time.

[0149] Additionally, a playlist evaluation value of 130 is displayed. The playlist evaluation value of 130 is an evaluation value of the "level of concentration" for all songs (all music) registered in the concentrated playlist, and is, for example, the average of the numerical values ​​(average values) of the concentration of all songs. In the example shown in Figure 23, the playlist evaluation value of 130 is "85". The playlist evaluation value of 130 is calculated by the list creation unit 72.

[0150] Furthermore, the playback control unit 76 may change the order of each song in the music playlist and play the music so that the user's brainwave state transitions to or is maintained at a desired brainwave state. For example, the playback control unit 76 may play the music in order from the song with the highest numerical value representing the desired brainwave state within the music playlist that matches the desired brainwave state. In the example above, the playback control unit 76 plays all the songs registered in the concentration playlist in order from the song with the highest "concentration level" evaluation value.

[0151] Figure 24 shows another playlist screen. Playlist screen 132 is a screen displayed in the UI unit 66. This playlist screen 132 displays, as an example, information about music registered in a music playlist that matches the brainwave state "concentration" (concentration playlist).

[0152] The playlist screen 132 displays, for example, the rating value 134 associated with the currently selected song in the focus playlist, the rating value 136 associated with the next song, and the rating value 138 associated with the previous song. Rating values ​​134, 136, and 138 represent the level of focus. For example, the level of focus associated with the selected song is "91," and a message indicating that the user was able to focus well on this song is displayed. Images related to the song and images with shapes corresponding to the level of focus are also displayed. The title of the selected song, "AAAAAAAAA," is also displayed.

[0153] Furthermore, as in the example shown in Figure 23, waveforms 140, 142, and evaluation value information 144 are displayed. These are pieces of information indicating the brainwave state associated with the selected song. Waveform 140 represents the time change of "concentration level," and waveform 142 represents the time change of "relaxation level." Evaluation value information 144 is information indicating the evaluation value at a specified point in time within the selected song, showing the "concentration level" and "relaxation level" at that point in time. Also, as in the example shown in Figure 23, the playlist evaluation value 146 is displayed.

[0154] In addition, comparison result information 148 is displayed. Comparison result information 148 is an example of information showing the effect of music playback on brainwave states, and shows the result of comparing the current playlist evaluation value with the playlist evaluation value at a past point in time. As mentioned above, each piece of music (song) has one or more brainwave states obtained in the past associated with it as a history, and the above comparison is performed using this history. This comparison is performed, for example, by the list creation unit 72. For example, the current playlist evaluation value (e.g., today's playlist evaluation value, this week's playlist evaluation value, this month's playlist evaluation value, this year's playlist evaluation value, etc.) is compared with the playlist evaluation value at a past point in time (e.g., yesterday's playlist evaluation value, last week's playlist evaluation value, last month's playlist evaluation value, last year's playlist evaluation value, etc.), and information showing the comparison result is displayed. In the example shown in Figure 24, the playlist evaluation value has increased by 5 points compared to last week. By displaying the comparison results in this way, users can learn about the differences between their past and current brainwave states, making the system enjoyable to use.

[0155] Furthermore, the EEG state evaluation unit 70 calculates the difference between a numerical value representing the EEG state during the previous playback and a numerical value representing the EEG state during the current playback for each piece of music, and the list creation unit 72 may change the playback order of each piece of music in the music playlist according to that difference. This difference corresponds to an example of the effect of music playback on the EEG state. For example, the list creation unit 72 sets the playback order of music in the music playlist higher for music with a larger increase in the numerical value. For example, for multiple pieces of music included in a music playlist that suits the same EEG state (for example, a music playlist for concentration), the playback order of music with a larger increase in the numerical value is set higher. The display control unit 74 may display information indicating the difference obtained for each piece of music on the UI unit 66. The EEG state evaluation unit 70 calculates the above difference for each piece of music with respect to the EEG state desired by the user, and the list creation unit 72 may change the playback order of each piece of music in the music playlist that suits the desired EEG state according to that difference.

[0156] Furthermore, the EEG state evaluation unit 70 may calculate, for each piece of music, the time required from the start of listening to the desired EEG state until the transition occurs (transition time), as an example of the effect of music playback on the EEG state. The display control unit 74 may display information indicating the transition time for each piece of music on the UI unit 66. In addition, the list creation unit 72 sets the playback order of music in the music playlist higher for music with shorter transition times. For example, for multiple pieces of music included in a music playlist that suits the same EEG state (e.g., a music playlist for concentration), the music with shorter transition times is set to a higher playback order. As a result, music with a greater effect on the EEG state is played first, so the time required to transition the user's EEG state to the desired EEG state is shortened compared to when music with a lesser effect is played first. The EEG state evaluation unit 70 calculates the transition time for each piece of music with respect to the EEG state desired by the user, and the list creation unit 72 may change the playback order of each piece of music in the music playlist that suits the desired EEG state according to its transition time.

[0157] Furthermore, the EEG state evaluation unit 70 may calculate the length of time (duration) for which the desired EEG state was maintained for each piece of music as an example of the effect of music playback on the EEG state. The display control unit 74 may display information indicating the duration for each piece of music on the UI unit 66. In addition, the list creation unit 72 sets the playback order of music with longer durations higher in the music playlist. For example, for multiple pieces of music included in a music playlist that suits the same EEG state (e.g., a music playlist for concentration), the music with longer durations is set higher in the playback order. As a result, music with a greater effect on the EEG state is played first, making it easier to maintain the desired EEG state for a longer period of time compared to playing music with a lesser effect first. The EEG state evaluation unit 70 calculates the duration for each piece of music with respect to the EEG state desired by the user, and the list creation unit 72 may change the playback order of each piece of music in the music playlist that suits the desired EEG state according to its duration.

[0158] As described above, the effect of music playback on brainwave states (for example, comparison results of playlist evaluation values, differences in numerical values ​​for each song, transition time, and duration) can be obtained. Since the effect of music playback is obtained for each user, the effect of music playback may be shared among multiple users, or competition may take place based on the effect of music playback. For example, the information processing system includes a management server, and information showing the effect of music playback for each user is transmitted from each user's terminal device 12 to the management server. The management server associates a ranking with each user based on the effect of music playback for each user and transmits information showing each user's ranking to each user's terminal device 12. The UI section 66 of each user's terminal device 12 displays each user's ranking. This creates a sense of competition among multiple users, allowing each user to enjoy using the system of this embodiment. In addition, the information showing the effect of music playback for each user may be transmitted to other users' terminal devices 12 via the management server or without going through the management server, and displayed on the UI section 66 of the terminal device 12. This allows users to know the effects of other users, and thus enjoy using the system of this embodiment.

[0159] Furthermore, information indicating each user's brainwave state may be transmitted from each user's terminal device 12 to a management server included in the information processing system, and the management server may manage and control each user's brainwave state. For example, the management server may transmit music to each user's terminal device 12 to transition or maintain each user's brainwave state to a specific brainwave state. For example, to help employees relax in the workplace, the management server may transmit music to each user's terminal device 12 to transition or maintain each employee's brainwave state to "relaxed." In this case, the management server may transmit different music to each individual user's terminal device 12.

[0160] According to this embodiment, music is played to transition or maintain the user's brainwave state to a desired brainwave state, so music that achieves the user's desired state can be played. The music that achieves the user's desired state may differ from user to user. According to this embodiment, by evaluating the brainwave state and controlling music playback using the evaluation results, music that achieves the user's desired state can be played for each user. For example, music that matches the user's preferences can be played.

[0161] (Integration with Music Distribution Services) The integration with music distribution services is described in detail below. The playback control unit 76 receives music data for listening from the music distribution server 14 and plays the music for listening. At this time, the brainwaves are measured by the earphone device 10, the brainwave state evaluation unit 70 evaluates the brainwave state, and the evaluation result (e.g., numerical value or waveform) is displayed. The control unit 68 determines whether or not to add the music to the user's music playlist based on the brainwave state during playback of the music for listening. The display control unit 74 displays information indicating the determination result on the UI unit 66. For example, if the numerical value representing the brainwave state is above a threshold, it is determined that the music should be added, and this is displayed. For example, if the "concentration level" is above a threshold during playback of a certain piece of music for listening, the music is displayed as music suitable for concentration. In other words, the music is recommended as music for concentration. This provides the user with information that is useful in deciding whether or not to purchase the music data. For example, music that matches the user's preferences is presented to the user.

[0162] Furthermore, sample music for each brainwave state is pre-prepared, and the music distribution server 14 transmits sample music data associated with the brainwave state specified by the user to the terminal device 12, which may then play the sample music. For example, sample music such as music for concentration and music for relaxation is provided, and if the user requests "concentration" as their brainwave state, concentration music is played as the sample music. During playback, if the "concentration level" exceeds a threshold, the music being sampled is recommended as music that enhances the user's concentration level. The display control unit 74 displays information indicating this recommendation on the UI unit 66. This makes it easier for the user to understand which music can help them achieve their desired brainwave state.

[0163] In addition, in music distribution services, the price of each song may be changed according to the effect of music playback on brainwave states (for example, the results of comparing playlist evaluation values, the difference in values ​​for each song, transition time, and duration). For example, the price of a song may increase as its effect increases. For example, information indicating the effect of music playback for each user is transmitted from each user's terminal device 12 to the music distribution server 14, and the music distribution server 14 applies statistical processing (for example, simple average or weighted average, etc.) to the effect of music playback for each user and determines the price of each song according to the value obtained from this application.

[0164] The system according to this embodiment may be linked with one music distribution service or with multiple music distribution services. When linking with multiple music distribution services, the system may be able to switch between music distribution services to enable the use of each service. Furthermore, if multiple music distribution services are integrated into a single music distribution service, the system may be able to enable the use of the integrated single music distribution service.

[0165] Furthermore, when the user wears the earphone device 10 and their brainwaves are measured, it may be possible to listen to music samples. For example, when information indicating the brainwave measurement results obtained from the measurement is sent from the terminal device 12 to the music distribution server 14, listening becomes possible, and music data for listening is sent from the music distribution server 14 to the terminal device 12 and the music for listening is played. This promotes the use of the earphone device 10 compared to a case where listening is possible even when the earphone device 10 is not being used.

[0166] Furthermore, the playback control unit 76 may change the volume of the music, rearrange the music, or change the playback speed of the music depending on the user's brainwave state. Even with the same song, the impression the user receives may differ depending on the volume, arrangement, and speed, which may change the brainwave state. The playback control unit 76 changes the volume of the music being played, rearranges the music, or changes the playback speed so that the user's brainwave state during music playback is closer to the desired brainwave state, that is, so that the numerical value representing the desired brainwave state becomes higher.

[0167] (Modification 1) Hereinafter, modification 1 of the music playlist will be described with reference to Figures 25 and 26. Figure 25 shows an example of the condition input screen, and Figure 26 shows an example of the music playback screen.

[0168] First, let's explain the condition input screen with reference to Figure 25. The condition input screen 150 is a screen displayed on the UI unit 66. For example, when a user gives a command to display the condition input screen 150, the display control unit 74 displays the condition input screen 150 on the UI unit 66. The condition input screen 150 displays input fields 152 and 154. Input field 152 is a field for entering information indicating the "desired brainwave state," and input field 154 is a field for entering information indicating the "location." As an example, input field 152 displays a list of candidates for the "desired brainwave state" in a pull-down format, and input field 154 displays a list of candidates for the "location" in a pull-down format. Of course, the user may also directly enter a string indicating the desired brainwave state or a string indicating the location. In the example shown in Figure 25, "concentration" is specified as the "desired brainwave state," and "jazz cafe" is specified as the "location." In other words, the user's wish is to "concentrate in a jazz cafe."

[0169] The display control unit 74 causes the UI unit 66 to display a music playlist containing music associated with the specified desired brainwave state and location. In the example shown in Figure 25, the music identification information (e.g., song title) registered in the music playlist is displayed in the song display field 156. The music associated with brainwave states and locations will be described in detail below.

[0170] In the modified version, music (song), the brainwave state during playback of that music, and the location where the music was played are associated with each other. As described above, a brainwave state is associated with each piece of music. The location where the music was played is identified, for example, by a GPS (Global Positioning System) function. For example, if the playback device (e.g., terminal device 12) is equipped with a GPS function and music is played on the playback device, the location information of the playback device during playback is acquired by the GPS function, and brainwave measurement results are obtained by the earphone device 10. In this way, the music, the location of the playback device playing the music, and the user's brainwave state during playback are obtained, and the brainwave state evaluation unit 70 associates the music identification information of the music, the location information (location information), and the brainwave state information and stores them in the memory unit 62. As a result, when a brainwave state and location are specified, the music associated with the specified brainwave state and location, that is, the music in which the specified brainwave state was obtained at the specified location, is identified.

[0171] The list creation unit 72 creates music playlists for each brainwave state and location according to the association between music identification information, location information, and brainwave state information. The display control unit 74 displays the music playlists containing music associated with the specified brainwave state and location on the UI unit 66. In the example shown in Figure 25, "concentration" is specified as the "desired brainwave state" and "jazz cafe" is specified as the "location," so the display control unit 74 displays the music playlists containing music associated with the brainwave state "concentration" and the location "jazz cafe" on the UI unit 66. This music playlist can be said to be a list suitable for concentrating in a jazz cafe.

[0172] Alternatively, an initial music playlist may be created in advance, with music, locations, and brainwave states that are presumed to be obtained by playing that music in those locations associated with each other, and this initial music playlist may be used. In this case, the display control unit 74 will display the initial music playlist associated with the specified brainwave state and location on the UI unit 66.

[0173] The condition input screen 150 displays a play button image 158, and when the user presses this play button image 158, the screen transitions to the music playback screen 160 shown in Figure 26. The music playback screen 160 is for playing music included in the music playlist selected as described above (for example, a music playlist suitable for concentrating in a jazz cafe). The music playback screen 160 displays information 162, for example, that indicates the brainwave state associated with the song to be played. This information 162 is, for example, an image with a shape corresponding to a numerical value. The music playback screen 160 displays a play button image 164, and when the user presses this play button image 164, the song to be played is played.

[0174] The music playback screen 160 displays button images 166 and 168 representing brainwave states. When a user presses a button image, the display control unit 74 displays a music playlist for the brainwave state associated with that button image on the UI unit 66. Button image 166 is associated with the brainwave state "concentration," and button image 168 is associated with the brainwave state "relaxation." In the example shown in Figures 25 and 26, "concentration" is specified as the brainwave state. In this state, when the user presses button image 168, the display control unit 74 displays a music playlist on the UI unit 66 that includes music associated with the brainwave state "relaxation" and the location "jazz cafe." In this way, the desired brainwave state can be switched.

[0175] According to Modification 1, music is played at a location specified by the user that can transition or maintain the user's brainwave state to a desired brainwave state.

[0176] Furthermore, the playback control unit 76 may use location information to play music that is suitable for the user's current location. For example, the terminal device 12 acquires the current location information of the terminal device 12, and the playback control unit 76 plays music associated with the brainwave state desired by the user and that location. For example, music suitable for desk work or music suitable for outdoor work may be played.

[0177] In the example shown in Figure 25, both the desired brainwave state and location are specified by the user, but either one or the other may be specified by the user. In this case, the display control unit 74 displays a music playlist that matches the one of them on the UI unit 66. For example, if the desired brainwave state is specified by the user, the display control unit 74 displays a music playlist on the UI unit 66 that contains music associated with that desired brainwave state, and if the location is specified by the user, it displays a music playlist on the UI unit 66 that contains music associated with that location.

[0178] (Modification 2) Modification 2 will be explained below with reference to Figure 27. Figure 27 shows an example of a list selection screen.

[0179] In Modification 2, other users' music playlists may be displayed. Figure 27 shows an example of this display. When the user gives a command to display a music playlist, the display control unit 74 displays a list selection screen 170 on the UI unit 66 where the music playlists are displayed. In the example shown in Figure 27, the list selection screen 170 displays a music playlist called "My Best," a music playlist called "Recommendation," and a music playlist called "...Selection." These music playlists are lists composed of music (songs) associated with the user's desired brainwave state. The "My Best" list is a list containing music selected by the user themselves. The "Recommendation" list is a list recommended by other users. The "...Selection" list is a list containing music selected by users with a specific occupation, industry, gender, age, etc. In addition, a list of celebrities may be created and displayed.

[0180] For example, music playlists are uploaded from the terminal device 12 to the music distribution server 14 either manually or automatically. As a result, each user's music playlist (for example, music playlists for each brainwave state, or music playlists containing music selected by each user) is sent to the music distribution server 14 and managed by the music distribution server 14.

[0181] For example, when a user specifies a desired brainwave state, information indicating that desired brainwave state is sent from the terminal device 12 to the music distribution server 14, and the music distribution server 14 sends data indicating a music playlist that matches that desired brainwave state to the terminal device 12. That music playlist is, as described above, a music playlist recommended by other users, etc.

[0182] When a user selects a music playlist on the list selection screen 170 and presses the play button image, the songs included in that music playlist will be played.

[0183] According to Modification 2, since music can be played according to other users' music playlists, the range of music playlist options is wider compared to using only one's own music playlist.

[0184] The list selection screen 170 displays button images 172 and 174 representing brainwave states. When a user presses a button image, the display control unit 74 displays a music playlist for the brainwave state associated with that button image on the UI unit 66. Button image 172 is associated with the brainwave state "concentration," and button image 174 is associated with the brainwave state "relaxation." In the example shown in Figure 27, "concentration" is selected as the brainwave state. In this state, when the user presses button image 174, the display control unit 74 displays a music playlist on the UI unit 66 that includes music associated with the brainwave state "relaxation." In this way, the desired brainwave state can be switched.

[0185] Furthermore, similar to Modification 1, if the user specifies a desired brainwave state and location, a music playlist that matches that desired brainwave state and location may be displayed.

[0186] (Other Embodiments) Other embodiments will be described below. When a user instructs the terminal device 12 to connect to the earphone device 10, the terminal device 12 communicates with the earphone device 10, for example, by short-range wireless communication (e.g., Bluetooth), thereby connecting the earphone device 10 and the terminal device 12 by short-range wireless communication. When the user puts on the earphone device 10, the earphone device 10 measures brain waves. Figure 28 shows an example of the brain wave display screen displayed on the UI unit 66 of the terminal device 12 at that time. The brain wave display screen 176 displays an image 178 associated with the earphone device 10, a message indicating that the earphone device 10 has been connected to the terminal device 12, and the brain wave measurement results (e.g., concentration level: 18%, relaxation level: 72%). In this state, as described above, when music is played, brain waves are measured during playback. At this time, for example, the screens shown in Figure 21 and Figure 22 are displayed on the UI unit 66 of the terminal device 12. For example, when one or more pieces of music for listening are played, brainwaves are measured for each piece of music, and the measurement results are recorded.

[0187] In addition, information indicating the EEG measurement status may be displayed. An example of such display is illustrated in Figure 29. The EEG display screen 180 is displayed on the UI unit 66 of the terminal device 12, similar to the EEG display screen 176 described above. The EEG display screen 180 displays a mark 182 as an image representing the EEG measurement status, along with an image 178 associated with the earphone device 10. The display control unit 74 changes the display form (e.g., color, shape, size, etc.) of the mark 182 according to the EEG measurement status. In the example shown in Figure 29, the color of the mark 182 changes according to the EEG measurement status. For example, if the EEG is being measured normally, the mark 182 is displayed in green. If the EEG is not being measured normally, the mark 182 is displayed in red. If the earphone device 10 is not connected to the terminal device 12 (for example, if connected via Bluetooth, if the earphone device 10 and the terminal device 12 are not paired), the mark 182 is displayed without lighting up. For example, if the potential difference resulting from the electroencephalogram (EEG) measurement falls within the noise level (e.g., below the threshold), the EEG is not being measured correctly, and mark 182 is displayed in red. If the potential difference is above the threshold, the EEG is being measured correctly, and mark 182 is displayed in green. By displaying information indicating the EEG measurement status in this way, the user can adjust the wearing position of the earphone device 10, and as a result, the EEG state can be measured more accurately.

[0188] Figure 30 shows an example of how EEG measurement results are displayed. The measurement results screen 184 is displayed on the UI section 66 of the terminal device 12 after or during EEG measurement. The measurement results screen 184 shows, as an example, the duration for which a numerical value representing the EEG state remains above a predetermined threshold. As an example, this threshold is 50%. Of course, this value is just an example, and other values ​​may be used, or the user may set any value. In the example shown in Figure 29, the duration for which the concentration level was 50% or higher was "15 seconds," and the duration for which the relaxation level was 50% or higher was "27 seconds." These values ​​may be results measured while playing music or videos, or they may be results measured without playing music or videos.

[0189] The following describes an example of the operation when adding music to a music playlist, with reference to Figure 31. Figure 31 shows an example of a music display screen. The music display screen 186 is displayed on the UI unit 66 of the terminal device 12. The music display screen 186 may display information about music specified by the user, or it may display information about randomly selected music. It may also display an image to instruct playback, etc. When music is displayed on the music display screen 186, the user can add or remove the music from the music playlist by performing a so-called flick operation. For example, if the user quickly moves an indicator such as a finger or stylus on the music display screen 186 in the direction of arrow 188 (the direction associated with adding to the playlist), the displayed music will be added to the music playlist, and if the user quickly moves the indicator in the direction of arrow 190 (the direction associated with removing from the playlist), the displayed music will be removed from the music playlist. For example, a user can specify an EEG state associated with a music playlist and perform the above operations to add or remove music from the playlist associated with that EEG state. In the example shown in Figure 31, "Concentration" is specified as the EEG state. When the user flicks in the direction of arrow 188, the currently displayed music is added to the "Concentration Music Playlist," and when the user flicks in the direction of arrow 190, the currently displayed music is removed from the "Concentration Music Playlist." Music is added or removed similarly for music playlists associated with other EEG states (e.g., Relaxation). Music playlists can be edited with such simple operations.

[0190] Furthermore, music playlists may also be linked to brainwave states through the flick operation described above. This operation will be explained with reference to Figure 32. Figure 32 shows an example of a playlist screen. The playlist screen 192 is displayed on the UI unit 66 of the terminal device 12. The playlist screen 192 displays information about music playlists specified by the user (e.g., the name of the music playlist) and information about music playlists provided by music distribution services. Images for instructing playback, etc., may also be displayed. When a music playlist is displayed on the playlist screen 192, the user can link a brainwave state to that music playlist by performing a flick operation. This linking is performed by the list creation unit 72. For example, if the user quickly moves the indicator in the direction of arrow 194 (the direction associated with relaxation) on the playlist screen 192, the brainwave state "relaxed" is linked to the displayed music playlist. In this case, the music playlist is registered as a music playlist for relaxation. Furthermore, if the user quickly moves the indicator in the direction of arrow 196 (the direction associated with concentration), the brainwave state of "concentration" is associated with the currently displayed music playlist. In this case, the music playlist is registered as a music playlist for concentration. Brainwave states can be associated with music with such simple operations. Of course, brainwave states can also be associated with music with similar operations. For example, if a flick operation is performed in the direction of arrow 194 while information about music is displayed, the brainwave state of "relaxation" will be associated with that music.

[0191] In the embodiments described above, the earphone device 10 may provide stimulation to the ear. This stimulation may be the music described above, sounds outside the range of human hearing (e.g., ultrasound), vibrations, or heat. The stimulation may be changed according to the results of brainwave measurements, similar to the music described above. For example, relaxation stimuli (music, ultrasound, vibrations, etc.) or concentration stimuli may be provided to the ear from the earphone device 10. For example, if the user is instructed to relax, sound waves in a first frequency band that produce a relaxing effect may be emitted from the earphone device 10, and if the user is instructed to concentrate, sound waves in a second frequency band that produce a concentration effect may be emitted from the earphone device 10. In addition, depending on the measured brainwaves, sound waves that produce a relaxing effect or sound waves that produce a concentration effect may be emitted from the earphone device 10.

[0192] Furthermore, in the embodiments described above, the first electroencephalogram (EEG) measuring device, the second electroencephalogram (EEG) measuring device, and the EEG measuring system are composed of an earphone device 10, but they do not need to have a sound-emitting function, and they may be composed of hearable devices other than the earphone device 10.

[0193] The hearable device according to this embodiment is provided with a light source, and light may be emitted from the light source in response to the measured brainwaves. Depending on the state of the measured brainwaves, different colored light (e.g., visible light) may be generated. For example, if brainwaves indicating relaxation are measured, a first color of light (e.g., blue light) may be emitted from the light source; if brainwaves indicating concentration are measured, a second color (e.g., green light) may be emitted from the light source; and if brainwaves indicating tension are measured, a third color (e.g., red light) may be emitted from the light source. By generating light of a color that represents the state of the brainwaves, the state of the brainwaves is provided to the user. Of course, the light source does not have to be provided in the hearable device itself. In this case, information indicating the brainwaves measured by the hearable device is transmitted from the hearable device to the light source, and light of a color corresponding to the state of the brainwaves is emitted from the light source.

[0194] (Other Embodiments Regarding Electroencephalogram Measurement) Other embodiments regarding electroencephalogram measurement will be described below. For the convenience of explanation, the first left electroencephalogram sensor 26L as the first electroencephalogram measurement means will be referred to as "electrode A", the second left electroencephalogram sensor 28L as the second electroencephalogram measurement means will be referred to as "electrode B", the first right electroencephalogram sensor 26R as the third electroencephalogram measurement means will be referred to as "electrode C", and the second right electroencephalogram sensor 28R as the fourth electroencephalogram measurement means will be referred to as "electrode D". Figure 33 is a diagram that reflects this correspondence. In the following explanation, the earphone device 10 will be used as an example, but this embodiment may also be applied to hearable devices other than the earphone device 10.

[0195] In electroencephalogram (EEG) measurement, brain waves are measured using at least two electrodes from the electrode group, including electrodes A, B, C, and D. For example, the control unit 68 of the terminal device 12 selects at least two electrodes from the electrode group based on the potentials detected by electrodes A, B, C, and D, and measures brain waves based on the potentials detected by those selected at least two electrodes. Of course, the control unit 58L or control unit 58R of the earphone device 10 may also select at least two electrodes from the electrode group based on the potentials detected by electrodes A, B, C, and D, and measure brain waves based on the potentials detected by those selected at least two electrodes. In the following, it will be assumed that the control unit 68 of the terminal device 12 performs the electrode selection.

[0196] For example, either a first measurement mode, which uses two electrodes to measure brain waves, or a second measurement mode, which uses three electrodes, is selected to measure brain waves. The measurement mode may be selected by the user, or depending on the brain wave measurement conditions (e.g., noise level, as described later), or depending on the remaining battery capacity. This selection will be explained in detail later.

[0197] In the first measurement mode, one electrode selected from the electrode group is used as a sensor electrode for detecting electroencephalograms (EEGs), and another electrode selected from the electrode group is used as a ground electrode for reference. In this case, the EEG is calculated based on the potential difference between the potential detected by the sensor electrode and the potential detected by the ground electrode. The process of calculating the EEG based on this potential difference is performed by the control unit 68 of the terminal device 12. Of course, the electrode selection process and the EEG calculation process may also be performed by the control unit 58L or control unit 58R of the earphone device 10. For example, the control unit 68 selects an electrode suitable for the sensor electrode and an electrode suitable for the ground electrode from the electrode group by comparing the potentials detected by electrodes A, B, C, and D with each other.

[0198] In the second measurement mode, one electrode selected from the electrode group is used as the sensor electrode, another electrode selected from the electrode group is used as the reference electrode, and yet another electrode selected from the electrode group is used as the ground electrode. In this case, the electroencephalogram (EEG) is calculated based on the potentials detected by the sensor electrode, the reference electrode, and the ground electrode. For example, the EEG is calculated based on the potential difference between the potential detected by the sensor electrode and the potential detected by the reference electrode, with the ground electrode as the reference. For example, the control unit 68 selects an electrode suitable for the sensor electrode, an electrode suitable for the reference electrode, and an electrode suitable for the ground electrode from the electrode group by comparing the potentials detected by electrodes A, B, C, and D with each other.

[0199] Suitable electrodes for sensor electrodes are those that detect potentials corresponding to electroencephalograms (EEGs). For example, electrodes that detect potentials above a predetermined sensor potential threshold, or electrodes that detect potentials with waveforms similar to those of EEGs, are selected as sensor electrodes. Suitable electrodes for ground electrodes are those that detect potentials below a predetermined ground potential threshold, or electrodes that detect potentials with small fluctuations and small values. For example, electrodes that detect potentials smaller than those detected by the sensor electrodes and larger than those detected by the ground electrodes are selected as reference electrodes.

[0200] Figure 34 shows typical potential waveforms. Waveform 198 represents a potential corresponding to an electroencephalogram (EEG). Electrodes that detect such waveforms are used as sensor electrodes. For example, a waveform in which the number of times peak potentials above the sensor potential threshold are detected (e.g., the number of detections per unit time) is greater than or equal to a predetermined threshold corresponds to a potential corresponding to an EEG. Waveform 200 represents a ground potential. Electrodes that detect such waveforms are used as ground electrodes. For example, a waveform in which the detected potential is less than the ground potential threshold corresponds to a ground potential. Waveform 202 represents a reference potential. Electrodes that detect such waveforms are used as reference electrodes. For example, a waveform in which the detected potential is above the ground potential threshold and the number of times peak potentials above the sensor potential threshold are detected is less than a threshold corresponds to a reference potential.

[0201] If multiple electrodes satisfy the conditions for a sensor electrode, one electrode selected from among them will be used as the sensor electrode. For example, the user may select the sensor electrode from among the multiple electrodes, or the electrode that detects the potential with the least amount of waveform presumed to be noise may be selected as the sensor electrode, or one electrode may be automatically and randomly selected as the sensor electrode from among the multiple electrodes. Similarly, if multiple electrodes satisfy the conditions for a ground electrode, one electrode selected from among them will be used as the ground electrode. The user may select the ground electrode, or the ground electrode may be automatically and randomly selected, or the electrode that detects the potential with the least noise may be selected as the ground electrode. Similarly, if multiple electrodes satisfy the conditions for a reference electrode, one electrode selected from among them will be used as the reference electrode. The user may select the ground electrode, or the ground electrode may be automatically and randomly selected, or the electrode that detects the potential with the least noise may be selected as the ground electrode.

[0202] In the first measurement mode, the potential difference between the potential shown by waveform 198 (potential of the sensor electrode) and the potential shown by waveform 200 (potential of the ground electrode) is calculated, and the electroencephalogram (EEG) is calculated based on that potential difference. In the second measurement mode, the potential difference between the potential shown by waveform 198 (potential of the sensor electrode) and the potential shown by waveform 202 (potential of the reference electrode) is calculated, and the EEG is calculated based on that potential difference. This calculation process may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10.

[0203] The following describes the processing when noise is present in waveform 198 detected by the sensor electrode, referring to Figure 35. Waveforms 204 and 206 in waveform 198 are presumed to be noise. For example, a waveform whose peak potential is less than the sensor potential threshold and is above a predetermined noise lower threshold is judged to be a waveform corresponding to noise. Waveform 204 is a waveform that satisfies this condition. Also, a waveform whose peak potential is above the noise upper threshold (a value greater than the sensor potential threshold) is judged to be a waveform corresponding to noise. Waveform 206 is a waveform that satisfies this condition. Noise detection may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10. Waveform 202 detected by the reference electrode also includes waveform 208 corresponding to waveform 204 and waveform 210 corresponding to waveform 206. Waveforms 208 and 210 are also waveforms that satisfy the conditions for noise and are detected as noise.

[0204] In the second measurement mode, the potential difference between the potential shown by waveform 198 (potential of the sensor electrode) and the potential shown by waveform 202 (potential of the reference electrode) is calculated, and the electroencephalogram (EEG) is calculated based on this potential difference. As a result, noise is canceled out between waveform 198 and waveform 202, and the EEG is calculated based on a potential difference from which noise has been removed or reduced. On the other hand, in the first measurement mode, the EEG is calculated based on the potential difference between the potential shown by waveform 198 and the potential shown by waveform 200, so an EEG affected by noise is obtained. Thus, the second measurement mode provides an EEG from which noise has been removed or reduced.

[0205] The user may select either the first measurement mode or the second measurement mode, or, as described above, the second measurement mode may be selected if the potential detected by the sensor electrode contains noise. Furthermore, the second mode may be selected if the amount of noise exceeds a threshold (for example, if the number of waveforms detected as noise per unit time exceeds a threshold). The mode selection may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10.

[0206] Multiple temporary sensor electrodes may be selected from the electrode group, and one sensor electrode may be selected from among these multiple temporary sensor electrodes. For example, if two electrodes detect a potential that satisfies the above conditions for a sensor electrode, those two electrodes are selected as temporary sensor electrodes, and a sensor electrode is selected from among those two electrodes. For example, if the waveform of the potential detected by one temporary sensor electrode contains a waveform that is presumed to be noise, and the waveform of the potential detected by the other temporary sensor electrode does not contain a waveform that is presumed to be noise, the other temporary sensor electrode is selected as the sensor electrode. Also, if the waveforms of the potential detected by all temporary sensor electrodes contain a waveform that is presumed to be noise, the temporary sensor electrode that detected the waveform with the least amount of noise is selected as the sensor electrode. For example, the temporary sensor electrode that detected the fewest waveforms as noise per unit time is selected as the sensor electrode.

[0207] Referring to Figure 36, the process of selecting a sensor electrode from multiple provisional sensor electrodes will be explained in detail. Let waveform 212 be a waveform showing the potential detected by electrode A, for example, and waveform 214 be a waveform showing the potential detected by electrode C, for example. Waveforms 212 and 214 are waveforms showing a potential above the sensor potential threshold, and electrodes A and C are electrodes that satisfy the above conditions for sensor electrodes. In this case, electrodes A and C are identified as provisional sensor electrodes. Waveform 214 also contains waveform 216. Waveform 216 is not included in waveform 212, and is a waveform that satisfies the above conditions for noise (potential is less than the sensor potential threshold and above the noise lower limit threshold). In this case, electrode A, which detected waveform 212, is selected as the sensor electrode, and electrode C, which detected waveform 214, is not selected as the sensor electrode. Then, the potential difference between the potential detected by electrode A and the potential detected by another electrode selected as the ground electrode is calculated, and the electroencephalogram is calculated based on that potential difference.

[0208] Figure 37 shows another example of noise. Waveform 218 is a waveform that shows the potential detected by electrode C, for example. Waveforms 214 and 218 are waveforms that show a potential above the sensor potential threshold, and electrodes A and C are electrodes that satisfy the above conditions for sensor electrodes and are identified as provisional sensor electrodes. Waveform 218 also contains waveform 220. Waveform 220 is not included in waveform 212 and is a waveform that satisfies the above conditions for noise (potential is above the noise upper threshold). In this case, electrode A, which detected waveform 212, is selected as the sensor electrode, and electrode C, which detected waveform 218, is not selected as the sensor electrode. The potential difference between the potential detected by electrode A and the potential detected by another electrode selected as the ground electrode is calculated, and the electroencephalogram is calculated based on that potential difference.

[0209] As described above, by selecting a sensor electrode from multiple provisional sensor electrodes, the electrode that detects potentials with less noise is used as the sensor electrode. Therefore, the accuracy of electroencephalogram (EEG) measurement is improved compared to when an electrode that detects potentials with more noise is used as the sensor electrode.

[0210] For example, calibration may be performed when the electroencephalogram (EEG) measurement application is started, when the earphone device 10 as an EEG measurement device is started, or when the terminal device 12 is started, and multiple electrodes to be used for EEG measurement may be selected from the electrode group. In this calibration, the potential is detected by each of electrodes A, B, C, and D, and based on the detection results, a sensor electrode, a ground electrode, and a reference electrode are selected from the electrode group. In addition, a first measurement mode or a second measurement mode may be selected depending on the amount of noise. If no noise is detected, or if the amount of detected noise is less than a threshold (for example, if the number of waveforms detected as noise per unit time is less than a threshold), the first measurement mode may be selected, and if noise is detected, or if the amount of detected noise is greater than or equal to a threshold (for example, if the number of waveforms detected as noise per unit time is greater than or equal to a threshold), the second measurement mode may be selected. Note that electrode selection and measurement mode selection may be performed while EEG is being measured. For example, the above calibration may be performed at predetermined intervals, and the electrodes used for EEG measurement and the measurement mode may be changed according to the results of the calibration.

[0211] Furthermore, in the second measurement mode, a reference electrode is used, resulting in improved accuracy of electroencephalogram (EEG) measurement compared to the first measurement mode, which does not use a reference electrode. On the other hand, in the first measurement mode, EEG is measured using two electrodes without a reference electrode, thus reducing power consumption compared to the second measurement mode, which uses three electrodes.

[0212] The measurement mode may be selected based on the remaining capacity of the battery in the electroencephalogram (EEG) measuring device. For example, if the remaining capacity of the battery in the earphone device 10 is below a predetermined threshold, the first measurement mode is selected, and if the remaining capacity is above the threshold, the second measurement mode is selected. This selection may be made by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10. When the remaining capacity is below the threshold, the first measurement mode, which consumes less power than the second measurement mode, is selected to suppress the decrease in remaining capacity.

[0213] Furthermore, a measurement mode selected without user input may be presented (recommended) to the user. For example, information indicating the first or second measurement mode selected based on the electroencephalogram measurement status (e.g., noise level) or remaining battery capacity may be displayed on the UI unit 66 of the terminal device 12.

[0214] Furthermore, depending on the contact status between electrodes A, B, C, and D and the living body, multiple electrodes for electroencephalogram measurement (sensor electrodes, ground electrodes, and reference electrodes) may be selected from the electrode group. The contact status is detected, for example, using at least one of a pressure sensor and a humidity sensor.

[0215] For example, pressure sensors are installed on electrodes A, B, C, and D, and the pressure of each electrode relative to the biological surface is detected as the contact status. The higher the pressure, the higher the degree of adhesion between the electrode and the biological surface is estimated to be. The electrode with the highest detected pressure is selected as the sensor electrode. If the first measurement mode is selected, the electrode with the second highest detected pressure is selected as the ground electrode. If the second measurement mode is selected, the electrode with the second highest detected pressure is selected as the reference electrode, and the electrode with the third highest detected pressure is selected as the ground electrode. Electrode selection based on pressure may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10. By selecting electrodes based on pressure as described above, electrodes with a higher degree of adhesion to the biological surface are used as sensor electrodes, thus improving the accuracy of electroencephalogram (EEG) measurement compared to cases where electrodes with a lower degree of adhesion are used as sensor electrodes.

[0216] Furthermore, humidity sensors may be installed on each of electrodes A, B, C, and D, and the humidity at each position may be detected as a contact condition. The higher the humidity, the higher the degree of adhesion between the electrode and the biological surface is presumed to be. The electrode with the highest detected humidity is selected as the sensor electrode. If the first measurement mode is selected, the electrode with the second highest detected humidity is selected as the ground electrode. If the second measurement mode is selected, the electrode with the second highest detected humidity is selected as the reference electrode, and the electrode with the third highest detected humidity is selected as the ground electrode. Electrode selection based on humidity may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10. By selecting electrodes based on humidity as described above, electrodes with a higher degree of adhesion to the biological surface are used as sensor electrodes, thus improving the accuracy of electroencephalogram measurement compared to when electrodes with a lower degree of adhesion are used as sensor electrodes.

[0217] The electrodes may be selected based on either pressure or humidity, or on both. For example, if both pressure and humidity are used, the electrode with the highest detected pressure and humidity is selected as the sensor electrode, the electrode with the lowest detected pressure and humidity is selected as the ground electrode, and the electrode in between is selected as the reference electrode. Alternatively, the electrode with the smallest sum of the detected pressure and humidity rankings may be selected as the sensor electrode, the electrode with the largest sum is selected as the ground electrode, and the electrode in between is selected as the reference electrode. The highest pressure and humidity rankings are assigned a rank of 1. Weighted addition processing may be applied to the pressure and humidity rankings, and the electrodes may be selected based on the result of this application.

[0218] Electrode selection based on contact conditions may be performed as a calibration at startup, or at predetermined intervals.

[0219] Furthermore, the determination of whether or not the electric potential is being accurately detected may be made based on predetermined settings for the human body's electric potential, the history of electric potential measurements, etc.

[0220] The following describes the information displayed in the UI section 66 during calibration.

[0221] During calibration, as shown in Figure 38, the control unit 68 of the terminal device 12 displays a calibration screen 222 on the UI unit 66. The screen 222 displays an image 224 associated with the earphone device 10. The image 224 may be an image generated by taking a picture of the earphone device 10, or it may be an image (for example, an icon) that schematically represents the earphone device 10. Marks 226, 228, 230, and 232, which have the shape of a circular frame or the like, are displayed in the part of the image 224 that represents the electrodes.

[0222] When the user specifies an electrode on image 224, the control unit 68 displays information on the UI unit 66 indicating the measurement status of the potential by the electrode specified by the user. The control unit 68 may also display information on the UI unit 66 indicating an evaluation of the potential measurement result. This evaluation may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10. For example, the measurement result is evaluated based on the amount of noise included in the waveform, the detected pressure, humidity, waveform shape, waveform clarity, etc. This evaluation is, for example, a ranking of the measurement result, and as shown in Figure 39, information indicating the ranking (1st to 4th place) is displayed on screen 222. For example, the electrode judged to be suitable as a sensor electrode is ranked 1st, the electrode judged to be suitable as a reference electrode is ranked 2nd, and the electrode judged to be suitable as a ground electrode is ranked 3rd or 4th.

[0223] The user may select the electrodes to be used as sensor electrodes and the electrodes to be used as ground electrodes, referring to the order of the electrodes. If the second measurement mode is selected, the user further selects the electrodes to be used as reference electrodes. The electroencephalogram (EEG) is measured using the electrodes selected by the user.

[0224] Furthermore, the control unit 68 may present (recommend) multiple electrodes to be used for electroencephalogram (EEG) measurement based on the above ranking. For example, the control unit 68 may display information on the UI unit 66 indicating that the electrode ranked 1 is suitable as a sensor electrode, or that the electrodes ranked 3rd or 4th are suitable as ground electrodes. The user may then refer to this information to select the electrodes to be used for EEG measurement.

[0225] The control unit 68 may display the waveform of the potential detected by the electrodes on the UI unit 66. Figure 40 shows an example of this display. Screen 222 displays the waveform 233 of the potential detected by the electrodes, and also displays information indicating the evaluation. The control unit 68 may display the waveform of the potential detected by the electrode selected by the user on the UI unit 66, or it may display the waveform of the potential detected by each electrode in sequence on the UI unit 66.

[0226] Furthermore, as shown in Figure 41, if waveform 234, which corresponds to noise, is included in waveform 233, the control unit 68 may display information indicating the presence of noise on the UI unit 66. In this case, the control unit 68 may recommend using a different electrode or recommend executing a second measurement mode.

[0227] The following explains how to set up the electrodes (EEG sensors).

[0228] When setting the electrodes, as shown in Figure 42, the control unit 68 of the terminal device 12 displays the electrode setting screen 236 on the UI unit 66. The screen 236 displays the image 224 associated with the earphone device 10. Also, as in Figure 38, marks 226, 228, 230, and 232 are displayed.

[0229] On screen 236, the user selects the electrodes. When the first measurement mode is executed, the user selects two electrodes (sensor electrode and ground electrode) from electrodes A, B, C, and D. When the second measurement mode is executed, the user selects three electrodes (sensor electrode, reference electrode, and ground electrode) from electrodes A, B, C, and D.

[0230] Furthermore, as shown in Figure 43, the control unit 68 may display recommendation information on the UI unit 66. For example, if electrode C is ranked 1st, electrode A is ranked 2nd, and electrode D is ranked 3rd, the control unit 68 will display information on the UI unit 66 recommending that electrodes C, A, and D be used as electrodes for electroencephalogram (EEG) measurement. The user may then select electrodes based on this recommendation information.

[0231] Furthermore, if electrodes are selected by the user, the control unit 68 may display a confirmation screen 238 on the UI unit 66, as shown in Figure 44. For example, if two electrodes are selected by the user, information indicating that those two electrodes have been selected as electrodes for electroencephalogram measurement will be displayed. The control unit 68 may also ask the user which electrodes will be used as sensor electrodes, or which electrodes will be used as ground electrodes. In response to these inquiries, the user may specify the sensor electrodes or ground electrodes on the confirmation screen 238.

[0232] If the user indicates that the settings are complete on the confirmation screen 238, the display control unit 74 displays the settings completion screen 240 on the UI unit 66, as shown in Figure 45. Subsequently, electroencephalograms are measured using multiple electrodes selected by the user.

[0233] The electroencephalogram (EEG) measurement status may be displayed. For example, if no potential is detected by the electrodes selected for EEG measurement, or if the selected electrodes do not detect a potential above a predetermined threshold, the control unit 68 may display a warning screen on the UI unit 66. Figure 46 shows such a warning screen 242. For example, if electrodes C and D are selected as electrodes for EEG measurement, and no potential is detected by electrodes C and D, or if electrodes C and D do not detect a potential above a threshold, the control unit 68 will display a warning screen 242 on the UI unit 66. The warning screen 242 will display information indicating that no potential is detected by electrodes C and D. The control unit 68 may also display information on the UI unit 66 recommending the use of electrodes other than electrodes C and D (for example, electrodes A and B).

[0234] Furthermore, if the user specifies an electrode on the warning screen 242, the control unit 68 may display the waveform 244 of the potential detected by the electrode specified by the user on the UI unit 66, for example, as shown in Figure 47. In the example shown in Figure 47, electrode C is specified by the user, and the waveform 244 of the potential detected by electrode C is displayed. The control unit 68 may also display on the UI unit 66 information prompting the use of a different electrode, information prompting the user to check the power and connection status of the equipment, information prompting the restart of the earphone device 10, information prompting the restart of the electroencephalogram measurement application, information to guide the user to the contact point in case of an abnormality, information prompting the user to stop the electroencephalogram measurement, etc.

[0235] Electrodes A and C are inserted into the external auditory canal, while electrodes B and D are located on the ear hook and contact the back of the auricle. Therefore, the degree of contact of electrodes A and C with the biological surface is usually higher than that of electrodes B and D. For this reason, normally, either electrode A or C is used as the sensor electrode, and either electrode B or D is used as the ground electrode. However, if the user moves, the position of the earphone device 10 relative to the ear may shift, reducing the degree of contact of electrodes A and C with the biological surface and decreasing the detection sensitivity of electrodes A and C. In this case as well, the shift in position may make it easier for electrodes B and D to contact the biological surface on the back of the auricle, increasing the degree of contact of electrodes B and D with the biological surface on the back of the auricle and improving the detection sensitivity of electrodes B and D. In this case, either electrode B or D is used as the sensor electrode, and either electrode A or C is used as the ground electrode. Thus, even if the position of the earphone device 10 shifts, one of the four electrodes is used as the sensor electrode to measure the electroencephalogram.

[0236] In the example above, two or three electrodes are selected from four electrodes (electrodes A, B, C, D). However, if three electrodes are provided in the earphone device 10, two or three electrodes may be selected from the three electrodes. Similarly, if five or more electrodes are provided in the earphone device 10, two or three electrodes may be selected from the five or more electrodes.

[0237] (Other Embodiments Regarding Data Communication Control) The following describes other embodiments regarding data communication control between the earphone device 10 and the terminal device 12. The control unit 68 of the terminal device 12 and the control units 58L and 58R of the earphone device 10 function as examples of communication control means.

[0238] (First Communication Control) The communication unit 60 of the terminal device 12 and the communication units 54L and 54R of the earphone device 10 may, as first communication control, transmit information to each other using different communication methods. For example, the communication unit 60 of the terminal device 12 may transmit music data to the earphone device 10 using a communication method with a faster communication speed than the communication method used by the communication units 54L and 54R of the earphone device 10. Specifically, the communication unit 60 of the terminal device 12 transmits music data to the earphone device 10 using a communication method such as Wi-Fi communication, and the communication units 54L and 54R of the earphone device 10 transmit electroencephalogram (EEG) measurement results to the terminal device 12 using a communication method such as Bluetooth or infrared communication. By using different communication methods for transmitting music data and transmitting EEG measurement results, the communication load on each communication method is reduced compared to when the same communication method is used for both. Therefore, the occurrence of problems such as delays or failures in data transmission is suppressed. Furthermore, generally speaking, the amount of data in music is greater than the amount of data in electroencephalogram (EEG) measurement results. By using a faster communication method for transmitting music data than the communication method used for transmitting EEG measurement results, the occurrence of delays and other problems in music data transmission can be suppressed.

[0239] In addition, in the earphone device 10, both communication units 54L and 54R may be used to communicate with the terminal device 12, or either one of the communication units may be used to communicate with the terminal device 12. Furthermore, one of the communication units 54L and 54R may be used to transmit electroencephalogram measurement results, and the other communication unit may be used to receive music data.

[0240] The communication unit 60 of the terminal device 12 and the communication units 54L and 54R of the earphone device 10 may transmit information using the same or different communication methods depending on the communication status. For example, when the communication units 60, 54L, and 54R are transmitting and receiving music data and electroencephalogram measurement results using the same communication method, if the communication status using that communication method reaches a specific condition, the communication units 60, 54L, and 54R will transmit and receive information using different communication methods as a first communication control. If the communication status does not meet the specific condition, the communication units 60, 54L, and 54R will transmit and receive information using the same communication method. When communication conditions meet specific criteria, for example, this could be when the ratio of data traffic to the maximum data capacity of the communication line in use exceeds the data allowance (the allowance may be defined for each communication method), when the data traffic per unit time exceeds a predetermined data traffic threshold (the data traffic threshold may be defined for each communication method), or when the communication speed falls below a predetermined communication speed threshold (the communication speed threshold may be defined for each communication method). By using different communication methods when communication conditions meet specific criteria, the communication load on each communication method is reduced, thereby suppressing the occurrence of problems such as delays and failures in data transmission.

[0241] (Second Communication Control) When the user gives a command to start music playback, the communication unit 60 of the terminal device 12 transmits the music data for the first song to be played to the earphone device 10 as a second communication control, and the playback control unit 76 of the terminal device 12 may start playing the music data when the transmission of the music data to the earphone device 10 is complete. For example, the earphone device 10 is provided with a storage unit, and the music data for the first song is stored in that storage unit, and the playback control unit 76 plays the music data stored in that storage unit. After the start of playback, the communication unit 60 of the terminal device 12 transmits the music data for the second song and subsequent songs to the terminal device 12. The music data for the second song and subsequent songs are stored in the storage unit of the earphone device 10. While the music data for the first song is playing, the music data for the second song and subsequent songs are gradually stored in the storage unit of the earphone device 10. This way, even if the communication conditions deteriorate and the transmission speed of music data for the second and subsequent songs slows down or becomes intermittent, there is a buffer of one song's worth of music data playback time, making it less likely that the transmission of music data will not keep up with playback. Therefore, the playback of music data becomes less likely to be interrupted. Music data that has finished playing is deleted from the memory unit of the earphone device 10. The communication units 54L and 54R of the earphone device 10 transmit the electroencephalogram measurement results to the terminal device 12 in real time (i.e., each time an electrical potential is detected). Second communication control may be performed if the communication conditions meet the specific conditions described above.

[0242] (Third Communication Control) The communication units 54L and 54R of the earphone device 10 may intermittently transmit the electroencephalogram (EEG) measurement results to the terminal device 12 as a third communication control. For example, the communication units 54L and 54R transmit the EEG measurement results to the terminal device 12 at predetermined time intervals. Specifically, time periods for transmitting EEG measurement results and time periods for not transmitting EEG measurement results are defined, and the communication units 54L and 54R transmit the EEG measurement results according to those time periods. The music data and EEG measurement results may be transmitted using the same communication method, or they may be transmitted using different communication methods. When the music data and EEG measurement results are transmitted using the same communication method, the intermittent transmission of the EEG measurement results reduces the communication load during the time periods when the EEG measurement results are not being transmitted. The third communication control may be performed when the communication status meets the above specific conditions.

[0243] The communication unit 60 of the terminal device 12 may, as a third communication control, intermittently transmit music data to the earphone device 10. In this case, the music data is stored in the memory unit of the earphone device 10, and the playback control unit 76 of the terminal device 12 plays the music data stored in the memory unit. This reduces the communication load during periods when music data is not being transmitted. The amount of each data sent intermittently is determined to prevent interruptions in music data playback.

[0244] Both electroencephalogram (EEG) measurement results and music data may be transmitted intermittently, or either one of the data may be transmitted intermittently.

[0245] Furthermore, the communication unit 60 of the terminal device 12 and the communication units 54L and 54R of the earphone device 10 may transmit music data and electroencephalogram (EEG) measurement results with staggered transmission timings. For example, while the communication unit 60 of the terminal device 12 is transmitting music data to the earphone device 10, the communication units 54L and 54R of the earphone device 10 do not transmit EEG measurement results to the terminal device 12, and while the communication unit 60 of the terminal device 12 is not transmitting music data to the earphone device 10, the communication units 54L and 54R of the earphone device 10 transmit EEG measurement results to the terminal device 12. For example, time periods for transmitting music data and time periods for not transmitting music data may be defined, and a time period for transmitting EEG measurement results may be defined within the time period for not transmitting music data. When music data and EEG measurement results are transmitted using the same communication method, both music data and EEG measurement results may be transmitted intermittently. Also, when the communication conditions meet specific criteria, both music data and EEG measurement results may be transmitted intermittently.

[0246] (Fourth Communication Control) If the communication status meets the above-mentioned specific conditions, the communication unit 60 of the terminal device 12 may, as a fourth communication control, change the sound quality of the music data and transmit it to the earphone device 10. For example, if the communication status meets the above-mentioned specific conditions, the communication unit 60 of the terminal device 12 may reduce the amount of music data transmitted by lowering the bitrate or cutting out a specific frequency band of the music data compared to when the communication status does not meet the above-mentioned specific conditions. This reduces the communication load compared to when the amount of music data transmitted is not reduced.

[0247] (Fifth Communication Control) The control unit 68 of the terminal device 12 may compress the music data as fifth communication control, and the communication unit 60 of the terminal device 12 may transmit the compressed music data to the earphone device 10. The control unit of the earphone device 10 restores (decompresses, expands, and compresses) the music data before compression, and the restored music data is played. This reduces the amount of music data to be transmitted, thereby reducing the communication load. The fifth communication control may be performed when the communication status meets the above specific conditions.

[0248] Furthermore, the control unit of the earphone device 10 may compress the information indicating the electroencephalogram (EEG) measurement results, and the communication units 54L and 54R of the earphone device 10 may transmit the compressed information indicating the EEG measurement results to the terminal device 12. The control unit 68 of the terminal device 12 restores the EEG measurement results before compression. The EEG measurement results may be compressed if the communication conditions meet the specific conditions described above.

[0249] Both the music data and the electroencephalogram (EEG) measurement results may be compressed, or either one of the data may be compressed.

[0250] Multiple communication controls selected from the first to fifth communication controls described above may be combined and executed. Furthermore, depending on the communication status, multiple communication controls may be combined and executed, or the multiple communication controls to be combined may be changed.

[0251] Information may be provided to the user to prompt them to perform the first to fifth communication controls described above. For example, the information for the prompt may be displayed on the UI unit 66 of the terminal device 12, or a sound such as a warning sound may be emitted.

[0252] Figure 48 shows a screen 246 for inquiries. This screen 246 is displayed on the UI unit 66 of the terminal device 12. For example, if the communication status meets the specific conditions described above, the display control unit 74 of the terminal device 12 displays screen 246 on the UI unit 66. For example, a message indicating that a communication failure may occur and a message asking the user whether or not to switch to the data saving mode as one of the first to fifth communication controls described above are displayed.

[0253] When a user instructs the system to execute data saving mode (for example, when the user presses the YES button), information indicating the first to fifth communication controls described above is displayed on the UI unit 66. When the user selects a communication control from the first to fifth communication controls, the display control unit 74 displays a confirmation screen 248 on the UI unit 66, as shown in Figure 49. For example, if data saving mode (3) (third communication control) is selected by the user, information is transmitted and received according to the third communication control. Of course, information may be transmitted and received according to a predetermined communication control without the user selecting a communication control, or information may be transmitted and received according to a communication control appropriate to the communication status.

[0254] If the user refuses to execute the data saving mode (for example, if the user presses the NO button), the display control unit 74 displays a confirmation screen 250 on the UI unit 66, as shown in Figure 50. The confirmation screen 250 displays, for example, a message indicating that communication will proceed according to the current settings.

[0255] The terminal device 12 may also send and receive information with multiple earphone devices 10. For example, as shown in Figure 51, the terminal device 12 may send and receive information with earphone devices 10A and 10B. Earphone devices 10A and 10B have the same configuration as the earphone device 10 described above. In this case, different communication methods may be used for each earphone device. This reduces the load on each communication method. Also, depending on the communication status between the terminal device 12 and each earphone device, one of the first to fifth communication controls described above may be executed for each individual earphone device. The terminal device 12 may also send different music data to each individual earphone device based on the electroencephalogram measurement results sent from each earphone device.

[0256] In the above-described embodiment and other embodiments, music data as an example of content is provided to the user. As content other than music data, video data, still image data, map information, information regarding place guidance, information regarding food, information regarding shopping, information regarding stores, etc. may be provided to the user according to the electroencephalogram measurement result. For example, when "relaxed" is specified by the user as the electroencephalogram state, video data having a relaxation effect, still image data having a relaxation effect, map information indicating a place having a relaxation effect, information for guiding the user to a place having a relaxation effect, information regarding food having a relaxation effect, information regarding shopping having a relaxation effect, information regarding stores having a relaxation effect, etc. are displayed on the UI unit 66 of the terminal device 12.

[0257] As another example, devices and the like may be controlled based on the electroencephalogram measurement result. As an example, when the user is driving a vehicle, the electroencephalogram of the user during driving is measured, and the driving mode of the vehicle may be controlled based on the electroencephalogram measurement result. This control may be performed by the terminal device 12 or may be performed by a control device mounted on the vehicle. For example, when the electroencephalogram measurement result indicates drowsiness, the driving mode of the vehicle may be switched to the automatic driving mode, a warning may be issued, or the vehicle may be parked. The automatic driving mode includes a mode in which the driving of the vehicle is automatically controlled without the user performing any driving operation, a mode that assists the user's driving operation (e.g., an automatic braking function or an automatic steering operation function, etc.).

[0258] As yet another example, when the user is making a phone call, information indicating the electroencephalogram measurement result of the user may be transmitted from the terminal device 12 to the terminal device of the person on the other end of the phone. Advice or the like based on the electroencephalogram measurement result may be given to the user from the person on the other end of the phone. Further, information indicating the electroencephalogram measurement result may be sent from the terminal device 12 to a terminal device installed in a facility such as a hospital registered in advance or to a terminal device of a medical professional and used for diagnosis, treatment, etc.

[0259] The above terminal device 12 is realized, for example, by the cooperation of hardware and software. Specifically, the terminal device 12 includes one or more processors such as a CPU (not shown). The functions of each part of the terminal device 12 are realized by the one or more processors reading and executing a program stored in a storage device (not shown). The above program is stored in the storage device via a recording medium such as a CD or a DVD, or via a communication path such as a network. As another example, each part of the terminal device 12 may be realized by hardware resources such as a processor, an electronic circuit, or an ASIC (Application Specific Integrated Circuit). A device such as a memory may be used in its realization. As yet another example, each part of the terminal device 12 may be realized by a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or the like.

Explanation of Signs

[0260] 10 Earphone device, 12 Terminal device, 14 Music distribution server.

Claims

1. Computers By placing electrodes on specific areas around the user's ear, brain waves are measured. An information processing method that outputs information relating to stimuli applied to a user, including heat, in accordance with the measured brainwaves of the user.

2. The electroencephalogram (EEG) includes information regarding the waveform showing the change in the EEG measured by the user over a predetermined period of time. Computers The information processing method according to claim 1, which outputs information relating to a stimulus corresponding to the waveform.

3. The aforementioned electroencephalogram includes one or more electroencephalogram states relating to the user's delta waves, theta waves, alpha waves, and beta waves. Computers The information processing method according to claim 1, which outputs information relating to a stimulus corresponding to the brainwave state.

4. Computers When brainwaves indicating relaxation are measured, information related to the first stimulus is output. The information processing method according to claim 1, wherein when brainwaves indicating concentration are measured, information relating to a second stimulus is output.

5. The device that emits the stimulus is installed in a different device from the device on which the electrodes for measuring the brain waves are installed. Computers The information processing method according to any one of claims 1 to 4, wherein the different device outputs a stimulus to the user that includes heat, by receiving an instruction to output information related to the stimulus.

6. It has a processor, The aforementioned processor, By placing electrodes on specific areas around the user's ear, brain waves are measured. In accordance with the measured brainwaves of the user, information relating to stimuli to the user, including heat, is output. Electroencephalogram (EEG) measuring device.

Images