Method for processing information and brain wave measuring device

Abstract

To present a state of brain wave.SOLUTION: A computer measures a brain wave by bringing an electrode into contact with a specific part around an ear of a user and outputs information of light having different colors in accordance with the measured brain wave of the user.SELECTED DRAWING: Figure 18

Description

[Technical field]

[0001] The present invention relates to an information processing method and an electroencephalogram measuring device. [Background technology]

[0002] Electroencephalography is one of the techniques for measuring a person's state. Normally, electroencephalography is measured by measuring the electrical potential using electrodes placed on the head (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 07-204168 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to present the state of electroencephalograms. [Means for solving the problem]

[0005] In the information processing method of the present invention, a computer measures brain waves by contacting electrodes with specific areas around the user's ears, and outputs light information of different colors depending on the measured brain waves of the user. In addition, the EEG measuring device of the present invention has a processor that measures EEG by contacting electrodes with specific locations around the user's ears, and outputs light information of different colors depending on the measured EEG of the user. In addition, the first embodiment of the EEG measuring device is an EEG measuring device that is used by contacting the ear, and has an electrode group including a plurality of electrodes arranged at different positions on a surface that contacts the ear, and an electrode from the electrode group that satisfies predetermined conditions related to noise is selected as either an EEG sensor electrode, a reference electrode, or a ground electrode.

[0006] The electroencephalogram measuring device of a second aspect is the electroencephalogram measuring device according to the first aspect, wherein the predetermined condition related to noise is a condition determined based on a result of calibration.

[0007] In the third aspect of the EEG measuring device, when there are multiple electrodes that satisfy a predetermined condition related to the noise in the EEG measuring device of the first or second aspect, the electrode that detects the potential with the least waveform that is considered to be noise is selected, or a predetermined number of the electrodes are automatically and randomly selected.

[0008] The fourth aspect of the EEG measuring device is an EEG measuring device relating to any one of the first to third aspects, in which an EEG sensor and a reference electrode are selectively selected from the group of electrodes on the EEG measuring device that are a predetermined distance apart.

[0009] The fifth aspect of the EEG measuring device is an EEG measuring device relating to any one of the first to fourth aspects, in which, when two electrodes, the EEG sensor electrode and the reference electrode, are selected in the electrode group, the EEG measuring device measures the EEG in a first measurement mode in which the EEG is measured using the two electrodes, and when three electrodes, the EEG sensor electrode, the reference electrode, and the ground electrode, are selected, the EEG measuring device measures the EEG in a second measurement mode in which the EEG is measured using the three electrodes.

[0010] The sixth aspect of the EEG measuring device is the EEG measuring device of the fifth aspect, in which the measurement mode for measuring EEG is selected based on the remaining capacity of a battery provided in the EEG measuring device, and when the remaining capacity is less than a specific threshold, the first measurement mode is selected, and when the remaining capacity is equal to or greater than a specific threshold, the second measurement mode is selected.

[0011] The electroencephalogram measuring device of the seventh aspect is the electroencephalogram measuring device according to the fifth aspect, wherein the measurement mode is selected from the first measurement mode or the second measurement mode depending on the measurement conditions of the electroencephalogram.

[0012] The eighth aspect of the electroencephalogram measuring device is an electroencephalogram measuring device relating to any one of the first to seventh aspects, wherein the electrode group is arranged linearly on a non-planar surface or densely arranged with a predetermined regularity. Effect of the Invention

[0013] According to the present invention, the state of electroencephalograms can be presented. [Brief description of the drawings]

[0014] [Figure 1] 1 is a block diagram showing an information processing system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a perspective view showing an overall configuration of an earphone device. [Diagram 3] FIG. 2 is a perspective view showing a configuration of a portion of the earphone device. [Figure 4] FIG. 2 is a perspective view showing the left earphone unit. [Diagram 5] FIG. 4 is a plan view showing the left earphone unit. [Figure 6] FIG. [Figure 7] FIG. [Figure 8] FIG. [Figure 9] FIG. [Figure 10] FIG. [Figure 11] FIG. [Figure 12] FIG. [Figure 13] FIG. [Figure 14] FIG. 2 is a perspective view showing a configuration of a portion of the earphone device. [Figure 15] FIG. 2 is a perspective view showing a configuration of a portion of the earphone device. [Figure 16] FIG. 2 is a perspective view showing a configuration of a portion of the earphone device. [Figure 17] FIG. 2 is a perspective view showing a configuration of a portion of the earphone device. [Figure 18] FIG. 2 is a functional block diagram of the earphone device. [Figure 19] FIG. 2 is a functional block diagram of a terminal device. [Figure 20] FIG. 13 is a diagram showing an electroencephalogram display screen. [Figure 21] FIG. 13 is a diagram showing a music playback screen. [Figure 22] FIG. 13 is a diagram showing a music playback screen. [Figure 23] FIG. 13 is a diagram showing a playlist screen. [Figure 24] FIG. 13 is a diagram showing a playlist screen. [Diagram 25] FIG. 13 is a diagram showing a condition input screen. [Figure 26] FIG. 13 is a diagram showing a music playback screen. [Figure 27] FIG. 13 is a diagram showing a list selection screen. [Figure 28] FIG. 13 is a diagram showing an electroencephalogram display screen. [Figure 29] FIG. 13 is a diagram showing an electroencephalogram display screen. [Diagram 30] FIG. 13 is a diagram showing electroencephalogram measurement results. [Diagram 31] FIG. 2 is a diagram showing a music display screen. [Diagram 32] FIG. 13 is a diagram showing a playlist screen. [Diagram 33] FIG. 1 is a perspective view showing an overall configuration of an earphone device. [Diagram 34] FIG. 4 is a diagram showing a waveform of a potential. [Diagram 35] FIG. 4 is a diagram showing a waveform of a potential. [Diagram 36] FIG. 4 is a diagram showing a waveform of a potential. [Figure 37] FIG. 4 is a diagram showing a waveform of a potential. [Figure 38] FIG. 13 is a diagram showing a screen during calibration. [Figure 39] FIG. 13 is a diagram showing a screen during calibration. [Diagram 40] FIG. 13 is a diagram showing a screen during calibration. [Diagram 41] FIG. 13 is a diagram showing a screen during calibration. [Diagram 42] FIG. 13 is a diagram showing a screen for setting electrodes. [Diagram 43] FIG. 13 is a diagram showing a screen for setting electrodes. [Diagram 44] FIG. 13 shows a confirmation screen. [Diagram 45] FIG. 13 illustrates a setting completion screen. [Diagram 46] FIG. 13 illustrates a warning screen. [Figure 47] FIG. 13 illustrates a warning screen. [Figure 48] FIG. 13 is a diagram showing a screen for inquiries. [Figure 49] FIG. 13 shows a confirmation screen. [Figure 50] FIG. 13 shows a confirmation screen. [Figure 51] FIG. 11 is a block diagram showing an information processing system according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, an electroencephalogram measuring device according to an embodiment of the present invention will be described. The electroencephalogram measuring device according to this embodiment is a device that measures an electroencephalogram by measuring an electric potential while being worn on a person's ear. The electroencephalogram measuring device according to this embodiment may be a so-called hearable device. The electroencephalogram measuring device according to this embodiment may be worn on one ear of a person to measure an electroencephalogram, or may be worn on both ears to measure an electroencephalogram. For example, a first electroencephalogram measuring device according to this embodiment may be worn on the left ear, a second electroencephalogram measuring device according to this embodiment may be worn on the right ear, and an electroencephalogram measuring system may be configured by the first electroencephalogram measuring device and the second electroencephalogram measuring device, and an electroencephalogram may be measured by the electroencephalogram measuring system. As another example, an electroencephalogram measuring device according to this embodiment may be worn on either the left ear or the right ear, and an electroencephalogram may be measured by the electroencephalogram measuring device.

[0016] The electroencephalogram measuring device according to the present embodiment includes a plurality of electroencephalogram measuring means. The electroencephalogram measuring means is an electrode for detecting an electric potential. The plurality of electrodes are provided in contact with the ears of the user, and the electroencephalogram of the user is measured using at least two electrodes among the plurality of electrodes. The electroencephalogram of the user may be measured using at least two electrodes selected from the plurality of electrodes provided on one ear of the user, or may be measured using at least two electrodes selected from the plurality of electrodes provided on both ears. The electroencephalogram of the user may be measured using at least three electrodes among the plurality of electrodes. By using more electrodes, the measurement accuracy of the electroencephalogram may be improved. Furthermore, the electroencephalogram may be measured using at least three electrodes by switching the electrodes used for the electroencephalogram measurement among the plurality of electrodes. For example, the electrodes used for the electroencephalogram measurement are switched according to the measurement conditions such as the detection sensitivity of the electric potential and noise. For example, the at least three electrodes may include a first electrode used as an electrode for detecting brain waves (sensor electrode), a second electrode used as a reference electrode, and a third electrode used as a ground electrode, and brain waves may be measured using the first electrode, the second electrode, and the third electrode. At least one of the first electrode, the second electrode, and the third electrode may be switched.

[0017] For example, the electroencephalogram measuring device according to this embodiment includes a first electroencephalogram measuring means that is inserted into the ear hole (ear canal) and contacts the surface of a living body in the ear canal to detect an electric potential. The first electroencephalogram measuring means is an electrode that detects an electric potential. The electrode is provided on the surface of an elastic member such as rubber. The elastic member is inserted into the ear canal to measure an electric potential. The elastic member inserted into the ear canal is deformed in the ear canal, improving the degree of contact with the surface of a living body and improving the measurement accuracy of the electric potential. The elastic member itself may be a conductive member. For example, conductive rubber may be used as the first electroencephalogram detecting means.

[0018] The electroencephalogram measuring device according to this embodiment further includes a second electroencephalogram measuring means (electrode) that is provided in a part of the human body other than the external auditory canal (for example, the auricle, the part behind the auricle, the earlobe, etc.) and detects an electric potential by contacting the biological surface of that part. The first electroencephalogram measuring means and the second electroencephalogram measuring means have an integrated structure in which they are connected to each other, and have a structure in which the first electroencephalogram measuring means and the second electroencephalogram measuring means sandwich the ear when the electroencephalogram measuring device is worn on the ear. In a state in which the first electroencephalogram measuring means and the second electroencephalogram measuring means sandwich the ear, the first electroencephalogram measuring means is inserted into the external auditory canal of the ear and comes into contact with the biological surface, and the second electroencephalogram measuring means comes into contact with the auricle, the part behind the auricle, the earlobe, etc. of the ear and comes into contact with the biological surface. According to the electroencephalogram measuring device having such a structure, since it is possible to measure an electroencephalogram in a state in which the ear is sandwiched, the installation position of the electroencephalogram measuring device is less likely to shift compared to a case in which an electroencephalogram is measured using only one electrode inserted into the external auditory canal. That is, when only one electrode is inserted into the ear canal, the electrode is not supported and is easily removed from the ear canal due to human movement, but in this embodiment, the ear is pinched by the integrated first and second electroencephalogram measuring means, so the position of the electroencephalogram measuring device is not easily displaced and the electrode is not easily removed from the ear. As an example of a configuration using multiple electrodes, one electrode is placed on the forehead of a person and the other electrodes are inserted into the ear canal, but such a device does not have a structure that pinches a living body part as in this embodiment, so each electrode is easily removed from the living body due to human movement. In contrast, in this embodiment, since the ear is pinched, the electrode is less likely to fall off the ear compared to when each electrode is placed individually.

[0019] In addition, since the electroencephalogram measuring device according to this embodiment measures electroencephalograms using at least two electrodes (first electroencephalogram measuring means and second electroencephalogram measuring means), the measurement accuracy is improved compared to the case where electroencephalograms are measured using only one electrode inserted into the ear canal. In other words, when only one electrode is used, for example, it is not possible to measure reference information or perform grounding, but by using multiple electrodes as in this embodiment, it becomes possible to measure reference information and perform grounding, and the measurement accuracy is improved.

[0020] The electroencephalogram measuring device may be provided in a member, device, or equipment that is attached to the ear, such as an earphone, a hearing aid, glasses, a piercing, or a clip-shaped member, or may be a device that is used in combination with such a member, device, or equipment. Of course, the electroencephalogram measuring device may be formed of a member (e.g., an elastic member) that does not have any function other than the electroencephalogram measuring function. For example, an electrode may be provided on an earphone inserted into the ear canal to measure the potential in the ear canal, an electrode may be provided on an ear hook that holds the earphone and hangs on the auricle to measure the potential at the back of the auricle, and an electroencephalogram may be measured based on the measurement results of these potentials. Alternatively, an electrode may be provided on the frame of glasses to measure the potential at the back of the auricle, and an electroencephalogram may be measured based on the measurement results of the potential. At this time, an electrode member may be inserted into the ear canal to measure the potential in the ear canal, and an electroencephalogram may be measured using the measurement results and the measurement results of the potential by the electrode provided on the eyeglass frame.

[0021] As described above, the electroencephalogram measuring device according to the present embodiment is a device that measures electroencephalograms while being worn on the ear. Therefore, compared with the conventional electroencephalogram measuring device that measures electroencephalograms by placing multiple electrodes on the head (scalp or forehead), it causes less trouble in real life. In other words, the conventional electroencephalogram measuring device that measures electroencephalograms by placing multiple electrodes on the scalp or forehead is not a device configured assuming that a person will move, so it is difficult for a person to move with multiple electrodes placed on the scalp or forehead, and it is not realistic for a person to move. In contrast, since the electroencephalogram measuring device according to the present embodiment corresponds to a so-called hearable device, a person can move easily even while wearing the electroencephalogram measuring device according to the present embodiment. In other words, it is not realistic and actually difficult to move the body (for example, walking, running, working, etc.) with multiple electrodes placed on the scalp or forehead. In contrast, it is easy to move the body even while wearing the electroencephalogram measuring device according to the present embodiment. Therefore, compared with the above-mentioned conventional electroencephalogram measuring device, it is also possible to wear the electroencephalogram measuring device according to the present embodiment for a long period of time. As an application example of this embodiment, for example, an office worker may wear the electroencephalogram measuring device according to the present embodiment. In this way, the brain waves are measured during work. Of course, the brain wave measuring device according to this embodiment may also be applied to situations other than work. For example, brain waves may be measured during a walk or jogging, brain waves may be measured during sleep, or brain waves may be measured while receiving content (for example, videos, still images (photos), movies, dramas, TV programs, music, paintings, lectures, etc.).

[0022] In the following, as an example, a case where the electroencephalogram measuring device according to the present embodiment is applied to earphones will be described. Of course, as described above, application examples of the present embodiment are not limited to earphones.

[0023] An information processing system according to an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 shows an example of an information processing system according to the present embodiment.

[0024] The information processing system according to the present embodiment includes, as an example, an earphone device 10, a terminal device 12, and a music distribution server 14.

[0025] The earphone device 10 is, for example, a canal-type earphone, a headphone (a device that converts an electric signal output from a playback device into a sound wave using a speaker) that is used by inserting it into the ear canal (ear canal). The earphone device 10 also functions as an electroencephalogram measuring system. Specifically, the earphone device 10 measures the electric potential of the user's head, and outputs information indicating the measurement result (for example, a signal indicating the electric potential) as information indicating the electroencephalogram measurement result.

[0026] The earphone device 10 has a wireless communication function. The communication method is, for example, short-distance wireless communication (such as Bluetooth (registered trademark), RFID (Radio Frequency Identifier), etc.), infrared communication, visible light communication, Wi-Fi (registered trademark) communication, etc. For example, the earphone device 10 receives a signal representing a sound (a sound signal such as an audio signal) from the terminal device 12 via wireless communication, and generates a sound according to the signal. The earphone device 10 also transmits information indicating the electroencephalogram measurement result to the terminal device 12 via wireless communication. Of course, the earphone device 10 may also have a wired communication function using a cable. In this case, the earphone device 10 may receive a sound signal via wired communication, generate a sound, and transmit information indicating the electroencephalogram measurement result to an external device via wired communication.

[0027] The terminal device 12 is, for example, a mobile terminal such as a smartphone, a mobile phone, or a tablet PC (personal computer), a PC, a music player, a video playback device, or the like, and corresponds to an example of an information processing device. The terminal device 12 has a wireless communication function. The terminal device 12 functions as a playback device (music playback device or video playback device). For example, the terminal device 12 plays music and transmits the sound signal to the earphone device 10 by wireless communication. The terminal device 12 may play a video and transmit the sound signal to the earphone device 10 by wireless communication. The terminal device 12 may also receive information indicating the electroencephalogram measurement result from the earphone device 10 by wireless communication, and evaluate the electroencephalogram state of the user by analyzing the electroencephalogram measurement result. The earphone device 10 may analyze the electroencephalogram measurement result, and information indicating the analysis result may be transmitted from the earphone device 10 to the terminal device 12, or the electroencephalogram measurement result may be analyzed by a device other than the earphone device 10 and the terminal device 12, and information indicating the analysis result may be transmitted to the terminal device 12. The terminal device 12 may transmit a sound signal to the earphone device 10 by wired communication using a cable, and may receive information indicating the electroencephalogram measurement result from the earphone device 10. The terminal device 12 also has a function of communicating with other devices via a communication path N such as a network. The communication method may be wireless communication such as Wi-Fi communication, or may be wired communication. The terminal device 12 can acquire information by connecting to the Internet, for example.

[0028] The music distribution server 14 is a device that has a function of communicating with other devices via the communication path N and provides a music distribution service via the communication path N. The music distribution server 14 distributes music data via the Internet, for example. The music distribution server 14 may provide the music data to the user in a download format, or may provide the music data to the user by streaming distribution. The music data is provided, for example, for a fee. A fee may be charged for each song or album, or a flat rate system (for example, a fee system in which a fixed fee is charged for each predetermined period, such as each month, and the service can be used unlimitedly or with a certain limit during that period) may be adopted. Of course, there may be music data provided free of charge. In addition, a limit on the number of downloads, a limit on the period of downloading, a limit on the period of streaming distribution, etc. may be set. The music distribution service may be available on a device in which an application (program) for the music distribution service is installed. The music distribution server 14 may provide music data for previewing.

[0029] A device (e.g., a video distribution server) that provides a video distribution service may be included in the information processing system. The music distribution server 14 may also function as a video distribution server to provide the video distribution service, or a video distribution server other than the music distribution server 14 may provide the video distribution service. The video distribution server may provide the video data to the user in a download format, for example, or may provide the video data to the user by streaming distribution. The video data is provided, for example, for a fee. A fee may be set for each video, or a flat rate system may be adopted. Of course, there may be video data provided free of charge. In addition, a limit on the number of downloads, a time limit, a time limit for streaming distribution, etc. may be set. The video distribution service may be available on a device in which an application for the video distribution service is installed. The video distribution server may provide video data for previewing.

[0030] Of course, a device that distributes both music and videos may be included in the information processing system.

[0031] In this embodiment, the earphone device 10 measures the user's brain waves, and information indicating the measurement results is transmitted to the terminal device 12. The terminal device 12 analyzes the measurement results to evaluate the user's brain wave state. In addition, a sound signal is transmitted from the terminal device 12 to the earphone device 10, and the earphone device 10 generates a sound. For example, music is played on the terminal device 12, and a sound corresponding to the music is generated from the earphone device 10. As a result, the user's brain waves when listening to music are measured by the earphone device 10, and the brain wave state is analyzed by the terminal device 12. The playback of music may be controlled according to the brain wave measurement results. For example, the music to be played may be changed according to the brain wave state. The music data may be data provided to the terminal device 12 from the music distribution server 14, or may be data stored in the terminal device 12 without being distributed from the music distribution server 14.

[0032] The earphone device 10 may be connected to another music playback device or video playback device without being used together with the terminal device 12, or may be used as a standalone electroencephalogram measuring device without generating sound (i.e., the earphone device 10 may be used as an electroencephalogram measuring device without playing music or videos). The terminal device 12 may be used as a standalone electroencephalogram analyzing device without being used together with the earphone device 10, or may be connected to earphones other than the earphone device 10, or may control the playback of music or videos based on electroencephalograms measured by an electroencephalogram measuring device other than the earphone device 10.

[0033] The earphone device 10 will be described in detail below with reference to Fig. 2 to Fig. 4. Fig. 2 is a perspective view showing the overall configuration of the earphone device 10. Fig. 3 is a perspective view showing a partial configuration of the earphone device 10, and is a view of the earphone device 10 viewed from a different direction than that of Fig. 2. Fig. 4 is a perspective view showing the configuration of the left earphone unit.

[0034] For convenience of explanation, the front and rear are defined as shown in Fig. 2. The front is the direction in which the user's face faces, and the rear is the opposite direction to the front.

[0035] 2 and 3, the earphone device 10 mainly includes a left earphone unit 16L to be worn on the left ear of the user, a right earphone unit 16R to be worn on the right ear of the user, and a cable 18 connecting the left earphone unit 16L and the right earphone unit 16R. The left earphone unit 16L corresponds to an example of a first electroencephalogram measuring device, and the right earphone unit 16R corresponds to an example of a second electroencephalogram measuring device.

[0036] The left earphone unit 16L includes a left speaker unit 20L that is inserted into the user's left ear hole (external ear canal), a left support unit 22L (left base unit) that supports the left speaker unit 20L, and a left ear hook unit 24L having one end connected to the left support unit 22L.

[0037] The left speaker unit 20L is composed of a driver unit that generates sound, a sound guide tube, an equalizer, a housing (frame, housing, etc.), and an ear pad (ear piece) that covers the part inserted into the ear. The left speaker unit 20L may be a speaker unit of a known canal type earphone. The ear pad of the left speaker unit 20L is composed of a resin such as rubber.

[0038] A first left EEG sensor 26L is provided on the side of the left speaker unit 20L. More specifically, the first left EEG sensor 26L is provided on the side of an ear pad constituting the left speaker unit 20L. The first left EEG sensor 26L is an electrode that detects the electric potential of the head together with a second left EEG sensor 28L described later. The first left EEG sensor 26L is made of, for example, conductive rubber made of carbon. The first left EEG sensor 26L corresponds to an example of a first EEG measuring means.

[0039] The left support part 22L has a thin rectangular parallelepiped shape, for example, and the left speaker part 20L is provided on a surface of the left support part 22L that faces the left ear of the user when the user wears the earphone device 10. The left support part 22L is, for example, a case, and houses components such as an electronic board inside.

[0040] The left ear hook 24L has a curved shape overall, and is a member that is hung on the left ear of the user when the user wears the earphone device 10. One end of the left ear hook 24L is connected to the front part of the left support part 22L, and the left ear hook 24L has a curved shape from the connection part to the rear side of the left support part 22L, and this part forms a curved part. The curved part is hung on the left ear from above the left ear. The other end of the left ear hook 24L is connected to one end of the cable 18.

[0041] The second left EEG sensor 28L is provided along the left ear hook 24L on the left ear hook 24L. The second left EEG sensor 28L is provided on the surface of the left ear hook 24L facing the left ear of the user so as to contact the left ear, more specifically, the back side of the left ear (closer to the skull) when the left ear hook 24L is hung on the left ear. By providing the second left EEG sensor 28L so as to contact the back side of the left ear, the potential can be detected at a position closer to the brain, thereby improving the accuracy of the EEG measurement. The second left EEG sensor 28L is an electrode that detects the potential of the head together with the first left EEG sensor 26L. The second left EEG sensor 28L is made of, for example, conductive rubber made of carbon. For example, the potential detected by the second left EEG sensor 28L is used as a reference potential, and the first left EEG sensor 26L measures the potential (potential difference) from the reference potential. The second left electroencephalogram sensor 28L corresponds to an example of a second electroencephalogram measuring means.

[0042] When the left ear hook 24L is placed over the left ear and the left speaker unit 20L is inserted into the left ear canal, the left ear is clamped between the first left EEG sensor 26L provided on the left speaker unit 20L and the second left EEG sensor 28L provided on the left ear hook 24L, and in this state, brain waves are measured by the first left EEG sensor 26L and the second left EEG sensor 28L.

[0043] As described above, by sandwiching the left ear between the first left EEG sensor 26L and the second left EEG sensor 28L, the EEG sensor can be brought into close contact with the left ear, thereby improving the accuracy of EEG measurement. Also, since the first left EEG sensor 26L is inserted into the left ear canal, the degree of contact between the first left EEG sensor 26L and the left ear is high.

[0044] The right earphone unit 16R includes a right speaker unit 20R that is inserted into the user's right ear hole (ear canal), a right support unit 22R (right base unit) that supports the right speaker unit 20R, and a right ear hook unit 24R having one end connected to the right support unit 22R.

[0045] The right speaker unit 20R, like the left speaker unit 20L, is composed of a driver unit, a sound guide tube, an equalizer, a housing, ear pads, etc. The right speaker unit 20R may be a speaker unit of a known canal-type earphone. The ear pads of the right speaker unit 20R are composed of resin such as rubber.

[0046] A first right EEG sensor 26R is provided on the side of the right speaker unit 20R. More specifically, the first right EEG sensor 26R is provided on the side of an ear pad constituting the right speaker unit 20R. The first right EEG sensor 26R is an electrode that detects the electric potential of the head together with a second right EEG sensor 28R described later. The first right EEG sensor 26R is made of, for example, conductive rubber made of carbon. The first right EEG sensor 26R corresponds to an example of a third EEG measuring means.

[0047] The right support part 22R has a thin rectangular parallelepiped shape, for example, and the right speaker part 20R is provided on the surface of the right support part 22R that faces the right ear of the user when the user wears the earphone device 10. The right support part 22R is, for example, a case, and houses components such as an electronic board inside.

[0048] The right ear hook 24R has a curved shape overall, and is a member that is hung on the right ear of the user when the user wears the earphone device 10. One end of the right ear hook 24R is connected to the front part of the right support part 22R, and the right ear hook 24R has a curved shape from the connection part to the rear side of the right support part 22R, and this part forms a curved part. The curved part is hung on the right ear from above the right ear. The other end of the right ear hook 24R is connected to the other end of the cable 18.

[0049] The right ear hook 24R is provided with a second right EEG sensor 28R along the right ear hook 24R. The second right EEG sensor 28R is provided on the surface of the right ear hook 24R facing the right ear of the user so as to contact the right ear, more specifically, the back side of the right ear (closer to the skull) when the right ear hook 24R is hung on the right ear. By providing the second right EEG sensor 28R so as to contact the back side of the right ear, the potential can be detected at a position closer to the brain, thereby improving the accuracy of the EEG measurement. The second right EEG sensor 28R is an electrode that detects the potential of the head together with the first right EEG sensor 26R. The second right EEG sensor 28R is made of, for example, conductive rubber made of carbon. For example, the potential detected by the second right EEG sensor 28R is used as a reference potential, and the first right EEG sensor 26R measures the potential (potential difference) from the reference potential. The second right electroencephalogram sensor 28R corresponds to an example of a fourth electroencephalogram measuring means.

[0050] When the right ear hook 24R is hung on the right ear and the right speaker unit 20R is inserted into the right ear canal, the right ear is clamped between the first right EEG sensor 26R provided on the right speaker unit 20R and the second right EEG sensor 28R provided on the right ear hook 24R, and in this state, brain waves are measured by the first right EEG sensor 26R and the second right EEG sensor 28R.

[0051] As described above, by sandwiching the right ear between the first right EEG sensor 26R and the second right EEG sensor 28R, the EEG sensor can be brought into close contact with the right ear, thereby improving the accuracy of EEG measurement. Also, since the first right EEG sensor 26R is inserted into the left ear canal, the close contact between the first right EEG sensor 26R and the right ear is high.

[0052] The earphone device 10 has a wireless communication function (e.g., Bluetooth) and communicates wirelessly with the terminal device 12. The communication interface (communication chip) having the wireless communication function is built in, for example, the left and right earphone parts. For example, a communication chip for wireless communication (e.g., a communication chip for Bluetooth) is built in the left support part 22L (case) of the left earphone part 16L, and similarly, a communication chip for wireless communication is built in the right support part 22R (case) of the right earphone part 16R. The left earphone part 16L receives a sound signal (sound signal for the left ear) transmitted from the terminal device 12 by the communication chip built in the left support part 22L, and generates a sound according to the sound signal. The right earphone part 16R receives a sound signal (sound signal for the right ear) transmitted from the terminal device 12 by the communication chip built in the right support part 22R, and generates a sound according to the sound signal.

[0053] Furthermore, information indicating the electroencephalogram measurement results obtained by the left earphone unit 16L and the right earphone unit 16R is transmitted from the earphone device 10 to the terminal device 12 by wireless communication (eg, Bluetooth).

[0054] The left earphone unit 16L and the right earphone unit 16R are physically connected by a cable 18, and transmit and receive data to and from each other via the cable 18.

[0055] Both the information indicating the electroencephalogram measurement result by the left earphone unit 16L and the information indicating the electroencephalogram measurement result by the right earphone unit 16R may be transmitted separately from the earphone device 10 to the terminal device 12, or the information may be compiled by, for example, statistical processing and transmitted to the terminal device 12. As the statistical processing, for example, a simple average or a weighted average of the electroencephalogram measurement result by the left earphone unit 16L and the electroencephalogram measurement result by the right earphone unit 16R may be performed in the earphone device 10, and information indicating the processing result may be transmitted from the earphone device 10 to the terminal device 12 by a communication chip installed in either the left earphone unit 16L or the right earphone unit 16R. Of course, information before such processing is transmitted from the earphone device 10 to the terminal device 12, and such processing may be performed in the terminal device 12.

[0056] For example, if a failure occurs in the cable 18 and data transmission / reception between the left earphone unit 16L and the right earphone unit 16R becomes impossible, information indicating the electroencephalogram measurement results by each earphone unit may be separately transmitted to the terminal device 12. In this case, information indicating the electroencephalogram measurement results by the left earphone unit 16L is transmitted from the left earphone unit 16L to the terminal device 12 by a communication chip installed in the left earphone unit 16L. Similarly, information indicating the electroencephalogram measurement results by the right earphone unit 16R is transmitted from the right earphone unit 16R to the terminal device 12 by a communication chip installed in the right earphone unit 16R. By transmitting the electroencephalogram measurement results in this manner, even if the cable 18 breaks down, the electroencephalogram measurement can be continued and the electroencephalogram measurement results can be transmitted to the terminal device 12.

[0057] Furthermore, if a communication chip installed in one of the earphone units breaks down, information indicating the EEG measurement result may be transmitted to the terminal device 12 using a communication chip that is not broken. In this case, information indicating the EEG measurement result by the left earphone unit 16L and information indicating the EEG measurement result by the right earphone unit 16R may be transmitted to the terminal device 12 separately, or information generated by applying processing such as statistical processing to both pieces of information may be transmitted to the terminal device 12. By transmitting the EEG measurement result in this manner, even if one of the communication chips breaks down, the EEG measurement can be continued and the EEG measurement result can be transmitted to the terminal device 12.

[0058] Furthermore, if one of the earphone units breaks down, information indicating the brainwave measurement results obtained by the other, non-broken earphone unit may be transmitted to the terminal device 12. By transmitting the brainwave measurement results in this manner, even if one of the earphone units breaks down, the brainwave measurement can be continued and the brainwave measurement results can be transmitted to the terminal device 12.

[0059] Any failure in the cable 18 or the communication chip is detected by a sensor or by checking the presence or absence of continuity.

[0060] A battery that supplies power to drive the earphone device 10 is installed in either the left earphone unit 16L or the right earphone unit 16R. For example, a battery is built into the left support unit 22L (case) of the left earphone unit 16L, and no battery is built into the right earphone unit 16R. In this case, each part of the left earphone unit 16L (e.g., the driver unit in the left speaker unit 20L, the communication chip, the parts related to the brain wave measurement, etc.) receives power supply from the battery and drives it. Also, power is supplied from the battery built into the left support unit 22L to the right earphone unit 16R via the cable 18, and each part of the right earphone unit 16R (e.g., the driver unit in the right speaker unit 20R, the communication chip, the parts related to the brain wave measurement, etc.) is driven by the power. A battery may not be provided in the left earphone unit 16L, but may be provided in the right earphone unit 16R. In this case as well, power is supplied from the right earphone unit 16R to the left earphone unit 16L via the cable 18. The battery may be charged, for example, via a USB cable, or may be charged wirelessly when the earphone device 10 is housed in a case. Note that both the left earphone unit 16L and the right earphone unit 16R may be provided with a battery.

[0061] In order to prevent the effect of battery charging on the potential measurement, the potential measurement may be stopped when charging starts. As another example, if a shielding material (electromagnetic wave protection material) is provided around the battery and the parts involved in charging, the potential measurement may be performed even during charging.

[0062] The earphone device 10 may be provided with an operation unit such as a remote control.

[0063] The shape of the ear hook portion will be described in more detail below with reference to Fig. 5. Fig. 5 is a diagram of the left earphone unit 16L as viewed from the left support portion 22L side.

[0064] The left ear hook 24L includes a first curved portion 30 having a first curvature, a second curved portion 32 having a second curvature, and a third curved portion 34 having a third curvature. One end of the first curved portion 30 is connected to the left support portion 22L, and the first curved portion 30 is a member provided from the left support portion 22L to the second curved portion 32. One end of the second curved portion 32 is connected to the other end of the first curved portion 30, and the second curved portion 32 is a member provided from the connection portion to the third curved portion 34. One end of the third curved portion 34 is connected to the other end of the second curved portion 32, and the third curved portion 34 is a member provided from the connection portion to the cable 18, and the other end of the third curved portion 34 is connected to the cable 18. The first curved portion 30, the second curved portion 32, and the third curved portion 34 are integrated, thereby forming the left ear hook 24L. Of course, the first curved portion 30, the second curved portion 32, and the third curved portion 34 may each be formed of separate members and connected to one another.

[0065] The first curvature of the first curved portion 30 is, for example, R12.5 to R14.5. The first curvature of the first curved portion 30 may be R13.0 to R14.0, or may be R13.5. The second curvature of the second curved portion 32 is, for example, R15.5 to R17.5. The second curvature of the second curved portion 32 may be R16.0 to R17.0, or may be R16.5. The third curvature of the third curved portion 34 is, for example, R106.5 to R108.5. The third curvature of the third curved portion 34 may be R107.0 to R108.0, or may be R107.6.

[0066] In this way, the left ear hook 24L has a shape with different curvatures in different parts, and is formed to cover the base of the left ear as a whole. By changing the curvature in parts, the left earphone 16L fits closely to the left ear, and as a result, the accuracy of measuring brain waves can be improved. Of course, the above curvature values ​​are merely examples, and the curvature values ​​may be determined to fit the shape of the user's ear.

[0067] Furthermore, if the direction perpendicular to the direction in which gravity acts (vertical direction) is defined as the horizontal direction, the left support part 22L is disposed so that when the left ear hook part 24L is hooked on the left ear of the user and the left earphone part 16L is worn on the left ear, the left support part 22L is inclined at a predetermined angle θ from the horizontal direction. The angle θ is, for example, 37° to 43°. The angle θ may be 39° to 41°, or may be 40°. By adopting such an angle, the degree of contact of the left earphone part 16L with the left ear can be improved.

[0068] The angle φ between the base of the first curved portion 30 and the side surface of the left support portion 22L is, for example, 30° to 40°. By providing the first curved portion 30 at such an angle, the degree of contact of the left earphone portion 16L with the left ear can be improved.

[0069] The right earphone unit 16R is similar to the left earphone unit 16L. The right earhook unit 24R includes a first curved portion having the above-mentioned first curvature, a second curved portion having the above-mentioned second curvature, and a third curved portion having the above-mentioned third curvature. The right support unit 22R is disposed so as to be inclined at the above-mentioned angle θ, and the first curved portion is disposed so as to be inclined at the above-mentioned angle φ.

[0070] According to the configuration shown in Fig. 5, the left earphone unit 16L is placed on the left ear by placing the left ear hook 24L of the left earphone unit 16L on the left ear, and then the left earphone unit 16L is rotated through an angle θ (for example, by rotating it toward the back of the head) so that the left earphone unit 16L is worn on the left ear. By rotating the left earphone unit 16L and wearing it on the left ear in this way, the left earphone unit 16L fits closely to the left ear, making it difficult for the left earphone unit 16L to fall off from the left ear. The right earphone unit 16R is worn on the right ear in the same way, and by rotating the right earphone unit 16R and wearing it on the right ear, the right earphone unit 16R fits closely to the right ear, making it difficult for the right earphone unit 16R to fall off from the right ear.

[0071] The brain wave sensors provided in the ear pads constituting the left speaker unit 20L and the right speaker unit 20R will be described in detail below.

[0072] An example of an ear pad is shown in Figures 6 and 7. Figure 6 is a diagram of the ear pad seen from the side, and Figure 7 is a diagram of the ear pad seen from above (the side that is inserted into the ear).

[0073] The ear pads 36 are used as ear pads constituting the left speaker unit 20L and the right speaker unit 20R. Known ear pads can be used for the ear pads 36 themselves. In the example shown in Figs. 6 and 7, the ear pads 36 have a circular cross section and a columnar shape whose width (diameter of the circle) narrows toward the tip. The ear pads 36 are formed with through holes 36a that penetrate in the height direction, and sound is transmitted to the outside through the through holes 36a. The ear pads 36 are made of, for example, resin such as rubber.

[0074] An electroencephalogram sensor 38 serving as an electrode is provided on the side surface of the ear pad 36. The electroencephalogram sensor 38 is composed of a plurality of linear sensors (electrodes) arranged in parallel in the height direction of the ear pad 36, and is arranged along the circumferential direction on the outer periphery of the ear pad 36.

[0075] When the ear pad 36 is provided on the left speaker unit 20L, the brain wave sensor 38 functions as the first left brain wave sensor 26L. Similarly, when the ear pad 36 is provided on the right speaker unit 20R, the brain wave sensor 38 functions as the first right brain wave sensor 26R.

[0076] The brainwave sensor 38 is made of, for example, conductive rubber made of carbon. In order to reduce electrical resistance, the brainwave sensor 38 may contain silver paste to reduce electrical resistance.

[0077] When the EEG sensor 38 has a certain degree of humidity, the potential may be easily measured. Therefore, in order to maintain the humidity of the EEG sensor 38, the surface of the EEG sensor 38 may be processed. In general, the wettability of a solid surface depends on the roughness of the solid surface. For example, according to Wenzel's formula, the greater the surface roughness, the smaller the contact angle on a hydrophilic surface, and the easier the surface becomes to wet (i.e., the easier it is to maintain humidity). Therefore, the surface of the EEG sensor 38 may be processed to adjust the surface roughness so that the surface roughness of the EEG sensor 38 is such that a humidity at which the potential is easily measured can be obtained. As another example, the surface of the EEG sensor 38 may be treated with fluorine gas to introduce an oxygen-containing functional group into the surface of the EEG sensor 38, thereby making the surface of the EEG sensor 38 hydrophilic, thereby maintaining the humidity of the EEG sensor 38. Of course, the humidity of the EEG sensor 38 may be maintained at a humidity at which the potential is easily measured by other methods.

[0078] Another example of the brain wave sensor is shown in Fig. 8 and Fig. 9. Fig. 8 and Fig. 9 are views of the ear pad 36 seen from the side. The ear pad 36 itself has the same shape as the ear pad 36 shown in Fig. 6 and Fig. 7. In the example shown in Fig. 8, the brain wave sensor 40 as an electrode is composed of multiple triangular sensors (electrodes) and is arranged along the circumferential direction on the outer periphery of the ear pad 36. In the example shown in Fig. 9, the brain wave sensor 42 as an electrode is composed of multiple circular sensors (electrodes) and is arranged along the circumferential direction on the outer periphery of the ear pad 36.

[0079] 10 to 13 show another example of the brain wave sensor. FIGS. 10, 12 and 13 are views of the ear pad 36 seen from the side, and FIG. 11 is a view of the ear pad 36 seen from above (the side inserted into the ear). The ear pad 36 itself has the same shape as the ear pad 36 shown in FIGS. 6 and 7. In the example shown in FIGS. 10 and 11, the brain wave sensor 44 as an electrode is composed of a plurality of linear sensors (electrodes) arranged in parallel in the circumferential direction of the ear pad 36, and is arranged along the height direction on the outer periphery of the ear pad 36. In the example shown in FIG. 12, the brain wave sensor 46 as an electrode is composed of a plurality of triangular sensors (electrodes), and is arranged along the height direction on the outer periphery of the ear pad 36. In the example shown in FIG. 13, the brain wave sensor 48 as an electrode is composed of a plurality of circular sensors (electrodes), and is arranged along the height direction on the outer periphery of the ear pad 36.

[0080] The above-mentioned shape and arrangement of the brain wave sensor are merely examples, and other shapes and arrangements may be adopted. Also, the brain wave sensor may be provided on the entire outer periphery of the ear pad 36.

[0081] Other examples of installation of the brain wave sensor will be described below with reference to Fig. 14 to Fig. 17. Fig. 14 to Fig. 17 are perspective views showing a partial configuration of the earphone device 10.

[0082] In the example shown in FIG. 14, an EEG sensor (electrode) is provided on the right earphone unit 16R, and no EEG sensor (electrode) is provided on the left earphone unit 16L. That is, a first right EEG sensor 26R is provided on the side (side of the ear pad) of the right speaker unit 20R, and a second right EEG sensor 28R is provided on the right ear hook unit 24R. In this case, the first right EEG sensor 26R and the second right EEG sensor 28R provided on the right earphone unit 16R measure potential, and information indicating the measurement result is transmitted from the earphone device 10 to the terminal device 12 as information indicating the EEG measurement result. Note that it is also possible to provide an EEG sensor on the left earphone unit 16L and not provide an EEG sensor on the right earphone unit 16R.

[0083] In the example shown in FIG. 15, similarly to the example shown in FIG. 14, an EEG sensor (electrode) is provided on the right earphone unit 16R, and an EEG sensor (electrode) is not provided on the left earphone unit 16L. The second right EEG sensor 28R provided on the right ear hook unit 24R of the right earphone unit 16R is a sensor including two EEG sensors 50 (electrodes) provided along the right ear hook unit 24R. In this case, for example, the potential difference between one of the two EEG sensors 50 and the first right EEG sensor 26R is adopted as the potential difference measured by the right earphone unit 16R. Of course, the second right EEG sensor 28R may include three or more EEG sensors 50. By configuring the second right EEG sensor 28R with a plurality of EEG sensors 50, the second right EEG sensor 28R is more likely to come into contact with the right ear, and therefore the potential is more likely to be reliably measured by the second right EEG sensor 28R. In other words, the potential is measured by bringing any one of the multiple brain wave sensors 50 into contact with the right ear, so the potential is measured more reliably than when only one brain wave sensor is used.

[0084] In the example shown in FIG. 16, the first right EEG sensor 26R is provided on the side of the right speaker unit 20R (side of the ear pad), the second right EEG sensor 28R is provided on the right ear hook unit 24R, and the second left EEG sensor 28L is provided on the left ear hook unit 24L. The first left EEG sensor 26L is not provided. In this case, for example, the potential difference between the first right EEG sensor 26R and the second right EEG sensor 28R, or the potential difference between the first right EEG sensor 26R and the second left EEG sensor 28L is measured, and the measured potential difference is adopted as the EEG measurement result. By using the second left EEG sensor 28L and the second right EEG sensor 28R in this way, even if one of the EEG sensors is not in contact with the ear or the contact between one of the EEG sensors and the ear is not good, it is possible to measure the EEG.

[0085] In the example shown in Fig. 17, the first right EEG sensor 26R is provided on the side surface (side surface of the ear pad) of the right speaker unit 20R, the second right EEG sensor 28R is provided on the right ear hook unit 24R, the first left EEG sensor 26L is provided on the side surface (side surface of the ear pad) of the left speaker unit 20L, and the second left EEG sensor 28L is provided on the left ear hook unit 24L. As in the example shown in Fig. 15, the second right EEG sensor 28R is a sensor including two EEG sensors 50 (electrodes) provided along the right ear hook unit 24R. Similarly, the second left EEG sensor 28L is a sensor including two EEG sensors 52 (electrodes) provided along the left ear hook unit 24L. In this case, for example, the potential difference between any one of the two brainwave sensors 50 and the first right brainwave sensor 26R is adopted as the potential difference measured by the right earphone unit 16R, and the potential difference between any one of the two brainwave sensors 52 and the first left brainwave sensor 26L is adopted as the potential difference measured by the left earphone unit 16L. Of course, three or more brainwave sensors 50, 52 may be provided. By configuring the second right brainwave sensor 28R and the second left brainwave sensor 28L with a plurality of sensors in this way, the second right brainwave sensor 28R is more likely to come into contact with the right ear, and the second left brainwave sensor 28L is more likely to come into contact with the left ear, so that the potentials are more reliably measured by the second right brainwave sensor 28R and the second left brainwave sensor 28L.

[0086] According to the earphone device 10 of this embodiment, by clamping the ears with multiple EEG sensors, the EEG sensors can be brought into close contact with the ears, thereby improving the accuracy of the potential measurement, and as a result, it is possible to improve the accuracy of the EEG measurement.

[0087] The functions of the earphone device 10 will be described in detail below with reference to Fig. 18. Fig. 18 is a functional block diagram of the earphone device 10.

[0088] As described above, the earphone device 10 includes the left earphone unit 16L, the right earphone unit 16R, and the cable 18 connecting the left earphone unit 16L and the right earphone unit 16R.

[0089] The left earphone unit 16L includes a left speaker unit 20L, a first left brain wave sensor 26L, a second left brain wave sensor 28L, a communication unit 54L, a battery 56, and a control unit 58L.

[0090] The communication unit 54L is a communication interface (communication chip) and has a function of transmitting data to other devices and a function of receiving data from other devices. The communication unit 54L has, for example, a wireless communication function. As described above, a short-distance wireless communication such as Bluetooth, infrared communication, visible light communication, Wi-Fi communication, etc. are used as the communication method. Here, it is assumed that short-distance wireless communication (for example, Bluetooth) is used as an example. For example, the communication unit 54L receives a signal representing a sound to be emitted from the left speaker unit 20L from an external device (for example, the terminal device 12) by short-distance wireless communication. The left speaker unit 20L generates a sound according to the signal received by the communication unit 54L. The communication unit 54L may also transmit information indicating an electroencephalogram measurement result to an external device (for example, the terminal device 12) by short-distance wireless communication. In addition, the earphone device 10 may be used in combination with an external device other than the terminal device 12 (e.g., a playback device, a display device, etc.), and therefore may communicate with an external device other than the terminal device 12 to receive sound signals from the external device, or may transmit information indicating the brain wave measurement results to the external device.

[0091] The battery 56 supplies power to each part of the left earphone unit 16L. For example, power is supplied from the battery 56 to the left speaker unit 20L, the communication unit 54L, and the control unit 58L, and the left speaker unit 20L, the communication unit 54L, and the control unit 58L are driven by the power supplied from the battery 56. Also, as described later, when a battery is not provided in the right earphone unit 16R, power is supplied from the battery 56 to each part of the right earphone unit 16R via the cable 18. For example, a rechargeable battery is used as the battery 56. Of course, a non-rechargeable battery may be used as the battery 56. Note that a shielding member (electromagnetic wave prevention member) may be provided around the battery 56 and the parts related to charging. By providing a shielding member, noise caused by electromagnetic waves emitted during charging can be reduced, thereby improving the accuracy of the brain wave measurement.

[0092] The control unit 58L controls the operation of each part of the left earphone unit 16L. For example, the control unit 58L controls communication by the communication unit 54L, processes the electroencephalogram measurement results (for example, statistical processing), detects failures in each part of the left earphone unit 16L, and detects failures in the cable 18.

[0093] The right earphone unit 16R includes a right speaker unit 20R, a first right brain wave sensor 26R, a second right brain wave sensor 28R, a communication unit 54R, and a control unit 58R.

[0094] The communication unit 54R is a communication interface (communication chip) similar to the communication unit 54L, and has a function of transmitting data to other devices and a function of receiving data from other devices. The communication unit 54R has, for example, a wireless communication function. The communication method is the same as the communication method (for example, Bluetooth) adopted by the communication unit 54L. For example, the communication unit 54R receives a signal representing a sound to be emitted from the right speaker unit 20R from the terminal device 12 by short-range wireless communication. The right speaker unit 20R generates a sound according to the signal received by the communication unit 54R. The communication unit 54R may also transmit information indicating an electroencephalogram measurement result to the terminal device 12 by short-range wireless communication.

[0095] The control unit 58R controls the operation of each unit of the right earphone unit 16R. For example, the control unit 58R controls communication by the communication unit 54R, processes the electroencephalogram measurement results (for example, statistical processing), detects failures in each unit of the right earphone unit 16R, and detects failures in the cable 18.

[0096] Note that either the control unit 58L or the control unit 58R may be provided in the earphone device 10, and the one control unit may control the operation of each unit of the earphone device 10.

[0097] No battery is provided in the right earphone unit 16R. As described above, power is supplied to the right earphone unit 16R from the battery 56 provided in the left earphone unit 16L via the cable 18, and the right speaker unit 20R, communication unit 54R and control unit 58R are driven by the power supplied from the battery 56. By providing a battery only in one of the earphone units, the overall weight of the earphone device 10 can be reduced.

[0098] Of course, batteries may be provided in both the left earphone unit 16L and the right earphone unit 16R. In this case, power is supplied to each unit of the right earphone unit 16R from the battery provided in the right earphone unit 16R. As another example, a battery may be provided in the right earphone unit 16R, and no battery may be provided in the left earphone unit 16L. In this case, power is supplied to the left earphone unit 16L from the battery provided in the right earphone unit 16R via the cable 18.

[0099] When the first potential difference is measured by the first left EEG sensor 26L and the second left EEG sensor 28L, and the second potential difference is measured by the first right EEG sensor 26R and the second right EEG sensor 28R, the control unit 58L or the control unit 58R applies statistical processing (e.g., simple average or weighted average) to the first potential difference and the second potential difference, and adopts the value obtained by the statistical processing as the EEG measurement result. In this case, information indicating the EEG measurement result is transmitted from the earphone device 10 to the terminal device 12 by the communication unit 54L or the communication unit 54R. Of course, information before the statistical processing is performed may be transmitted from the earphone device 10 to the terminal device 12, and the statistical processing may be performed in the terminal device 12. In this case, information indicating the first potential difference is transmitted from the earphone device 10 to the terminal device 12 by the communication unit 54L as information indicating the first EEG measurement result, and information indicating the second potential difference is transmitted from the earphone device 10 to the terminal device 12 by the communication unit 54R as information indicating the second EEG measurement result.

[0100] If a failure occurs in the cable 18, information indicating the first EEG measurement result may be transmitted from the earphone device 10 to the terminal device 12 by the communication unit 54L, and information indicating the second EEG measurement result may be transmitted from the earphone device 10 to the terminal device 12 by the communication unit 54R.

[0101] If either the communication unit 54L or the communication unit 54R fails, information indicating the electroencephalogram measurement result may be transmitted to the terminal device 12 using the communication unit (communication chip) that is not failing.

[0102] If either the left earphone unit 16L or the right earphone unit 16R malfunctions, the non-faulty earphone unit may transmit to the terminal device 12 information indicating the electroencephalogram measurement result obtained by that earphone unit.

[0103] During charging of the battery 56, the control unit 58L or the control unit 58R may not transmit information indicating the electroencephalogram measurement result to the terminal device 12, or may stop the electroencephalogram measurement. As another example, during charging of the battery 56, the control unit 58L may stop the electroencephalogram measurement by the first left electroencephalogram sensor 26L and the second left electroencephalogram sensor 28L, and the control unit 58R may continue the electroencephalogram measurement by the first right electroencephalogram sensor 26R and the second right electroencephalogram sensor 28R. In this case, information indicating the electroencephalogram measurement result obtained by the right earphone unit 16R is transmitted from the earphone device 10 to the terminal device 12. During charging of the battery 56, the electroencephalogram measurement result obtained by the left earphone unit 16L provided with the battery 56 is easily affected by noise caused by the charging, but the electroencephalogram measurement result obtained by the right earphone unit 16R not provided with a battery is not easily affected by such noise. Therefore, by stopping the electroencephalogram measurement by the left earphone unit 16L and transmitting information indicating the electroencephalogram measurement result obtained by the right earphone unit 16R to the terminal device 12, the electroencephalogram measurement result less affected by noise caused by charging is provided to the terminal device 12. Of course, the electroencephalogram measurement by the left earphone unit 16L may be continued even while the battery 56 is being charged. In this case, the electroencephalogram is obtained using the measurement result obtained by the right earphone unit 16R without using the measurement result by the left earphone unit 16L. For example, the information indicating the measurement result by the left earphone unit 16L may not be transmitted from the earphone device 10 to the terminal device 12, and may not be used during the electroencephalogram analysis.

[0104] The configuration of the terminal device 12 will be described in detail below with reference to Fig. 19. Fig. 19 is a functional block diagram of the terminal device 12.

[0105] The communication unit 60 is a communication interface and has a function of transmitting data to other devices and a function of receiving data from other devices. The communication unit 60 has, for example, a wireless communication function. As the communication method, short-range wireless communication such as Bluetooth, infrared communication, visible light communication, Wi-Fi communication, etc. are used. The communication unit 60 may also have a wired communication function.

[0106] The communication unit 60 communicates with the earphone device 10, for example, by short-distance wireless communication (for example, Bluetooth). More specifically, the communication unit 60 transmits a signal representing a sound emitted from the left speaker unit 20L to the communication unit 54L of the left speaker unit 20L, and transmits a signal representing a sound emitted from the right speaker unit 20R to the communication unit 54R of the right speaker unit 20R, by short-distance wireless communication. The communication unit 60 also receives information indicating an electroencephalogram measurement result from the earphone device 10 by short-distance wireless communication. Note that the terminal device 12 may be used in combination with an earphone other than the earphone device 10 or an electroencephalogram measurement device. In this case, the terminal device 12 may receive information indicating an electroencephalogram measurement result from the electroencephalogram measurement device, and transmit a sound signal to the earphone device 10 or another earphone.

[0107] The communication unit 60 also communicates with other devices via a communication path N using a wireless communication function such as Wi-Fi or a wired communication function. The communication unit 60 transmits and receives information via the Internet, for example. The communication unit 60 may download music data from the music distribution server 14 via the communication path N, or may receive music data in streaming format.

[0108] The storage unit 62 is a storage device such as a hard disk or a memory (e.g., SSD, etc.). The storage unit 62 stores, for example, various data, various programs, address information indicating the address of the music distribution server 14, etc. The storage unit 62 also includes a list storage unit 64.

[0109] The list storage unit 64 stores data of one or more content playlists. The content is, for example, music or video, and the content playlist is a list made up of content identification information for identifying the content. One or more pieces of content are registered in the content playlist, and the content playlist is made up of one or more pieces of content identification information corresponding to one or more pieces of content.

[0110] The list storage unit 64 stores data of one or more music playlists as an example of a content playlist. The music playlist is a list configured with music identification information (e.g., song title, artist name, album name, etc.) for identifying music (songs). One or more pieces of music are registered in the music playlist, and the music playlist is configured with one or more pieces of music identification information corresponding to the one or more pieces of music. The music playlist is created for each user, for example, and managed in association with the user. Specifically, user identification information (e.g., user ID, user name, etc.) for identifying the user is associated with the data of the music playlist. In addition, an initial music playlist may be created in advance, a music playlist for each brainwave state may be created in advance, or a music playlist for each brainwave state desired by the user may be created. Data of these music playlists may be stored in the list storage unit 64. The initial music playlist is a list configured with one or more pieces of music identification information corresponding to one or more pieces of music (songs) selected in advance. Of course, a list for each genre, a list for each artist, a list for each age group, etc. may be created. The music data itself may be stored in the storage unit 62, or may be stored in another device (for example, the music distribution server 14 or another server, etc.).

[0111] The list storage unit 64 may store data of one or more video playlists as an example of a content list. The video playlist is a list configured by video identification information (e.g., video title, video creator, etc.) for identifying a video. One or more videos are registered in the video playlist, and the video playlist is configured by one or more video identification information corresponding to one or more videos. The video playlist is created for each user, for example, and managed in association with the user. Specifically, user identification information is associated with the data of the video playlist. In addition, an initial video playlist may be created in advance, or a video playlist for each brainwave state may be created in advance. Data of these video playlists may be stored in the list storage unit 64. The initial video playlist is a list configured by one or more video identification information corresponding to one or more videos selected in advance. Of course, a list for each genre, a list for each video creator, a list for each age group, etc. may be created. The video data itself may be stored in the storage unit 62, or may be stored in another device (e.g., a video distribution server or another server, etc.).

[0112] It should be noted that a content playlist containing both music and video may be created and stored in the list storage unit 64.

[0113] The UI unit 66 is a user interface unit, and includes a display unit and an operation unit. The display unit is, for example, a display device such as a liquid crystal display. The operation unit is, for example, an input device such as a touch panel, buttons, a keyboard, or a mouse. Of course, it may be a user interface that combines the display unit and the operation unit (for example, a touch-type display or a device that electronically displays a keyboard or the like on a display).

[0114] The control unit 68 controls the operation of each unit of the terminal device 12. The control unit 68 also includes an electroencephalogram state evaluation unit 70, a list creation unit 72, a display control unit 74, and a playback control unit 76.

[0115] The electroencephalogram state evaluation unit 70 receives information indicating the electroencephalogram measurement result and analyzes the electroencephalogram measurement result (e.g., potential difference) to evaluate the electroencephalogram state of the user. The electroencephalogram state is, for example, concentrated, relaxed, sleepy, awake, etc. The electroencephalogram state evaluation unit 70 may digitize the electroencephalogram state obtained by the electroencephalogram analysis. The electroencephalogram state of the user may not be determined to one state, and may be a mixture of multiple electroencephalogram states. For example, when the electroencephalogram state includes a mixture of a "concentrated" state and a "relaxed" state, the electroencephalogram state evaluation unit 70 digitizes each of the "degree of concentration" and the "degree of relaxation". It should be noted that a publicly known technique can be used as a method for evaluating the electroencephalogram state from the electroencephalogram measurement result (information indicating the potential difference). For example, the electroencephalogram state can be evaluated by analyzing delta waves, theta waves, alpha waves, and beta waves obtained from the electroencephalogram measurement result.

[0116] The electroencephalogram state evaluation section 70 may calculate a value representing the electroencephalogram state for each unit time (e.g., every second), or may calculate an average value (time average) of the values ​​representing the electroencephalogram state for a predetermined time. The electroencephalogram state evaluation section 70 may also generate a waveform representing the change over time of the value (waveform representing the change over time of the electroencephalogram state).

[0117] Furthermore, the electroencephalogram state evaluation section 70 associates the content with the electroencephalogram state. For example, while music is being played, the electroencephalogram state evaluation section 70 evaluates the user's electroencephalogram state based on information indicating the electroencephalogram measurement result, and associates the music with the electroencephalogram state. Since the time change of the electroencephalogram state is obtained, the electroencephalogram state at each time point in a song is measured. This makes it possible to identify the electroencephalogram state at each time point in a song.

[0118] The electroencephalogram state evaluation section 70 associates, for example, music identification information (e.g., title, etc.) that identifies music with electroencephalogram state information that indicates the electroencephalogram state of the user. The music identification information is stored in the storage section 62 in a state in which the music identification information is associated with the electroencephalogram state information. The electroencephalogram state information is information that indicates the electroencephalogram state obtained while the song is being played, and is, for example, information that indicates a numerical value that indicates the electroencephalogram state for each unit time, an average value of the numerical value, a waveform that indicates the time change of the numerical value, etc. The average value is, for example, a time average for the entire time period of one song or a part of a time period (e.g., a specified time period). For example, when the electroencephalogram state corresponds to "concentration", the electroencephalogram state information includes a "degree of concentration" (numerical value) for each unit time, the average value, a waveform that indicates the time change of the "degree of concentration", etc. When multiple electroencephalogram states are mixed, the electroencephalogram state information includes a numerical value that indicates each electroencephalogram state for each unit time, an average value (time average) of the numerical values ​​of each electroencephalogram state, and a waveform that indicates each electroencephalogram state. For example, when the brainwave states are a mixture of "concentration" and "relaxation," the brainwave state information includes the "level of concentration" (numerical value) per unit time, its average value, a waveform representing the change in the "level of concentration" over time, the "level of relaxation" (numerical value) per unit time, its average value, and a waveform representing the change in the "level of relaxation" over time.

[0119] When brain waves are measured while a video is being played, the process is similar to that for music, and video identification information (such as a title) that identifies the video is associated with brainwave state information that indicates the user's brainwave state.

[0120] The electroencephalogram measurement results analyzed by the electroencephalogram state evaluation section 70 may be results obtained by the earphone device 10, or may be results obtained by another electroencephalogram measurement device.

[0121] The brainwave state evaluation section 70 may be provided in another device, not in the terminal device 12. For example, a management server may be included in the information processing system, and the brainwave state evaluation section 70 may be provided in the management server. In this case, the brainwave state of the user may be evaluated by another device such as the management server, and information indicating the brainwave state may be transmitted from the other device to the terminal device 12. Of course, the brainwave state evaluation section 70 may be provided in the earphone device 10, and the earphone device 10 may analyze the brainwave measurement result to evaluate the brainwave state. In this case, brainwave state information indicating the evaluation may be transmitted from the earphone device 10 to the terminal device 12.

[0122] The list creation unit 72 creates a music playlist or a video playlist as a content playlist. The list creation unit 72 may create a music playlist including music identification information of music selected by the user or a video playlist including video identification information of a video selected by the user, or may automatically create a music playlist or a video playlist for each electroencephalogram state. Of course, the list creation unit 72 may create a list by genre, a list by artist or video creator, a list by age group, etc.

[0123] As described above, when the user's brainwave state is evaluated while music is being played, the music is associated with the brainwave state. In this case, the list creation unit 72 creates a music playlist (music playlist for that brainwave state) that is suitable for the brainwave state based on the evaluation result of the brainwave state. For example, when the average value of the numerical values ​​representing the brainwave state associated with a certain piece of music is equal to or greater than a threshold, the list creation unit 72 registers the music in a music playlist that is suitable for that brainwave state. For example, when a certain piece of music is associated with the brainwave states "concentration" and "relaxation," and the "degree of concentration" is equal to or greater than a threshold and the "degree of relaxation" is less than a threshold, the list creation unit 72 registers the music in a music playlist that is suitable for "concentration" (music playlist for concentration). When the "degree of relaxation" is also equal to or greater than a threshold, the list creation unit 72 registers the music in a music playlist related to "concentration" and also in a music playlist related to "relaxation" (music playlist for relaxation). In this way, a music playlist that is unique to the user and is a music playlist for each brainwave state is created.

[0124] When the user's electroencephalogram state is evaluated while a video is being played, the process is similar to that for music, and a video playlist is created for each user's unique electroencephalogram state.

[0125] In addition, the content list data may not be created by the list creation unit 72, but may be created by another device (e.g., a PC, a smartphone, a music player, etc.), or may be created by the music distribution server 14, a video distribution server, a management server, etc.

[0126] The display control section 74 controls the display of various information. The display control section 74 may cause the UI section 66 to display information (e.g., numerical values ​​or waveforms) indicating the electroencephalogram state obtained by the electroencephalogram state evaluation section 70, may cause the UI section 66 to display a music playlist or a video playlist, or may cause the UI section 66 to display information related to the song or video currently being played.

[0127] The playback control unit 76 plays back the content (music and video) included in the content playlist.

[0128] For example, when a user specifies a music playlist from among a plurality of music playlists stored in the list storage unit 64 and issues a playback instruction, the playback control unit 76 plays the music (songs) registered in the music playlist specified by the user. For example, when music data registered in a music playlist is stored in the storage unit 62, the playback control unit 76 may acquire the music data from the storage unit 62 and play it, or may download the music data from the music distribution server 14 and play it, or may play the music data streamed by the music distribution server 14, or may acquire the music data from a device other than these and play it. Of course, when a music playlist is not specified by the user and the music (song) itself is specified, the playback control unit 76 plays the specified music.

[0129] Also, when the user specifies a desired brainwave state and instructs playback, the playback control unit 76 plays music (song) for transitioning or maintaining the user's brainwave state to the desired brainwave state. When music and a brainwave state are associated, the playback control unit 76 plays music associated with the user's desired brainwave state. For example, the playback control unit 76 plays music whose numerical value (e.g., average value) representing the desired brainwave state is equal to or greater than a threshold. To explain with a specific example, when the desired brainwave state is "concentration", the playback control unit 76 plays music associated with a "degree of concentration" (e.g., average value) equal to or greater than a threshold. The playback control unit 76 may randomly play music associated with a numerical value equal to or greater than a threshold, or may play music with a higher numerical value before music with a lower numerical value, or, when a genre or artist is specified, may play music of the specified genre or artist associated with a numerical value equal to or greater than a threshold. Also, the playback control unit 76 may play music registered in a music playlist that matches the desired brainwave state. For example, if the desired brainwave state is "concentration," the playback control unit 76 plays music registered in a music playlist that is suitable for "concentration" (a music playlist for concentration).

[0130] During the playback of the music, the earphone device 10 measures the brainwave, the brainwave state is evaluated by the brainwave state evaluation unit 70, and the brainwave state is associated with the music. When a piece of music that is already associated with a brainwave state is played, the brainwave state is newly evaluated, and the new brainwave state is also associated with the music. That is, a brainwave state obtained in the past and a newly obtained current brainwave state are associated with the same music. In this way, the brainwave state obtained in each playback is associated with the music as a history of the brainwave state. This makes it possible to compare the past brainwave state with the current brainwave state when the user listens to the same music. Of course, the brainwave state obtained in the playback immediately before the current playback may be associated with the music, and the brainwave state obtained earlier than that may not be associated with the music. In this example, the earphone device 10 measures the brainwave during the playback of music, but of course, the earphone device 10 may measure the brainwave even if music or a video is not played.

[0131] The playback control unit 76 may receive music data for preview from the music distribution server 14 and play the music for preview. The music data for preview is, for example, data provided free of charge, and its playback time is shorter than that of the music data of the paid version, and its sound quality is lower than that of the music data of the paid version. During playback of the sample music, the earphone device 10 measures the brainwave, the brainwave state is evaluated by the brainwave state evaluation unit 70, and a numerical value or waveform representing the brainwave state is displayed on the UI unit 66. A numerical value representing the brainwave state obtained during playback of the music for preview may be presented to the user as a decision-making material for purchasing the music. As another example, a music playlist recommended by the music distribution server 14 may be displayed on the terminal device 12. The music data for preview may be data of one or more songs specified by the music distribution server 14, or may be music data selected from one or more genres.

[0132] When playing video, the same process is carried out as when playing music.

[0133] The content playlist data may be stored in another device (such as the music distribution server 14, a video distribution server, or a management server) without being stored in the list storage unit 64. In this case, the playback control unit 76 acquires the content playlist data from the other device in which the content playlist data is stored, or refers to the content playlist stored in the other device, and plays back the content included in the content playlist.

[0134] In addition, when measuring the brainwave state during playback of each music, the playback control unit 76 plays a part of the music (song) (for example, a part from the beginning to the middle of the song), the brainwave state evaluation unit 70 evaluates the brainwave state based on the brainwave measurement result obtained during the playback, and the playback control unit 76 and the brainwave state evaluation unit 70 may perform this set of playback and evaluation for multiple music (songs) as a set. In this way, each music is partially played, and the brainwave state during playback of each music is measured. The list creation unit 72 may create a music playlist for each brainwave state using information indicating the brainwave state obtained in this way. For example, when there is no music playlist for each brainwave state, the above-mentioned set is performed for multiple music, and a music playlist for each brainwave state is easily created.

[0135] The process performed by the terminal device 12 will now be described in detail.

[0136] When the user wears the earphone device 10 and the brainwave is measured, information indicating the brainwave measurement result is transmitted from the earphone device 10 to the terminal device 12. The brainwave state evaluation unit 70 calculates a numerical value indicating the brainwave state of the user by analyzing the information indicating the brainwave measurement result transmitted from the earphone device 10, and generates a waveform indicating the change in the numerical value over time. The display control unit 74 causes the UI unit 66 to display an brainwave display screen indicating the evaluation and the waveform.

[0137] FIG. 20 shows an example of an electroencephalogram display screen. The electroencephalogram display screen 78 is a screen displayed on the UI unit 66. As an example, waveforms 80 and 82 and evaluation values ​​84 and 86 are displayed on the electroencephalogram display screen 78. The waveform 80 is a waveform representing a time change in the "degree of concentration" of the user as an example of an electroencephalogram state, and the waveform 82 is a waveform representing a time change in the "degree of relaxation" of the user as an example of an electroencephalogram state. The waveforms 80 and 82 are waveforms generated by the electroencephalogram state evaluation unit 70. The evaluation value 84 indicates a time average of the "degree of concentration" (for example, an average value during a predetermined time), and the evaluation value 86 indicates a time average of the "degree of relaxation". The evaluation values ​​84 and 86 are values ​​calculated by the electroencephalogram state evaluation unit 70. In the example shown in FIG. 20, an electroencephalogram state of "concentration" and an electroencephalogram state of "relaxation" are mixed, and each is quantified. Of course, only information (for example, numerical values) indicating the electroencephalogram state designated by the user may be displayed, or only information indicating a predetermined electroencephalogram state may be displayed.

[0138] When music is played by the playback control unit 76, the earphone device 10 measures the user's brain waves during the playback, and information indicating the brain wave measurement results is transmitted from the earphone device 10 to the terminal device 12. The brain wave state evaluation unit 70 evaluates the user's brain wave state based on the information indicating the brain wave measurement results. The display control unit 74 causes the UI unit 66 to display a music playback screen that displays the music selected as the playback target, and displays information indicating the evaluation result of the brain wave state within the music playback screen.

[0139] FIG. 21 shows an example of a music playback screen. The music playback screen 88 is a screen displayed on the UI unit 66. As an example, as shown by an arrow 90, the music playback screen 88 displays a playback operation button image, a seek bar, elapsed time, a song title "AAAAAAAAA", and the like. The music playback screen 88 also displays an image 92 associated with the music to be played, evaluation values ​​94, 96, and arc-shaped evaluation bars 98, 100. The data of the image 92 may be stored in the terminal device 12 or in another device such as the music distribution server 14. The evaluation value 94 is a value indicating the "degree of concentration" of the user, and the evaluation value 96 is a value indicating the "degree of relaxation" of the user. The evaluation values ​​94, 96 may be instantaneous values ​​at the present time, or may be average values ​​from the start of playback of the song being played to the present time. The evaluation bar 98 is an image representing the "degree of concentration". The length of the rating bar 98 reflects the value of "degree of concentration", and the greater the value of "degree of concentration", the longer the length of the rating bar 98. The rating bar 100 is an image representing "degree of relaxation". The length of the rating bar 100 reflects the value of "degree of relaxation", and the greater the value of "degree of relaxation", the longer the length of the rating bar 100.

[0140] The electroencephalogram state evaluation section 70 associates music identification information for identifying music being played with electroencephalogram state information indicating the electroencephalogram state obtained during the playback, and stores the music identification information associated with the electroencephalogram state information in the storage section 62. In this way, the electroencephalogram state evaluation section 70 associates music identification information with electroencephalogram state information for each piece of played music, and stores them in the storage section 62. The list creation section 72 creates a music playlist for each user's unique electroencephalogram state, based on the electroencephalogram state information associated with the music identification information.

[0141] For example, assume that the threshold value for the electroencephalogram state is set to "60." In the example shown in FIG. 21, the average value of "degree of concentration" is "91," which is greater than or equal to the threshold value of "60," so the list creation unit 72 registers the music shown in FIG. 21 in a music playlist suitable for "concentration" (music playlist for concentration). Note that the threshold value is merely an example, and a different value may be used. Also, the user may be allowed to change the threshold value.

[0142] FIG. 22 shows another example of the music playback screen. The music playback screen 102 is a screen displayed on the UI unit 66. As an example, the music playback screen 102 displays a playback operation button image, a song title, and the like, as indicated by an arrow 104. The music playback screen 102 also displays waveforms 106 and 108, evaluation value information 110, an average value 112, and a message 114 as information indicating an electroencephalogram state associated with music. The music may be, for example, music specified by the user, or may be music selected randomly. The electroencephalogram state is, for example, an electroencephalogram state obtained in the past.

[0143] The waveform 106 is a waveform representing the time change of the "degree of concentration" of the user as an example of the brainwave state, and the waveform 108 is a waveform representing the time change of the "degree of relaxation" of the user as an example of the brainwave state. The evaluation value information 110 is information indicating the evaluation value at a specified time point in the song, and indicates the "degree of concentration" and the "degree of relaxation" at that time point. In the example shown in FIG. 22, the "degree of concentration" at that time point is "71", and the "degree of relaxation" is "60". This display is possible because a numerical value representing the brainwave state is obtained for each unit time. When the user specifies a time in the song, the evaluation value at that time is displayed. This allows the user to know what kind of brainwave state is in what time period in one song. For example, the user can know the time (part of the song) when the "degree of concentration" is high or the time when the "degree of relaxation" is high. The average value 112 is the average value of the numerical values ​​of the brainwave state for the entire time or a part of the time of one song. In the example shown in Fig. 22, since the average value of "degree of concentration" is greater than the average value of "degree of relaxation", the average value of "degree of concentration" is displayed as "77". In addition, since the average value is equal to or greater than the threshold, it is evaluated that the person was able to concentrate well, and a message 114 to that effect is displayed. Note that the average value of "degree of relaxation" may be calculated and displayed.

[0144] A timer function may be provided. For example, when a desired brainwave state (e.g., concentration, relaxation, etc.) and time length are specified by the user, the playback control unit 76 controls the playback of music so that the user's brainwave state is maintained in the desired brainwave state for the specified time. A plurality of candidates for the time length are predefined, and the user may specify a desired time length from among the plurality of candidates, or may specify any desired time length.

[0145] A music playlist that matches the brainwave state will be described in detail below with reference to Fig. 23. Fig. 23 shows an example of a playlist screen. The playlist screen 116 is a screen displayed on the UI unit 66. For example, when the user specifies a music playlist from one or more music playlists, the display control unit 74 causes the playlist screen 116 to be displayed on the UI unit 66, and displays information about music included in the music playlist specified by the user on the playlist screen 116. When the user specifies a desired brainwave state, the display control unit 74 may display information about music included in a music playlist that matches the desired brainwave state on the playlist screen 116.

[0146] 23 shows an example of information about music registered in a music playlist (concentration playlist) that matches the brainwave state "concentration." A concentration playlist is a list in which one or more pieces of music associated with a "degree of concentration" equal to or greater than a threshold are registered.

[0147] On the playlist screen 116, for example, an evaluation value 118 associated with the currently selected song (music) in the concentration playlist, an evaluation value 120 associated with the next song, and an evaluation value 122 associated with the previous song are displayed. The evaluation values ​​118, 120, and 122 represent "concentration level." For example, the concentration level associated with the selected song is "91," and a message is displayed indicating that the user was able to concentrate well on this song. An image having a shape corresponding to the level of concentration level is also displayed. The title of the selected song, "AAAAAAAAA," is also displayed.

[0148] Also displayed are waveforms 124, 126 and evaluation value information 128. These are information indicating the brain wave state associated with the selected song. Waveform 124 is a waveform that represents the change over time in "concentration level," and waveform 126 is a waveform that represents the change over time in "relaxation level." Furthermore, evaluation value information 128 is information that indicates the evaluation value at a specified point in time during the selected song, and indicates the "concentration level" and "relaxation level" at that point in time.

[0149] Also displayed is the playlist evaluation value 130. The playlist evaluation value 130 is an evaluation value of the "concentration level" for all songs (all music) registered in the concentrated playlist, and is, for example, the average value of the concentration level values ​​(average values) of all songs. In the example shown in FIG. 23, the playlist evaluation value 130 is "85." The playlist evaluation value 130 is calculated by the list creation unit 72.

[0150] Furthermore, the playback control unit 76 may change the order of each piece of music (songs) included in the music playlist and play the music so that the user's brainwave state transitions to or is maintained in the desired brainwave state. For example, the playback control unit 76 plays the music in the music playlist that matches the desired brainwave state in order of the number representing the desired brainwave state. In the above example, the playback control unit 76 plays the music in the order of the number of songs with the highest "concentration" evaluation value among all the songs registered in the concentration playlist.

[0151] Another playlist screen is shown in Fig. 24. The playlist screen 132 is a screen displayed on the UI section 66. As an example, this playlist screen 132 displays information about music registered in a music playlist (concentration playlist) that matches the brainwave state "concentration."

[0152] On the playlist screen 132, for example, an evaluation value 134 associated with the currently selected song in the concentration playlist, an evaluation value 136 associated with the next song, and an evaluation value 138 associated with the previous song are displayed. The evaluation values ​​134, 136, and 138 represent the concentration level. For example, the concentration level associated with the selected song is "91," and a message is displayed indicating that the user was able to concentrate well on this song. Also displayed are an image related to the song and an image having a shape corresponding to the level of the concentration level. Also displayed is the title of the selected song, "AAAAAAAAA."

[0153] Also, similar to the example shown in FIG. 23, waveforms 140, 142 and evaluation value information 144 are displayed. These are information indicating the brain wave state associated with the selected song. Waveform 140 is a waveform that represents the change over time in "concentration level," and waveform 142 is a waveform that represents the change over time in "relaxation level." Also, evaluation value information 144 is information indicating the evaluation value at a specified point in time in the selected song, and indicates the "concentration level" and "relaxation level" at that point in time. Also, similar to the example shown in FIG. 23, a playlist evaluation value 146 is displayed.

[0154] Also, the comparison result information 148 is displayed. The comparison result information 148 corresponds to an example of information showing the effect of music playback on the brainwave state, and is information showing the comparison result between the playlist evaluation value at the current time point and the playlist evaluation value at the past time point. As described above, one or more brainwave states obtained in the past are associated with each piece of music (song) as a history, and the above comparison is performed by using the history. This comparison is performed, for example, by the list creation unit 72. For example, the playlist evaluation value at the current time point (for example, today's playlist evaluation value, this week's playlist evaluation value, this month's playlist evaluation value, this year's playlist evaluation value, etc.) is compared with the playlist evaluation value at the past time point (for example, yesterday's playlist evaluation value, last week's playlist evaluation value, last month's playlist evaluation value, last year's playlist evaluation value, etc.) on a daily, weekly, monthly, yearly, or user-specified time basis, and information showing the comparison result is displayed. In the example shown in FIG. 24, the playlist evaluation value is increased by 5 points from last week. In this way, by displaying the comparison results, the user can know the difference between the past electroencephalogram state and the current electroencephalogram state, and can use the present system in an enjoyable manner.

[0155] Furthermore, the brainwave state evaluation section 70 may calculate the difference between the value representing the brainwave state at the time of previous playback for each piece of music and the value representing the brainwave state at the time of current playback for each piece of music, and the list creation section 72 may change the playback order of each piece of music in the music playlist according to the difference. The difference corresponds to an example of the effect of music playback on the brainwave state. For example, the list creation section 72 sets the playback order in the music playlist to a higher value for music with a larger increase in value. For example, for multiple pieces of music included in a music playlist (e.g., a music playlist for concentration) that are suitable for the same brainwave state, the playback order of the music with a larger increase in value is set to a higher value. The display control section 74 may cause the UI section 66 to display information indicating the difference obtained for each piece of music. The brainwave state evaluation section 70 may calculate the above difference for each piece of music with respect to the brainwave state desired by the user, and the list creation section 72 may change the playback order of each piece of music in the music playlist that is suitable for the desired brainwave state according to the difference.

[0156] The electroencephalogram state evaluation section 70 may also calculate, for each piece of music, the time required from the start of listening to the music until the music transitions to a desired electroencephalogram state (transition time) as an example of the effect of music playback on the electroencephalogram state. The display control section 74 may cause the UI section 66 to display information indicating the transition time for each piece of music. The list creation section 72 may also set the playback order in the music playlist to be higher for music with a shorter transition time. For example, for multiple pieces of music included in a music playlist (e.g., a music playlist for concentration) that are suitable for the same electroencephalogram state, the playback order of the music with a shorter transition time is set to be higher. As a result, music with a greater effect on the electroencephalogram state is played first, so the time required to transition the user's electroencephalogram state to the desired electroencephalogram state is shorter than when music with a smaller effect is played first. The electroencephalogram state evaluation section 70 may calculate the transition time for each piece of music with respect to the electroencephalogram state desired by the user, and the list creation section 72 may change the playback order of each piece of music in the music playlist that is suitable for the desired electroencephalogram state according to the transition time.

[0157] The electroencephalogram state evaluation section 70 may also calculate the length of time (duration) for each piece of music that the desired electroencephalogram state is maintained as an example of the effect of music playback on the electroencephalogram state. The display control section 74 may cause the UI section 66 to display information indicating the duration of each piece of music. The list creation section 72 may also set the playback order in the music playlist to be higher for music with a longer duration. For example, for multiple pieces of music included in a music playlist (e.g., a music playlist for concentration) that are suitable for the same electroencephalogram state, the playback order of the music with a longer duration is set to be higher. As a result, music with a greater effect on the electroencephalogram state is played first, making it easier to maintain the desired electroencephalogram state for a longer period of time compared to playing music with a smaller effect first. The electroencephalogram state evaluation section 70 may calculate the duration of each piece of music with respect to the electroencephalogram state desired by the user, and the list creation section 72 may change the playback order of each piece of music in the music playlist that is suitable for the desired electroencephalogram state according to its duration.

[0158] As described above, the effect of music playback on the brainwave state (for example, the comparison result of the playlist evaluation value, the difference in the numerical value for each piece of music, the transition time, and the duration) can be obtained. Since the music playback effect is obtained for each user, the music playback effect may be shared among a plurality of users, or a competition may be held according to the music playback effect. For example, the information processing system includes a management server, and information indicating the music playback effect of each user is transmitted from the terminal device 12 of each user to the management server. The management server associates a ranking according to the music playback effect of each user with each user, and transmits information indicating the ranking of each user to the terminal device 12 of each user. The ranking of each user is displayed on the UI unit 66 of the terminal device 12 of each user. This creates a competitive spirit among the plurality of users, and each user can enjoy using the system of the present embodiment. In addition, the information indicating the music playback effect of each user may be transmitted to the terminal device 12 of the other user via the management server or without the management server, and displayed on the UI unit 66 of the terminal device 12. This allows the user to know the effects of other users, and therefore, to enjoy using the system of the present embodiment.

[0159] Furthermore, information indicating the brainwave state of each user may be transmitted from each user's terminal device 12 to a management server included in the information processing system, and the management server may manage and control the brainwave state of each user. For example, the management server may transmit music to each user's terminal device 12 for transitioning or maintaining the brainwave state of each user to a specific brainwave state. For example, in order to allow employees to relax in the workplace, the management server may transmit music to each user's terminal device 12 for transitioning or maintaining the brainwave state of each employee to "relaxed". At this time, the management server may transmit different music to each user's terminal device 12.

[0160] According to this embodiment, music is played to transition or maintain the user's brainwave state to a desired brainwave state, so that music that allows the user to achieve the state desired by the user can be played. The music that allows the user to achieve the state desired by the user may differ from user to user. According to this embodiment, the brainwave state is evaluated and the playback of music is controlled using the evaluation result, so that music that allows the user to achieve the state desired by the user can be played for each user. For example, music that matches the user's preferences can be played.

[0161] (Linkage with music distribution service) Linkage with music distribution service will be described in detail below. The playback control unit 76 receives music data for preview from the music distribution server 14 and plays the music for preview. At this time, the earphone device 10 measures the brainwave, the brainwave state evaluation unit 70 evaluates the brainwave state, and the evaluation result (e.g., numerical value or waveform) is displayed. The control unit 68 judges whether or not the music for preview should be added to the user's music playback list based on the brainwave state during playback of the music for preview. The display control unit 74 causes the UI unit 66 to display information indicating the judgment result. For example, if the numerical value indicating the brainwave state is equal to or greater than a threshold, it is judged to be music to be added, and a message to that effect is displayed. For example, if the "concentration level" is equal to or greater than a threshold during playback of a certain music for preview, the music is displayed as music suitable for concentration. In other words, the music is recommended as music for concentration. This provides the user with information that is useful for the user in deciding whether or not to purchase music data. For example, music that matches the user's preferences is presented to the user.

[0162] Also, music for previewing may be prepared for each brainwave state, and the music distribution server 14 may transmit music data for previewing associated with the brainwave state designated by the user to the terminal device 12, and the terminal device 12 may play the preview music. For example, music for concentration, music for relaxation, etc. may be prepared as the preview music, and when the user desires "concentration" as the brainwave state, the music for concentration is played as the preview music. During the playback, when the "degree of concentration" reaches or exceeds a threshold, the music being previewed is recommended as music that will increase the degree of concentration of the user. The display control unit 74 causes the UI unit 66 to display information indicating the recommendation. This makes it easier for the user to know which music will enable the user to obtain the desired brainwave state.

[0163] In a music distribution service, the price of each piece of music may be changed depending on the effect of music playback on the brainwave state (e.g., the result of comparing playlist evaluation values, the difference in values ​​for each piece of music, transition time, duration). For example, the price may be higher for music with a greater effect. For example, information indicating the effect of music playback for each user is transmitted from each user's terminal device 12 to music distribution server 14, and music distribution server 14 applies statistical processing (e.g., simple average, weighted average, etc.) to the effect of music playback for each user, and determines the price of each piece of music depending on the value obtained by the application.

[0164] The system according to the present embodiment may cooperate with one music distribution service or may cooperate with multiple music distribution services. When cooperating with multiple music distribution services, the music distribution service may be switched to allow each music distribution service to be used. Also, when multiple music distribution services are integrated to provide one music distribution service, the integrated single music distribution service may be made available.

[0165] Also, music may be available for preview when the user wears the earphone device 10 and the brainwaves are measured. For example, preview becomes available when information indicating the brainwave measurement results obtained by the measurement is transmitted from the terminal device 12 to the music distribution server 14, and music data for preview is transmitted from the music distribution server 14 to the terminal device 12, and the music for preview is played. This promotes the use of the earphone device 10 compared to a case where preview is available even when the earphone device 10 is not being used.

[0166] The playback control unit 76 may change the volume of the music being played, arrange the music, or change the playback speed of the music, depending on the user's brainwave state. Even if it is the same song, the impression the user gets will differ depending on the volume, arrangement, and speed, which may change the brainwave state. The playback control unit 76 changes the volume of the music being played, arranges the music, or changes the playback speed so that the user's brainwave state during music playback will be closer to the desired brainwave state, that is, so that the numerical value representing the desired brainwave state will be higher.

[0167] (Modification 1) Hereinafter, modification 1 of the music play list will be described with reference to Fig. 25 and Fig. 26. Fig. 25 shows an example of a condition input screen, and Fig. 26 shows an example of a music play screen.

[0168] First, the condition input screen will be described with reference to FIG. 25. The condition input screen 150 is a screen displayed on the UI unit 66. For example, when the user gives an instruction to display the condition input screen 150, the display control unit 74 causes the UI unit 66 to display the condition input screen 150. The condition input screen 150 displays input fields 152 and 154. The input field 152 is a field for inputting information indicating a "desired brainwave state", and the input field 154 is a field for inputting information indicating a "location". As an example, the input field 152 displays a list of candidates for the "desired brainwave state" in a pull-down format, and the input field 154 displays a list of candidates for the "location" in a pull-down format. Of course, the user may directly input a character string indicating the desired brainwave state or a character string indicating a location. In the example shown in FIG. 25, "concentration" is specified as the "desired brainwave state", and "jazz cafe" is specified as the "location". In other words, the user's desire is to "concentrate at a jazz cafe".

[0169] The display control unit 74 causes the UI unit 66 to display a music playlist including music associated with the designated desired brainwave state and location. In the example shown in Fig. 25, music identification information (e.g., song titles, etc.) registered in the music playlist is displayed in the song display field 156. The music associated with the brainwave state and location will be described in detail below.

[0170] In the modified example, music (song), the brainwave state during the playback of the music, and the location where the music was played are associated with each other. As described above, each piece of music is associated with a brainwave state. The location where the music was played is identified, for example, by a GPS (Global Positioning System) function. For example, when a playback device (for example, the terminal device 12) has a GPS function and music is played on the playback device, the GPS function acquires the location information of the playback device during the playback, and the earphone device 10 obtains the brainwave measurement result. In this way, the music, the location of the playback device that is playing the music, and the user's brainwave state during the playback are obtained, and the brainwave state evaluation unit 70 associates the music identification information of the music, information indicating the location (location information), and the brainwave state information with each other and stores them in the storage unit 62. As a result, when the brainwave state and the location are specified, the music associated with the specified brainwave state and location, that is, the music in which the specified brainwave state was obtained at the specified location, is specified.

[0171] The list creation unit 72 creates a music playlist for each electroencephalogram state and for each location according to the association between the music identification information, the position information, and the electroencephalogram state information. The display control unit 74 causes the UI unit 66 to display a music playlist including music associated with the specified electroencephalogram state and location. In the example shown in FIG. 25, "concentration" is specified as the "desired electroencephalogram state" and "jazz cafe" is specified as the "location", so the display control unit 74 causes the UI unit 66 to display a music playlist including music associated with the electroencephalogram state "concentration" and the location "jazz cafe". This music playlist can be said to be a list suitable for concentrating at a jazz cafe.

[0172] Alternatively, an initial music playlist may be created in advance in which music, a location, and an electroencephalogram state estimated to be obtained by playing the music at the location are associated with each other, and the initial music playlist may be used. In this case, the display control unit 74 causes the UI unit 66 to display the initial music playlist associated with the designated electroencephalogram state and location.

[0173] A play button image 158 is displayed on the condition input screen 150, and when the play button image 158 is pressed by the user, the screen transitions to a music play screen 160 shown in FIG. 26. The music play screen 160 is a screen for playing music included in a music playlist selected as described above (for example, a music playlist suitable for concentrating in a jazz cafe). For example, information 162 indicating an electroencephalogram state associated with a song to be played is displayed on the music play screen 160. The information 162 is, for example, an image having a shape corresponding to a numerical value. A play button image 164 is displayed on the music play screen 160, and when the play button image 164 is pressed by the user, the song to be played is played.

[0174] In addition, on the music playback screen 160, button images 166, 168 representing brainwave states are displayed, and when the user presses a button image, the display control unit 74 causes the UI unit 66 to display a music playlist for the brainwave state associated with the button image. The button image 166 is an image associated with the brainwave state "concentration", and the button image 168 is an image associated with the brainwave state "relax". In the example shown in Figs. 25 and 26, "concentration" is specified as the brainwave state. In this state, when the user presses the button image 168, the display control unit 74 causes the UI unit 66 to display a music playlist including music associated with the brainwave state "relax" and the location "jazz cafe". In this manner, the desired brainwave state may be switched.

[0175] According to the first modification, music that can cause the user's electroencephalogram state to transition to or maintain the user's desired electroencephalogram state is played at a location designated by the user.

[0176] The playback control unit 76 may use the location information to play music that is suitable for the user's current location. For example, the terminal device 12 acquires the current location information of the terminal device 12, and the playback control unit 76 plays music associated with the user's desired brainwave state and the location. For example, music suitable for desk work, music suitable for outdoor work, etc. are played.

[0177] In the example shown in Fig. 25, both the desired electroencephalogram state and the location are specified by the user, but only one of them may be specified by the user. In this case, the display control unit 74 causes the UI unit 66 to display a music playlist that matches one of them. For example, when the desired electroencephalogram state is specified by the user, the display control unit 74 causes the UI unit 66 to display a music playlist in which music associated with the desired electroencephalogram state is registered, and when the location is specified by the user, the display control unit 74 causes the UI unit 66 to display a music playlist in which music associated with the location is registered.

[0178] (Modification 2) Modification 2 will now be described with reference to Fig. 27. Fig. 27 shows an example of a list selection screen.

[0179] In the second modification, music playlists of other users may be displayed. FIG. 27 shows an example of such a display. When the user gives an instruction to display a music playlist, the display control unit 74 causes the UI unit 66 to display a list selection screen 170 on which the music playlists are displayed. In the example shown in FIG. 27, a music playlist called "My Best", a music playlist called "Recommendation", and a music playlist called "··· Selection" are displayed on the list selection screen 170. These music playlists are lists made up of music (songs) associated with the user's desired brainwave state. The "My Best" list is a list containing music selected by the user himself. The "Recommendation" list is a list recommended by other users. The "··· Selection" list is a list containing music selected by users of a particular occupation, industry, gender, age, etc. Also, a list of celebrities may be created and the list may be displayed.

[0180] For example, the music playlist is uploaded manually or automatically from the terminal device 12 to the music distribution server 14. As a result, each user's music playlist (for example, a music playlist for each brainwave state, a music playlist including music selected by each user, etc.) is sent to the music distribution server 14 and managed by the music distribution server 14.

[0181] For example, when a user specifies a desired brainwave state, information indicating the desired brainwave state is transmitted from terminal device 12 to music distribution server 14, and music distribution server 14 transmits data indicating a music playlist that matches the desired brainwave state to terminal device 12. The music playlist is, as described above, a music playlist recommended by other users, or the like.

[0182] When the user selects a music playlist on the list selection screen 170 and presses the play button image, the songs included in that music playlist are played.

[0183] According to the second modification, music can be played back according to other users' music playlists, which provides a wider range of music playlist options than when only one's own music playlist is used.

[0184] In addition, the list selection screen 170 displays button images 172, 174 representing electroencephalogram states, and when the user presses a button image, the display control unit 74 causes the UI unit 66 to display a music playlist for the electroencephalogram state associated with the button image. The button image 172 is an image associated with the electroencephalogram state "concentration," and the button image 174 is an image associated with the electroencephalogram state "relax." In the example shown in FIG. 27, "concentration" is specified as the electroencephalogram state. In this state, when the user presses the button image 174, the display control unit 74 causes the UI unit 66 to display a music playlist including music associated with the electroencephalogram state "relax." In this manner, the desired electroencephalogram state may be switched.

[0185] Also, similarly to the first modification, when a desired electroencephalogram state and location are designated by the user, a music playlist that matches the desired electroencephalogram state and location may be displayed.

[0186] (Other embodiments) Hereinafter, other embodiments will be described. When a user instructs a connection to the earphone device 10 using the terminal device 12, the terminal device 12 communicates with the earphone device 10 by, for example, short-distance wireless communication (e.g., Bluetooth), and thus the earphone device 10 and the terminal device 12 are connected by short-distance wireless communication. When a user wears the earphone device 10, the earphone device 10 measures brain waves. FIG. 28 shows an example of an brain wave display screen displayed on the UI unit 66 of the terminal device 12 at that time. The brain wave display screen 176 displays an image 178 associated with the earphone device 10, a message indicating that the earphone device 10 is connected to the terminal device 12, a measurement result of the brain wave (e.g., concentration level: 18%, relaxation level: 72%), and the like. In this state, when music is played as described above, the brain wave during the playback is measured. At this time, for example, a screen shown in FIG. 21 or FIG. 22 is displayed on the UI unit 66 of the terminal device 12. For example, when one or more pieces of music for listening are played, brain waves are measured for each piece of music, and the measurement results are recorded.

[0187] Also, information indicating the measurement state of the brainwave may be displayed. An example of the display is shown in FIG. 29. The brainwave display screen 180 is displayed on the UI unit 66 of the terminal device 12, similar to the above-mentioned brainwave display screen 176. On the brainwave display screen 180, a mark 182 as an image indicating the measurement state of the brainwave is displayed together with an image 178 associated with the earphone device 10. The display control unit 74 changes the display form (e.g., color, shape, size, etc.) of the mark 182 according to the measurement state of the brainwave. In the example shown in FIG. 29, the color of the mark 182 changes according to the measurement state of the brainwave. For example, when the brainwave is normally measured, the mark 182 is displayed in green. When the brainwave is not normally measured, the mark 182 is displayed in red. When the earphone device 10 is not connected to the terminal device 12 (for example, when connecting by Bluetooth, when the earphone device 10 and the terminal device 12 are not paired), the mark 182 is displayed without lighting. For example, when the potential difference as the electroencephalogram measurement result corresponds to a noise level (e.g., less than a threshold), it is determined that the electroencephalogram is not being measured normally and mark 182 is displayed in red, and when the potential difference corresponds to the threshold or more, it is determined that the electroencephalogram is being measured normally and mark 182 is displayed in green. In this way, by displaying information indicating the measurement state of the electroencephalogram, the user can correct the wearing position of earphone device 10, and as a result, the electroencephalogram state can be measured more accurately.

[0188] FIG. 30 shows an example of the display of the electroencephalogram measurement result. The measurement result screen 184 is displayed on the UI unit 66 of the terminal device 12 after or during the electroencephalogram measurement. The measurement result screen 184 shows, as an example, the time during which the numerical value representing the electroencephalogram state continues to be equal to or greater than a predetermined threshold. The threshold is, as an example, 50%. Of course, this value is merely an example, and another value may be used, or the user may set an arbitrary value. In the example shown in FIG. 29, the time during which the concentration level of 50% or more continues is "15 seconds," and the time during which the relaxation level of 50% or more continues is "27 seconds." These values ​​may be the results of measurements taken while, for example, music or a video is being played, or may be the results of measurements taken without playing music or a video.

[0189] An example of an operation for adding music to a music playlist will be described below with reference to FIG. 31. FIG. 31 shows an example of a music display screen. The music display screen 186 is displayed on the UI unit 66 of the terminal device 12. The music display screen 186 may display information about music designated by the user, or information about music selected randomly. Also, an image for instructing playback or the like may be displayed. When music is displayed on the music display screen 186, the user performs a so-called flick operation to add the music to the music playlist or remove the music from the music playlist. For example, when the user quickly moves an indicator such as a finger or a stylus on the music display screen 186 in the direction of an arrow 188 (a direction associated with adding to a playlist), the music being displayed is added to the music playlist, and when the user quickly moves the indicator in the direction of an arrow 190 (a direction associated with removing from a playlist), the music being displayed is removed from the music playlist. For example, the user specifies an electroencephalogram state associated with a music playlist and performs the above-mentioned operations to add music to or remove music from the music playlist associated with that electroencephalogram state. In the example shown in FIG. 31, "concentration" is specified as the electroencephalogram state. When the user performs a flick operation in the direction of arrow 188, the displayed music is added to the "music playlist for concentration," and when the user performs a flick operation in the direction of arrow 190, the displayed music is removed from the "music playlist for concentration." Music is similarly added to or removed from music playlists associated with other electroencephalogram states (e.g., relaxation). With such simple operations, the music playlist can be edited.

[0190] Also, a music playlist may be linked to an electroencephalogram state by the above-mentioned flick operation. This operation will be described with reference to FIG. 32. FIG. 32 shows an example of a playlist screen. The playlist screen 192 is displayed on the UI unit 66 of the terminal device 12. For example, information about a music playlist designated by the user (for example, the name of the music playlist, etc.) or information about a music playlist provided by a music distribution service is displayed on the playlist screen 192. An image for instructing playback, etc. may also be displayed. When a music playlist is displayed on the playlist screen 192, the user performs a flick operation to link the music playlist to the electroencephalogram state. The linking is performed by the list creation unit 72. For example, when the user quickly moves the indicator on the playlist screen 192 in the direction of the arrow 194 (the direction linked to relaxation), the displayed music playlist is linked to "relax" as the electroencephalogram state. In this case, the music playlist is registered as a music playlist for relaxation. Furthermore, when the user quickly moves the pointer in the direction of arrow 196 (the direction associated with concentration), the brainwave state "concentration" is associated with the displayed music playlist. In this case, the music playlist is registered as a music playlist for concentration. With such a simple operation, the brainwave state can be associated with the music playlist. Of course, a similar operation can also be used to associate a brainwave state with music. For example, when information about music is displayed and a flick operation is performed in the direction of arrow 194, the music is associated with the brainwave state "relaxed."

[0191] In the above-described embodiment, a stimulus may be given to the ear from the earphone device 10. The stimulus may be the above-described music, a sound outside the human audible range (e.g., ultrasound), vibration, or heat. The stimulus may be changed according to the measurement result of the brain wave, similar to the above-described music. For example, a stimulus for relaxation (music, ultrasound, vibration, etc.) or a stimulus for concentration may be given to the ear from the earphone device 10. For example, when a user gives an instruction to relax, sound waves in a first frequency band that provides a relaxing effect are emitted from the earphone device 10, and when a user gives an instruction to concentrate, sound waves in a second frequency band that provides a concentration effect are emitted from the earphone device 10. Also, sound waves that provide a relaxing effect or sound waves that provide a concentration effect may be emitted from the earphone device 10 according to the measured brain wave.

[0192] In addition, in the above-described embodiment, the first EEG measuring device, the second EEG measuring device and the EEG measuring system are constituted by the earphone device 10, but they do not have to have the function of emitting sound, and may be constituted by a hearable device other than the earphone device 10.

[0193] A light source may be provided in the hearable device according to the present embodiment, and light may be emitted from the light source in response to the measured brainwave. Different colors of light (e.g., visible light) may be generated in response to the state of the measured brainwave. For example, when a brainwave indicating relaxation is measured, a first color of light (e.g., blue light) is emitted from the light source, when a brainwave indicating concentration is measured, a second color (e.g., green light) is emitted from the light source, and when a brainwave indicating tension is measured, a third color (e.g., red light) is emitted from the light source. By generating light of a color that represents the state of the brainwave, the state of the brainwave is provided to the user. Of course, the light source may not be provided in the hearable device itself. In this case, information indicating the brainwave measured by the hearable device is transmitted from the hearable device to the light source, and light of a color according to the state of the brainwave is emitted from the light source.

[0194] (Another embodiment related to electroencephalogram measurement) Hereinafter, another embodiment related to electroencephalogram measurement will be described. For convenience of explanation, the first left electroencephalogram sensor 26L as the first electroencephalogram measurement means will be referred to as "electrode A", the second left electroencephalogram sensor 28L as the second electroencephalogram measurement means will be referred to as "electrode B", the first right electroencephalogram sensor 26R as the third electroencephalogram measurement means will be referred to as "electrode C", and the second right electroencephalogram sensor 28R as the fourth electroencephalogram measurement means will be referred to as "electrode D". FIG. 33 is a diagram reflecting the correspondence. Hereinafter, the earphone device 10 will be described as an example, but this embodiment may be applied to a hearable device other than the earphone device 10.

[0195] In the electroencephalogram measurement, an electroencephalogram is measured using at least two electrodes from the electrode group including the electrodes A, B, C, and D. For example, the control unit 68 of the terminal device 12 selects at least two electrodes from the electrode group based on the potentials detected by the electrodes A, B, C, and D, and measures an electroencephalogram based on the potentials detected by the selected at least two electrodes. Of course, the control unit 58L or the control unit 58R of the earphone device 10 may select at least two electrodes from the electrode group based on the potentials detected by the electrodes A, B, C, and D, and measure an electroencephalogram based on the potentials detected by the selected at least two electrodes. In the following, it is assumed that the control unit 68 of the terminal device 12 selects the electrodes.

[0196] For example, a first measurement mode in which brain waves are measured using two electrodes, or a second measurement mode in which brain waves are measured using three electrodes is selected to measure brain waves. The measurement mode may be selected by the user, or may be selected according to the measurement conditions of the brain waves (for example, the amount of noise as described later), or may be selected according to the remaining capacity of the battery. This selection will be described in detail later.

[0197] In the first measurement mode, one electrode selected from the electrode group is used as a sensor electrode for detecting brain waves, and another electrode selected from the electrode group is used as a ground electrode for reference. In this case, brain waves are calculated based on the potential difference between the potential detected by the sensor electrode and the potential detected by the ground electrode. The process of calculating brain waves based on the potential difference is performed by the control unit 68 of the terminal device 12. Of course, the electrode selection process and the brain wave calculation process may be performed by the control unit 58L or the control unit 58R of the earphone device 10. For example, the control unit 68 compares the potentials detected by the electrodes A, B, C, and D with each other to select an electrode suitable for the sensor electrode and an electrode suitable for the ground electrode from the electrode group.

[0198] In the second measurement mode, one electrode selected from the electrode group is used as a sensor electrode, another electrode selected from the electrode group is used as a reference electrode, and yet another electrode selected from the electrode group is used as a ground electrode. In this case, an electroencephalogram is calculated based on the potentials detected by the sensor electrode, the reference electrode, and the ground electrode. For example, an electroencephalogram is calculated based on the potential difference between the potential detected by the sensor electrode and the potential detected by the reference electrode, with the ground electrode as a reference. For example, the control unit 68 compares the potentials detected by the electrodes A, B, C, and D with each other to select an electrode suitable for the sensor electrode, an electrode suitable for the reference electrode, and an electrode suitable for the ground electrode from the electrode group.

[0199] An electrode suitable for the sensor electrode is an electrode that detects an electric potential corresponding to an electroencephalogram, for example, an electrode that detects an electric potential equal to or higher than a predetermined sensor electric potential threshold, or an electrode that detects an electric potential having a waveform similar to that of an electric potential corresponding to an electroencephalogram, is selected as the sensor electrode. An electrode suitable for the ground electrode is an electrode that detects an electric potential lower than a predetermined ground electric potential threshold, or an electric potential with small fluctuations and small values, for example, is selected as the ground electrode. An electrode that detects an electric potential smaller than that detected by the sensor electrode and larger than that detected by the ground electrode is selected as the reference electrode.

[0200] FIG. 34 shows typical waveforms of potential. Waveform 198 is a waveform representing a potential corresponding to an electroencephalogram. An electrode that detects such a waveform is used as a sensor electrode. For example, a waveform in which the number of detections of peak potentials equal to or greater than the sensor potential threshold (for example, the number of detections per unit time) is equal to or greater than a predetermined number threshold corresponds to a waveform representing a potential corresponding to an electroencephalogram. Waveform 200 is a waveform representing a ground potential. An electrode that detects such a waveform is used as a ground electrode. For example, a waveform in which the detected potential is less than the ground potential threshold corresponds to a waveform representing a ground potential. Waveform 202 is a waveform representing a reference potential. An electrode that detects such a waveform is used as a reference electrode. For example, a waveform in which the detected potential is equal to or greater than the ground potential threshold and the number of detections of peak potentials equal to or greater than the sensor potential threshold is less than a number threshold corresponds to a waveform representing a reference potential.

[0201] In addition, when there are a plurality of electrodes that satisfy the conditions of the sensor electrode, one electrode selected from the plurality of electrodes is used as the sensor electrode. For example, the sensor electrode may be selected by the user from the plurality of electrodes, or an electrode that detects a potential with a waveform that is assumed to be noise among the plurality of electrodes may be selected as the sensor electrode, or one electrode may be automatically and randomly selected from the plurality of electrodes as the sensor electrode. Similarly, when there are a plurality of electrodes that satisfy the conditions of the ground electrode, one electrode selected from the plurality of electrodes is used as the ground electrode. The ground electrode may be selected by the user, or may be automatically and randomly selected, or an electrode that detects a potential with the least noise may be selected as the ground electrode. Similarly, when there are a plurality of electrodes that satisfy the conditions of the reference electrode, one electrode selected from the plurality of electrodes is used as the reference electrode. The ground electrode may be selected by the user, or may be automatically and randomly selected, or an electrode that detects a potential with the least noise may be selected as the ground electrode.

[0202] In the first measurement mode, a potential difference between the potential indicated by the waveform 198 (potential of the sensor electrode) and the potential indicated by the waveform 200 (potential of the ground electrode) is calculated, and an electroencephalogram is calculated based on the potential difference. In the second measurement mode, a potential difference between the potential indicated by the waveform 198 (potential of the sensor electrode) and the potential indicated by the waveform 202 (potential of the reference electrode) is calculated, and an electroencephalogram is calculated based on the potential difference. This calculation process may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or the control unit 58R of the earphone device 10.

[0203] Hereinafter, referring to FIG. 35, a process when noise occurs in the waveform 198 detected by the sensor electrode will be described. The waveforms 204 and 206 in the waveform 198 are waveforms that are assumed to be noise. For example, a waveform whose peak potential is less than the sensor potential threshold and is equal to or greater than a predetermined noise lower limit threshold is determined to be a waveform corresponding to noise. The waveform 204 is a waveform that satisfies the condition. Also, a waveform whose peak potential is equal to or greater than the noise upper limit threshold (a value greater than the sensor potential threshold) is determined to be a waveform corresponding to noise. The waveform 206 is a waveform that satisfies the condition. The detection of noise may be performed by the control unit 68 of the terminal device 12, or may be performed by the control unit 58L or the control unit 58R of the earphone device 10. The waveform 202 detected by the reference electrode also includes a waveform 208 corresponding to the waveform 204 and a waveform 210 corresponding to the waveform 206. The waveforms 208 and 210 are also waveforms that satisfy the noise condition and are detected as noise.

[0204] In the second measurement mode, the potential difference between the potential indicated by the waveform 198 (the potential of the sensor electrode) and the potential indicated by the waveform 202 (the potential of the reference electrode) is calculated, and an electroencephalogram is calculated based on the potential difference. As a result, noise is offset between the waveform 198 and the waveform 202, so that an electroencephalogram is calculated based on the potential difference from which the noise has been removed or reduced. On the other hand, according to the first measurement mode, an electroencephalogram is calculated based on the potential difference between the potential indicated by the waveform 198 and the potential indicated by the waveform 200, so that an electroencephalogram influenced by noise is obtained. In this way, according to the second measurement mode, an electroencephalogram from which the noise has been removed or reduced is obtained.

[0205] The user may select either the first measurement mode or the second measurement mode, or, as described above, the second measurement mode may be selected when the potential detected by the sensor electrode contains noise. Also, when the amount of noise is equal to or greater than a threshold (for example, when the number of waveforms detected as noise per unit time is equal to or greater than a threshold), the second mode may be selected. The mode selection may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10.

[0206] A plurality of provisional sensor electrodes may be selected from the electrode group, and one sensor electrode may be selected from the plurality of provisional sensor electrodes. For example, when two electrodes detect a potential that satisfies the above-mentioned conditions for the sensor electrode, the two electrodes are selected as provisional sensor electrodes, and a sensor electrode is selected from the two electrodes. For example, when the waveform of the potential detected by one provisional sensor electrode includes a waveform that is presumed to be noise, and the waveform of the potential detected by the other provisional sensor electrode does not include a waveform that is presumed to be noise, the other provisional sensor electrode is selected as the sensor electrode. Also, when the waveforms of the potential detected by all the provisional sensor electrodes include a waveform that is presumed to be noise, the provisional sensor electrode that detected the waveform with the least amount of noise is selected as the sensor electrode. For example, the provisional sensor electrode with the least number of waveforms detected as noise per unit time is selected as the sensor electrode.

[0207] With reference to FIG. 36, the process of selecting a sensor electrode from a plurality of provisional sensor electrodes will be described in detail. The waveform 212 is a waveform indicating a potential detected by, for example, the electrode A, and the waveform 214 is a waveform indicating a potential detected by, for example, the electrode C. The waveforms 212 and 214 are waveforms indicating a potential equal to or higher than the sensor potential threshold, and the electrodes A and C are electrodes that satisfy the above-mentioned conditions of the sensor electrodes. In this case, the electrodes A and C are identified as provisional sensor electrodes. The waveform 214 also includes a waveform 216. This waveform 216 is not included in the waveform 212, and is a waveform that satisfies the above-mentioned noise conditions (potential is less than the sensor potential threshold and is equal to or higher than the noise lower limit threshold). In this case, the electrode A that detected the waveform 212 is selected as the sensor electrode, and the electrode C that detected the waveform 214 is not selected as the sensor electrode. Then, the potential difference between the potential detected by the electrode A and the potential detected by another electrode selected as the ground electrode is calculated, and the brain wave is calculated based on the potential difference.

[0208] FIG. 37 shows another example of noise. Waveform 218 is a waveform showing a potential detected by, for example, electrode C. Waveforms 214 and 218 are waveforms showing a potential equal to or higher than the sensor potential threshold, and electrodes A and C are electrodes that satisfy the above-mentioned conditions of sensor electrodes and are identified as tentative sensor electrodes. Waveform 218 also includes waveform 220. This waveform 220 is not included in waveform 212, and is a waveform that satisfies the above-mentioned conditions of noise (potential is equal to or higher than the noise upper threshold). In this case, electrode A that detected waveform 212 is selected as the sensor electrode, and electrode C that detected waveform 218 is not selected as the sensor electrode. Then, the potential difference between the potential detected by electrode A and the potential detected by another electrode selected as a ground electrode is calculated, and an electroencephalogram is calculated based on the potential difference.

[0209] By selecting a sensor electrode from the plurality of provisional sensor electrodes as described above, an electrode that detects a potential with less noise is used as the sensor electrode, and therefore the accuracy of the electroencephalogram measurement is improved compared to the case where an electrode that detects a potential with more noise is used as the sensor electrode.

[0210] For example, when an electroencephalogram measurement application is started, when the earphone device 10 as an electroencephalogram measurement device is started, or when the terminal device 12 is started, calibration may be performed to select a plurality of electrodes to be used for electroencephalogram measurement from among the group of electrodes. In this calibration, potentials are detected by each of the electrodes A, B, C, and D, and a sensor electrode, a ground electrode, and a reference electrode are selected from among the group of electrodes based on the detection results. In addition, the first measurement mode or the second measurement mode may be selected according to the amount of noise. When noise is not detected or when the amount of detected noise is less than a threshold (for example, when the number of waveforms detected as noise per unit time is less than a threshold), the first measurement mode may be selected, and when noise is detected or when the amount of detected noise is equal to or greater than a threshold (for example, when the number of waveforms detected as noise per unit time is equal to or greater than a threshold), the second measurement mode may be selected. Note that the selection of electrodes and the selection of the measurement mode may be performed while measuring an electroencephalogram. For example, the above calibration may be performed at every predetermined unit time, and the electrodes and the measurement mode to be used for electroencephalogram measurement may be changed according to the result of the calibration.

[0211] In addition, since the second measurement mode uses a reference electrode, the accuracy of the brainwave measurement is improved compared to the first measurement mode that does not use a reference electrode. Meanwhile, in the first measurement mode, the brainwave is measured by two electrodes without using a reference electrode, so power consumption is reduced compared to the second measurement mode that uses three electrodes.

[0212] The measurement mode may be selected based on the remaining capacity of the battery provided in the electroencephalogram measuring device. For example, when the remaining capacity of the battery provided in the earphone device 10 is less than a predetermined threshold, the first measurement mode is selected, and when the remaining capacity is equal to or greater than the threshold, the second measurement mode is selected. This selection may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or control unit 58R of the earphone device 10. When the remaining capacity is less than the threshold, the first measurement mode, which consumes less power than the second measurement mode, is selected, thereby suppressing a decrease in the remaining capacity.

[0213] The measurement mode selected without the user's selection may be presented (recommended) to the user. For example, information indicating the first measurement mode or the second measurement mode selected based on the measurement status of the electroencephalogram (e.g., the amount of noise) or the remaining capacity of the battery is displayed on the UI unit 66 of the terminal device 12.

[0214] In addition, a plurality of electrodes for measuring electroencephalograms (sensor electrode, ground electrode, reference electrode) may be selected from the electrode group according to the contact state between the living body and each of the electrodes A, B, C, and D. The contact state is detected, for example, by using at least one of a pressure sensor and a humidity sensor.

[0215] For example, a pressure sensor is installed in each of the electrodes A, B, C, and D, and the pressure of each electrode against the biological surface is detected as a contact state. It is estimated that the higher the pressure, the higher the degree of adhesion between the electrode and the biological surface. The electrode with the highest detected pressure is selected as the sensor electrode. When the first measurement mode is selected, the electrode with the second highest detected pressure is selected as the ground electrode. When the second measurement mode is selected, the electrode with the second highest detected pressure is selected as the reference electrode, and the electrode with the third highest detected pressure is selected as the ground electrode. The selection of electrodes based on pressure may be performed by the control unit 68 of the terminal device 12, or may be performed by the control unit 58L or the control unit 58R of the earphone device 10. By selecting electrodes based on pressure as described above, electrodes with a higher degree of adhesion with the biological surface are used as sensor electrodes, and thus the measurement accuracy of the brainwave is improved compared to the case where electrodes with a lower degree of adhesion are used as sensor electrodes.

[0216] Also, a humidity sensor may be installed in each of the electrodes A, B, C, and D, and the humidity at each position may be detected as the contact state. It is estimated that the higher the humidity, the higher the degree of contact between the electrode and the biological surface. The electrode with the highest detected humidity is selected as the sensor electrode. When the first measurement mode is selected, the electrode with the second highest detected humidity is selected as the ground electrode. When the second measurement mode is selected, the electrode with the second highest detected humidity is selected as the reference electrode, and the electrode with the third highest detected humidity is selected as the ground electrode. The selection of the electrode based on the humidity may be performed by the control unit 68 of the terminal device 12, or may be performed by the control unit 58L or the control unit 58R of the earphone device 10. By selecting the electrode based on the humidity as described above, an electrode with a higher degree of contact with the biological surface is used as the sensor electrode, and thus the measurement accuracy of the brain wave is improved compared to the case where an electrode with a lower degree of contact is used as the sensor electrode.

[0217] Note that the electrodes may be selected based on either the pressure or the humidity, or may be selected based on both the pressure and the humidity. For example, when both the pressure and the humidity are used, the electrode with the highest detected pressure and humidity is selected as the sensor electrode, the electrode with the lowest detected pressure and humidity is selected as the ground electrode, and the electrode between them is selected as the reference electrode. As another example, the electrode with the smallest sum of the detected pressure height ranking and humidity height ranking may be selected as the sensor electrode, the electrode with the largest sum may be selected as the ground electrode, and the electrode between them may be selected as the reference electrode. Note that the highest pressure and humidity rankings are ranked 1. A weighted addition process may be applied to the pressure ranking and the humidity ranking, and an electrode may be selected based on the application result.

[0218] Selection of the electrode based on the contact state may be performed as a calibration at the time of startup, or may be performed at predetermined unit time intervals.

[0219] The determination as to whether the potential has been accurately detected may be made based on a predetermined set value of the human body potential, a history of potential measurements, or the like.

[0220] The information displayed on the UI unit 66 during calibration will now be described.

[0221] During calibration, as shown in Fig. 38, the control unit 68 of the terminal device 12 causes the UI unit 66 to display a calibration screen 222. An image 224 associated with the earphone device 10 is displayed on the screen 222. The image 224 may be an image generated by photographing the earphone device 10, or may be an image (e.g., an icon) that diagrammatically represents the earphone device 10. Marks 226, 228, 230, and 232 having a shape such as a circular frame are displayed in the portion of the image 224 that represents the electrodes.

[0222] When the user specifies an electrode on the image 224, the control unit 68 causes the UI unit 66 to display information indicating the measurement status of the potential by the electrode specified by the user. The control unit 68 may, for example, cause the UI unit 66 to display information indicating an evaluation of the measurement result of the potential. The evaluation may be performed by the control unit 68 of the terminal device 12, or by the control unit 58L or the control unit 58R of the earphone device 10. For example, the measurement result is evaluated based on the amount of noise contained in the waveform, the detected pressure, the humidity, the shape of the waveform, the clarity of the waveform, and the like. The evaluation is, for example, a ranking of the measurement result, and as shown in FIG. 39, information indicating the ranking (1st to 4th) is displayed on the screen 222. For example, the ranking of an electrode determined to be suitable for a sensor electrode is 1st, the ranking of an electrode determined to be suitable for a reference electrode is 2nd, and the ranking of an electrode determined to be suitable for a ground electrode is 3rd or 4th.

[0223] The user may select an electrode to be used as a sensor electrode and an electrode to be used as a ground electrode by referring to the electrode ranking. When the second measurement mode is selected, the user further selects an electrode to be used as a reference electrode. The electroencephalogram is measured using the electrodes selected by the user.

[0224] Furthermore, the control unit 68 may present (recommend) a plurality of electrodes to be used for electroencephalogram measurement based on the above ranking. For example, the control unit 68 causes the UI unit 66 to display information indicating that the first ranked electrode is suitable as a sensor electrode, and information indicating that the third and fourth ranked electrodes are suitable as ground electrodes, etc. The user may select electrodes to be used for electroencephalogram measurement with reference to the information.

[0225] The control unit 68 may cause the UI unit 66 to display the waveform of the potential detected by the electrode. An example of such a display is shown in Fig. 40. A waveform 233 of the potential detected by the electrode is displayed on the screen 222, and information indicating the evaluation is also displayed. The control unit 68 may cause the UI unit 66 to display the waveform of the potential detected by the electrode selected by the user, or may cause the UI unit 66 to display the waveforms of the potential detected by each electrode in turn.

[0226] 41, when a waveform 234 corresponding to noise is included in the waveform 233, the control unit 68 may cause the UI unit 66 to display information indicating that noise is included. At this time, the control unit 68 may recommend using a different electrode or recommend execution of the second measurement mode.

[0227] The settings of the electrodes (brain wave sensor) will be described below.

[0228] When setting the electrodes, as shown in Fig. 42, the control unit 68 of the terminal device 12 causes the UI unit 66 to display an electrode setting screen 236. An image 224 associated with the earphone device 10 is displayed on the screen 236. Also, marks 226, 228, 230, and 232 are displayed in the same manner as in Fig. 38.

[0229] Electrodes are selected by the user on screen 236. When the first measurement mode is executed, the user selects two electrodes (a sensor electrode and a ground electrode) from among the electrodes A, B, C, and D. When the second measurement mode is executed, the user selects three electrodes (a sensor electrode, a reference electrode, and a ground electrode) from among the electrodes A, B, C, and D.

[0230] 43, the control unit 68 may display recommendation information on the UI unit 66. For example, if the electrode C is ranked first, the electrode A is ranked second, and the electrode D is ranked third, the control unit 68 displays information on the UI unit 66 recommending the use of electrodes C, A, and D as electrodes for measuring electroencephalograms. The user may select electrodes with reference to the recommendation information.

[0231] Also, when an electrode is selected by the user, the control unit 68 may display a confirmation screen 238 on the UI unit 66 as shown in Fig. 44. For example, when two electrodes are selected by the user, information indicating that the two electrodes are selected as electrodes for measuring electroencephalograms is displayed. Also, the control unit 68 may inquire of the user which electrode is to be used as a sensor electrode, or may inquire of the user which electrode is to be used as a ground electrode. In response to the inquiry, the user may specify a sensor electrode or a ground electrode on the confirmation screen 238.

[0232] When the user instructs to complete the setting on the confirmation screen 238, the display control unit 74 causes the UI unit 66 to display a setting completion screen 240, as shown in Fig. 45. Then, the electroencephalogram is measured using the multiple electrodes selected by the user.

[0233] The measurement status of the brainwave may be displayed. For example, when the electrode selected as the electrode for measuring the brainwave does not detect a potential, or when the selected electrode does not detect a potential equal to or higher than a predetermined threshold, the control unit 68 may cause the UI unit 66 to display a warning screen. FIG. 46 shows the warning screen 242. For example, when the electrodes C and D are selected as the electrodes for measuring the brainwave, when the electrodes C and D do not detect a potential, or when the electrodes C and D do not detect a potential equal to or higher than a threshold, the control unit 68 causes the UI unit 66 to display the warning screen 242. The warning screen 242 displays information indicating that the electrodes C and D do not detect a potential. The control unit 68 may also display information indicating that it is recommended to use electrodes other than the electrodes C and D (for example, the electrodes A and B).

[0234] Furthermore, when the user specifies an electrode on the warning screen 242, the control unit 68 may cause the UI unit 66 to display a waveform 244 of the potential detected by the electrode specified by the user, as shown in Fig. 47 for example. In the example shown in Fig. 47, the electrode C is specified by the user, and a waveform 244 of the potential detected by the electrode C is displayed. The control unit 68 may cause the UI unit 66 to display information such as information encouraging the use of a different electrode, information encouraging the user to check the power supply and connection status of the device, information encouraging the user to restart the earphone device 10, information encouraging the user to restart the electroencephalogram measurement application, information for guiding the user to a contact point in the event of an abnormality, and information encouraging the user to stop the electroencephalogram measurement.

[0235] In addition, since the electrodes A and C are inserted into the ear canal, and the electrodes B and D are provided on the ear hook and contact the back side of the auricle, the degree of adhesion of the electrodes A and C to the surface of the living body is usually higher than the degree of adhesion of the electrodes B and D to the surface of the living body. Therefore, usually, one of the electrodes A and C is used as a sensor electrode, and one of the electrodes B and D is used as a ground electrode. However, when the user moves, the position of the earphone device 10 relative to the ear may shift, and the degree of adhesion of the electrodes A and C to the surface of the living body may decrease, and the detection sensitivity of the electrodes A and C may decrease. Even in this case, the position shift may make it easier for the electrodes B and D to contact the surface of the living body behind the auricle, and the degree of adhesion of the electrodes B and D to the surface of the living body behind the auricle may increase, and the detection sensitivity of the electrodes B and D may improve. In this case, one of the electrodes B and D is used as a sensor electrode, and one of the electrodes A and C is used as a ground electrode. In this way, even if the position of the earphone device 10 is shifted, one of the four electrodes is used as a sensor electrode to measure the brain wave.

[0236] In the above example, two or three electrodes are selected from four electrodes (electrodes A, B, C, and D), but if three electrodes are provided in the earphone device 10, two or three electrodes may be selected from the three electrodes, and if five or more electrodes are provided in the earphone device 10, two or three electrodes may be selected from the five or more electrodes.

[0237] (Another embodiment related to data communication control) Hereinafter, a description will be given of another embodiment related to data communication control between the earphone device 10 and the terminal device 12. Note that the control unit 68 of the terminal device 12 and the control units 58L and 58R of the earphone device 10 function as an example of a communication control means.

[0238] (First communication control) The communication unit 60 of the terminal device 12 and the communication units 54L, 54R of the earphone device 10 may transmit information to the other party using different communication methods as the first communication control. For example, the communication unit 60 of the terminal device 12 may transmit music data to the earphone device 10 using a communication method with a faster communication speed than the communication method used by the communication units 54L, 54R of the earphone device 10. Specifically, the communication unit 60 of the terminal device 12 transmits music data to the earphone device 10 using a communication method such as Wi-Fi communication, and the communication units 54L, 54R of the earphone device 10 transmit the brain wave measurement results to the terminal device 12 using a communication method such as short-range wireless communication such as Bluetooth or infrared communication. By using different communication methods for transmitting music data and transmitting brain wave measurement results, the communication load due to each communication method is reduced compared to when the same communication method is used. Therefore, the occurrence of failures such as delays and failures in data transmission is suppressed. In addition, the amount of music data is generally greater than the amount of electroencephalogram measurement data. By using a communication method for transmitting music data that is faster than the communication method used for transmitting electroencephalogram measurement results, the occurrence of problems such as delays in transmitting music data can be suppressed.

[0239] In the earphone device 10, both of the communication units 54L, 54R may be used to communicate with the terminal device 12, or either one of the communication units may be used to communicate with the terminal device 12. Also, one of the communication units 54L, 54R may be used to transmit the electroencephalogram measurement results, and the other communication unit may be used to receive music data.

[0240] The communication unit 60 of the terminal device 12 and the communication units 54L, 54R of the earphone device 10 may transmit information using the same or different communication methods depending on the communication situation. For example, when the communication units 60, 54L, 54R transmit and receive music data and electroencephalogram measurement results using the same communication method, if the communication situation by the communication method reaches a specific condition, the communication units 60, 54L, 54R transmit and receive information using different communication methods as the first communication control. If the communication situation does not meet the specific condition, the communication units 60, 54L, 54R transmit and receive information using the same communication method. The case where the communication situation satisfies a specific condition is, for example, the case where the ratio of the communication amount to the maximum communication capacity of the communication line in use is equal to or exceeds the communication allowable amount (the allowable amount may be determined for each communication method), the case where the communication amount per unit time is equal to or exceeds a predetermined communication amount threshold (the communication amount threshold may be determined for each communication method), the case where the communication speed is less than a predetermined communication speed threshold (the communication speed threshold may be determined for each communication method), etc. By using different communication methods when the communication situation satisfies a specific condition, the communication load due to each communication method is reduced, and the occurrence of failures such as delays and failures in data transmission is suppressed.

[0241] (Second communication control) When a user gives an instruction to start playing music, the communication unit 60 of the terminal device 12 may transmit the music data of the first song to be played to the earphone device 10 as the second communication control, and the playback control unit 76 of the terminal device 12 may start playing the music data when the transmission of the music data to the earphone device 10 is completed. For example, the earphone device 10 is provided with a storage unit, and the music data of the first song is stored in the storage unit, and the playback control unit 76 plays the music data stored in the storage unit. After the start of the playback, the communication unit 60 of the terminal device 12 transmits the music data of the second song and subsequent songs to the terminal device 12. The music data of the second song and subsequent songs is stored in the storage unit of the earphone device 10. During the playback of the music data of the first song, the music data of the second song and subsequent songs is gradually stored in the storage unit of the earphone device 10. In this way, even if the communication conditions deteriorate and the transmission speed of the second and subsequent music data becomes slow or intermittent, there is a margin of one song for the playback of the music data, so the possibility that the transmission of the music data will not be able to keep up with the playback is reduced. Therefore, the playback of the music data is less likely to be interrupted. Music data that has finished being played is deleted from the storage unit of the earphone device 10. The communication units 54L and 54R of the earphone device 10 transmit the electroencephalogram measurement results to the terminal device 12 in real time (i.e., every time an electric potential is detected). When the communication conditions meet the above specific conditions, the second communication control may be performed.

[0242] (Third communication control) The communication units 54L and 54R of the earphone device 10 may transmit the electroencephalogram measurement results to the terminal device 12 intermittently as the third communication control. For example, the communication units 54L and 54R transmit the electroencephalogram measurement results to the terminal device 12 at predetermined time intervals. Specifically, a time period during which the electroencephalogram measurement results are transmitted and a time period during which the electroencephalogram measurement results are not transmitted are determined, and the communication units 54L and 54R transmit the electroencephalogram measurement results according to the time period. Note that the music data and the electroencephalogram measurement results may be transmitted using the same communication method, or may be transmitted using different communication methods. When the music data and the electroencephalogram measurement results are transmitted using the same communication method, the electroencephalogram measurement results are transmitted intermittently, thereby reducing the communication load during the time period during which the electroencephalogram measurement results are not transmitted. When the communication situation meets the above-mentioned specific condition, the third communication control may be performed.

[0243] The communication unit 60 of the terminal device 12 may transmit music data intermittently to the earphone device 10 as the third communication control. In this case, the music data is stored in a storage unit of the earphone device 10, and the playback control unit 76 of the terminal device 12 plays the music data stored in the storage unit. This reduces the communication load during the time period when the music data is not being transmitted. The amount of each data item to be transmitted intermittently is determined so that the playback of the music data is not interrupted.

[0244] Both the electroencephalogram measurement results and the music data may be transmitted intermittently, or either one of the data may be transmitted intermittently.

[0245] Also, the communication unit 60 of the terminal device 12 and the communication units 54L, 54R of the earphone device 10 may transmit data by shifting the transmission timing of the music data and the brain wave measurement result. For example, while the communication unit 60 of the terminal device 12 transmits the music data to the earphone device 10, the communication units 54L, 54R of the earphone device 10 do not transmit the brain wave measurement result to the terminal device 12, and while the communication unit 60 of the terminal device 12 does not transmit the music data to the earphone device 10, the communication units 54L, 54R of the earphone device 10 transmit the brain wave measurement result to the terminal device 12. For example, a time period during which music data is transmitted and a time period during which music data is not transmitted are determined, and a time period during which brain wave measurement results are transmitted within the time period during which music data is not transmitted is determined. When the music data and the brain wave measurement results are transmitted using the same communication method, both the music data and the brain wave measurement results may be transmitted intermittently. Also, when the communication situation corresponds to a specific condition, both the music data and the brain wave measurement results may be transmitted intermittently.

[0246] (Fourth Communication Control) When the communication situation meets the above-mentioned specific condition, the communication unit 60 of the terminal device 12 may change the sound quality of the music data and transmit it to the earphone device 10 as the fourth communication control. For example, when the communication situation meets the above-mentioned specific condition, the communication unit 60 of the terminal device 12 reduces the communication volume of the music data by lowering the bit rate or cutting a specific frequency band of the music data, compared to when the communication situation does not meet the above-mentioned specific condition. In this way, the communication load is reduced compared to when the communication volume of the music data is not reduced.

[0247] (Fifth communication control) The control unit 68 of the terminal device 12 may compress music data as the fifth communication control, and the communication unit 60 of the terminal device 12 may transmit the compressed music data to the earphone device 10. The control unit of the earphone device 10 restores (decompresses, expands, and decompresses) the music data before compression, and the restored music data is played. This reduces the communication volume of music data, thereby reducing the communication load. The fifth communication control may be performed when the communication situation satisfies the above specific condition.

[0248] Furthermore, the control unit of the earphone device 10 may compress information indicating the electroencephalogram measurement result, and the communication units 54L, 54R of the earphone device 10 may transmit the information indicating the compressed electroencephalogram measurement result to the terminal device 12. The control unit 68 of the terminal device 12 restores the electroencephalogram measurement result before compression. When the communication situation satisfies the above-mentioned specific condition, the electroencephalogram measurement result may be compressed.

[0249] Both the music data and the electroencephalogram measurement results may be compressed, or only one of the data may be compressed.

[0250] A plurality of communication controls selected from the above-mentioned first to fifth communication controls may be combined and executed. Also, a plurality of communication controls may be combined and executed, or the plurality of communication controls to be combined may be changed, depending on the communication situation.

[0251] Information for inquiring the user about the execution of the above-mentioned first to fifth communication controls may be provided to the user. For example, the information for the inquiry may be displayed on the UI unit 66 of the terminal device 12, or a sound such as a warning sound may be generated.

[0252] 48 shows a screen 246 for inquiry. The screen 246 is displayed on the UI unit 66 of the terminal device 12. For example, when the communication situation meets the above-mentioned specific condition, the display control unit 74 of the terminal device 12 causes the UI unit 66 to display the screen 246. For example, a message indicating that a communication failure may occur and a message inquiring the user as to whether or not to switch to the data saving mode as the above-mentioned first to fifth communication controls are displayed.

[0253] When the user instructs execution of the data saving mode (for example, when the user presses the YES button), information indicating the above-mentioned first to fifth communication controls is displayed on the UI unit 66, and when the user selects a communication control from the first to fifth communication controls, the display control unit 74 causes the UI unit 66 to display a confirmation screen 248 as shown in Fig. 49. For example, when the data saving mode (3) (third communication control) is selected by the user, information is transmitted and received according to the third communication control. Of course, information may be transmitted and received according to a predetermined communication control without the user selecting a communication control, or information may be transmitted and received according to a communication control depending on the communication situation.

[0254] If the user refuses to execute the data saving mode (for example, if the user presses the NO button), the display control unit 74 causes the UI unit 66 to display a confirmation screen 250 as shown in Fig. 50. On the confirmation screen 250, for example, a message is displayed indicating that communication will be performed according to the current settings.

[0255] The terminal device 12 may transmit and receive information to and from a plurality of earphone devices 10. For example, as shown in FIG. 51, the terminal device 12 may transmit and receive information to and from the earphone devices 10A and 10B. The earphone devices 10A and 10B have the same configuration as the above-mentioned earphone device 10. In this case, a different communication method may be used for each earphone device. In this way, the load in each communication method is reduced. Also, any of the above-mentioned first to fifth communication controls may be executed for each earphone device according to the communication status between the terminal device 12 and each earphone device. The terminal device 12 may transmit different music data to each earphone device based on the electroencephalogram measurement result sent from each earphone device.

[0256] In the above embodiment and other embodiments, music data as an example of content is provided to the user. As content other than music data, video data, still image data, map information, information on location guidance, information on food, information on shopping, information on stores, etc. may be provided to the user according to the electroencephalogram measurement results. For example, when the user specifies "relax" as the electroencephalogram state, video data with a relaxing effect, still image data, map information showing a location with a relaxing effect, information for guiding the user to a location with a relaxing effect, information on food with a relaxing effect, information on shopping with a relaxing effect, information on stores with a relaxing effect, etc. are displayed on the UI unit 66 of the terminal device 12.

[0257] As another example, devices and the like may be controlled based on the electroencephalogram measurement results. As an example, when a user is driving a car, the user's electroencephalogram may be measured while driving, and the driving mode of the car may be controlled based on the electroencephalogram measurement results. This control may be performed by the terminal device 12 or by a control device mounted on the car. For example, if the electroencephalogram measurement results indicate drowsiness, the driving mode of the car may be switched to an automatic driving mode, a warning may be issued, or the car may be parked. The automatic driving mode includes a mode in which the driving of the car is automatically controlled without the user performing any driving operation, a mode in which the driving operation of the user is assisted (for example, an automatic braking function, an automatic steering function, etc.), and the like.

[0258] As yet another example, when a user is on the phone, information indicating the electroencephalogram measurement result of the user may be transmitted from the terminal device 12 to the terminal device of the other party on the phone. Advice or the like based on the electroencephalogram measurement result may be given to the user from the other party on the phone. Furthermore, information indicating the electroencephalogram measurement result may be transmitted from the terminal device 12 to a terminal device installed in a preregistered facility such as a hospital or a terminal device of a medical professional, and used for diagnosis, treatment, or the like.

[0259] The terminal device 12 is realized by cooperation of hardware and software, for example. Specifically, the terminal device 12 includes one or more processors such as a CPU (not shown). The one or more processors read and execute a program stored in a storage device (not shown), thereby realizing the functions of each part of the terminal device 12. The program is stored in the storage device via a recording medium such as a CD or DVD, or via a communication path such as a network. As another example, each part of the terminal device 12 may be realized by hardware resources such as a processor, an electronic circuit, or an ASIC (Application Specific Integrated Circuit). A device such as a memory may be used in the realization. As yet another example, each part of the terminal device 12 may be realized by a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or the like. [Explanation of symbols]

[0260] 10 earphone device, 12 terminal device, 14 music distribution server.

Claims

1. The computer Electrodes are placed on specific areas around the user's ears to measure brainwaves. An information processing method that outputs light information of different colors depending on the measured brain waves of the user.

2. The electroencephalogram includes information regarding a waveform indicating a change in the electroencephalogram measured from the user over a predetermined time period; The computer The information processing method according to claim 1 , further comprising outputting information of light of a color corresponding to the waveform.

3. The brain waves include one or more brain wave states of the user related to delta waves, theta waves, alpha waves, and beta waves, The computer The information processing method according to claim 1 , further comprising outputting light information of a color corresponding to the electroencephalogram state.

4. The computer When brain waves indicating relaxation are measured, a first color of light information is output. The information processing method according to claim 1 , further comprising the step of outputting information of the second color of light when an electroencephalogram indicating concentration is measured.

5. The light source that emits light is provided in a device different from a device in which the electrodes for measuring the brain waves are provided, The computer The information processing method according to claim 1 , further comprising the step of: receiving an instruction to output light information, and causing the different device to output light.

6. A processor is included. The processor, Electrodes are placed on specific areas around the user's ears to measure brainwaves. outputting light information of different colors according to the measured brain waves of the user; Brain wave measuring device.

Images