Head set
The headset addresses the challenge of acquiring electroencephalograms from various head regions by incorporating a movable arm with a positioning mechanism and a biosensor, allowing for easy and accurate signal acquisition while maintaining a conventional headset design.
Patent Information
- Application Number
- JP2022059181
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-03-31
- Publication Date
- 2025-06-11
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Conventional audio headsets equipped with biosignal sensors struggle to easily acquire electroencephalograms from various parts of the head.
A headset design featuring a pair of sound output devices connected by an arm with a positioning mechanism that allows the arm to move in the front-rear direction of the user's head, accommodating a biosensor to acquire biological information from different head regions.
Enables easy and accurate acquisition of electroencephalograms from various parts of the head, reducing the need for separate positioning members and potentially lowering costs while maintaining a familiar headset appearance.
Smart Images

Figure 2025087937000001_ABST
Abstract
Description
Technical Field
[0001] The disclosed technology relates to a headset.
Background Art
[0002] Conventionally, an audio headset equipped with a biosignal sensor has been known. For example, an audio headset equipped with a biosignal sensor is disclosed to provide an arm as a separate member from the arm of a normal headphone, and to acquire a biosignal on the user's forehead by a biosensor on the arm of the separate member (see, for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, a conventional audio headset equipped with a biosignal sensor provides an arm as a separate member from the arm of a normal headphone and acquires an electroencephalogram signal on the forehead, but it cannot easily acquire electroencephalograms of each part of the head.
[0005] Therefore, an object of the disclosed technology is to provide a headset that can easily acquire electroencephalograms of each part of the head.
Means for Solving the Problems
[0006] A headset according to an aspect of the disclosed technology includes a pair of sound output devices including a driver unit, an arm connecting the pair of sound output devices to each other, a positioning mechanism provided on the arm for positioning the arm by moving it in the front-rear direction of the user's head, and a biosensor provided on the arm for acquiring biological information by contacting the user's head.
Advantages of the Invention
[0007] According to the disclosed technology, electroencephalograms of each part of the head can be easily obtained.
Brief Description of the Drawings
[0008]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Modes for Carrying Out the Invention
[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are merely examples and are not intended to exclude various modifications and applications of technologies not explicitly described below. That is, the disclosed technology can be implemented with various modifications without departing from its gist. Also, in the following descriptions of the drawings, the same or similar parts are denoted by the same or similar reference numerals. The drawings are schematic and do not necessarily match actual dimensions, ratios, etc. There may be parts where the dimensional relationships and ratios are different between the drawings.
[0010] [Embodiment] Hereinafter, an example of a headset in an embodiment will be described with reference to the drawings.
[0011] <Configuration of Headset> First, with reference to FIG. 1, an example of the configuration of a headset in an embodiment will be described. FIG. 1 is a perspective view showing an example of a headset 1 in the present embodiment.
[0012] In FIG. 1, the headset 1 includes a pair of sound output devices 2R, 2L, an arm 4 that connects the pair of sound output devices 2R, 2L to each other, positioning mechanisms 8R, 8L provided on the arm 4 for positioning the arm 4 when the arm 4 moves in the front-rear direction of the user's head, a biosensor 6 provided on the arm 4 for acquiring biological information by contacting the user's head, a microphone set 10, a pair of length adjustment mechanisms 12R, 12L for adjusting the length in the longitudinal direction of the arm 4, and a movement mechanism 14 for moving the position of the biosensor 6. Note that the microphone set 10, the adjustment mechanisms 12R, 12L, and the movement mechanism 14 are not necessarily essential components of the headset 1.
[0013] In FIG. 1, an example using earpieces as the sound output devices 2R, 2L is shown, but sound may be output from a device having ordinary headphone-type ear pads or housings. Hereinafter, for the RL notation of left and right, when the left and right are not distinguished, the RL notation is omitted. For example, a positioning mechanism that does not distinguish between left and right is denoted as the positioning mechanism 8.
[0014] According to the configuration shown in FIG. 1, the positioning mechanisms 8R and 8L enable a part of the arm 4 including the biological sensor 6 to be moved in the front-rear direction of the user's head. As a result, the biological sensor 6 can be positioned at each part from the prefrontal lobe to the occipital lobe of the user's head, and biological information (e.g., electroencephalogram signal) at a desired position can be acquired. Further, since the positioning mechanisms 8R and 8L are provided as a part of the arm 4, a separate member for positioning the biological sensor 6 is not required, and it is possible to reduce the cost of the headset 1. Further, according to the configuration shown in FIG. 1, since the arm 4 that supports the mounting of the sound output devices 2R and 2L has the biological sensor 6 and the positioning mechanisms 8R and 8L, it has the same appearance as a normal audio headset, and it is possible to reduce the psychological burden during use.
[0015] Further, the positioning mechanisms 8R and 8L may be provided in a pair at a predetermined position on the side of each of the sound output devices 2R and 2L between the substantially central position in the longitudinal direction of the arm 4 and each of the sound output devices 2R and 2L. For example, the positioning mechanisms 8R and 8L may be provided at the connection portion between the end of each of the sound output devices 2R and 2L and the arm 4, or at the connection portion between the extending portion extending from this end and the arm 4. Any mechanism may be used as long as the positioning mechanisms 8R and 8L can adjust the angle of the arm 4. Further, the positioning mechanisms 8R and 8L do not necessarily have to be the same mechanism, and they may be provided with different mechanisms or at different positions respectively.
[0016] With the above configuration, a substantially elliptical portion of the arm 4 along the user's head can be moved in the front-rear direction of the user's head without changing its shape, and it is possible to move the arm 4 without discomfort to the user to position the biological sensor 6.
[0017] Further, at least one of the pair of positioning mechanisms 8R and 8L may include a bellows mechanism. When one of the pair of positioning mechanisms 8R and 8L is a bellows mechanism, the other may be a hinge having a lock mechanism with adjustable angle. More preferably, both of the pair of positioning mechanisms 8R and 8L are bellows mechanisms. The bellows mechanism enables the arm 4 to be stably positioned at an arbitrary angle in the front-rear direction of the head or the like.
[0018] With the above configuration, by using the bellows mechanism as the positioning mechanisms 8R and 8L, the user can freely adjust and position the position of the biological sensor 6 of the arm 4.
[0019] In addition, the pair of length adjustment mechanisms 12R and 12L have, for example, a slide mechanism or the like to adjust the length of the arm 4 in the longitudinal direction. Thereby, it becomes possible to appropriately bring the biological sensor 6 of the arm 4 into contact with the head according to the shape of the user's head.
[0020] Further, the arm 4 may have a moving mechanism 14 that changes the position of the biological sensor 6 in the longitudinal direction of the arm 4. For example, the moving mechanism 14 may be a slide mechanism that slides the biological sensor 6 along the longitudinal direction of the arm 4, or a detachable mechanism that removes the biological sensor 6 once and attaches it to an arbitrary predetermined position.
[0021] As the detachable mechanism, for example, one of a pair of structures for fitting or screwing may be arranged at a plurality of positions in the arm 4. The biological sensor 6 has the other of the pair of detachable structures for fitting or screwing. The biological sensor 6 is positioned by being attached to the one structure arranged at a predetermined position of the arm 4. Further, when the biological sensor 6 is attached to the arm 4, it is electrically connected to the wire 112 inside the arm 4 described later.
[0022] In the example shown in FIG. 1, there is one biological sensor 6, but any number of biological sensors 6 may be added so that a plurality of biological sensors 6 acquire a plurality of biological signals at a plurality of predetermined positions.
[0023] Here, with reference to FIGS. 2 to 4, an example of a brain wave signal (EEG: electroencephalogram) as biological information that can be acquired by the biological sensor 6 of the headset 1 in the embodiment will be described. FIG. 2 is a diagram showing an example of a top view when electrodes are arranged according to the 10-20 method to acquire each brain wave signal. FIG. 3 is a diagram showing an example of a side view when electrodes are arranged according to the 10-20 method to acquire each brain wave signal. FIG. 4 is a diagram showing electrode symbols and site names of the 10-20 method.
[0024] According to the example shown in FIG. 1, the biological sensor 6 is provided at the central position in the longitudinal direction of the arm 4, and the arm 4 can be moved and positioned in the front-rear direction of the user's head by the positioning mechanism 8. By this positioning mechanism 8, the biological sensor 6 can correspond to the electrodes Fz at the midfrontal region, Cz at the midcentral region, and Pz at the midparietal region shown in FIGS. 2 and 4.
[0025] In addition, by the above-described movement mechanism 14, the biological sensor 6 can also move in the left-right direction of the user's head. By this movement mechanism 14, the biological sensor 6 can correspond to, for example, the electrodes F3, F4 at the frontal region, C3, C4 at the central region, P3, P4 at the parietal region, and O1, O2 at the occipital region shown in FIGS. 3 and 4.
[0026] In addition, by providing a plurality of biological sensors 6 on the arm 4, the plurality of biological sensors 6 can acquire, at the same timing, biological information corresponding to biological information from both left and right electrodes such as the electrodes F3 and F4 at the frontal region, C3 and C4 at the central region, P3 and P4 at the parietal region, or O1 and O2 at the occipital region shown in FIGS. 3 and 4.
[0027] <Configuration of Biological Sensor> FIG. 5 is a cross-sectional view of the biosensor 6 disposed on the arm 4 in the present embodiment. FIG. 5 is a view showing a V-V cross-section including the center of the biosensor 6 shown in FIG. 1. The biosensor 6 shown in FIG. 5 includes, for example, a bioelectrode 102 having elasticity, a screw A 104, a spacer 106 made of a conductive member, and a screw B 108.
[0028] In the example shown in FIG. 5, the bioelectrode 102 is formed of, for example, a conductive resin and includes one or more convex portions and a cylindrical portion. Since one or more convex portions (three in the example shown in FIG. 1) are in contact with the user's hair and the head, the shape of the bioelectrode 102 leads to prevention of displacement of the biosensor 6 disposed on the arm 4. In the example shown in FIG. 5, a cross-section of one of the three convex portions of the bioelectrode 102 is illustrated. Inside the cylindrical portion of the bioelectrode 102, a spacer 106 is provided in the vertical Z direction from a substantially central position of the bioelectrode 102 in the X direction (substantially the center point of the circle of the cylindrical portion).
[0029] The spacer 106 is formed of a conductive material and includes, for example, a brass spacer. The spacer 106 is in contact with the bioelectrode 102. For example, in the example shown in FIG. 5, conduction is achieved by contact of the lower surface of the spacer 106 in the Z2 direction with the bioelectrode 102. Note that the side surface of the spacer 106 may also be in contact with the bioelectrode 102.
[0030] The screw A 104 is rotated in the Z1 direction from the central hole in the Z2 direction of the cylindrical portion of the bioelectrode 102 and screwed into the spacer 106 to fix the bioelectrode 102 and the spacer 106. The screw A 104 is, for example, a flat head screw and may have conductivity.
[0031] The screw B 108 is rotated in the Z2 direction from the central hole in the Z1 direction of the cylindrical portion of the bioelectrode 102 and screwed into the spacer 106 to fix the arm 4 and the biosensor 6. The screw B 108 is, for example, a brass countersunk head screw and has conductivity.
[0032] The elastic member 110 is provided between the biological sensor 6 (or the biological electrode 102) and the arm 4. The elastic member 110 has a function as a buffer material. When the convex portion of the biological electrode 102 contacts the user's scalp, the elastic member 110 allows any position to deform and the convex portion to sway slightly, enabling the convex portion of the biological electrode 102 to be positioned. The elastic member 110 may be formed of, for example, an elastic resin or a porous material such as a sponge. Further, the elastic member 110 has a cylindrical shape, and the inner wall of the central hole of the elastic member 110 does not have to contact the spacer 106 in order to increase the movement range of the biological electrode 102.
[0033] By providing the elastic member 110 between the biological sensor 6 and the arm 4, the biological electrode 102 sways and contacts the scalp, increasing the feeling of fit to the scalp. When the biological electrode 102 appropriately contacts the scalp, it becomes possible to accurately measure biological information.
[0034] The arm 4 has a conductive wire 112 disposed therein. The wire 112 is connected so as to be electrically conductive with the head portion of the screw B108. The screw B108 is, for example, a brass countersunk screw. Thereby, the flat portion on the upper surface of the head of the countersunk screw contacts the wire 112, the contact area with the wire 112 can be widened, and the conductivity can be stabilized. Further, when the arm 4 does not include the movement mechanism 14, the head of the screw B108 and the wire 112 may be soldered together. Note that the wire 112 may be connected to a substrate disposed inside the earpieces 2 on both sides, or may be connected to either the first earpiece 2R or the second earpiece 2L.
[0035] According to the biosensor 6 shown in FIG. 5, the convex portion of the bioelectrode 102 contacts the scalp to detect biological information. The detected biological information is transmitted in sequence through the convex portion, cylindrical portion, spacer 106, screw B108, and wire 112 of the bioelectrode 102, enabling the transmission of biological information to a substrate or the like at the tip of the wire 112. Note that the configuration of the biosensor 6 is not limited to the example shown in FIG. 5, and it may have a configuration in which biological information detected using the bioelectrode 102 is transmitted to a predetermined device or substrate or the like by wire or wirelessly. Also, the biosensor 6 may be an electrode pad or the like having a bioelectrode.
[0036] <Configuration of the sound output device> Subsequently, the sound output devices 2R and 2L will be described with reference to FIGS. 6 and 7. Since the sound output devices 2R and 2L in the present embodiment will be described by taking the earpiece as an example, hereinafter, they will also be referred to as the first earpiece 2R and the second earpiece 2L.
[0037] First, an example of the external shape of the earpiece and the arrangement mode of each sensor will be described. FIG. 6 is a diagram showing an example of the external shape of the earpiece in the present embodiment. FIG. 7 is a cross-sectional view showing the IV-IV cross-section of FIG. 6. Since the first earpiece 2R and the second earpiece 2L only have different forms suitable for being inserted into the left and right ears and have a common basic structure, the first earpiece 2R will be described as an example.
[0038] The first earpiece 2R includes a housing 21. The housing 21 is a member having a cavity inside, and a driver unit 24 including a speaker and a battery 25 are accommodated in this cavity portion. Also, the ear tip 22 is attached to a nozzle 26 protruding from the housing 21.
[0039] The nozzle 26 has a shape in which a flange is formed at one end of a cylindrical member. Specifically, the nozzle 26 includes a cylindrical portion 31 positioned in the wearer's external auditory canal when the first earpiece 2R is worn, a flange portion 32 fixed to the housing 21, and a sound guiding portion 33 connecting the interiors of the cylindrical portion 31 and the flange portion 32 in the first direction X.
[0040] The cylindrical portion 31 extends in the first direction T so as to protrude from the housing 21, and a locking projection 35 for detachably locking the ear tip 22 is formed on the tip side of the cylindrical portion 31. The flange portion 32 is formed on the proximal end side of the cylindrical portion 31. The sound guiding portion 33 functions as a passage through which sound from the driver unit 24 passes. Such a nozzle 26 is formed as a rigid body. As long as it has this property, the material forming the nozzle 26 is not limited, but as an example, a hard ABS resin can be mentioned.
[0041] The housing 21 includes a nozzle fixing portion 40 that fixes the flange portion 32 of the nozzle 26, and an extension portion 42 that extends from the nozzle fixing portion 40 to the side opposite to the nozzle 26 and expands more than the nozzle fixing portion 40. The nozzle fixing portion 40 has an opening 50 through which the cylindrical portion 31 of the nozzle 26 is inserted, a restricting portion 52 that abuts against the flange portion 32 of the nozzle 26 to restrict the nozzle 26 from falling out of the opening 50, and a surrounding portion 54 that connects between the restricting portion 52 and the extension portion 42 and surrounds the flange portion 32. Fixing of the nozzle 26 to the nozzle fixing portion 40 can be performed, for example, by fitting the flange portion 32 into the surrounding portion 54, or by adhering the flange portion 32 to the restricting portion 52 or the surrounding portion 54.
[0042] The extension part 42 is formed so as to gradually expand as it moves away from the nozzle fixing part 40 as a whole. Inside the extension part 42, the driver unit 24 is accommodated on the nozzle 26 side, and the battery 25 is accommodated in a part that is larger than the accommodation part of the driver unit 24. Further, the extension part 42 has a wiring opening 60 at the end part 42a where the extension ends. Through this opening 60, the driver unit 24 and the battery 25 are wired and connected to the substrate 70. Also, the opening 60 is also used to put the driver unit 24 and the battery 25 into the housing 21 when assembling the first earpiece 2R.
[0043] The end face 42b of the extension part 42 where the extension ends is formed as a flat surface. On the end face 42b, a plate 72 fixing the substrate 70 is placed, and a cover 74 covering the substrate 70 and the plate 72 is attached. An antenna for performing wireless communication is provided on the substrate 70. The antenna corresponds to, for example, a wireless communication standard such as Bluetooth (registered trademark). Therefore, the first earpiece 2R is configured as a wireless earphone and is wirelessly connected to devices such as mobile terminals and laptops, and communicates data such as sound with these devices. The substrate 70 is provided with a first time acquisition unit 271, a first communication unit 276, etc.
[0044] An annular attachment part 80 fitted into the peripheral surface of the cover 74 is provided. The end part of the attachment part 80 in the Z1 direction is connected to the arm 4. The cover 74 and the attachment part 80 may be described as a part of the housing 21.
[0045] The ear tip 22 is formed by a first member 22A having conductivity and a second member 22B. For example, the first member 22A and the second member 22B are formed of different materials and are each detachable. Note that the shape of the first member 22A is not limited to the example shown in FIGS. 6 and 7, as long as there is a part that contacts the inner wall of the user's external auditory canal and this contact part is configured to appropriately contact the external auditory canal. Also, it is preferable that the surface area of this contact part is large.
[0046] The ear tip 22 includes a first member 22A located on the eardrum side and a second member 22B located on the housing 21 side. The first member 22A is made of, for example, conductive rubber, and this conductive rubber contains silver or silver chloride. Preferably, in order to ensure appropriate conductivity, silver or silver chloride is contained in a predetermined mass percentage or more of the conductive substances contained in the conductive rubber.
[0047] The first member 22A may be formed of a silicon material containing a metal-based filler. For example, the first member 22A can be made into a highly conductive material by appropriately blending silver, copper, gold, aluminum, zinc, nickel, etc. as the metal-based filler into the silicon material. Also, it is not necessary for all of the fillers contained to be silver or silver chloride, and it is sufficient if a part of the fillers is silver or silver chloride. Thereby, since the content rate of silver or silver chloride can be reduced, the hardness of the rubber can be lowered, and a conductive rubber with an appropriate hardness can be created.
[0048] The second member 22B is preferably formed of an inexpensive non-conductive elastic body (such as silicone rubber).
[0049] The housing 21 or a part of the housing 21 is made of, for example, conductive rubber, and this conductive rubber contains silver or silver chloride. Preferably, in order to ensure appropriate conductivity, silver or silver chloride is contained in a predetermined mass percentage or more of the conductive substances contained in the conductive rubber.
[0050] The housing 21 or a part of the housing 21 may be formed of a silicon material containing a metal-based filler. For example, the first member 22A can be made into a highly conductive material by appropriately blending silver, copper, gold, aluminum, zinc, nickel, etc. as the metal-based filler into the silicon material. Also, it is not necessary for all of the fillers contained to be silver or silver chloride, and it is sufficient if a part of the fillers is silver or silver chloride. Thereby, since the content rate of silver or silver chloride can be reduced, the hardness of the rubber can be lowered, and a conductive rubber with an appropriate hardness can be created.
[0051] By configuring as described above, at least a part of the first member 22A of the ear tip 22 and the housing 21 has conductivity. In the example shown in this embodiment, the first member 22A is used as the ear sensor 272 of the biometric electrode, and the housing 21 is used as the ground sensor 274 of the biometric electrode, but it is not limited to this example. Also, the conductive material of the housing 21 and the conductive material of the first member 22A may be the same or different from each other. Further, the conductivity of the first member 22A may be made higher than the conductivity of the housing 21.
[0052] <Headset processing configuration> FIG. 8 is a diagram showing an example of the processing configuration of the headset 1 in this embodiment. In the example shown in FIG. 8, the sound output device 2 includes a first earpiece 2R and a second earpiece 2L. The first earpiece 2R is worn on the user's right ear. The second earpiece 2L is worn on the user's left ear. The first earpiece 2R and the second earpiece 2L are configured to be able to communicate with the smartphone M.
[0053] The smartphone M is an example of an external communication terminal different from the headset 1. The first earpiece 2R and the second earpiece 2L are configured to be able to receive GNSS signals transmitted from GNSS satellites Sa and the like.
[0054] The first earpiece 2R includes a first time acquisition unit 271, an ear sensor 272, a signal acquisition unit 273, a ground sensor 274, a first A / D conversion unit 275, and a first communication unit 276.
[0055] The first time acquisition unit 271 receives the GNSS signal transmitted from the GNSS satellite Sa and acquires the absolute time information included in the GNSS signal. The first time acquisition unit 271 outputs the acquired absolute time information to the first A / D conversion unit 275. The first time acquisition unit 271 includes, for example, a GPS (Global Positioning System) chip.
[0056] The ear sensor 272, which is a biosensor, uses the first member 22 having conductivity of the above-described ear tip 22 to contact the user's ear and acquire biological information (third biological information) as an electrical signal. The ear sensor 272 outputs the sensed biological information (third biological information) to the first A / D conversion unit 275.
[0057] The signal acquisition unit 273 acquires an electrical signal of the user's biological information (first biological information) acquired from the biosensor 6. The signal acquisition unit 273 outputs the acquired first biological information to the first A / D conversion unit 275. Further, the signal acquisition unit 273 may be connected to a wire 112 disposed inside the arm 4 and may be a signal line connected to the first A / D conversion unit 275.
[0058] The ground sensor 274 is a sensor that acquires ground potential information as an electrical signal. Regarding the arrangement position of the ground sensor 274, for example, it is the housing 21 or a part of the housing 21. The ground sensor 274 outputs the sensed ground potential information to the first A / D conversion unit 275.
[0059] The first A / D conversion unit 275 samples each piece of information in accordance with the timing of the absolute time information. For example, as a method of sampling in accordance with the timing of the absolute time information, sampling may be performed in accordance with the absolute time information each time, or sampling may be performed in accordance with the absolute time information at regular timings such as every second. The first A / D conversion unit 275 outputs the sampled pieces of information to the first communication unit 276.
[0060] The first communication unit 276 transmits the third biological information output from the ear sensor 272 and the first biological information output from the signal acquisition unit 273 to the communication terminal M in association with the absolute time information, respectively. Further, the first communication unit 276 may generate third difference information, which is the difference between the third biological information output from the ear sensor 272 and the ground potential information output from the ground sensor 274, and transmit it to the communication terminal M in association with the absolute time information.
[0061] Similarly, the first communication unit 276 may generate first difference information, which is the difference between the first biological information output from the signal acquisition unit 273 and the ground potential information output from the ground sensor 274, and transmit it to the communication terminal M in association with the absolute time information. Note that associating the absolute time information with each piece of information (e.g., adding a time stamp) may be performed by the first A / D conversion unit 275.
[0062] In the example described above, the first communication unit 276 transmits the first biological information or the first difference information and the absolute time information to the communication terminal M on the first channel in association with each other. The absolute time information associated with the first biological information or the first difference information is synchronized with the timing sensed by the biological sensor 6.
[0063] Also, the first communication unit 276 transmits the third biological information or the third difference information and the absolute time information to the communication terminal M on the third channel in association with each other. The absolute time information associated with the third biological information or the third difference information is synchronized with the timing sensed by the ear sensor 272. Note that the third channel may be the same channel as or a different channel from the first channel. Also, each of the above-described biological information or ground potential information includes information sampled by the first A / D conversion unit 275.
[0064] The second earpiece 2L includes a second time acquisition unit 281, an ear sensor 282, a signal acquisition unit 283, a ground sensor 284, a second A / D conversion unit 285, and a second communication unit 286.
[0065] The second time acquisition unit 281 receives the GNSS signal transmitted from the GNSS satellite Sa and acquires the absolute time information included in the GNSS signal. The second time acquisition unit 281 outputs the acquired absolute time information to the second A / D conversion unit 285.
[0066] The ear sensor 282 uses the first member 22 having the conductivity of the above-described ear tip 22 to acquire the biological information (fourth biological information) of the user as an electrical signal. The ear sensor 282 outputs the sensed fourth biological information to the second A / D conversion unit 285.
[0067] The signal acquisition unit 283 acquires the electrical signal of the biological information (second biological information) of the user acquired from the biological sensor 6. The signal acquisition unit 283 outputs the acquired second biological information to the second A / D conversion unit 285. Also, the signal acquisition unit 283 may be connected to a wire 112 disposed inside the arm 4 and may be a signal line connected to the second A / D conversion unit 285.
[0068] The ground sensor 284 is a sensor that acquires ground potential information as an electrical signal. Regarding the arrangement position of the ground sensor 284, for example, it may be the housing 21 or a part of the housing 21. The ground sensor 284 outputs the sensed ground potential information to the second A / D conversion unit 285.
[0069] The second A / D conversion unit 285 samples each piece of information in accordance with the timing of the absolute time information. For example, as a method of sampling in accordance with the timing of the absolute time information, sampling may be performed in accordance with the absolute time information each time, or sampling may be performed in accordance with the absolute time information at regular timings such as every second. The second A / D conversion unit 285 outputs the sampled pieces of information to the second communication unit 286.
[0070] The second communication unit 286 transmits the fourth biological information output from the ear sensor 282 and the second biological information output from the signal acquisition unit 283 to the communication terminal M in association with the absolute time information, respectively. Also, the second communication unit 286 may generate fourth difference information, which is the difference between the fourth biological information output from the ear sensor 282 and the ground potential information output from the ground sensor 284, and transmit it to the communication terminal M in association with the absolute time information.
[0071] Similarly, the second communication unit 286 may generate second difference information, which is the difference between the second biological information output from the signal acquisition unit 283 and the ground potential information output from the ground sensor 284, and transmit it to the communication terminal M in association with the absolute time information. Note that associating the absolute time information with each piece of information (e.g., attaching a time stamp) may be performed by the second A / D conversion unit 285.
[0072] In the above example, the second communication unit 286 associates the second biological information or the second differential information with the absolute time information and transmits the information to the communication terminal M on the second channel. The absolute time information associated with the second biological information or the second differential information is synchronized with the timing sensed by the biological sensor 6.
[0073] Further, the second communication unit 286 associates the fourth biological information or the fourth differential information with the absolute time information and transmits the information to the communication terminal M on the fourth channel. The absolute time information associated with the fourth biological information or the fourth differential information is synchronized with the timing sensed by the ear sensor 282. Note that the fourth channel may be the same channel as the second channel or a different channel. Also, each of the above-described biological information or the ground potential information includes information sampled by the second A / D conversion unit 285.
[0074] Note that, as examples of the information acquired from the biological sensor 6, the first biological information and the second biological information are given, but only one of them may be transmitted to the communication terminal M. Also, when there are a plurality of biological sensors 6, the biological information sensed by the biological sensor 6 located on the right side of the center of the headset 1 is input to the signal acquisition unit 273 of the first earpiece 2R, and the biological information sensed by the biological sensor 6 located on the left side of the center of the headset 1 is input to the signal acquisition unit 283 of the second earpiece 2L.
[0075] According to the above-described configuration, the first communication unit 276 associates the first biological information acquired by the biological sensor 6 of the arm 4 and the third biological information acquired by the ear sensor 272 on the right ear side where the first earpiece 2R is worn with the absolute time information and transmits the information to the communication terminal. Thereby, at the communication terminal, it is possible to appropriately grasp at which time or timing the biological information was acquired.
[0076] The second communication unit 286 transmits the second biometric information acquired by the biometric sensor 6 of the arm 4 and the second biometric information acquired by the ear sensor 282 on the left ear side wearing the second earpiece 2L to the communication terminal in association with the absolute time information. Thereby, in the communication terminal, it is possible to appropriately grasp at which time or timing the biometric information was acquired.
[0077] Since the earpiece is worn on the ear, even if a plurality of sensors for acquiring biometric information are provided within the same earpiece, it is difficult to improve the accuracy as biometric information because the potential difference of the acquired signals is small and the signals cancel each other out. On the other hand, if sensors are provided in each of the different earpieces and biometric information is acquired by each sensor, the problem of inability to secure a potential difference can be solved. However, if biometric information acquired in different earpieces is transmitted to the communication terminal for information processing, there is a new problem that an error occurs due to communication delay or the like. Therefore, in the present embodiment, by transmitting each biometric information acquired by each earpiece to the communication terminal in association with the absolute time information, the error caused by communication delay is eliminated, and it is possible to acquire accurate biometric information with a secured potential difference.
[0078] In the present embodiment, the absolute time information included in the GNSS signal is used as an example of the reference time information. However, as long as it has the accuracy required for specifying the time of each biometric information acquired by each earpiece, other time information can be used as the reference time information. For example, the first time acquisition unit 271 and the second time acquisition unit 281 may acquire a signal such that the error of the reference time of each earpiece is 1 ms or less. Further, the reference time information can be used not only to indicate the acquisition time of each biometric information but also as information for synchronizing with each biometric information acquired by other earpieces.
[0079] Note that the reference time information can also be replaced with synchronization information for synchronizing with biometric information acquired by other earpieces. In this case, the first time acquisition unit 271 and the second time acquisition unit 281 may function as a synchronization information generation unit that generates synchronization information. For example, the first time acquisition unit 271 and the second time acquisition unit 281 may generate identification information (synchronization information) corresponding to the reference time information. Note that the amount of data of the identification information is preferably smaller than that of the reference time information.
[0080] As described above, the headset 1 has a biological sensor 6 that acquires first biological information at a position different from the ear sensor 272 of the first earpiece 2R. The first communication unit 276 transmits the first biological information, the third biological information, and the absolute time information as an example of the reference time information, in association with each other, to the communication terminal.
[0081] In addition, the headset 1 has a biological sensor 6 that acquires second biological information at a position different from the ear sensor 282 of the second earpiece 2L. The second communication unit 286 transmits the second biological information, the fourth biological information, and the absolute time information as an example of the reference time information, in association with each other, to the communication terminal.
[0082] By doing so, the absolute time information is associated with the biological information acquired at three different positions and transmitted from the two earpieces to the communication terminal. Therefore, at the communication terminal, at least three pieces of biological information with the acquisition time accurately recorded by the absolute time information can be acquired.
[0083] For example, the communication terminal M performs cross-processing such as processing the first biological information and the fourth biological information as main biological information and reference biological information, respectively, and processing the second biological information and the third biological information as main biological information and reference biological information, respectively, using the absolute time information. This enables cross-reference processing that increases the signal component or increases the potential difference.
[0084] As described above, the first time acquisition unit 271 receives the GNSS signal transmitted from the GNSS satellite Sa and acquires reference time information including absolute time information, and the second time acquisition unit 281 receives the GNSS signal transmitted from the GNSS satellite Sa and acquires reference time information including absolute time information.
[0085] As described above, the first earpiece 2R has a ground sensor 274 that acquires ground potential information at a position different from that of the ear sensor 272. The first communication unit 276 transmits the first difference information between the first biological information and the ground potential information, the third difference information between the third biological information and the ground potential information, and the reference time information to the communication terminal in association with each other.
[0086] The second earpiece 2L has a ground sensor 284 that acquires ground potential information at a position different from that of the ear sensor 282. The second communication unit 286 transmits the second difference information between the second biological information and the ground potential information, the fourth difference information between the fourth biological information and the ground potential information, and the reference time information to the communication terminal in association with each other.
[0087] Note that the first difference information or the third difference information may be calculated as the difference between the first biological information or the third biological information sampled at the same timing by the first A / D conversion unit 275 and the ground potential information. Similarly to the first difference information, the second difference information and the fourth difference information may also be calculated by the second A / D conversion unit 285.
[0088] By transmitting the difference information, which is the difference between the potential indicating the biological information and the installation potential, to the communication terminal in association with the reference time information, the communication terminal M can acquire the biological information with improved signal accuracy in association with the reference time.
[0089] As described above, the first earpiece 2R has a first A / D conversion unit 275 that samples the third electrical signal measured by the ear sensor 272 based on the reference time information, and the first communication unit 276 may transmit the third biological information sampled by the first A / D conversion unit 275 and the reference time information to the communication terminal M in association with each other.
[0090] Further, the second earpiece 2L has a second A / D conversion unit 285 that samples a fourth electrical signal measured by the ear sensor 282 based on reference time information, and the second communication unit 286 may transmit the fourth biological information sampled by the second A / D conversion unit 285 and the reference time information to the communication terminal M in association with each other.
[0091] Thereby, the sampling timings of the center and the left and right can be made to coincide, and it becomes possible to more appropriately synchronize the biological information of the center and the left and right. For example, even if accurate timestamps are given to each biological information, if the sampling timings by the center and left and right sensors are not synchronized, it becomes difficult to appropriately synchronize the biological information of the center and the left and right. However, this problem is solved by making the sampling timings of the center and the left and right coincide based on the reference time information. Note that the sampling timings may also be made to coincide based on the reference time information in the first biological information, the second biological information, and each ground potential information.
[0092] In the above-described embodiment, broader electroencephalogram information is estimated from the electroencephalogram information (electroencephalogram signal) acquired from the ear or the head, but the prediction is not limited to the broader electroencephalogram information. For example, it is also possible to estimate biological information that can be acquired from the human body from electroencephalogram information or biological information that can be acquired from the ear or the head. As a specific example, biological signals that can be acquired from near the head include, in addition to electroencephalograms, electrooculogram signals, heartbeat signals from the carotid artery or the like, and electromyogram signals from the masseter muscle or the temporal muscle. Further, as biological signals that can be acquired from the human body, there are, for example, electrocardiogram signals. These biological information may be measured using a biological sensor that measures the corresponding biological information.
[0093] In the above-described embodiment, an earphone having a pair of earpieces was described as an example of a device for acquiring biological information. However, the technology of the present disclosure can also be applied to at least two biological information measurement devices that measure biological information at different positions. For example, one device is one of the earpieces of the present disclosure, and the other device is, for example, eyewear (glasses) and has a configuration similar to that of the other earpiece of the present disclosure. Also, the two devices are connected by the above-described arm 4.
[0094] According to the above example, the biological information measurement device includes a first device that can communicate with a communication terminal and is worn on a first predetermined part of a user, and a second device that can communicate with the communication terminal and is worn on a second predetermined part of the user. The first device has a first sensor that acquires first biological information, a first time acquisition unit that acquires reference time information, and a first communication unit that associates the first biological information and the reference time information and transmits them to the communication terminal. The second device has a second sensor that acquires second biological information, a second time acquisition unit that acquires reference time information, and a second communication unit that associates the second biological information and the reference time information and transmits them to the communication terminal. Also, the two devices are connected by the above-described arm 3. This enables cross-reference signal processing that utilizes the synchronization technology of each biological information acquired by the two devices and the arm 4. For this biological information measurement device as well, the configurations and processes in the above-described embodiment can be applied.
[0095] <Usage Example> Using FIGS. 9 to 11, a usage example of the headset 1 will be described. FIG. 9 is a diagram showing Usage Example 1 of the headset 1 in the present embodiment. In the example shown in FIG. 9, the positioning mechanism 8 is worn on the user's head in the state of the default position. In the example shown in FIG. 9, the biological sensor 6 provided on the arm 4 acquires biological information around the center center part shown in FIGS. 2 to 4.
[0096] FIG. 10 is a diagram showing a second usage example of the headset 1 in the present embodiment. In the example shown in FIG. 10, the positioning mechanism 8 is positioned such that the arm 4 comes to a position in front of the user's head. In the example shown in FIG. 10, the biological sensor 6 provided on the arm 4 acquires biological information in the vicinity of the mid-frontal head shown in FIGS. 2 to 4.
[0097] FIG. 11 is a diagram showing a third usage example of the headset 1 in the present embodiment. In the example shown in FIG. 11, the positioning mechanism 8 is positioned such that the arm 4 comes to a position behind the user's head. In the example shown in FIG. 11, the biological sensor 6 provided on the arm 4 acquires biological information in the vicinity of the mid-parietal head shown in FIGS. 2 to 4.
[0098] As described above, the user can place the biological sensor 6 at the site of the biological information to be measured by operating the positioning mechanism 8 by himself / herself.
[0099] <Configuration of Communication Terminal> FIG. 12 is a block diagram showing an example of the communication terminal M according to the present embodiment. The communication terminal M is constituted by an information processing apparatus, and is, for example, a terminal such as a mobile terminal (such as a smartphone), a computer, or a tablet terminal. The communication terminal M is also denoted as the communication terminal 300.
[0100] The communication terminal 300 includes one or more processors (e.g., CPU) 310, one or more network communication interfaces 320, a memory 330, a user interface 350, and one or more communication buses 370 for interconnecting these components.
[0101] The user interface 350 includes a display 351 and an input device (such as a keyboard and / or a mouse or some other pointing device) 352. Further, the user interface 350 may be a touch panel.
[0102] The memory 330 is a high-speed random access memory such as, for example, DRAM, SRAM, DDR RAM, or other random access solid-state storage devices, and may also be a non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
[0103] Also, other examples of the memory 330 can include one or more storage devices installed remotely from the processor 310. In certain embodiments, the memory 330 stores the following programs, modules, and data structures, or subsets thereof. Also, the memory 330 may be a computer-readable non-transitory storage medium.
[0104] One or more processors 310 read and execute programs from the memory 330 as needed. For example, one or more processors 310 may constitute an application control unit (hereinafter also referred to as the "app control unit") 312 by executing a program stored in the memory 330. This app control unit 312 is an application that processes each biological signal and has, for example, an app control unit 312, an acquisition unit 313, a specification unit 314, a processing unit 315, and an output unit 316.
[0105] The acquisition unit 313 acquires each piece of biological information transmitted from the headset 1 via the network communication interface 320. For example, the acquisition unit 313 sequentially acquires the first biological information and the third biological information associated with the reference time information transmitted from the first communication unit 276, or the first difference information and the third difference information associated with the reference time information. Note that the reference time information may be synchronization information.
[0106] Also, the acquisition unit 313 sequentially acquires the second biological information and the fourth biological information associated with the reference time information transmitted from the second communication unit 286, or the second difference information and the fourth difference information associated with the reference time information. Note that the reference time information may be synchronization information.
[0107] For each piece of information acquired by the acquisition unit 313, the specifying unit 314 specifies the information acquired at the same timing using the reference time information (or synchronization information). For example, for the first biological information and the third biological information transmitted from the first communication unit 276 and the second biological information and the fourth biological information transmitted from the second communication unit 286, the specifying unit 314 uses the reference time information associated with each of them to specify each piece of information with the same reference time information.
[0108] Similarly, for the first difference information and the third difference information transmitted from the first communication unit 276 and the second difference information and the fourth difference information transmitted from the second communication unit 286, the specifying unit 314 may use the reference time information associated with each of them to specify each piece of information with the same reference time information.
[0109] The processing unit 315 performs predetermined processing on each piece of biological information having the same reference time information (or synchronization information). The predetermined processing includes, for example, generating one piece of biological information using each piece of biological information or calculating the average value of a predetermined time for each part. When one piece of biological information is generated from each piece of biological information, the processing unit 315 may obtain the average value of each piece of biological information, or may obtain the average value from the cross-reference information after generating the above-described cross-reference information.
[0110] In addition, as the predetermined processing, the processing unit 315 may include inputting each piece of biological information or one piece of biological information generated by the above-described processing into a learned emotion estimation model to estimate the emotion. The learned emotion estimation model may use known techniques.
[0111] In addition, the processing unit 315 may obtain an inference result using a learning model for each predetermined part. For example, since the first biological information and / or the second biological information are biological information of a part different from the third biological information and the fourth biological information, the processing unit 315 may input the first biological information and / or the second biological information into a learning model different from the third biological information and the fourth biological information. The learning model may be appropriately selected according to the model desired by the user.
[0112] Further, as a predetermined process, the processing unit 315 may generate one piece of biological information using each piece of biological information, and specify an operation command for a predetermined application based on the generated biological information. For example, the processing unit 315 may refer to the time-series data of the biological information for a predetermined time and determine an operation command corresponding to a predetermined time-series pattern. The operation command may be, for example, an operation command for a predetermined medium (such as a video or music) being output, an operation command for the communication terminal 300, or an operation command for an external device communicating with the communication terminal 300.
[0113] The output unit 316 outputs the result processed by the processing unit 315. For example, when the processing unit 315 estimates the emotion using each piece of biological information, the output unit 316 outputs the estimation result as image data to the display 351 or as audio data to the earpiece 2 or the like.
[0114] Further, when the operation command is specified by the processing unit 315, the output unit 316 may output the specified operation command to the OS of the own device or an external device.
[0115] <Processing Procedure> Next, the operation of the communication terminal 300 in the present embodiment will be described. FIG. 13 is a flowchart showing an example of the processing of the communication terminal 300 in the present embodiment. In the example shown in FIG. 13, an example in which the communication terminal 300 processes biological information will be described.
[0116] In step S102, the acquisition unit 313 acquires each piece of biological information from the headset 1 worn by the user. For example, the acquisition unit 313 acquires biological information measured by a biological electrode provided on the ear tip of the earphone or biological information measured by a biological electrode on the arm 4. At this time, reference time information is associated with each piece of biological information. Hereinafter, the reference time information may be read as synchronization information.
[0117] In step S104, the specifying unit 314 specifies each piece of biological information that has been sensed (or sampled) at the same timing for each acquired piece of biological information, using the reference time signal. For example, the specifying unit 314 specifies each piece of biological information having the same reference time signal as a pair.
[0118] In step S106, the processing unit 315 executes a predetermined process on each piece of biological information specified as having the same reference time information. The predetermined process includes, for example, emotion estimation and operation command determination.
[0119] In step S108, the output unit 316 outputs the processing result by the processing unit 315 to an output destination set according to the processing result. For example, if the processing result is the estimation result of emotion estimation, the output unit 316 outputs the estimation result to the display 351 or the like, and if the processing result is an operation command, the output unit 316 outputs the operation command to the OS or the like.
[0120] According to the above processing, even if each piece of biological information is transmitted from a plurality of devices by wireless communication or the like and different communication delays or the like occur in each device, by using the reference time information (or synchronization information), it is possible to specify the biological information sensed (or sampled) at the same timing, and it becomes possible to appropriately execute the subsequent processing.
[0121] The present embodiment has been described above with reference to specific examples. However, the present disclosure is not limited to these specific examples. Those obtained by appropriately making design changes by those skilled in the art to these specific examples are also included in the scope of the present disclosure as long as they have the features of the present disclosure. Each element included in each of the above-described specific examples and its arrangement, conditions, shape, etc. are not limited to those illustrated and can be changed as appropriate. Each element included in each of the above-described specific examples can be combined as appropriate as long as no technical contradiction occurs.
[0122] For example, the following modification examples can be cited. <Modification Example 1> When the moving mechanism 14 is provided so that the biosensor 6 moves in the longitudinal direction with respect to the arm 4, the moving mechanism 14 may be provided with notations that can identify which part of the electrodes can be measured. For example, numbers 1 to 8 corresponding to the electrode symbols shown in FIG. 4 may be engraved or the like at a predetermined position on the inner side of the arm 4 (the side where the biosensor 6 is provided).
[0123] Corresponding to the above, the user may input to the communication terminal M which part of the biological information is being acquired. For example, the user should be able to select the part being measured from the part names, electrode symbols shown in FIG. 4, or the schematic diagram shown in FIG. 3 displayed on the communication terminal M. At this time, the communication terminal M may associate the information regarding the part input by the user with the biological signal acquired from the headset 1. Further, the first A / D conversion unit 275 and the second A / D conversion unit 285 of the headset 1 may attach identification information of the biosensor to the biological information so as to be able to identify which biosensor the biological information was measured by.
[0124] Through the above processing, the user can easily grasp which part should be measured. Also, the communication terminal M can identify and process the biological information for each biosensor.
[0125] <Modification Example 2> When the method of transmitting biological information from the headset 1 to the communication terminal M is wired, the first time acquisition unit 271 and the second time acquisition unit 281 are not necessarily required. Also, the first A / D conversion unit 275 and the second A / D conversion unit 285 may be provided in the communication terminal M.
[0126] <Modification Example 3> The ear sensors 272, 282 and / or the ground sensor 274 provided on the earpiece 2 are not necessarily required. In this case, the information acquired from one of the plurality of biosensors 6 provided on the arm 4 may be used as the ground potential information.
[0127] <Modification Example 4> Also, as described above, the sound output device 2 may be of a headphone type instead of an earpiece type. Further, the sound output device 2 may be a device that can fix the position of the arm 4 without outputting sound.
Explanation of Signs
[0128] 1 Headset 2 Sound output device 2R: First earpiece 2L: Second earpiece 4 Arm 6 Biosensor 8 Positioning mechanism 12 Slide mechanism 14 Moving mechanism 21: Housing 22: Ear tip 24: Driver unit 25: Battery 26: Nozzle 42: Extension part 60: Aperture 70: Substrate 272, 282: Ear sensor 274, 274: Ground sensor Sa: Satellite
Claims
1. A pair of sound output devices including a driver unit, An arm that connects the pair of sound output devices to each other, A positioning mechanism provided on the arm that moves in the front-rear direction of the user's head to position the arm, A biosensor provided on the arm that contacts the user's head to acquire biological information, A headset comprising the above.
2. The positioning mechanism is, The headset according to claim 1, which is provided in pairs at predetermined positions on the side of each sound output device, between the center position of the arm and each sound output device.
3. The headset according to claim 1, wherein at least one of the pair of positioning mechanisms includes a bellows mechanism.
4. The headset according to claim 1, further comprising an elastic member provided between the arm and the biosensor.
5. The headset according to claim 1, wherein the pair of sound output devices are each provided with a biosensor that contacts each ear of the user to acquire biological information.
6. The headset according to claim 5, wherein each biosensor provided in the pair of sound output devices includes contacting the ear canal to acquire biological information.
7. The headset according to claim 5, further comprising a communication unit that transmits each piece of biological information measured by the biosensor provided on the arm and each biosensor provided in the pair of sound output devices to an external device by wired communication or wireless communication.
8. The communication unit is, The headset according to claim 7, which includes transmitting each piece of biological information provided with synchronization information to the external device.
9. The arm is, The headset according to any one of claims 1 to 8, which has a moving mechanism for changing the position of the biosensor in the longitudinal direction of the arm.
Citation Information
Patent Citations
Audio headset with biosignal sensor
JP2011514745A