Memory fixation control device and memory fixation method

The memory consolidation device enhances memory retention by using brain activity information to stimulate hearing and apply sensory stimuli at optimal times, addressing the inefficiencies of existing technologies.

JP7757641B2Active Publication Date: 2025-10-22JVC KENWOOD CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021105833
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-25
Publication Date
2025-10-22
Estimated Expiration
2041-06-25

AI Technical Summary

Technical Problem

Existing technologies provide sensory stimuli without considering the subject's memory retention state, making it difficult to efficiently consolidate memories.

Method used

A memory consolidation control device that acquires brain activity information, determines the activity state of specific brain regions, plays content to stimulate hearing, and applies multimodal sensory stimuli based on the activity state to enhance memory consolidation.

Benefits of technology

Efficiently solidifies memories by determining optimal times for auditory and sensory stimulation based on brain activity, promoting memory retention.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007757641000001
    Figure 0007757641000001
  • Figure 0007757641000002
    Figure 0007757641000002
  • Figure 0007757641000003
    Figure 0007757641000003
Patent Text Reader

Abstract

To fix a memory efficiently to a subject.SOLUTION: The memory fixing control apparatus includes an acquisition part for acquiring brain activity information showing the active state of a brain of a subject, a state determination part for determining the active state of a prescribed portion of the brain of the subject based on the acquired brain activity information, a reproduction control part for allowing a reproducer to reproduce a content stimulating a hearing sensation of the subject according to a determination result by the state determination part, and a memory fixing determination part for determining whether the content is fixed as a memory or not.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a memory fixing control device and a memory fixing method. [Background technology]

[0002] BACKGROUND ART There is known a technique for enhancing the cognitive domain of a subject by providing sensory stimulation to the subject in a sleeping state (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2021-503339 Summary of the Invention [Problem to be solved by the invention]

[0004] The technology described in Patent Document 1 provides sensory stimuli regardless of whether the subject has retained their memory, making it difficult to efficiently retain their memory. Therefore, there is a need for a technology that can efficiently retain memories in subjects.

[0005] The present invention has been made in view of the above, and has as its object to provide a memory consolidation control device and a memory consolidation method that can efficiently consolidate memories in a subject. [Means for solving the problem]

[0006] The memory consolidation control device of the present invention comprises an acquisition unit that acquires brain activity information indicating the activity state of the subject's brain, a state determination unit that determines the activity state of a specific part of the subject's brain based on the acquired brain activity information, a playback control unit that causes a playback device to play content that stimulates the subject's hearing based on the determination result of the state determination unit, and a memory consolidation determination unit that determines whether the content has been consolidated as a memory.

[0007] The memory consolidation method of the present invention includes acquiring brain activity information indicating the activity state of a subject's brain, determining the activity state of a specific part of the subject's brain based on the acquired brain activity information, playing content that stimulates the subject's hearing on a playback device according to the activity state determination result, and determining whether the content has been consolidated as a memory. [Effects of the Invention]

[0008] According to the present invention, it is possible to efficiently solidify memories in subjects. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram showing an example of a memory fixing device according to the present embodiment. [Figure 2] FIG. 2 is a functional block diagram showing an example of the memory fixing device according to the present embodiment. [Figure 3] FIG. 3 is a diagram showing an example of sleep levels. [Figure 4] FIG. 4 is a graph showing an example of the change over time in the deoxyhemoglobin concentration of a subject. [Figure 5] FIG. 5 is a diagram showing an example of time-dependent changes in the sleep level of a subject. [Figure 6] FIG. 6 is a flowchart showing an example of the operation of the control device. [Figure 7] FIG. 7 is a diagram showing an example of the change over time in the sleep level of a subject. [Figure 8] FIG. 8 is a flowchart showing an example of the operation of the control device. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of a memory fixation control device and a memory fixation method according to the present invention will be described with reference to the accompanying drawings. Note that the present invention is not limited to these embodiments. Furthermore, the components in the following embodiments include those that are easily replaceable by those skilled in the art, or those that are substantially the same.

[0011] 1 is a schematic diagram showing an example of a memory fixation device 100 according to this embodiment. As shown in FIG. 1, the memory fixation device 100 includes a detection device 10, a setting device 20, a control device (memory fixation control device) 30, a playback device 40, and a stimulus providing device 50.

[0012] The detection device 10 detects brain activity information indicating the activity state of the subject's brain. As the detection device 10, for example, a measurement device that measures cerebral blood flow based on the principle of fNIRS (functional Near-Infrared Spectroscopy) is used. Note that the detection device 10 is not limited to a measurement device based on the principle of fNIRS, and for example, a measurement device that measures based on the principle of fMRI (functional Magnetic Resonance Imaging) that measures brain activity as brain activity information may be used.

[0013] The detection device 10 includes, for example, a head-mounted unit 11, a plurality of optical fiber channels 12, and an information generating unit 13. The head-mounted unit 11 is attached to the head of the subject. The optical fiber channel 12 includes an emitting optical fiber 12a that emits near-infrared light from a light source (not shown) to the subject's head, and a receiving optical fiber 12b that receives near-infrared light reflected or scattered inside the subject's head and sends the light to the information generating unit 13. The optical fiber 12a and the optical fiber 12b are positioned at positions where the Wernicke's area of ​​the subject's brain can be measured. Note that the optical fiber 12a and the optical fiber 12b may be positioned at positions where the Broca's area can be measured in addition to or instead of the Wernicke's area of ​​the subject's brain.

[0014] The information generating unit 13 calculates the oxygenated hemoglobin concentration as brain activity information based on the near-infrared light transmitted from the light-receiving optical fiber 12b. The information generating unit 13 may calculate at least one of the deoxygenated hemoglobin concentration and the total hemoglobin concentration as brain activity information, in addition to or instead of the oxygenated hemoglobin concentration. In this embodiment, the brain activity information calculated by the information generating unit 13 is activity information about the Wernicke's area of ​​the subject's brain. The optical fiber 12b and the information generating unit 13 may be connected by wire or wirelessly. The information generating unit 13 may be built into the head-mounted unit 11.

[0015] The setting device 20 inputs setting information for the memory fixing device 100. The setting information includes, for example, information about the content to be played back by the playback device 40. The setting device 20 may be an input device such as a keyboard or a mouse, or may be a smartphone or tablet with a touch panel.

[0016] The control device 30 comprehensively controls the operation of the memory fixing device 100. The control device 30 has a processing device such as a CPU (Central Processing Unit) and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory).

[0017] The playback device 40 plays back the first content and the second content under the control of the playback control unit 33. The playback device 40 has, for example, a speaker that outputs sound. The speaker may be, for example, mounted on headphones that can be worn on the head of the subject.

[0018] The stimulus application device 50 is a device that stimulates a sense other than the subject's hearing. The stimulus application device 50 includes, for example, a visual stimulus unit 51 that stimulates the subject's vision, a tactile stimulus unit 52 that stimulates the subject's tactile sense, and an olfactory stimulus unit 53 that stimulates the subject's olfactory sense. The visual stimulus unit 51 can be, for example, an eye mask with a light irradiation function. The tactile stimulus unit 52 can be, for example, a glove-type tactile device. The olfactory stimulus unit 53 can be, for example, a device that can spray a fragrance component such as an air freshener. The stimulus application device 50 can apply multimodal stimuli to the subject by applying stimuli corresponding to words in content played on the playback device 40 as stimuli for the vision, touch, and smell.

[0019] Next, the configuration of the control device 30 according to this embodiment will be described. Fig. 2 is a functional block diagram showing an example of the memory consolidation device 100 according to this embodiment. As shown in Fig. 2, the control device 30 has an acquisition unit 31, a state determination unit 32, a playback control unit 33, a stimulus control unit 34, a memory consolidation determination unit 35, and a storage unit 36.

[0020] The acquisition unit 31 acquires the brain activity information generated by the information generation unit 13 of the detection device 10. The acquisition unit 31 may be configured to have the functions of the information generation unit 13 described above. In other words, the acquisition unit 31 may be configured to directly acquire a signal sent from the optical fiber 12b of the detection device 10 and calculate the brain activity information. The acquisition unit 31 acquires the brain activity information at predetermined intervals.

[0021] The state determination unit 32 determines the activity state of a predetermined region of the subject's brain based on the brain activity information acquired by the acquisition unit 31. The timing at which the state determination unit 32 determines the activity information can be, for example, the same as or corresponding to the timing at which the acquisition unit 31 acquires the brain activity information. In this embodiment, the predetermined region of the brain is, for example, Wernicke's area. The activity state can be set to two stages: an adaptive state (predetermined state) that is suitable for memory consolidation, and a non-adaptive state that is not suitable for memory consolidation.

[0022] Figure 3 shows an example of the change over time in the oxygenated hemoglobin concentration of a subject. When brain cells are active, oxygen molecules are released from the oxygenated hemoglobin in the blood (deoxidation), converting it to deoxygenated hemoglobin, and the oxygen molecules produced by deoxidation are transported to brain cells. In other words, a state in which the oxygenated hemoglobin concentration is low and the deoxygenated hemoglobin concentration is high can be recognized as a state in which brain cells are actively active and deoxygenation is occurring actively. On the other hand, a state in which the oxygenated hemoglobin concentration is high and the deoxygenated hemoglobin concentration is low can be recognized as a state in which deoxygenation is not occurring as actively and brain cells have ample room for activity.

[0023] Therefore, as shown in FIG. 3, for example, the state determination unit 32 can determine that the state is adaptive when the oxyhemoglobin concentration in the Wernicke's area of ​​the brain is equal to or greater than a predetermined threshold A1, and can determine that the state is non-adaptive when the oxyhemoglobin concentration in the Wernicke's area of ​​the brain is less than the threshold A1.

[0024] The state determination unit 32 may determine the sleep level of the subject. The timing at which the state determination unit 32 determines the sleep level may be the same as or correspond to the timing at which the acquisition unit 31 acquires the brain activity information, or may be different from or not correspond to the timing at which the acquisition unit 31 acquires the brain activity information.

[0025] 4 is a diagram showing an example of sleep levels. As shown in FIG. 4, in this embodiment, the sleep levels can be set to six levels, for example, level 0 for an awake state (a state that is not asleep), level 1 for REM sleep, level 2 for stage 1 of non-REM sleep, level 3 for stage 2 of non-REM sleep, level 4 for stage 3 of non-REM sleep, and level 5 for stage 4 of non-REM sleep. Note that the sleep level settings are not limited to the above and may be set to, for example, five or fewer levels or seven or more levels. The state determination unit 32 may determine the sleep level using the brain activity information acquired by the acquisition unit 31, or may determine the sleep level using brain waves and heart rate detected by an electroencephalograph or heart rate monitor, or the person's movements and vibrations during sleep detected by a three-axis acceleration sensor or the like.

[0026] Based on the determination result of the state determination unit 32, the playback control unit 33 causes the playback device 40 to play content that stimulates the auditory sense of the subject. In this embodiment, the content is, for example, audio set by the subject using the setting device 20, and includes first content including details to be memorized by the subject, and second content different from the first content. Examples of the second content include music related to the content of the first content, music that calms the subject, and advertising audio that appeals to the subject about products and services.

[0027] When the state determination unit 32 determines that the sleep level is the first level and that the activity state is the adaptive state, the playback control unit 33 causes the playback device 40 to play the first content as the content. In this embodiment, the first level can be, for example, level 1, where the subject is in REM sleep. During period L (see FIG. 4) in the non-adaptive state, the playback control unit 33 controls so that the first content is not played even if the subject's sleep level is the first level. This avoids placing more strain than necessary on brain cells, allowing memory consolidation to occur efficiently in a state where brain cells have room for activity.

[0028] When the state determination unit 32 determines that the sleep level is a second level different from the first level, the playback control unit 33 causes the playback device 40 to play the second content as the content. The second level can be a level of sleep that is deeper than the first level. In this embodiment, the second level can be, for example, a level corresponding to stage 1 or stage 2 of non-REM sleep in the subject, that is, level 2 or level 3. Note that the playback control unit 33 does not need to cause the playback of the second content. For example, when causing the playback device 40 to play audio of an advertisement as the second content, the playback control unit 33 can start the playback after a predetermined time has elapsed since the state determination unit 32 determined that the sleep level of the subject is at the second level, so as not to hinder the memory retention of the details of the first content.

[0029] After causing the playback device 40 to play the first content, the playback control unit 33 stops the first content if the state determination unit 32 determines that the sleep level is different from the first level or that the subject's brain activity state is not an adaptive state. Furthermore, after causing the playback device 40 to play the second content, the playback control unit 33 stops the second content if the state determination unit 32 determines that the sleep level is different from the second level.

[0030] The playback control unit 33 adjusts the playback mode of the content on the playback device 40 according to the determination result of the memory consolidation determination unit 35, which will be described later. For example, if the determination result of the memory consolidation determination unit 35 is a consolidation state (a state in which memory is consolidated: which will be described later), the playback control unit 33 may switch the content to be played on the playback device 40 from the currently played content (first content for memory) to another content. In this case, the content to be switched to may be another first content previously set by the subject, or the second content. When selecting the content to be switched from multiple types of first content, if the playback order is set by the setting device 20, the playback control unit 33 selects the first content based on the playback order setting. Furthermore, the playback control unit 33 may calculate the comprehension difficulty level based on the amount of language included in the first content, the field, etc., and select the first content based on the calculated comprehension difficulty level. In this case, the playback control unit 33 may select the first content, for example, in ascending or descending order of comprehension difficulty level. Furthermore, when the determination result of the memory fixation determination unit 35 is a non-fixed state (a state in which memory is not fixed: described later), the playback control unit 33 may cause the playback device 40 to repeatedly play the currently played content (first content for storage). Furthermore, when the determination result of the memory fixation determination unit 35 is a non-fixed state (a state in which memory is not fixed: described later), the playback control unit 33 may cause the playback device 40 to repeatedly play the currently played content.

[0031] The stimulus control unit 34 causes the stimulus providing device 50 to provide a stimulus to a sense other than the subject's hearing when content is played back on the playback device 40. For example, when a first content is played back on the playback device 40, the stimulus control unit 34 causes the stimulus providing device 50 to provide the subject with a stimulus corresponding to a word played back on the playback device 40.

[0032] FIG. 5 is a diagram showing an example of the correspondence between the types of stimuli provided to the subject and the words reproduced by the reproduction device 40. As shown in FIG. 5, for example, when the reproduction device 40 reproduces words representing visual conditions such as dazzling, flickering, strong sunlight, afternoon sun, and oncoming vehicle headlights, the stimulus control unit 34 can provide the subject with a visual stimulus via the visual stimulus unit 51. For example, when the reproduction device 40 reproduces words representing tactile conditions such as painful, hot, rough, smooth, and soft, the stimulus control unit 34 can provide the subject with a tactile stimulus via the tactile stimulus unit 52. For example, when the reproduction device 40 reproduces words representing olfactory conditions such as the scent of roses, the scent of Kikuno, the smell of rotten fish, and the smell of soy sauce, the stimulus control unit 34 can provide the subject with an olfactory stimulus via the olfactory stimulus unit 53.

[0033] The memory fixation determination unit 35 determines whether the content has been fixed as a memory. In this embodiment, the memory fixation determination unit 35 determines whether the content of the first content for storage set by the setting device 20 has been fixed as a memory. Note that the memory fixation determination unit 35 may also determine whether the content of the second content has been fixed as a memory.

[0034] FIG. 6 is a diagram showing an example of the temporal change in the concentration of oxyhemoglobin in the Wernicke's area of the subject. When the Wernicke's area can understand the meaning of language, it becomes possible to process the language without activating the activity in the Wernicke's area. Therefore, it is known that deoxidation is reduced and the concentration of oxyhemoglobin increases. On the other hand, when the Wernicke's area cannot understand the meaning of language, it is known that deoxidation is not reduced and the concentration of oxyhemoglobin does not increase. That is, in a state where the concentration of oxyhemoglobin is high, it can be determined that the Wernicke's area understands the meaning of language and the memory is established. On the other hand, in a state where the concentration of oxyhemoglobin is low, it can be determined that the Wernicke's area cannot understand the meaning of language and the memory is not established. Therefore, when the concentration of oxyhemoglobin in the Wernicke's area of the brain is equal to or higher than a predetermined threshold value A2, the memory fixation determination unit 35 determines that the memory is in a fixed state (hereinafter, the fixed state), and when it is less than the threshold value A2, it determines that the memory is in a non-fixed state (hereinafter, the non-fixed state). Note that for the threshold value A2 of the concentration of oxyhemoglobin in the Wernicke's area of the subject's brain, since it is assumed that the activity state is the adaptation state, A1 < A2 can be established. In the example shown in FIG. 6, the memory fixation determination unit 35 makes a determination for each predetermined unit period, and determines that the memory is in a fixed state when the concentration of oxyhemoglobin is equal to or higher than the threshold value A2 in at least a part of the unit period, but it is not limited thereto. Here, the memory fixation determination unit 35 may determine that the memory is in a fixed state when the concentration of deoxyhemoglobin in the Wernicke's area of the brain is less than a predetermined threshold value, and determine that the memory is in a non-fixed state when it is equal to or higher than the predetermined threshold value.

[0035] The storage unit 36 ​​stores various types of information. The storage unit 36 ​​has storage such as a hard disk drive or a solid state drive. Note that an external storage medium such as a removable disk may be used as the storage unit 36. The storage unit 36 ​​stores programs, data, etc. for executing various processes of the acquisition unit 31, the state determination unit 32, and the playback control unit 33 in the control device 30. The storage unit 36 ​​also stores the first content and the second content. The storage unit 36 ​​also stores the setting details set by the setting device 20.

[0036] The memory unit 36 ​​stores a program that causes a computer to execute the following processes: acquiring brain activity information indicating the activity state of the subject's brain; determining the activity state of a specific part of the subject's brain based on the acquired brain activity information; playing content that stimulates the subject's hearing on the playback device 40 according to the activity state determination result; and determining whether the content has been retained in memory.

[0037] Next, a memory fixation method using the memory fixation device 100 configured as described above will be described. The subject wears the head-mounted unit 11 of the detection device 10 on their head and adjusts the position so that the optical fiber channel 12 corresponds to Wernicke's area of ​​the brain. The subject sleeps in this state. Figure 7 is a diagram showing an example of changes in the subject's sleep level over time. In the example shown in Figure 7, the subject's sleep level gradually changes from level 0, which is an awake state, to a deep sleep state (e.g., level 5), and then repeatedly rises and falls over time.

[0038] The detection device 10 irradiates near-infrared light onto the subject's head from the optical fiber 12a and sends the near-infrared light received by the optical fiber 12b to the information generation unit 13. The information generation unit 13 calculates the oxyhemoglobin concentration in the Wernicke's area of ​​the subject's brain as brain activity information based on the near-infrared light sent from the optical fiber 12b.

[0039] In the control device 30, the acquisition unit 31 acquires the brain activity information generated by the information generation unit 13. The state determination unit 32 determines the sleep level of the subject, and determines the activity state of a predetermined part of the subject's brain based on the brain activity information acquired by the acquisition unit 31.

[0040] In the example shown in FIG. 7 , at time t1, the state determination unit 32 determines that the subject's sleep level is level 3. In this case, the playback control unit 33 controls the playback device 40 to play the second content C2 as the content. The subject in a level 3 sleep state has their hearing stimulated by the second content C2 played from the playback device 40. For example, when the hearing is stimulated by music related to the content of the first content, memory can be consolidated even in a level 3 or level 4 sleep state. Furthermore, when the hearing is stimulated by music that calms the subject, the subject is put into a calm state, thereby suppressing the accumulation of fatigue. Furthermore, when the hearing is stimulated by advertising audio, the content of a product or service can be efficiently promoted to a subject in a level 3 or level 4 sleep state. After time t1, the determination result of the subject's sleep level remains at level 3 for a certain period of time and then changes to level 2. During this period, the playback control unit 33 continues playing the second content C2.

[0041] Also, at time t2, the state determination unit 32 determines that the subject's sleep level has changed to level 1. In this case, the playback control unit 33 checks whether the state determination unit 32 determines that the subject's activity state is an adaptive state. If the state determination unit 32 determines that the subject's activity state is an adaptive state, the playback of the second content C2 is stopped, and the playback device 40 plays the first content C1. The subject in REM sleep (level 1 sleep state) has their hearing stimulated by the first content C1 played from the playback device 40. This stimulation causes the content contained in the first content C1 to be fixed in the brain as memory. Note that when the first content C1 is being played, the stimulation control unit 34 may also cause the stimulation device 50 to stimulate a sense other than hearing.

[0042] When the first content C1 is played back by the playback device 40, the memory fixation determination unit 35 determines whether the content of the first content C1 has been fixed as memory by the subject (whether it is a fixed state or an unfixed state). If the memory fixation determination unit 35 determines that the content of the first content C1 has been fixed, the playback control unit 33 can stop the playback of the first content C1 or change the content of the first content C1 and play it back from the playback device 40. If the memory fixation determination unit 35 determines that the content of the first content C1 has not been fixed, the playback control unit 33 can cause the playback device 40 to repeatedly play back the content of the first content C1.

[0043] Furthermore, during a period L from time t3 to time t4, the state determination unit 32 determines that the subject's activity state is in a non-adaptive state. In this case, the playback control unit 33 stops the playback of the first content C1. At time t4, the determination result of the subject's activity state is again in an adaptive state. In this case, the playback control unit 33 resumes the playback of the first content C1.

[0044] After the playback of the first content C1 is resumed, the determination result of the subject's sleep level changes to level 2 at time t5. In this case, the playback control unit 33 stops the playback of the first content C1 and starts the playback of the second content C2. After time t5, the determination result of the subject's sleep level remains at level 2 for a certain period of time and then changes to level 3. During this period, the playback control unit 33 continues the playback of the second content C2. Furthermore, at time t6, the determination result of the subject's sleep level changes to level 4. In this case, the playback control unit 33 stops the playback of the second content C2.

[0045] In this way, since the memory consolidation determination unit 35 determines whether the state is consolidated or not, it is possible to easily determine whether the details of the first content C1 have been consolidated as a memory by the subject. Furthermore, the playback control unit 33 adjusts the playback mode of the content on the playback device 40 according to the determination result of the memory consolidation determination unit 35, so that the content can be played back according to the consolidation state of the memory of the subject. Furthermore, the stimulus control unit 34 causes the stimulus imparting device 50 to impart a stimulus to a sense other than the subject's hearing when the content is played back from the playback device 40, so that the consolidation of the memory in the subject can be promoted.

[0046] Fig. 8 is a flowchart showing an example of the operation of the control device 30. As shown in Fig. 8, the acquisition unit 31 acquires the brain activity information generated by the information generation unit 13 (step S10). The state determination unit 32 determines the sleep level of the subject, and determines the activity state of a predetermined part of the subject's brain based on the brain activity information acquired by the acquisition unit 31 (step S20).

[0047] If the state determination unit 32 determines that the sleep level is the first level and the activity state is the adaptive state (Yes in step S30), the playback control unit 33 determines whether the second content is being played back (step S40). If the playback control unit 33 determines that the second content is being played back (Yes in step S40), the playback control unit 33 stops the playback of the second content (step S50). If the playback control unit 33 determines that the second content is not being played back (No in step S40) or has stopped the playback of the second content, the playback control unit 33 determines whether the first content is being played back (step S60). If the playback control unit 33 determines that the first content is not being played back (No in step S60), the playback control unit 33 causes the playback device 40 to play the first content (step S70). If the playback control unit 33 determines that the first content is being played back (Yes in step S60), the playback control unit 33 skips step S70 and performs the processes from step S150 onwards, which will be described later.

[0048] If it is determined in step S30 that the sleep level is not the first level or the activity state is not the adaptive state (No in step S30), the playback control unit 33 determines whether the first content is being played back (step S80).If it is determined that the first content is being played back (Yes in step S80), the playback control unit 33 stops the playback of the first content (step S90).

[0049] If the playback control unit 33 determines that the first content is not being played back (No in step S80) or if the playback of the first content has stopped, the playback control unit 33 determines whether the sleep level determination result is the second level. If the playback control unit 33 determines that the sleep level determination result is the second level (Yes in step S100), the playback control unit 33 determines whether the second content is being played back (step S110). If the playback control unit 33 determines that the second content is not being played back (No in step S110), the playback control unit 33 causes the playback device 40 to play the second content (step S120). If the playback control unit 33 determines that the second content is being played back (Yes in step S110), the playback control unit 33 skips step S120 and ends the process.

[0050] Furthermore, if the playback control unit 33 determines that the sleep level determination result is not the second level (No in step S100), it determines whether the second content is being played back (step S130). If the playback control unit 33 determines that the second content is being played back (Yes in step S130), it stops the playback of the second content (step S140). If the playback control unit 33 determines that the second content is not being played back (No in step S130), it skips step S140 and ends the process.

[0051] If step S70 has been performed or if the process of step S60 is No, the stimulus control unit 34 determines whether or not a predetermined word is included in the first content played back from the playback device 40 (step S150). If the stimulus control unit 34 determines that the predetermined word is included (Yes in step S150), it causes the stimulus providing device 50 to provide a sensory stimulus corresponding to the word to the subject (step S160). If the stimulus control unit 34 determines that the predetermined word is not included (No in step S150), it skips the process of step S160.

[0052] If step S160 has been performed or if the process of step S150 is No, the memory fixation determination unit 35 determines whether the details of the first content have been fixed as memory by the subject (fixed state or not fixed state) (step S170). The playback control unit 33 changes at least one of the content to be played back by the playback device 40 and the playback mode of the content in the playback device 40, depending on the determination result of the memory fixation determination unit 35 (step S180).

[0053] In step S180, if the memory fixation determination unit 35 determines that the state is fixed, the playback control unit 33 can perform processing such as stopping the playback of the first content, or if multiple first contents are set in the setting device 20, playing the next first content.

[0054] Furthermore, if the memory fixation determination unit 35 determines in step S180 that the content is not fixed, the playback control unit 33 can perform processing such as causing the repeat playback device 40 to play back the details of the first content, or causing the playback device 40 to play back second content that helps understand the details of the first content, etc. When causing the repeat playback device 40 to play back the details of the first content, the playback speed may be changed, for example, by slowing down the playback speed.

[0055] As described above, the control device 30 according to this embodiment includes an acquisition unit 31 that acquires brain activity information indicating the activity state of the subject's brain, a state determination unit 32 that determines the activity state of a specific part of the subject's brain based on the acquired brain activity information, a playback control unit 33 that causes the playback device 40 to play content that stimulates the subject's hearing in accordance with the determination result of the state determination unit 32, and a memory consolidation determination unit 35 that determines whether the content has been consolidated as memory.

[0056] In addition, the memory consolidation method according to this embodiment includes acquiring brain activity information indicating the activity state of the subject's brain, determining the activity state of a specific part of the subject's brain based on the acquired brain activity information, causing the playback device 40 to play content that stimulates the subject's hearing based on the activity state determination result, and determining whether the content of the content has been consolidated as memory.

[0057] According to this configuration, a determination is made as to whether the content played back from the playback device 40 has been fixed in the subject's memory, so that it is easy to determine whether the content has been fixed in the subject's memory or not, and the memory can be fixed in the subject efficiently.

[0058] In the control device 30 according to this embodiment, the playback control unit 33 changes at least one of the content played back by the playback device 40 and the playback mode of the content in the playback device 40, depending on the determination result of the memory consolidation determination unit 35. In this configuration, by changing at least one of the content and the playback mode depending on the memory consolidation status of the subject, it is possible to allow the subject to efficiently consolidate their memory.

[0059] In the control device 30 according to this embodiment, the predetermined state is a state in which the oxygenated hemoglobin concentration in the Wernicke's area of ​​the subject's brain is equal to or greater than the first threshold A1. This configuration allows for efficient memory consolidation according to the activity state of the subject's language center.

[0060] In the control device 30 according to this embodiment, the memory consolidation determination unit 35 determines that the content has been consolidated as a memory when the oxyhemoglobin concentration in the Wernicke's area of ​​the subject's brain is equal to or greater than the second threshold A2. With this configuration, it is easy to determine whether the content has been consolidated as a memory in the subject based on the activity state of the subject's language center.

[0061] The control device 30 according to this embodiment further includes a stimulus control unit 34 that causes a stimulus application device to apply a stimulus to a sense other than the auditory sense of the subject when the content is played back. With this configuration, it is possible to apply multimodal stimuli to the senses other than the auditory sense of the subject, thereby efficiently solidifying the memory.

[0062] The technical scope of the present invention is not limited to the above-described embodiments, and appropriate modifications can be made without departing from the spirit of the present invention. For example, in the above-described embodiments, Level 1 (a state in REM sleep) is used as an example of the first level of sleep, but this is not limiting. Note that the first level may be, for example, in addition to or instead of Level 1, a level corresponding to Stage 1 or Stage 2 of non-REM sleep in which the subject is sleeping, i.e., Level 2 or Level 3.

[0063] <Variation 1> Furthermore, when the state determination unit 32 determines the activity state of a predetermined region of the subject's brain, the threshold value of the oxyhemoglobin concentration may be changed depending on the sleep level. For example, when the sleep level corresponding to the first level is high (wakefulness is low), the threshold value of the oxyhemoglobin concentration can be increased, and when the sleep level corresponding to the first level is low (wakefulness is high), the threshold value of the oxyhemoglobin concentration can be decreased. In this way, auditory stimuli can be applied to the subject more easily when the wakefulness level is high and more carefully when the wakefulness level is low, thereby reducing the impact on the subject's health.

[0064] <Variation 2> Although the state determination unit 32 can determine whether the subject is in an adaptive state or a non-adaptive state based on whether the oxyhemoglobin concentration in the Wernicke's area is greater than or equal to a predetermined value, the difference between the oxyhemoglobin concentration and the deoxyhemoglobin concentration in the Wernicke's area may be used instead of the oxyhemoglobin concentration in the Wernicke's area. That is, the state determination unit 32 determines the subject to be in an adaptive state when the difference between the oxyhemoglobin concentration and the deoxyhemoglobin concentration in the Wernicke's area is greater than or equal to a predetermined value B1, and determines the subject to be in a non-adaptive state when the difference between the oxyhemoglobin concentration and the deoxyhemoglobin concentration in the Wernicke's area is less than the predetermined value B1. In this manner, when both the oxyhemoglobin concentration and the deoxyhemoglobin concentration are high, providing an auditory stimulus to the subject can effectively reduce the impact on the subject's health without forcing the subject to further supply oxyhemoglobin. Furthermore, by using the difference between the oxygenated hemoglobin concentration and the deoxygenated hemoglobin concentration, a relative value can be obtained, which makes it easier to tolerate individual differences.

[0065] <Variation 3> Furthermore, although the memory consolidation determination unit 35 determines whether the memory is consolidated or not based on whether the oxyhemoglobin concentration in the Wernicke's area of ​​the brain is above or below a predetermined threshold, the memory consolidation determination unit 35 may use the difference between the oxyhemoglobin concentration and the deoxyhemoglobin concentration in the Wernicke's area of ​​the brain instead of the oxyhemoglobin concentration in the Wernicke's area of ​​the brain. That is, the memory consolidation determination unit 35 may determine that the memory is consolidated when the difference between the oxyhemoglobin concentration and the deoxyhemoglobin concentration in the Wernicke's area of ​​the brain is above a predetermined value B2, and may determine that the memory is not consolidated when the difference is below the predetermined value B2.

[0066] <Variation 4> In addition, although the state determination unit 32 has been exemplified as determining the activity state of Wernicke's area as a predetermined region of the brain, Broca's area may also be included as a predetermined region of the brain. That is, the state determination unit 32 may determine an adaptive state when the oxyhemoglobin concentrations in both Wernicke's area and Broca's area of ​​the brain are equal to or greater than predetermined values ​​(thresholds A1 and C1, respectively), and may determine a non-adaptive state when the oxyhemoglobin concentrations in at least one of Wernicke's area and Broca's area of ​​the brain are less than thresholds A1 and C1, respectively. In this case, the memory consolidation determination unit 35 determines a memory consolidation state when the oxyhemoglobin concentrations in both Wernicke's area and Broca's area of ​​the brain are equal to or greater than predetermined values ​​(thresholds A2 and C2, respectively), and may determine a memory non-consolidation state when the oxyhemoglobin concentrations in at least one of Wernicke's area and Broca's area of ​​the brain are less than thresholds A2 and C2, respectively.

[0067] It should be noted that each of the above modifications can be combined with other modifications. [Explanation of symbols]

[0068] 10...detection device, 11...head-mounted unit, 12...optical fiber channel, 12a, 12b...optical fiber, 13...information generation unit, 20...setting device, 30...control device, 31...acquisition unit, 32...state determination unit, 33...playback control unit, 34...stimulation control unit, 35...memory consolidation determination unit, 36...memory unit, 40...playback device, 50...stimulation device, 51...visual stimulation unit, 52...tactile stimulation unit, 53...olfactory stimulation unit, 100...memory consolidation device

Claims

1. an acquisition unit that acquires brain activity information indicating the oxyhemoglobin concentration or the deoxyhemoglobin concentration in the Wernicke's area and the Broca's area of ​​the brain of the subject; a state determination unit that determines whether an activity state of a predetermined region of the subject's brain is in a predetermined state based on the acquired brain activity information; a playback control unit that causes a playback device to play content that stimulates the auditory sense of the subject in accordance with a determination result of the state determination unit; a memory consolidation determination unit that determines whether the content has been consolidated as a memory based on the acquired brain activity information; Equipped with The predetermined state is a state in which the oxygenated hemoglobin concentration in the Wernicke's area of ​​the brain of the subject is equal to or higher than a first threshold. Memory consolidation control device.

2. The playback control unit changes at least one of the content to be played back by the playback device and the playback mode of the content in the playback device according to the determination result of the storage stability determination unit. The memory fixing control device according to claim 1 .

3. The memory consolidation determination unit determines that the content has been consolidated as a memory when the oxyhemoglobin concentration in the Wernicke's area of ​​the brain of the subject is equal to or greater than a second threshold.

3. The memory fixing control device according to claim 1 or 2.

4. a stimulus control unit that causes a stimulus applying device to apply a stimulus to a sense other than the hearing of the subject when the content is played back; The memory fixing control device according to any one of claims 1 to 3.

5. acquiring brain activity information indicating oxyhemoglobin concentration or deoxyhemoglobin concentration in Wernicke's area and Broca's area of ​​the brain of the subject; determining whether an activity state of a predetermined region of the subject's brain is in a predetermined state based on the acquired brain activity information; causing a playback device to play content that stimulates the subject's hearing in accordance with the determination result of the active state; determining whether the content has been retained as a memory based on the acquired brain activity information; Including, The predetermined state is a state in which the oxygenated hemoglobin concentration in the Wernicke's area of ​​the brain of the subject is equal to or higher than a first threshold. Memory consolidation method.

6. An acquisition unit that acquires brain activity information indicating oxyhemoglobin concentration or deoxyhemoglobin concentration in Wernicke's area and Broca's area of ​​the brain of a subject; a state determination unit that determines whether an activity state of a predetermined region of the subject's brain is in a predetermined state based on the acquired brain activity information; a playback control unit that causes a playback device to play content that stimulates the auditory sense of the subject in accordance with a determination result of the state determination unit; a memory consolidation determination unit that determines whether the content has been consolidated as a memory based on the acquired brain activity information; Equipped with The memory consolidation determination unit determines that the content has been consolidated as a memory when the oxyhemoglobin concentration in the Wernicke's area of ​​the brain of the subject is equal to or greater than a second threshold. Memory consolidation control device.

Citation Information

Patent Citations

  • Auxiliary learning method based on brain-computer interface, terminal and computer storage medium

    CN111443799A

  • Method and apparatus for enhancing memory consolidation

    JP2018505712A

  • SYSTEM AND METHOD FOR PROVIDING SENSORY STIMULUS TO A USER TO ENHANCE THE USER'S COGNITIVE DOMAIN - Patent application

    JP2021503339A

  • Closed-loop intervention control system

    US20180068581A1

  • Apparatus, system, and methods for targeted memory enhancement during sleep

    US20180092600A1