Method for presenting information for dementia examination

By integrating the cognitive function test control unit and analysis unit into the electronic device and using brain wave measurement technology to present strange tasks in daily activities, the problem of psychological burden on the examinee in the existing technology is solved and a load-free cognitive function test is achieved.

CN115153584BActive Publication Date: 2025-09-12MAXELL LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202210789476.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2017-04-28
Publication Date
2025-09-12
Estimated Expiration
2037-04-28

AI Technical Summary

Technical Problem

Existing dementia examination technologies put psychological strain on the examinee, affecting the examination results.

Method used

By integrating a cognitive function test control unit and a cognitive function analysis unit into an electronic device, the subject's brain wave data is analyzed by using brain wave measurement technology to perform unusual tasks during daily activities and to extract cognitive function indicators.

Benefits of technology

It is possible to obtain necessary cognitive function examination data without causing psychological burden on the subjects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115153584B_ABST
    Figure CN115153584B_ABST
Patent Text Reader

Abstract

The present disclosure provides a method for presenting information for dementia examinations, and a technology for obtaining data required for cognitive function examinations without placing a psychological burden on a subject. To this end, an electronic device (101) is provided, which obtains and analyzes brain wave data of a subject, and comprises: a cognitive function examination control unit (109) for presenting examination data used in the cognitive function examination of the subject when the subject performs an action having a purpose different from that of measuring brain waves; and a cognitive function analysis unit (111) for extracting an index of the cognitive function of the subject from the brain wave data of the subject measured when presenting the examination data.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application. The filing date of the parent application is April 28, 2017. The international application number is PCT / JP2017 / 016991. The application number entering the Chinese national phase is 201780089712.7. The name of the invention is “Brain wave data analysis system, information processing terminal, electronic device and method for presenting information for dementia examination”. Technical Field

[0002] The present invention relates to electronic devices, and more particularly to electronic devices capable of testing cognitive functions using electroencephalogram technology. Background Art

[0003] Among relatively inexpensive brain measurement technologies used for dementia screening is near-infrared spectroscopy, described in Patent Document 1. Patent Document 1 describes the system as comprising: a data acquisition unit that acquires biosignal data from a predetermined brain region of a subject, measured while a task is performed to activate the brain; a feature extraction unit that extracts feature quantities from the biosignal data acquired by the data acquisition unit; and a determination unit that determines the degree of cognitive impairment in the subject based on the feature quantities extracted by the feature extraction unit and pre-determined data used for determining cognitive impairment.

[0004] Another example of an electroencephalogram recognition method adjustment device and method using the P300 is the technology described in Patent Document 2. Patent Document 2 describes "a device for adjusting an identification method in an electroencephalogram interface unit, comprising: a database defining the correlation between the P3 component of an event-related potential obtained by stimulation in a non-visual form and the P3 component of a visual event-related potential; a stimulus presentation unit that presents the stimulus via the output unit; an analysis unit that analyzes the event-related potential contained in the electroencephalogram signal after the stimulus presentation; and an identification method adjustment unit that derives a feature value of the user related to the P3 component of the visual event-related potential based on the analyzed P3 component of the event-related potential and the database, and adjusts the electroencephalogram recognition method in the electroencephalogram interface unit based on the feature value."

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: U.S. Patent No. 9,131,889

[0008] Patent Document 2: Japanese Patent Application Laid-Open No. 2009-268826 Summary of the Invention

[0009] The test described in Patent Document 1 requires the subject to wear a near-infrared spectrometer. Furthermore, in Patent Document 2, the subject is aware of the cognitive function test. Therefore, performing the tests described in Patent Documents 1 and 2 may place a psychological burden on the subject.

[0010] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technology for obtaining data required for cognitive function testing without imposing a psychological burden on a subject.

[0011] To solve the above-mentioned problems, the present invention has the structure described in the claims. In one example, the present invention is an electronic device that acquires and analyzes electroencephalogram data of a subject, and is characterized by comprising: a cognitive function test control unit that presents test data for testing the subject's cognitive function when an action having a purpose different from electroencephalogram measurement is performed on the subject; and a cognitive function analysis unit that extracts an index of the subject's cognitive function from the subject's electroencephalogram data measured when the test data is presented.

[0012] Another example of the present invention is a method for presenting information for dementia examination, which is performed by an electronic device having a screen and a call function, and is characterized in that it includes: an incoming call step, an incoming call; and a presentation step, during the execution of an action for notifying a user of the electronic device of an incoming call, randomly presenting information related to the caller of the call as information for the dementia examination.

[0013] According to the present invention, it is possible to provide a technique for obtaining data required for cognitive function testing without imposing a psychological burden on the subject. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a functional block diagram of a cognitive function testing device.

[0015] Figure 2 This is a hardware diagram of a smartphone that is a cognitive function testing device.

[0016] Figure 3A This is a rear view showing an example of how the cognitive function testing device is mounted on a smartphone.

[0017] Figure 3B This is a side view showing an example of how the cognitive function testing device is mounted on a smartphone.

[0018] Figure 3C This is a front view showing an example of mounting the cognitive function testing device on a smartphone.

[0019] Figure 4 Graph showing the basic waveform of event-related potential.

[0020] Figure 5A This is a diagram of the guardian table structure.

[0021] Figure 5B It is a structural diagram of a standard table.

[0022] Figure 6A This is a diagram showing an example of how to use a smartphone when a call comes in (Incoming Call).

[0023] Figure 6B This diagram shows an example of how to use a smartphone when a call comes in (holding the smartphone).

[0024] Figure 6C This is a diagram (visual stimulation) showing an example of how to use a smartphone when a call comes in.

[0025] Figure 6D This diagram shows an example of how to use a smartphone when a call comes in (auditory stimulation).

[0026] Figure 7 This is a diagram showing the flow of an initial setting test for creating inspection data.

[0027] Figure 8 It is a diagram showing the flow of the inspection data creation unit.

[0028] Figure 9 This is a diagram showing the overall processing flow of a cognitive function test using a smartphone equipped with a dementia test function.

[0029] Figure 10 It is a diagram showing a structural example of inspection data.

[0030] Figure 11A FIG2 is a diagram showing an example of test data for an oddball task (visual stimulation).

[0031] Figure 11B : is a diagram showing an example of test data of an oddball task (auditory stimulation).

[0032] Figure 12 It is a diagram showing an example of the data structure of electroencephalogram data.

[0033] Figure 13 It is a diagram showing an example of the structure of analysis data.

[0034] Figure 14 This is a diagram showing an example of the data structure (period average) of cognitive function analysis results.

[0035] Figure 15 This is a diagram showing the flow of the cognitive function analysis unit.

[0036] Figure 16 : is a figure which shows the example of the cognitive function analysis result.

[0037] Figure 17 This is a functional block diagram of a cognitive function testing device equipped with a priority sensory analysis unit.

[0038] Figure 18 This is a diagram showing the process of the priority sensory analysis unit.

[0039] Figure 19A This is a diagram showing an example of how to use the smartphone alarm (when ringing / vibrating).

[0040] Figure 19B This figure shows an example of how to use the smartphone alarm clock (in a handheld state).

[0041] Figure 19C This is a diagram (visual stimulation) showing an example of how to use a smartphone alarm clock.

[0042] Figure 19D This is a diagram showing an example of how to use the alarm clock of a smartphone (OFF button display).

[0043] Figure 20A This is a back view showing an example of how the cognitive function test device is mounted on a smartphone case.

[0044] Figure 20B This is a side view showing an example of how the cognitive function testing device is mounted on a smartphone case.

[0045] Figure 20C This is a front view showing an example of how a cognitive function test device can be mounted on a smartphone case.

[0046] Figure 20D This is a front view showing an example of how the cognitive function testing device is mounted on a smartphone case (when a smartphone is mounted).

[0047] Figure 21A This is a diagram showing an example of attachment to a pair of glasses or sunglasses equipped with an electroencephalogram measurement function.

[0048] Figure 21B This is a front view of a cognitive function testing device (smartphone) that works with eyeglasses or sunglass frames.

[0049] Figure 21C This is a front view of a cognitive function testing device (tablet PC) that cooperates with eyeglasses or sunglass frames.

[0050] Figure 21DThis is a front view of a cognitive function testing device (TV) that cooperates with eyeglasses or sunglass frames.

[0051] Figure 22A This diagram shows headphones equipped with an electroencephalogram measurement function.

[0052] Figure 22B This is a diagram showing a cognitive function testing device (radio receiver) that cooperates with headphones equipped with an electroencephalogram measurement function.

[0053] Figure 23A This is a front view showing a hearing aid equipped with an electroencephalogram measurement function.

[0054] Figure 23B This is a rear view showing a hearing aid equipped with an electroencephalogram measurement function.

[0055] Figure 23C This is a diagram showing a wearing state of a hearing aid equipped with an electroencephalogram measurement function.

[0056] Figure 24A This is a front view showing a mouse equipped with an electroencephalogram measurement function.

[0057] Figure 24B This is a diagram showing a usage state of a mouse equipped with an electroencephalogram measurement function.

[0058] Figure 25A This is a back view showing a TV remote control equipped with an electroencephalogram measurement function.

[0059] Figure 25B This is a diagram showing how a television remote controller equipped with an electroencephalogram measurement function is used.

[0060] Figure 26A This is a front view showing an installation example of the cognitive function testing device (robot).

[0061] Figure 26B This is a diagram showing an example of the use of an installation example of a cognitive function testing device (robot).

[0062] Figure 27 This is a functional block diagram of a cognitive function testing system that incorporates an electroencephalogram measurement function into a measurement device.

[0063] Figure 28 This is a diagram showing an example of a service utilizing a cognitive function testing device and a cognitive function testing system.

[0064] (Explanation of symbols)

[0065] 101: Cognitive function examination device; 102: Cognitive function measurement / determination unit; 103: Weird task data storage unit; 104: Caller determination unit; 105: Encephalogram measurement unit; 106: Encephalogram data storage unit; 107: Examination data production unit; 108: Examination data storage unit; 109: Cognitive function examination control unit; 110: Analysis data storage unit; 111: Cognitive function analysis unit; 112: Analysis result storage unit; 113: Cognitive function reduction notification unit. DETAILED DESCRIPTION

[0066] Alzheimer's disease (AD) accounts for approximately half of all dementias. Neurophysiological biomarkers, such as brain waves, are highly anticipated as biomarkers for the early diagnosis of AD. The US National Institutes of Health defines a biomarker as "a characteristic objectively measured and evaluated as an indicator of normal physiological processes, pathological processes, or pharmacological response to therapeutic intervention."

[0067] Compared to brain examination technologies such as fMRI (functional magnetic resonance imaging), functional magnetic resonance imaging, MEG (magnetoencephalography), and magnetoencephalography, EEG technology can be measured using relatively inexpensive equipment. Furthermore, since it only measures electrical potentials on the surface of the head, it places less strain and restriction on the body during measurement. Therefore, it is expected to be used not only in the medical field but also in a wide range of fields such as consumer, health and welfare, robotics, and automotive applications.

[0068] One of the biomarkers in EEG is the event-related potential. An event-related potential refers to electrical brain activity that occurs in temporal correlation with external or internal events. Potentials related to external events such as visual and auditory stimuli are used in the examination of AD and mild cognitive impairment. In particular, the peak latency of the P300, the peak of the third waveform in the positive direction of the event-related potential, is used as a biomarker for the examination of AD and mild cognitive impairment. Furthermore, an oddball task is used as a tool to induce this P300. An oddball task involves randomly presenting two stimuli to the subject in order to direct their attention to the less frequent stimulus and induce a response such as pressing a button. In an oddball task, the less frequent stimulus is called the target stimulus (hereinafter referred to as the "target"), and the more frequent stimulus is called the standard stimulus (hereinafter referred to as the "standard").

[0069] Hereinafter, as an embodiment of the present invention, the following electroencephalogram data analysis system, information processing terminal, and electronic device are described: when an action having a purpose different from that of electroencephalogram measurement is performed, a strange task is presented to the subject as information for dementia examination, and the subject's electroencephalogram at this time is analyzed to extract indicators of cognitive function. In the following description, as an example of an electronic device, a smartphone is mainly used as an example, but as described in each embodiment described later, the information processing terminal and the electronic device are not limited to smartphones. The present invention can also be similarly applied to electronic devices such as PCs, tablets, e-books, household robots, televisions, radio receivers, and audio-visual equipment, wearable devices, etc.

[0070] <First embodiment>

[0071] The first embodiment is an example in which a smartphone is used as an electronic device (hardware) and the cognitive function testing device of the present invention is installed therein.

[0072] (Description of the functional blocks of the cognitive function test device)

[0073] Figure 1 This is a functional block diagram of a cognitive function testing device.

[0074] The cognitive function testing device 101 includes a cognitive function measuring / determining unit 102 , an operating unit 114 , a display unit 115 , a communication unit 116 , a sound output unit 117 , a sound input unit 118 , and a timer 119 .

[0075] The operation unit 114 receives an operation input from a user (equivalent to a subject) to the cognitive function testing apparatus 101 and outputs an operation signal.

[0076] The display unit 115 performs control to display an operation screen and various information to the user.

[0077] The communication unit 116 controls communication with external devices via various Internet phone networks, WiFi, Bluetooth (a registered trademark in Japan), and the like.

[0078] The sound output unit 117 and the sound input unit 118 control the output and input of sound via a speaker 225 and a microphone 226 to be described later.

[0079] The timer 119 generates time information and outputs it to the cognitive function measurement / determination unit 102 .

[0080] The cognitive function measurement / determination unit 102 is configured to include an unusual task data storage unit 103, a caller determination unit 104, an electroencephalogram measurement unit 105, an electroencephalogram data storage unit 106, an inspection data creation unit 107, an inspection data storage unit 108, a cognitive function inspection control unit 109, an analysis data storage unit 110, a cognitive function analysis unit 111, an analysis result storage unit 112, and a cognitive function reduction notification unit 113.

[0081] The weird task data storage unit 103 stores weird task data. The weird task data storage unit 103 stores information related to the person (guardian) who monitors the user to be tested for cognitive function, such as the guardian's phone number, name, email address, voice, and photo.

[0082] In this embodiment, an example will be described in which the unusual task data storage unit 103 mainly stores information related to the guardian.

[0083] When receiving a phone call or an email via the communication unit 116 , the caller determination unit 104 determines whether the caller is a guardian registered in the unusual task data storage unit 103 .

[0084] The electroencephalogram measurement unit 105 operates as an electroencephalogram data acquisition unit for acquiring electroencephalogram data of a user (subject) to be tested for cognitive function. The electroencephalogram measurement unit 105 includes an electroencephalogram detection sensor (in this embodiment, an electroencephalogram measurement electrode 221 as described later) for acquiring electroencephalogram data.

[0085] The electroencephalogram data storage unit 106 stores the electroencephalogram data acquired by the electroencephalogram measurement unit 105 .

[0086] The test data generating unit 107 automatically generates data for a cognitive function test using the guardian's voice, photos, images such as emojis stored in advance in a smartphone, and ringtones stored in the odd task data storage unit 103 .

[0087] The inspection data storage unit 108 stores the inspection data created by the inspection data creation unit 107 .

[0088] The cognitive function test control unit 109 detects that the electroencephalogram measurement unit 105 has detected a potential from the electroencephalogram measurement electrode 221, which serves as an electroencephalogram detection sensor, and that electroencephalograms can be measured. It then initiates a test using the test data stored in the test data storage unit 108 and stores the measured electroencephalograms in the electroencephalogram data storage unit 106. Furthermore, the cognitive function test control unit 109 controls the entirety of the cognitive function measurement / determination unit 102. While the electroencephalogram measurement electrode 221 is used as the electroencephalogram detection sensor here, a magnetic sensor may also be used.

[0089] The analytical data storage unit 110 stores data used for analyzing and evaluating cognitive functions.

[0090] The cognitive function analysis unit 111 analyzes the electroencephalogram data stored in the electroencephalogram data storage unit 106 and compares it with the data calculated in advance in the analysis data storage unit 110 to perform cognitive function analysis.

[0091] The analysis result storage unit 112 stores the analysis result of the cognitive function analysis unit 111 .

[0092] When the cognitive function analysis unit 111 detects a decrease in cognitive function and a sign of dementia (equivalent to when a predetermined notification criterion is satisfied), the cognitive function reduction notification unit 113 notifies a guardian pre-registered in the unusual task data storage unit 103 .

[0093] The guardian registered in the unusual task data storage unit 103 is a person who silently monitors the life and health of the elderly user who is the subject of the cognitive function test, and can be, for example, a relative of the user, a caregiver, etc. By using a smartphone equipped with the cognitive function test device 101, the guardian can monitor the elderly user's cognitive function status in daily life from a remote location.

[0094] The data registered in the weird task data storage unit 103 can use the data phone number, name, address, email address, etc. stored in the address book of the smartphone, photos, data phone number, name, email address, sound stored in the built-in memory, SD card, or can use the data newly sent from the guardian to register.

[0095] (Description of the hardware structure)

[0096] Figure 2 It shows that the application Figure 1 FIG. 1 is a diagram showing the hardware configuration of the smartphone of the cognitive function testing device 101 described in FIG.

[0097] The smartphone 201 includes: a CPU (Central Processing Unit CPU) 211, which controls the entire system of the smartphone 201; a ROM (Read Only Memory) 212, which stores basic programs such as the OS used within the smartphone; a RAM (Random Access Memory) 213, which temporarily stores programs and various data and serves as a cache or working memory; a storage device 214, which stores programs that implement the functions of the cognitive function testing device 101, various data used in each functional block, and brain wave measurement results; a timer 215 (used in conjunction with the timer); Figure 1The memory device 214 includes a memory card 216 (corresponding to the timer 119) for use in obtaining the time during electroencephalogram measurement, setting the timer, and the like; and an external I / F 216 for connecting to external devices. Here, the memory device 214 is composed of, for example, a non-volatile memory such as an HDD (Hard Disk Drive) or a flash memory. In this example, the cognitive function testing device 101 of this embodiment is applied to a smartphone, so the memory device 214 is preferably composed of a non-volatile memory. Alternatively, when the cognitive function testing device 101 of this embodiment is applied to a PC, the memory device 214 is composed of an HDD or an SSD (Solid State Drive) equipped with a semiconductor memory such as a flash memory.

[0098] Furthermore, the smartphone 201 is configured to include: an electroencephalogram measuring electrode 221 for measuring the potential of electroencephalograms; a signal processing device 222 for removing noise from the potential signal derived from the electroencephalogram measuring electrode 221 and amplifying the noise-removed signal; an ADC (Analog to Digital Converter) 223 for converting the analog signal processed by the signal processing device 222 into a digital signal; and an operation / display display 224 (connected to the display). Figure 1 The operating unit 114 and the display unit 115 correspond to each other), including a touch panel (not shown) for receiving or inputting user operations, and for displaying images and providing information to the user; a speaker 225 (corresponding to Figure 1 The sound output unit 117 corresponds to the sound output unit 117), reproducing the incoming call sound, the sound; the microphone 226 (corresponding to the sound output unit 117) Figure 1 The voice input unit 118 corresponds to the voice input unit 118), input voice; wired / wireless communication module 227 (with Figure 1 201 ); an accelerometer 228 for detecting data related to tilt, movement, vibration, and impact; a geomagnetic sensor 229 for measuring orientation; a GPS (Global Positioning System) 230 for obtaining location information of a receiver; a gyroscope 231 for detecting changes in rotation and orientation; a thermometer 232 for measuring body temperature, etc.; a system bus 233 as a data communication path for sending and receiving data between the CPU 211 and various components within the smartphone 201; a battery 234 for supplying power; and a call module 235.

[0099] The communication module 227 includes wireless communication functions such as 3G, 4G, Wi-Fi, Bluetooth, infrared communication, and broadcast service communication, and wired communication functions such as wired LAN.

[0100] Here, in Figure 1Among the functional blocks shown, the electroencephalogram measurement electrodes 221, the signal processing device 222, the ADC 223, the CPU 211, the ROM 212, the RAM 213, and the storage device 214 constitute the hardware 210 of the cognitive function measurement / determination unit 102. These hardware 210 and the program that realizes the cognitive function measurement / determination function cooperate to form a system. Figure 1 The functional blocks of the cognitive function measurement / determination unit 102 are shown.

[0101] (Example of attaching electrodes for electroencephalogram measurement to a smartphone)

[0102] Next, refer to Figure 3A to Figure 3C An example of attaching the electroencephalogram measurement electrodes 221 to the smartphone 201 will be described.

[0103] Generally speaking, brain waves are measured by deriving them from electrodes placed on the scalp, but in recent years, technologies such as body wave technology have been developed to read brain waves from the surface of the skin of the wrist and hand. Figure 3A as well as Figure 3B An example of a case where this technology is utilized and implemented is shown.

[0104] Figure 3A This is an example of a case where two electrodes 302 and 303 for measuring electroencephalograms are arranged on the back 301 of a smartphone 201. The sensing method is bipolar sensing, and electroencephalograms are measured using the potential difference derived from the two electrodes. The electrodes are arranged at a portion of the back that is easily accessible to the hand. Figure 3A Although two electrodes are mounted, two or more electrodes may be arranged to automatically select two locations of the hand contact portion for measurement.

[0105] Figure 3B This is an example in which electroencephalogram measurement electrodes 306 and 307 are respectively arranged on the left side 304 and the right side 305 of the smartphone facing the front surface.

[0106] and Figure 3A Similarly, this is a bipolar sensing electrode configuration. EEG waves are measured using the potential difference generated from two locations on the surface of the hand when holding a smartphone. Alternatively, two or more electrodes can be configured, and the potential detected when the hand touches the electrodes can be used to detect contact with the electrodes, automatically selecting the two locations where the hand touches the electrodes for measurement.

[0107] Here you can also install Figure 3A and Figure 3B The electrodes may be mixed, for example, one on the back and one on the side, or one on the back and two on the side.

[0108] Figure 3C This is the configuration of electrodes when using electrodes that can detect potential in a non-contact state. Electrodes 310 and 311 are configured near the speaker 309 on the front surface 308 of the smartphone. In recent years, non-contact electrodes for body area networks have been developed. Therefore, an example of the electrode configuration when using this technology is shown. When there is an incoming call, the speaker 309 on the front surface 308 of the smartphone is brought close to the ear to derive the potential. Since it is a non-contact electrode, there is no need to bring the electrode into contact with the head. The electrodes 310 and 311 are equipped with an amplifier ADC and a communication module, and can send the derived potential from one electrode to another. This electrode can derive the potential even if there is an insulator between the electrode and the head.

[0109] Here you can also install Figure 3A 、 3B All electrodes of 3C can also be set to Figure 3A 、 3B , 3C mixed existence. For example, it can also be Figure 3C and Figure 3B or Figure 3C and Figure 3A combination.

[0110] (Description of the basic waveforms of EEG and event-related potentials, and the characteristics of P300)

[0111] Next, refer to Figure 4 The following describes the brain wave data obtained in the present embodiment. In essence, brain waves are waves that store the electrical activity of neurons in the brain, and the potential changes derived from the electrodes installed on the scalp are stored as waveforms mainly over time. There are two types of brain waves: spontaneous brain waves and induced brain waves. Spontaneous brain waves are potentials that fluctuate all the time regardless of the occurrence of a specific event, and are brain waves in a continuous state. In contrast, induced brain waves are potentials that occur in association with the occurrence of an event (hereinafter referred to as event-related potentials). There are exogenous induced brain waves originating from perceptual vision, hearing, and body sensation, and endogenous induced brain waves related to inner events such as expectation, attention, and intention determination. Here, we use Figure 4 The basic waveform of the event-related potential of an electroencephalogram will be briefly described. Figure 4 It is an explanatory diagram showing the basic waveform of an event-related potential of an electroencephalogram.

[0112] The event-related potential is represented by the vertical axis as potential μV and the horizontal axis as time ms. The waveform of the event-related potential is often recorded with the upper side as negative and the lower side as positive. The point where the event occurs based on external stimulation is represented by 0ms on the horizontal axis of the curve graph. The waveform near 0μV is called the baseline 401. In the negative direction of the brain wave graph, the upward vibration is called N (Negative), and in the positive direction graph, the downward vibration is called P (Positive). The order of occurrence of each waveform is assigned a number (P1, P2, etc. in the graph), or a standard peak latency in ms is applied to distinguish them. Peak latency is the time from the stimulation to the peak.

[0113] The P300 (symbol 402) induced by the oddball task is the peak of the third waveform in the positive direction. Its peak latency is approximately 300 ms, hence the name P300. When analyzing EEG characteristics, in addition to peak latency, peak-to-peak amplitude 404 and baseline-based peak amplitude 405 are used.

[0114] The peak latency 403 of the P300 is known as a biomarker for AD. While the peak latency 403 of the P300 (reference numeral 402) generally increases with age, it is further delayed in AD patients beyond the typical age-related delay. Furthermore, it is known that the more delayed the peak latency is in AD patients, the greater the decline in cognitive function. Furthermore, the peak latency 403 of the P300 (reference numeral 402) is also delayed in healthy individuals with a high genetic risk of AD.

[0115] In an oddball task, when multiple stimuli such as images and sounds are presented to the user, stimuli that are presented less frequently are called targets, and stimuli that are presented more frequently are called standards.

[0116] As can be seen, the P300 (reference numeral 402) appears less frequently when the target frequency within the stimulus is relatively high, and appears more frequently when the target frequency is low. Because the P300 (reference numeral 402) appears in response to these target frequencies, individual differences exist. Therefore, the target frequency (the frequency of target presentation to the user) must be adjusted to suit each individual's characteristics.

[0117] Furthermore, the P300 (symbol 402 ) may not appear when attention to the target decreases during the oddball task, so it is also important to maintain attention to the target during the task.

[0118] Furthermore, the peak latency 403 of the P300 is often calculated primarily by arithmetic averaging of event-related potentials. This is because evoked electroencephalograms also contain spontaneous electroencephalogram components, which occur randomly. Arithmetic averaging is used to eliminate the influence of spontaneous electroencephalograms. However, there are also methods for calculating the peak latency 403 of the P300 (reference numeral 402) from a single event-related potential, so the calculation method is not limited to arithmetic averaging.

[0119] In this embodiment, when performing an operation with a purpose other than electroencephalogram measurement, such as answering an incoming call, the subject is presented with an unusual task designed to produce the aforementioned P300 (reference numeral 402). This allows the subject to be tested for the P300 (reference numeral 402) without imposing the psychological burden of cognitive function testing on the subject. The data used for this purpose is described below.

[0120] (Example of the structure of the guardian form)

[0121] Next, use Figure 5A , shows the structure of a table 501 (hereinafter referred to as a “guardian table”) in which data related to a guardian is stored in the odd task data storage unit.

[0122] The guardian table 501 includes the guardian's telephone number 502 [Tel_Num], name 503 [Name], email address 504 [Mail_Address], relationship with the user 505 [Relation], contact level data 506 [Information_Level], photo data item 507, sound data item 508, and selected sensory stimulation 517 [Select_Stimulus].

[0123] The relationship 505 with the user describes data indicating the relationship with the user, such as family relationship (son, daughter), information on the person in charge of the care service, such as the care manager and the doctor who always consults the user.

[0124] The notification level data 506 stores the notification level for measurement results, analysis results, etc. For example, for family members, notification of analysis results may be set whenever a result is available, regardless of whether a sign is detected. For relevant personnel such as caregivers, notification may be set only when a sign is detected.

[0125] The photo data item 507 holds the number 509 [Picture_File_No] of the file storing the guardian's photo, the variable 510 [Validity] indicating whether P300 is detected in the initial test described later, the presentation frequency 511 [Frequency] in the oddball task (stored based on the results of the initial test, with 20% or less as the benchmark value), the interval 512 [SInterval] for displaying photos (stored based on the results of the initial test, in ms, with 1.5 ms as the benchmark value), and the size 518 [Size] of the photo displayed in the oddball task.

[0126] The sound data item 508 also stores the number 513 [Voice_File_No] of the file storing the guardian's voice, the variable 514 [Validity] indicating whether P300 is detected in the initial test described later, the presentation frequency 515 [Frequency] in the odd task (stored according to the results of the initial test, with 20% or less as the benchmark value), the interval 516 [SInterval] of the reproduced sound (stored according to the results of the initial test, in ms, with 1.5 ms as the benchmark value), and the volume 519 [Volume] of the reproduced sound in the odd task.

[0127] In selecting sensory stimulation 517, the sensory stimulation for the examination of cognitive function is maintained. Figure 5A In the example of , when a visual photo is selected, "P" is input, and when an auditory sound is selected, "V" is input.

[0128] Regarding selecting sensory stimulation 517, after selection, the same stimulation will be applied to all guardians.

[0129] The sense used in the test is set by the user or by the method of the second embodiment described below as a sensory stimulus (image, sound, or vibration) that is preferentially used as an interface with the smartphone when the cognitive function test device starts to be used.

[0130] If this process is performed at the start of use of the cognitive function test device, Figure 7 However, changes can be made even after that.

[0131] (Example of the structure of a standard table)

[0132] Next, use Figure 5B , shows the structure of a table 520 (hereinafter referred to as “standard table”) storing standard data in the unusual task data storage unit 103 .

[0133] Data related to standards used in the oddball task is stored in the standard table 520. The standard table 520 includes a file identification number 521 [File_ID_No], a stimulus type 522 [Stimulus_Type], and data usability 523 [Validity].

[0134] The file identification number 521 is an identification number of a file serving as standard photo data or audio data.

[0135] The stimulus type 522 indicates the type of stimulus presented to the user. If it is image data as visual stimulation, “P” is input, and if it is sound data as auditory stimulation, “V” indicating auditory data is input.

[0136] Regarding data usability 523 [Validity], in the initial test described later, "1" is set if the data can be used as a standard without any problems, and "0" is set if the data is not suitable for use due to the occurrence of P300, which should not occur.

[0137] (Instructions for using a smartphone equipped with a cognitive function test device when receiving an incoming call)

[0138] Next, use Figure 6A to Figure 6D , shows how to use a smartphone equipped with the cognitive function testing device 101 of the present invention when a phone call comes in.

[0139] exist Figure 6A to Figure 6D In, use Figure 3A The following description will be given using an example of a smartphone 201 having electroencephalogram measurement electrodes 302 and 303 arranged on the back surface thereof.

[0140] When a call comes in from a guardian registered in the guardian table in the smartphone 201, the smartphone 201 notifies the caller of the incoming call with a ring tone or vibration ( Figure 6A When the user holds the smartphone 201 and touches the surface of his hand to the two electroencephalogram measurement electrodes 302 and 303 on the back 301 of the smartphone 201, the smartphone 201 starts the cognitive function test ( Figure 6B , symbol 601).

[0141] When the cognitive function test is set to "Test using vision", that is, when the value of the selected sensory stimulation 517 [Select_Stimulus] of the guardian table 501 is set to "P", the user observes the screen and confirms the caller ( Figure 6C ).

[0142] Specifically, on a screen 602 of a smartphone, an image 603 of an emoji or the like selected as a standard and a facial photo (equivalent to a facial image) 604 of a target caller are randomly displayed.

[0143] The user observes the facial photo 604 displayed on the screen 602 from the displayed series of images 605 to confirm the caller.

[0144] On the other hand, if the cognitive function test is set to "test using hearing", the value of the selected sensory stimulation 517 [Select_Stimulus] in the guardian table 501 is set to "V". In this case, the user listens to the calling sound and confirms the caller ( Figure 6D Specifically, when the user touches the surface of their hand to the electroencephalogram measurement electrodes 302 and 303 on the back 301 of the smartphone, an incoming call sound 606 and a caller's name spoken in a random voice 607 are reproduced. The user listens to the series of calling sounds 608 to confirm the caller.

[0145] After confirming the caller's identity through the caller's facial photo 604 or the name spoken 607 , the user presses the receive button to start the call.

[0146] The standard sound used in the oddball task can be an incoming call sound pre-stored in the smartphone, or an arbitrary sound can be selected from the incoming call sounds saved by the user.

[0147] (Initial setting test flow)

[0148] Here, use Figure 7 , showing the test flow during initial setting. Figure 7 This is a test flow chart for initial settings. This flow chart is a processing flow for initial settings when the cognitive function testing device 101 of the present invention is first used.

[0149] The purpose of this testing process is to select standard and target data and confirm whether they can be used to test the user's cognitive function.

[0150] Factors that influence inspections include the compatibility of both stimulus data (standard and target), the frequency of targets during inspection, the interval between presenting targets and standards to the user, and the quality of the stimuli (image size, sound volume, etc.). This test flow helps to appropriately set and adjust these factors.

[0151] The cognitive function test control unit 109 implements this initial setting test process.

[0152] In response to confirming whether the test is correctly performed in this test process, the cognitive function test control unit 109 stores the validity of the target used in the test in Validity 510 of the photo data item 507 or Validity 514 of the voice data item 508 of the guardian table.

[0153] In addition, the results of this test processing flow are stored in the photo data item 507 and the voice data item 508 of the guardian table 501 .

[0154] The guardian table 501 and the standard table 520 are used by the examination data generating unit 107 to generate examination data.

[0155] The inspection data created by the inspection data creating unit 107 is used by the cognitive function inspection control unit 109 when performing the inspection.

[0156] This test flow assumes that data related to the guardian in the guardian table 501 is set in advance by the user.

[0157] For example, before executing this test process, the user is shown a guardian registration screen, and the user is prompted to select a guardian from the phone numbers, email addresses, photos, etc. of the members pre-registered in the phone book of the smartphone. Figure 5A The phone number 502, name 503, email address 504, and relationship with the user 505. The following describes the test process during initial setting.

[0158] exist Figure 7 In the process of , visual data and auditory data are assumed as types of inspection data. However, in addition to these, types of inspection data include stimulation data for physical sensations such as vibration, and the present invention is not limited to these.

[0159] First, the cognitive function test control unit 109 selects one guardian (Xn) from the guardian table 501 and selects the photo data item 507 (visual data P) or the audio data item 508 (auditory data V) (step 701 ).

[0160] Next, the cognitive function test control unit 109 selects one image or sound from the visual data P or auditory data V selected in step 701 (step 702). In the case of visual data, the photo data 509 [Picture_File_No] stored in the guardian table 501 is selected, and in the case of auditory data, the voice data 513 [Voice_File_No] stored in the guardian table 501 is selected.

[0161] Next, the cognitive function test control unit 109 selects a standard from among emoticons, icons, and ringtones pre-registered in the smartphone, etc. (step 703 ). For visual data, emoticons and icons DPn are selected, and for auditory data, ringtone data DVn is selected.

[0162] Next, the cognitive function test control unit 109 sets an initial value for the number of target stimulation measurements, Zn, during the initial test (step 704). To verify the reproducibility of responses to the stimulation, the number of target stimulations is set to a multiple, for example, three. Furthermore, the number of P300 occurrences, N, is set to an initial value ≤ Zn, for example, two.

[0163] Next, the cognitive function test control unit 109 sets an initial value for the target frequency Fn (step 705). The target frequency is generally set to approximately 20%. For example, if five images are prepared, one of them is used as the target stimulus image. Generally speaking, when the frequency of attention-grabbing stimuli presented to the user at the target frequency is low, the P300 is more likely to appear. Because the manner in which the P300 is stimulated varies from person to person, the test is performed starting at 20%. If the P300 manner is poor, the frequency is reduced accordingly.

[0164] Next, the cognitive function test control unit 109 sets an initial value for the stimulation interval SIn between stimuli presented to the user (step 706). The stimulation interval refers to the interval between the target and standard stimuli presented to the user. In the oddball task, the baseline interval between the standard and target stimuli presented to the user is 1.5 seconds. Because responses to stimuli vary from person to person, this interval also requires adjustment.

[0165] Next, the cognitive function test control unit 109 uses the electroencephalogram measurement unit 105 to check whether a potential is detected from the electroencephalogram measurement electrodes 302 and 303 on the back of the smartphone (step 707). If no potential is detected from the electrodes (step 707 / No), the user is prompted to touch the electroencephalogram measurement electrodes 302 and 303 (step 708). Regarding the method of prompting attention, if the test uses images, the operation / display display 224 displays the prompt on the smartphone screen, and if the test uses sound, the prompt is delivered via the smartphone speaker 225.

[0166] If the potential is detected from the electrode (step 707 / “Yes”), the cognitive function test control unit 109 starts the initial test (step 709 ).

[0167] The initial test process (step 709) is a test for performing a test inspection using the standard and target selected in steps 702 and 703, the set target number of stimulation measurements, the target frequency, and the stimulation interval. Specifically, it is assumed that Figure 6A to Figure 6C A series of actions shown in the figure.

[0168] Next, the cognitive function test control unit 109 performs P300 analysis (step 710 ) using the electroencephalogram data measured in the initial test process (step 709 ).

[0169] The cognitive function test control unit 109 temporarily stores the waveform of each target stimulus during the test execution and the analysis result of P300 (waveform indicating the presence or absence of the waveform) in the buffer RAM 213 .

[0170] If the user displays a P300 for all target stimuli in the test (step 711 / Yes), the cognitive function test control unit 109 sets the image or sound registered in the guardian table 501 as usable (step 712). Specifically, the value of the Validity variable 510 or 514 in the guardian table 501 is set to 1. A value of 1 in the Validity variable 510 or 514 indicates that the image or sound is usable.

[0171] Then, the target frequency Fn (set in step 705) and the stimulation interval SIn (set in step 706), the size of the photo, and the volume of the reproduced sound are saved as the presentation frequency [Frequency] variable 511 or 515, the [SInterval] variable 512 or 516, the photo size 518 [Size] variable, and the volume 519 [Volume] variable of the target attributes of the guardian table 501 (step 713).

[0172] Regarding the values ​​of the variables of the photo size 518 [Size] and the volume 519 [Volume], the initial setting values ​​are input, or the values ​​are input after the adjustment in step 716 .

[0173] Finally, save the data related to the standard used in the test to the standard table 520. Specifically, save the standard file number in the file identification number [File_ID_No] of the standard table, save the type of standard data in the stimulus type [Stimulus_Type] 522 of the standard table 520 (if the standard is image data, enter "p"; if the standard is sound data, enter "v"). Enter "1" in the data validity [Validity] 523.

[0174] Next, another registered image or sound is selected (step 702 ).

[0175] If the user does not show a P300 for all target stimuli in step 711 (step 711 / No), the system checks whether the P300 has appeared N times or more (step 714). If not (step 714 / No), the user is prompted to focus on the test (step 715). This step of prompting attention is included because the P300 may not appear due to distracted attention. The size and volume of the image or sound are then adjusted (step 716), and the initial test is repeated (step 709).

[0176] If the occurrence of the P300 for the target stimulus is confirmed N times in step 714 (step 717 / "Yes"), the cognitive function test control unit 109 determines whether the stimulation interval Sin is ≥ 2.0 (step 717). If Sin is not ≥ 2.0 (step 717 / "No"), the stimulation interval Sin is increased by S (step 718). The variable S is set to 0.1, for example.

[0177] If the stimulation interval SIn is ≥ 2.0 in step 717 (step 717 / "Yes"), the cognitive function test control unit 109 determines whether the target frequency at that time is ≤ 0.05 (step 719). If it is not ≤ 0.05 (step 719 / "No"), the target frequency is reduced by T (step 720). For example, the variable T is set to -0.05%.

[0178] In the above step 719, when the target frequency is ≤ 0.05 (step 719 / "Yes"), the cognitive function test control unit 109 determines whether P300 appears for the standard (step 721). If P300 appears in the standard, an emoji, icon or incoming call sound with other images or sounds pre-stored in the smartphone is selected (step 722), and the process returns to step 703.

[0179] Normally, the P300 waveform does not appear in the standard. However, there is a possibility that the P30 does not appear in the target due to the standard stimulation. Therefore, the brain wave waveform in the standard is finally confirmed.

[0180] If P300 does not appear in the criteria (step 721 / YES), the cognitive function test control unit 109 sets the registered image or sound to be unusable and notifies the user of the result (step 723 ).

[0181] Specifically, the value of the Validity variable 510 or 514 of the guardian table 501 is set to 0. The value 0 of the Validity variable 510 or 514 means that it cannot be used.

[0182] The reason for notifying the user is that the data of the registered guardian is not suitable for inspection. In response to this notification, the user needs to re-register the data for the guardian. This content is also included in the notification of the result.

[0183] It is investigated whether all photos and sounds have been checked (step 724). If not, the process returns to the above step 702 to select a new target.

[0184] If all photos and sounds have been checked (step 724 / "Yes"), it is confirmed whether the test has been performed on all guardians (step 725). If the test has not been performed (step 725 / "No"), the process returns to step 701 and another guardian is selected. If the test has been performed on all guardians (step 725 / "Yes"), the test process ends.

[0185] Here, in step 717 , the boundary value of SIn is set to 2.0, but the present invention is not limited thereto.

[0186] When P300 appears in the standard in step 721, enter the file number of the data used as the standard in the file identification number 521 [File_ID_No] of the standard table 520, and enter "p" if the standard is image data in the stimulation type [Stimulus_Type] 522 of the standard table 520, and enter "v" if the standard is sound data.

[0187] In addition, “0” is input in [Validity] 523 of the standard table 520 to indicate whether the data can be used.

[0188] (Example of the structure of inspection data (table))

[0189] Figure 10 1 is a structural example of the inspection data table stored in the inspection data storage unit 108 .

[0190] Table 1001 of the inspection data storage unit 108 (hereinafter referred to as "inspection data storage table") includes ID No. 1002 of the inspection data, the number of the image or sound file used 1003, the target frequency 1004 [Target_Frequency], the type of stimulation 1005 [Stimulus_Type], visual stimulation P or auditory stimulation V, the order of stimulation of the target and standard 1006 [Or1, Or2, Or3, Or4, Or5..., OrN], the order of arrangement of the target and standard, and the stimulation presentation interval 1007 [SInt].

[0191] The number 1003 of the used image and audio file includes a target file number 1008 [Target_File_No] and a standard file number 1009 [Standard_File_No].

[0192] (Inspection of data production process)

[0193] Next, use Figure 8 , shows the processing flow of the inspection data generating unit 107. Figure 7 The results of the test process are Figure 7 This processing flow is executed by the cognitive function test control unit 109 immediately after the test flow is executed or when a call is received from the guardian.

[0194] The execution time when there is a call from the guardian may be immediately after there is a call from the guardian or after the call from the guardian ends.

[0195] exist Figure 8 The process of FIG. 1 shows an example of a situation that is implemented just after a call from a guardian.

[0196] The cognitive function test control unit 109 checks whether the test data is stored in the test data storage table and confirms whether it is the first time to create (step 801). If it is the first time to create (step 801 / "Yes"), it selects the guardian Xn in the guardian table 501 (step 802). The first test data is created in Figure 7 The test process is implemented just after execution.

[0197] Next, the test data creation unit 107 selects the stimulus type for the created test (step 803). Regarding the stimulus type, the unit refers to the monitor table 501 and the selected sensory stimulus 517 and stimulus type 522 in the standard table 520 in the oddball task data storage unit 103, and selects one of the registered stimulus types. If visual data and auditory data are stored, "P" or "V" is selected.

[0198] Next, the examination data generating unit 107 refers to the guardian table 501 in the unusual task data storage unit 103 and selects 509 for the target image or audio data file number or photo, and selects 513 for audio (step 804 ).

[0199] If vision is selected in step 803, the guardian's photo data item 507 is selected, and if hearing is selected, the guardian's voice data item 508 is selected. At this time, the value of [Validity] 510 is selected as 1 for photos, and the value of [Validity] 514 is selected as 1 for voice.

[0200] Next, the inspection data creation unit 107 refers to the standard table 520 in the unusual task data storage unit 103 and selects an image or sound to serve as a standard (step 805). If visual data "P" is selected in step 803, the value of the stimulus type [Stimulus_Type] 522 in the standard table 520 is "P" and the value of the data validity [Validity] 523 is 1.

[0201] Next, the examination data creating unit 107 refers to the guardian table 501 and sets a target frequency Fn (Frequency 511 for photos and Frequency 515 for sounds) of the selected object (step 806 ).

[0202] Next, the standard of the oddball task and the order of presentation of the targets are determined so that the targets appear at the frequency Fn set in step 806 (step 807 ).

[0203] Next, the presentation order of the target and the standard determined in step 807 is stored in the stimulation order 1006 of the inspection data storage table 1001 of the inspection data storage unit 108 (step 808 ).

[0204] In the stimulation order 1006 , for example, a symbol “T” representing a target and a symbol “S” representing a standard may be used to store their arrangement order as the stimulation order.

[0205] Next, the stimulation presentation interval of the selected target (SInterval 512 for photos, SInterval 516 for sounds) is stored in the stimulation presentation interval [SInt] 1007 of the inspection data storage table 1001 of the inspection data storage unit 108 (step 809 ).

[0206] The other inspection data are stored in the inspection data storage table 1001 of the inspection data storage unit 108 (step 810 ).

[0207] Specifically, the target file number selected in step 804 is stored in Target_File_No 1008 of the image or audio file number 1003 in the inspection data storage table 1001. The standard file number selected in step 805 is stored in Standard_File_No 1009 of the image or audio file number 1003 in the inspection data storage table 1001.

[0208] The target frequency Fn set in step 806 is stored in the target frequency [Target_Frequency] 1004 of the inspection data storage table 1001 .

[0209] The stimulation type set in step 803 is stored in the stimulation type [Stimulus_Type] 1005 of the inspection data storage table 1001. In the case of a photo, "P" is stored, and in the case of a sound, "V" is stored.

[0210] Refer to the selected sensory stimulation 517 of the guardian table 501 to confirm whether it is executed with all registered sensory stimulations (step 811). If it is executed with all senses (step 811 / "Yes"), then confirm whether it is executed by all registrants registered in the guardian table (step 812).

[0211] If all registrants have executed the request (step 812 / "Yes"), the process ends. If not all registrants have executed the request (step 812 / "No"), another guardian is selected (step 802).

[0212] Returning to step 811 , it is confirmed whether the stimulation has been performed with all senses. If the stimulation has not been performed with all senses (step 811 / “No”), another stimulation type is selected (step 803 ).

[0213] Return to step 801 to confirm whether it is the first time. If it is not the first time (step 801 / "No"), identify the guardian Xn (step 813), refer to the selected sensory stimulation 517 of the guardian table 501, and confirm the selected sensory stimulation (step 814).

[0214] Next, a search is performed on either [File_NumberPicture_File_No] 509 or [Voice_File_No] 513 for the selected stimulus selected in step 813. Based on the search result, [Target_File_No] 1008 of the file number 1003 of the image or voice is referenced and the ID is checked using the examination data [ID No] 1002 (step 815). Based on the examination data (primarily the target frequency 1004) of the checked examination data ID, the order of presentation of the standard and target is determined again (step 816).

[0215] The result of step 816 is saved and updated as the stimulation sequence 1006 in the inspection data storage table 1001 (step 817 ), and the process ends.

[0216] (Overall process of cognitive function examination)

[0217] Next, use Figure 9 The overall processing flow of the cognitive function test is described. When the smartphone is activated, the cognitive function test control unit 109 executes Figure 9 process.

[0218] In with Figure 6A to Figure 6D In the corresponding Figure 6A Corresponding to step 901, Figure 6B Corresponding to step 905, Figure 6C and Figure 6D Corresponding to step 907.

[0219] When someone calls a user's smartphone, the smartphone enters an incoming call state.

[0220] In response to this, in this process flow, an incoming call is received (step 901 ), and a caller determination process is executed using the incoming call as an event (step 902 ).

[0221] Specifically, the guardian table 501 is referenced and the incoming call number is checked to see if the number is registered in the table to confirm whether the person is a guardian (step 903 ). If not (step 903 / “No”), the process ends.

[0222] If the caller is a guardian (step 903 / “Yes”), the above-mentioned inspection data creation process is executed to generate inspection data (step 904 ).

[0223] Next, the system checks whether an electroencephalogram potential has been detected (step 905). If not (step 905 / No), a prompt to touch the electrode is provided through a display on the screen, a sound, or the like (step 906). Furthermore, to prevent the user from answering the call without confirming the caller, a display or notification prompting the user to confirm the caller may be provided when the caller is identified as a caregiver or when an electroencephalogram potential is detected.

[0224] If an electroencephalogram potential is detected in step 905 (step 905 / “Yes”), an inspection and electroencephalogram measurement process is executed (step 907 ).

[0225] Specifically, the cognitive function test control unit 109 executes the test by referring to the test data storage table 1001 of the test data storage unit 108 , and instructs the electroencephalogram measurement unit 105 to start electroencephalogram measurement.

[0226] Next, it is checked whether the receive button has been selected (step 908 ). If the receive button has been selected (step 908 / “Yes”), the examination and electroencephalogram measurement process are terminated, and cognitive function analysis is executed (step 909 ).

[0227] The cognitive function analysis in step 909 is performed by the cognitive function analysis unit 111 , and is executed when the cognitive function test control unit 109 outputs an instruction to the cognitive function analysis unit 111 in response to an event caused by pressing the examination button.

[0228] In the cognitive function analysis at step 909 , the P300 value is calculated based on the electroencephalogram measurement results, and this value is compared with pre-set analysis data to detect signs of cognitive function decline.

[0229] If the receive button is not selected in step 908 (step 908 / “No”), the execution of the inspection test and the electroencephalogram measurement are directly continued (step 907 ).

[0230] Next, based on the analysis results of step 909, it is determined whether a sign of cognitive impairment has been detected (step 910). If not (step 910 / No), the process ends. If a sign of cognitive impairment has been detected (step 910 / Yes), cognitive impairment notification processing is executed (step 911), and the process ends.

[0231] The cognitive function decline notification in step 911 is handled by the cognitive function decline notification unit 113 and is executed when the cognitive function analysis unit 111 outputs an instruction to the cognitive function decline notification unit 113 in response to detecting a sign of cognitive function decline.

[0232] In the cognitive function decline notification in step 911, the analysis result is sent to the guardian registered in the guardian table using the registered email address. Alternatively, the analysis result is displayed on the display unit 115 to notify the user himself.

[0233] exist Figure 9 In the process, the cognitive function reduction notification unit 113 implements the cognitive function reduction notification in response to the detection of the sign of cognitive function reduction, but may also notify the analysis result regardless of the result of the sign detection.

[0234] In addition, in this embodiment, email is used as a method of contacting the guardian, but the present invention is not limited to this.

[0235] Furthermore, when the result of the P300 value of a patient close to AD is obtained, the user may be prompted to go directly to a hospital for diagnosis, or a specialized department of a local government or the like may be automatically notified.

[0236] Here, in this flow, the electroencephalogram potential detection confirmation in step 905 may be performed before the test data creation in step 904 or before the caller determination in step 902 .

[0237] In the preparation of the inspection data in step 904 , inspection data to be used at the time of the last incoming call / the next incoming call may be generated in advance and stored in the inspection data storage unit 108 , and the inspection data may be read out.

[0238] (Example of test data for oddball tasks)

[0239] Next, use Figure 11A-11B illustrate Figure 9 An example of executing the oddball task used in the inspection and electroencephalogram measurement of step 907.

[0240] Figure 11A This is an example of a weird task based on the fact that the type of inspection data is visual data, that is, image visual stimulation. In this example, a standard image ( Figure 11A ) star mark and the target image ( Figure 11A , 1104).

[0241] exist Figure 11A In FIG. 1 , the horizontal axis represents time in ms and the vertical axis represents potential in μV. The upper portion of the graph represents negative potential, and the lower portion represents positive potential. The upper portion 1101 of the graph shows the timing of presentation of the inspection data image.

[0242] The image presentation interval is set to 1.5 seconds (reference numeral 1102 ). This time is a reference value and is not limited to this time. The presentation interval is set based on the value described in the stimulus presentation interval 1007 of the test data storage table 1001 .

[0243] The measurement range of the electroencephalogram for the target and standard stimulation images includes a period of 1.5 seconds from 100 ms before presentation of these stimulations (reference value time 1103 is not limited to this time).

[0244] Furthermore, in order to verify the validity of the test results later, the electroencephalogram is measured not only for the target but also for the standard, and the results are saved. Alternatively, depending on the available data capacity, only the electroencephalogram for the target can be measured and saved.

[0245] according to Figure 10 The standard and target images are reproduced based on the stimulation sequence 1006 and the stimulation presentation interval 1007 of the table 1001 stored in the inspection data storage table 1001 of the inspection data storage unit 108 . Figure 11A This is an example of a case where the stimulus presentation interval 1007 is set to 1.5 s.

[0246] The lower part of the graph shows an example of electroencephalograms measured when an image of inspection data is presented. Figure 11A The example is an example of a case where the third photo of the target guardian is presented and the receiving button is pressed immediately thereafter. Figure 11A In the example of , the electroencephalogram is measured until the receive button is selected, so the electroencephalogram for the fourth and fifth criteria is not measured.

[0247] exist Figure 11A In the example, P300 appears in the electroencephalogram 1104 (the waveform during the period indicated by symbol 1105) when the target image is presented for the third time, but P300 does not appear in the electroencephalogram 1107 when the standard images are presented for the first and second times.

[0248] exist Figure 11A In the example, the measurement result of the brain wave when the target is presented is assumed to be the waveform of the 1.5 s period from 100 ms before the presentation of the target stimulus to 100 ms before the next standard stimulus prompt (point 1108) (the waveform of the period shown by symbol 1105).

[0249] exist Figure 11AIn the example shown, the electroencephalogram measurement ends when the user selects the receive button, but the measurement continues at least until the end point 1108 of the target electroencephalogram measurement period. Therefore, even if the receive button is selected before the end point 1108, the measurement continues until the end point 1108.

[0250] Figure 11B This is an example of an oddball task in which the type of examination data is auditory data, ie, sound auditory stimulation.

[0251] In this example, a sound ( Figure 11B )'s "bell" sound and the sound of being targeted ( Figure 11B , 1114) as an example of the sound of reading a guardian's name.

[0252] and Figure 11A Similarly, the horizontal axis represents time in ms, and the vertical axis represents potential in μV. The upper portion of the graph represents negative potential, and the lower portion represents positive potential. The image 1111 in the upper portion of the graph shows the timing of presentation of the inspection data sound.

[0253] The stimulus presentation interval is set to 1.5 seconds (reference numeral 1112 ). This time is a reference value and is not limited to this time.

[0254] The presentation interval is set according to the value described in the stimulus presentation interval 1007 of the inspection data storage table 1001 .

[0255] The measurement range of the electroencephalogram for the target and standard stimulation sounds includes a period of 1.5 seconds from 100 ms before the stimulation is presented (reference numeral 1113 ). This time is a reference value and is not limited to this time.

[0256] Furthermore, in order to verify the validity of the test results later, the electroencephalogram is measured not only for the target but also for the standard, and the results are saved. Alternatively, depending on the available data capacity, only the electroencephalogram for the target can be measured and saved.

[0257] The standard and target sounds are reproduced according to the stimulation sequence 1006 stored in the test data storage table 1001 and the stimulation presentation interval 1007 of the table 1001. Figure 11B This is an example of a case where the stimulus presentation interval 1007 is set to 1.5 s.

[0258] according to Figure 10 The stimulation sequence 1006 stored in the inspection data storage table 1001 of the inspection data storage unit 108 is reproduced.

[0259] The lower part of the graph shows the electroencephalogram measured when the examination data is presented.

[0260] Figure 11B The example is the third presentation in which a voice reads out the name of the target guardian and the receive button is pressed immediately thereafter.

[0261] exist Figure 11B In the example, the brain waves are measured until the receive button is selected, so the brain waves for the 4th and 5th standard presentations are not measured. Figure 11B In the example, P300 (symbol 1117) appears in the electroencephalogram when the target sound 1114 is presented for the third time (the waveform during the period shown by 1115), but P300 does not appear in the electroencephalogram when the standard sounds are presented for the first and second times.

[0262] The portion of the brainwave used by the cognitive function analysis unit 111 during target presentation is the waveform of the 1.5 s period from 100 ms before the presentation of the target stimulus 1114 to 100 ms before the next standard stimulus presentation (point 1108 ) (the waveform of the period indicated by reference numeral 1115 ).

[0263] exist Figure 11B In the example shown, the electroencephalogram measurement ends when the user selects the receive button, but the measurement continues at least until the end point 1118 of the target electroencephalogram measurement period. Therefore, even if the receive button is selected before the end point 1118, the measurement continues until the end point 1118.

[0264] (Table structure example of the electroencephalogram data storage unit)

[0265] Next, use Figure 12 An example of the structure of the electroencephalogram data table stored in the electroencephalogram data storage unit 106 will be described.

[0266] The electroencephalogram data table 1201 includes an ID No. 1202, the name of the caller (guardian) 1203 [Name], the stimulation type 1204 [image [P] or sound [V]], the measurement time 1205 [measurement start time 1206 and measurement end time 1207], the measurement data 1208 (μV, every 5 ms), the target and standard file numbers 1209 [Target_File_No 1210, Standard_File_No 1211], the target frequency 1212 [Target_Frequency], the stimulation order 1213 [Or1, Or2, Or3, Or4, Or5..., OrN], and the stimulation interval 1214 [SInt].

[0267] The measurement data 1208 receives the measurement results from the electroencephalogram measurement unit 105 and is stored in real time by the cognitive function test control unit 109 at intervals of 5 ms (however, the interval is not limited to this as long as a waveform equivalent to or longer can be measured).

[0268] In the target and standard file numbers 1209 [Target_File_No 1210 , Standard_File_No 1211 ], the target and standard file numbers used during the inspection are stored.

[0269] The target frequency 1212 stores the target frequency during inspection.

[0270] The stimulation sequence 1213 stores the order of reproduction of the target and standard files. For example, the order of symbols may be expressed as "t" for the target and "s" for the standard.

[0271] The stimulation interval 1214 stores the interval at which stimulation is presented during the examination.

[0272] (Example of table structure of analysis data storage unit)

[0273] Next, use Figure 13 An example of the structure of the analytical data storage table stored in analytical data storage unit 110 will be described.

[0274] Analysis data storage table 1301 includes ID No. 1302, data type 1303, measurement period 1304 for calculating analysis data, average P300 peak latency 1305 (ms), delay rate 1306 (%) from the period average of past peak latencies, P300 peak latency 1307 (ms) used for determining the presence or absence of signs, and required number of samples 1308. Required number of samples 1308 indicates the number of samples of electroencephalogram data required to calculate the P300 of the target electroencephalogram by arithmetic averaging.

[0275] exist Figure 13 In the example, three types of analysis data [DataType] 1303 are set.

[0276] One is analysis data derived from the user's past test results. This is indicated by the value 1 (defined by SelfLog) of the variable [DataType] (symbol 1309). The measurement period used to calculate the data for this analysis data is represented by the measurement period 1304 of the data obtained by calculating the analysis data. The average value of the P300 peak latency during this measurement period is stored in the P300 peak latency average value 1305. By setting a certain delay ratio in the P300 peak latency average value 1305, signs of cognitive impairment are calculated. This delay ratio is the delay rate 1306 (%) from the period average of past peak latencies. Furthermore, the value obtained by multiplying the P300 peak latency average value 1305 by the delay rate 1306 (%) from the period average of past peak latencies becomes the P300 peak latency 1307 (ms) used to determine the presence or absence of signs.

[0277] The remaining two are set as general data.

[0278] One is the average user age. This is represented by the value 2 (defined by AgeAve) of the variable [DataType] (symbol 1310). This value is stored in the P300 peak latency 1307, which is used to determine the presence or absence of signs. The measurement period 1304, the average value 1305 of the P300 peak latency, the delay rate (%) from the period average of the average peak latency 1306, and the required number of samples 1308, obtained by calculating the analysis data, are all data related to SelfLog 1309, so these values ​​are all set to 0.

[0279] The other is represented by the value 3 (defined by ADAgeAve) of the variable [DataType], which is the average age of patients with AD (symbol 1311 ).

[0280] This value is stored in the P300 peak latency 1307 used for determining the presence or absence of a sign.

[0281] The measurement period 1304 of the data obtained by calculating the analysis data, the average value 1305 of the peak latency of P300, the delay rate 1306 (%) from the period average value of the average peak latency, and the required number of samples 1308 are data related to SelfLog 1309, so these values ​​are all set to 0.

[0282] The measurement period 1304 of the data obtained by calculating the analysis data is composed of a start date 1312 [Start: YYYY-MM-DD] and an end date 1313 [YYYY-MM-DD].

[0283] 1314 shows an example of data entry in the SelfLog 1309 of the data type 1303 .

[0284] 1315 shows an example of data entry of AgeAve 1310 of data type 1303 .

[0285] 1316 shows an example of data entry of ADAgeAve1311 of data type 1303.

[0286] Here, regarding the average value 1310 [AgeAve] for each age and the average age 1311 [ADAgeAve] of Alzheimer's patients, data selected according to the user's age from the average value data initially pre-stored in the device can be stored, or results retrieved according to the user's age by accessing a medical database when a network connection is possible can be stored.

[0287] Furthermore, the data type 1303 to be compared is set in advance by initial setting, mode change, or the like.

[0288] (Example of table structure for the cognitive function analysis result storage unit)

[0289] Reference Figure 14 A configuration example of a table stored in the analysis result storage unit 112 will be described.

[0290] Table 1401 of the cognitive function analysis result storage unit includes the analysis result ID No. 1402, the calculation period 1403 of the data for calculating the average time of the peak latency of P300, the caller 1404, the stimulus type 1405, the average peak latency of P300 1406, the analysis data type 1407 used in symptom detection, and the result of the symptom presence or absence judgment 1408.

[0291] The calculation period 1403 for calculating the data of the average time of the peak latency of P300 is composed of a start date and time 1409 and an end date and time 1410 .

[0292] In addition, the stimulus type 1405 is a visual stimulus: [P] 1411 or an auditory stimulus [V] 1412 .

[0293] The average peak latency of P300 1406 is the average during the data calculation period, and the unit is ms.

[0294] In [DataType] of the analysis data type 1407, when using one's own past P300 peak latency, a value of 1 is stored (SelfLog1413), when using the average value of the P300 peak latency of the user's age, a value of 2 is stored (AgeAve1414), and when using the average value of the P300 peak latency of the average age of Alzheimer's patients, a value of 3 is stored (ADAgeAve1415).

[0295] In [Result] 1416 of the sign presence / absence determination result 1408 , 1 is set (symbol 1417 ) when there is a sign, and 0 is set (symbol 1418 ) when there is no sign.

[0296] (Processing flow of the Cognitive Function Analysis Department)

[0297] Next, use Figure 15 The processing contents of the cognitive function analysis unit 111 of the present invention will be described.

[0298] In this embodiment, the description is based on the premise that the data analysis period is predetermined. For example, it may be the last day of the month or the last day of a period determined by the user.

[0299] The cognitive function analysis unit 111 uses the timer 119 to manage a schedule for performing cognitive function data analysis on electroencephalogram data. For example, the unit checks whether the next data analysis period has arrived (step 1501 ). If not (step 1501 / "No"), the process ends.

[0300] When the data analysis period has arrived (step 1501 / “Yes”), a guardian Xn who has stored data within the analysis period is selected (step 1502 ).

[0301] Next, data for each stored data type is extracted from the data stored during the analysis period (step 1503). Specifically, the caller (caregiver) selected from the caller's (caregiver's) name 1203 in the electroencephalogram data table 1201 is searched for, and data for each stimulation type 1204 is extracted from the corresponding results (step 1503).

[0302] Next, it is determined whether or not the data extracted in step 1503 contain the necessary minimum data samples (step 1504 ).

[0303] In the analytical data storage table 1301 , SelfLog 1309 is selected, and the value of the required number of samples 1308 is referred to to check the minimum necessary data samples.

[0304] If there is a sample (step 1504 / “Yes”), the measured waveform data appearing in response to the target stimulus is extracted from the stored electroencephalogram data with reference to the order of the stimulation data and temporarily stored in the buffer (step 1505 ).

[0305] Regarding the order of stimulation data, the order of "t" is examined by referring to stimulation order 1213 in electroencephalogram data table 1201. The time at which "t" appears is calculated based on the duration of the stimulation interval. The data for that period is then extracted from measurement data 1208. For example, if "t" is the third and the stimulation interval is 1.5 seconds, the target will appear approximately 3 seconds later, so the corresponding data is from 3 seconds to 4.5 seconds of the measurement data. In reality, the data to be analyzed is from 0.1 milliseconds before the stimulation is presented, but measurement data is also measured from 0.1 seconds before the stimulation is presented, so only the measurement data from 3 seconds to 4.5 seconds will be extracted.

[0306] The buffer is provided on the RAM 213 and is managed by the cognitive function analysis unit 111 .

[0307] Next, the waveform extraction for the target period is confirmed from the results extracted in step 1503 (step 1506). If not (step 1506 / No), the target measurement waveform data is extracted and temporarily stored in the buffer (step 1505). The buffer stores and saves the waveform identification number [Wave_No], caller guardian [Name], stimulation type [P] or [V], measurement time (measurement start time: [Start_Time], measurement end time: [Start_Time]), target waveform data μV, every 5 ms, and stimulation interval [SInt].

[0308] If the waveform of the target period is extracted from the results extracted in step 1503 in step 1506 (step 1506 / "Yes"), the added mean of the P300 peak latency is calculated using the electroencephalogram data of the target stimulus accumulated in the extracted buffer (step 1507).

[0309] Next, the calculation result of the arithmetic mean of P300 in the set period is stored in the average peak latency of P300 1406 of the analysis result storage unit 112 (step 1508 ).

[0310] Next, data type 1303 to be compared is selected from analytical data storage table 1301 in analytical data storage unit 110 (step 1509 ).

[0311] Next, the value of the P300 peak latency 1307 used for determining the presence or absence of a sign of the selected data type 1303 is compared with the average time of the P300 peak latency within the analysis period calculated in step 1507 (step 1510 ).

[0312] If the value of the peak latency 1307 of the P300 used in determining the presence or absence of a sign for the selected data type 1303 in step 1510 is less than or equal to that of the peak latency 1307 of the P300 (step 1511 / "No"), it is determined that there is no sign, and this result is saved in table 1401 of the analysis result storage unit 112 together with the type of analysis data used as a comparison object (step 1512).

[0313] If the value of the peak latency 1307 of P300 used in determining the presence or absence of signs is greater than that of the selected data type 1303 in step 1510 (step 1511 / "Yes"), it is determined that there is a sign, and the result is saved together with the type of analysis data used as a comparison object in the average peak latency 1406 of P300 in table 1401 of the analysis result storage unit 112 (step 1513).

[0314] It is checked whether all data types 1303 in analytical data storage table 1301 have been compared (step 1514 ). If not (step 1514 / “No”), a data type to be compared in analytical data storage unit 110 is selected (step 1509 ).

[0315] exist Figure 13 In the example of , three data types are registered. In this case, in step 1514, it is checked whether comparison with these three data types has been performed.

[0316] It is checked whether comparison with all data types 1303 has been performed. If comparison has been performed (step 1514 / "Yes"), it is confirmed whether analysis has been performed on the data of all guardians (step 1515). If analysis has been performed (step 1515 / "Yes"), the process ends.

[0317] Referring to the caller (guardian) name 1203 in the electroencephalogram data table 1201, it is confirmed whether the data of all guardians have been analyzed (step 1515). If not analyzed (step 1515 / "No"), the guardian Xn with stored data during the analysis period is selected (step 1502).

[0318] The reason for analyzing EEG data for each individual is that the images and sounds presented to the user as data stimuli during measurement are different for each individual. Furthermore, EEG data is analyzed for each visual or auditory stimulus because the trends in P300 peak latency vary depending on the type of stimulus used.

[0319] (Example of cognitive function analysis results)

[0320] Figure 16 An example of cognitive function analysis results for a specific caregiver is shown. Figure 16 The example of FIG. 1 is an example in which the calculation period for the average peak latency is set to 1601, and the peak latency of P300 for each month is analyzed. The horizontal axis represents the measurement month unit, and the vertical axis represents the peak latency of P300.

[0321] exist Figure 16 In the example, the analytical data storage unit 110 is pre-set to define a delay of 15% or more in the average time of the peak latency of P300 in monthly units compared with the results of the past three months as a sign of cognitive function decline.

[0322] The peak latency of P300 in May 2016 (symbol 1602) was delayed by more than 15% (symbol 1604) compared to the average peak latency of P300 in the past three months (symbol 1603), so it was judged to be a sign.

[0323] In addition, for each guardian, calculate Figure 16 Therefore, even in the same period, depending on the guardian, there are cases where it is judged that there are signs and cases where it is judged that there are no signs. However, even for a single person, it is possible to judge that there are signs when it is judged that there are signs, or it is possible to judge that there are signs when the results for all registered guardians show that there are signs.

[0324] like Figure 16 The analysis results of the peak latency of P300 shown above can also be notified to a specific caregiver when a sign is detected or every time the results are calculated through monthly analysis.

[0325] According to this embodiment, by automatically generating unusual tasks, automatically executing them, and automatically measuring brain waves during these tasks, the user's (subject's) cognitive function status can be checked in daily life. In this case, by presenting the unusual task during an action with a different purpose than the cognitive function test, such as responding to a phone call, and acquiring corresponding brain wave data, the user is less likely to notice that a cognitive function test has been performed. This reduces the psychological burden on the user during the cognitive function test.

[0326] Furthermore, by providing a function of automatically analyzing the test results, the state of the user's cognitive function can be checked regularly.

[0327] In addition, according to this embodiment, it is possible to automatically generate data for cognitive function tests using a DB that stores stimuli for odd tasks. In addition, it is possible to detect that brain waves can be measured in the brain wave measurement unit, execute data for cognitive function tests automatically generated in response to this, and measure and store the brain waves at this time. In addition, it is possible to implement cognitive function tests using the user's priority sensory stimulation. As a result, the elderly can easily and continuously implement cognitive function tests in their daily lives. In addition, when a decrease in cognitive function is detected, the results of the test can be notified to the person himself or the guardian of the pre-registered relevant person user.

[0328] <Second embodiment>

[0329] A smartphone having the cognitive function test function described in the first embodiment is characterized in that, when a phone call comes in, the receiver pays attention to who the caller is, confirms that the caller is an acquaintance through an incoming call image, an incoming call sound, etc., and then answers the call. Such general phone usage actions are selected and utilized in an odd task. When a call comes in from a guardian, an incoming call image or an incoming call sound automatically generated according to the odd task is displayed or reproduced to the user, and the user's brain wave P300 induced in response to the call is measured / analyzed, thereby testing the user's cognitive function.

[0330] As mentioned above, the stimuli that induce the P300 in oddball tasks include hearing, vision, and physical sensation. Generally, people have a sense that they prioritize among these (a dominant sense), and this differs from person to person. Therefore, people with an auditory advantage might use sounds in oddball tasks, while those with a visual advantage might use images. This could improve user convenience and allow for more frequent cognitive function testing.

[0331] Generally speaking, the dominance of the above three senses is known by analyzing the predicates (verbs, adjectives, adverbs) in the language used in daily life. In the present invention, it is possible to select the type of stimulation used in the cognitive function test, such as visual or auditory, based on the difference in the preferred senses of each person by making use of this. More specifically, the predicates contained in at least one of the subject's past conversations and emails are extracted, and the frequency of use of visual expressions and auditory expressions shown in the predicates is calculated. If the frequency of use of visual expressions is high, it is decided to use visual stimulation as the type of stimulation for the test data presented to the subject. If the frequency of use of auditory expressions is high, it is decided to use auditory stimulation as the type of stimulation for the test data presented to the subject.

[0332] In order to analyze the above-mentioned descriptive words, a text database for language research called a "corpus" available on the Internet is used to analyze the descriptive words and analyze the dominance of the user's feelings.

[0333] This embodiment is characterized in that data such as emails or calls are analyzed with an eye to descriptive words to determine the sensory dominance of the user, and based on the result, the type of sensory data used in the inspection is determined, for example, a structure for determining whether to use visual images or auditory sounds is installed in a device that can use vision and hearing.

[0334] (Example of cognitive function analysis results)

[0335] Figure 17 This is a functional block diagram of the cognitive function testing device (smartphone) used in this embodiment.

[0336] Compared with the first embodiment Figure 1 The difference is that it has a priority feeling analysis unit 1701 inside, which obtains user data related to emails and calls (sent emails, call records) stored in the memory of an information device (smartphone 1702, PC, tablet 1703) connected to the external network via the communication unit 116 or on the cloud 1704, and analyzes the user's priority feeling.

[0337] Individuals increasingly own multiple devices, including smartphones, PCs, and tablets. This is accompanied by an increase in the use of cloud services to upload information such as emails, address books, images, and audio to change device models and share various data between devices. Furthermore, smartphones that have been discontinued due to model changes, for example, may retain a user's past activity history, such as call logs and content playback history. In this embodiment, this information is used to determine a user's perceived superiority.

[0338] Furthermore, when analyzing the priority sense by descriptive words (verbs, adverbs, adjectives), the above-mentioned corpus 1705 is used.

[0339] The processing of the priority sense analysis unit 1701 is executed at the time of initial setting.

[0340] The cognitive function test device 1706 of this embodiment includes a priority feeling analysis unit 1701, which analyzes the user's priority feeling based on the user data (sent emails, call records) related to emails and calls in the information equipment (1702, 1703) connected to the outside via the communication unit 116 or on the cloud 1704. The other functional blocks are related to Figure 1 Same block structure.

[0341] In addition, Figure 17In the example, corpus 1705 uses a corpus on the Internet, but it takes time to search for vocabulary in a general corpus on the Internet, so it is also possible to make use of corpora on the Internet and create a corpus for visual and auditory vocabulary analysis and configure it in the device.

[0342] In registering data to the weird task data storage unit 103, the user can extract and register the data registered in the weird task data storage unit 103 (guardian's phone number, name, email address, voice, photo) from the address book data, photos recorded in the photo album, and call log data already recorded in the smartphone, or register the data using data newly sent from the guardian.

[0343] Alternatively, you can register using data stored on another smartphone or cloud that can be connected to the Internet.

[0344] (Priority sensory analysis processing flow)

[0345] Next, use Figure 18 The content of the priority feeling analysis process performed by the priority feeling analysis unit 1701, which is a feature of the present invention, will be described.

[0346] During the initial setup of this embodiment, the priority sensory analysis unit 1701 attempts to connect to an external device (1702, 1703) or the cloud 1704 via the communication unit 116 (step 1801). The priority sensory analysis unit 1701 confirms whether it can connect to the external device or cloud (step 1802). If it cannot connect (step 1802 / No), it checks whether it has failed N times or more (step 1803). If not (step 1803 / No), it attempts to connect to the external device or cloud (step 1801). If it has failed N times or more (step 1803 / Yes), the process ends.

[0347] The priority perception analysis unit 1701 checks whether the connection is possible (step 1802), checks whether the user's past outgoing emails exist on the connected external device or cloud (step 1802 / Yes), and checks whether past outgoing emails exist (step 1804). If so, the outgoing emails are analyzed for part of speech (step 1805). Descriptive words (verbs, adjectives, and adverbs) are extracted from the results of the part of speech analysis (step 1806).

[0348] Next, the corpus 1705 on the Internet is referenced to extract words that express visual and auditory senses, classify them according to visual and auditory senses, and analyze the frequency of occurrence of each of these senses (step 1807).

[0349] Examples of visual expressions include "see," "shine," "bright," "sparkle," and "dazzle." Examples of auditory expressions include "hear," "speak," "loud," "noisy," and "quiet." A corpus available on the Internet can be used directly as the corpus, or dedicated databases for visual and auditory expressions can be created using data from corpora on the Internet and stored within device 1706.

[0350] Next, the priority sensory analysis unit 1701 receives the results of the visual and auditory vocabulary frequency analysis in step 1807 and checks whether the visual vocabulary frequency is high (step 1808). If so (step 1808 / "Yes"), the cognitive function test control unit 109 sets the test to use images, and the process ends (step 1809). On the other hand, if the visual vocabulary frequency is not high (step 1808 / "No"), the test is set to use audio (step 1810), and the process ends.

[0351] If no past emails sent by the user exist in step 1804 (step 1804 / No), the system checks whether there are past call audio recordings (step 1811). If there are past call audio recordings (step 1811 / Yes), a part-of-speech analysis is performed (step 1805) to analyze the perceived priority. Before call analysis can be performed, the audio data must be converted to text. This conversion to text data can be performed using audio-to-text software stored on smartphones 1702, PCs, tablets 1703, or cloud computing systems 1704, or by installing the software in the device of the present invention.

[0352] If no past audio recordings of the user's calls exist in step 1811 (step 1811 / No), the system checks for the presence of produced sentences (step 1812). If produced sentences exist (step 1812 / Yes), the sentences are analyzed for part of speech (step 1805) to determine their perceived priority. If no produced sentences exist in step 1812 (step 1812 / No), the process ends. In this case, a cognitive function test based on a default stimulus pre-determined at the time the device is shipped can also be performed. The default stimulus can be either visual or auditory.

[0353] Here, in Figure 18 While the priority perception is analyzed based on descriptive word analysis, it is also possible to analyze the priority perception based on the frequency of content playback. Specifically, the playback frequency of both visual and audio content is investigated separately. If the playback frequency of visual content is high, the process is terminated using images. Alternatively, if the playback frequency of audio content is high, the process is terminated using audio.

[0354] Alternatively, a questionnaire for analyzing the priority sense may be presented and the answers to the questions may be analyzed to determine the priority sense, and the type of stimulation data used in the cognitive function test may be selected based on the result.

[0355] As described above, the type of stimulation data used in cognitive function testing is set based on the preferred sense. However, the type of stimulation data (image or sound) used in cognitive function testing can also be automatically changed based on the surrounding conditions. For example, in situations where sound is disturbing to the surroundings, the use of visual (image) data can be changed. The surrounding conditions can be set manually by the user or based on location information using information such as GPS.

[0356] As described above, the cognitive function testing device 1706 of this embodiment is equipped with the priority sense analyzing unit 1701 , and can thereby test the cognitive function using data on the sense that the user preferentially uses.

[0357] <Third embodiment>

[0358] A smartphone equipped with the cognitive function testing function described in the first and second embodiments performs cognitive function testing using situations and timings that occur in everyday activities, such as incoming phone calls from caregivers. This eliminates the psychological burden of cognitive function testing on users, particularly the elderly, and allows for easy early detection of dementia during daily activities.

[0359] In this embodiment, an example of implementing a cognitive function test in daily actions other than an incoming call is described. Figure 1 as well as Figure 17 The structure of the record.

[0360] (Example of how to use the alarm clock)

[0361] use Figure 19A to Figure 19D , showing how to use an alarm clock (including a wake-up clock and a scheduler) for cognitive function testing. The alarm clock function is performed by timer 119. The user sets the alarm using an application that uses timer 119 (e.g., a wake-up application, a scheduler, etc.).

[0362] When the time (or event) preset by the user arrives, the timer 119 reproduces an alarm sound or generates vibration via the sound output unit 117 and notifies the cognitive function test control unit 109 ( Figure 19A ).

[0363] When the user holds the smartphone and touches the surface of his hand to the electroencephalogram measurement electrodes 302 and 303 on the back or the electroencephalogram measurement electrodes 306 and 307 on the side of the smartphone, the cognitive function test control unit 109 detects that the electroencephalogram measurement unit 105 can measure the electroencephalogram via the electrodes, and uses the test data creation unit 107 to create test data, and displays the test data on the display unit 115, thereby starting the cognitive function test ( Figure 19B ).

[0364] In order to turn off the alarm, the user views the inspection data generated by the inspection data generating unit 107 and displayed on the screen of the display unit 115 ( Figure 19C ). On the screen, an image 1901 such as an emoji that serves as a standard stimulus for the odd task and an icon 1902 for the switch OFF that serves as a target are randomly displayed. The switch OFF icon 1902 is displayed at a low frequency similar to the first embodiment described above. The user focuses on the display of the switch OFF icon 1902 from a series of displayed screens 1903, and when the switch OFF icon 1902 is displayed, the user touches the switch OFF icon 1902 on the screen to turn off the alarm sound ( Figure 19D When the alarm sound turns off, the timer 119 notifies the cognitive function test control unit 109 of this fact, and the cognitive function test control unit 109 ends the cognitive function test. The method of analyzing the signs of dementia using the measurement results is the same as that of the first embodiment.

[0365] In addition to the above alarm clock operations, cognitive function tests can also be performed.

[0366] Whenever a user turns pages using an e-book application installed on a smartphone of the present invention, a predetermined character, pop-up window, or color change is displayed on a page or specific page (such as the table of contents, section / chapter titles, or pages with illustrations or photos) that the user appears interested in. EEG waves are then measured throughout or partially throughout the reading process, from the time the book is opened to the time it is closed, and the P300 of the EEG waves is analyzed when there are changes in the pages. In this case, the frequency of pages that appear to be of interest is set below a certain value.

[0367] In this case, the target image is a page screen displaying predetermined characters and a pop-up window, and the standard image is a page screen displaying neither characters nor a pop-up window.

[0368] The cognitive function test is performed from the time when the electronic book application is executed on the smartphone and the user touches any two of the electroencephalogram measurement electrodes 302 , 303 , 306 , and 307 to the time when the electronic book application is terminated.

[0369] In addition, when viewing video content on the smartphone of this embodiment, videos related to the content to be viewed (such as the title of the content, etc.) are mixed and reproduced at a low frequency between standard videos in the weird task storage unit that are unrelated to the content viewed at the start of playback.

[0370] When changing the content being viewed, the same method of video playback is performed immediately after the content is changed. When the video playback app in the smartphone is set up as described above, the brainwaves during viewing are measured, and the P300 of the brainwaves when the video related to the desired content is played back is analyzed to examine cognitive function.

[0371] In this case, the target image is, for example, the title of the content the user wants to watch, and the standard image is the data in the standard management table stored in the odd task data storage unit. Alternatively, other images pre-stored in the smartphone may be used as the standard.

[0372] The cognitive function test is performed from the time when the user touches any two of the electroencephalogram measurement electrodes 302 , 303 , 306 , and 307 with their hands when the content playback application is activated until the playback of the content or the change of the content is completed.

[0373] Furthermore, favorite images and sounds are registered as startup wallpapers and startup sounds, and these are then played back after the startup process ends. When the startup processing method within the smartphone is set as described above, brainwaves are measured during startup, and the P300 of the brainwaves when the favorite wallpapers and startup sounds are played back is analyzed to analyze cognitive function.

[0374] In this case, the target image and sound are those already set as wallpaper, and the standard image and sound are those stored in the standard management table in the odd task data storage unit. The standard image and sound may also be other images and sounds not registered as favorites but pre-stored in the smartphone.

[0375] The cognitive function test starts from when the user touches any two of the electroencephalogram measurement electrodes 302 , 303 , 306 , and 307 when the smartphone is activated, and ends when the user displays or reproduces a favorite wallpaper or startup sound at the end of the activation.

[0376] Furthermore, when measuring with a thermometer, etc., an unrelated screen or sound is displayed or played back slightly before the measurement result is displayed, and then a screen displaying the result or a sound reading out the result is output. When the temperature measurement app in a smartphone is set up as described above, the brainwave during temperature measurement is measured, and the P300 of the brainwave when the measurement result is displayed or read out is analyzed and checked. The temperature sensor can be used by connecting to the smartphone or installed internally.

[0377] In this case, the target image or sound is the body temperature measurement result (image or sound), and the standard is the data (image or sound) in the standard management table stored in the odd task data storage unit 103. Other images or sounds pre-stored in the smartphone may also be used as the standard.

[0378] The cognitive function test is performed from the time when the hand touches any two of the electroencephalogram measurement electrodes 302 , 303 , 306 , and 307 at the start of body temperature measurement until the body temperature measurement result is displayed or reproduced.

[0379] In addition, the game randomly displays characters and other images in low-frequency intervals between images of symbols. When a character appears, the player touches the screen or presses a button on the device. Encephalograms are measured while playing this game on a smartphone, and the P300 of the brainwave when the characters appear on the screen is analyzed to assess cognitive function.

[0380] The game involves randomly mixing different sounds (such as musical instruments, human voices, bird calls, and vehicle horns) at low frequencies between individual sounds. Players are asked to press buttons or move their hands or feet while playing the different sounds. Brain waves are measured while playing the game on a smartphone, and the P300 peak of these waves, which is detected during the playback of these different sounds, is analyzed to assess cognitive function.

[0381] In this case, the target is an image of a character or the like, and the standard is an image in the standard management table stored in the odd task data storage unit. The standard may also be another image pre-stored in the smartphone.

[0382] The cognitive function test is performed from the time the player touches any two of the electroencephalogram measurement electrodes 302 , 303 , 306 , and 307 with their hands at the start of the game until the end of the game.

[0383] While the above primarily describes smartphone applications, the present invention is not limited to these. For example, even landline phones can function similarly to smartphones. Furthermore, even a hallway intercom, for example, can function similarly to the smartphone's incoming call display.

[0384] <Fourth embodiment>

[0385] In the above embodiment, a smartphone-based device was used as the cognitive function test device. In this embodiment, other shapes and forms are described below.

[0386] First, the description will Figure 1 1 is a functional block diagram of the cognitive function testing system of the present invention in which the electroencephalogram measuring unit 105 is installed in the measuring device.

[0387] Figure 27 This is a functional block diagram of a cognitive function testing system including a cognitive function measuring device and an electroencephalogram measuring device.

[0388] Figure 27 The present invention is shown to be realized as a smartphone case ( Figure 20A to Figure 20D ), frames for glasses or sunglasses ( Figure 21A ),earphone( Figure 22A ), hearing aids ( Figure 23A as well as Figure 23B ),mouse( Figure 24A ), TV remote control (the following TV remote control: Figure 25A ) and smartphones with cognitive function testing capabilities ( Figure 21B ), a tablet PC (2110), a desktop PC, a notebook PC, an e-book TV main body (2111), a radio receiver main body (2214), etc. A mouse is an example of an information input device, and a device that cooperates with it is an information processing device, such as a PC, that operates according to operation information input from the mouse.

[0389] Functional block diagram of the first embodiment ( Figure 1 ) is that the electroencephalogram measurement unit 105 is incorporated into a measurement device 2703 comprised of an external device. Furthermore, the measurement device 2703 including the electroencephalogram measurement unit 2705 also includes a communication unit 2704, enabling the cognitive function testing device 2701, such as a smartphone, and the measurement device 2703 including the electroencephalogram measurement unit 2705 to collaborate via the communication unit 2704.

[0390] Below, we use a smartphone as a cognitive function test device ( Figure 21B ) is used as an example to illustrate.

[0391] Furthermore, the communication between the cognitive function testing device 2701 and the measurement device 2703 including the electroencephalogram measurement unit 2705 may be wired or wireless.

[0392] The cognitive function testing system of the present invention includes a cognitive function testing device 2701 and a measuring device 2703 .

[0393] The cognitive function testing device 2701 includes a cognitive function measuring / determining unit 2702 , an operating unit 114 , a display unit 115 , a communication unit 116 , a sound output unit 117 , a sound input unit 118 , and a timer 119 .

[0394] The user performs operation input on the cognitive function testing device 2701 in the operation unit 114 .

[0395] The display unit 115 displays an operation screen and various information for the user.

[0396] The communication unit 116 communicates with external devices via various networks (telephone network, WiFi, Bluetooth, etc.) In this embodiment, the communication unit 116 also operates as an electroencephalogram data acquisition unit.

[0397] The audio output unit 117 and the audio input unit 118 output and input audio via a microphone and a speaker.

[0398] The timer 119 is a clock, an alarm clock, a stopwatch, or the like, and measures time.

[0399] The cognitive function measurement / determination unit 2702 is configured to include a strange task data storage unit 103, a caller determination unit 104, an electroencephalogram data storage unit 106, an inspection data production unit 107, an inspection data storage unit 108, a cognitive function inspection control unit 109, an analysis data storage unit 110, a cognitive function analysis unit 111, an analysis result storage unit 112, and a cognitive function reduction notification unit 113.

[0400] The unusual task data storage unit 103 is a portion for storing data for unusual tasks.

[0401] The unusual task data storage unit 103 stores information related to a person (guardian) who guards a user who is a subject of a cognitive function test, such as the guardian's phone number, name, email address, voice, and photo.

[0402] When receiving a phone call or an email via the communication unit 116 , the caller determination unit 104 determines whether the caller is a guardian registered in the strange task data storage unit 103 .

[0403] The electroencephalogram data storage unit 106 records the electroencephalogram measured by the measurement device 2703 .

[0404] The test data generating unit 107 automatically generates data for cognitive function testing using the guardian's voice, photos, images such as emojis pre-recorded in the smartphone, and ringtones stored in the unusual task data storage unit 103 .

[0405] The inspection data storage unit 108 stores the inspection data created by the inspection data creating unit 107 .

[0406] The cognitive function examination control unit 109 is a part that detects the potential from the electrodes in the above-mentioned measuring device 2703 and can measure brain waves, and starts the examination using the examination data stored in the examination data storage unit 108 to record the measured brain waves in the brain wave data storage unit 106, and executes the control of the entire part that constitutes the cognitive function measurement / determination unit 2702.

[0407] The analytical data storage unit 110 stores data used for analyzing and evaluating cognitive functions.

[0408] The cognitive function analysis unit 111 analyzes the electroencephalogram measurement results recorded in the electroencephalogram data storage unit 106 and compares them with the data calculated in advance in the analysis data storage unit 110 to perform cognitive function analysis.

[0409] The analysis result storage unit 112 records the analysis result of the cognitive function analysis unit 111 .

[0410] When the cognitive function analyzing unit 111 detects a decrease in cognitive function and a sign of dementia, the cognitive function reduction notifying unit 113 notifies a guardian registered in advance in the unusual task data storage unit 103 .

[0411] Here, the guardian registered in the unusual task data storage unit 103 is a person who silently monitors the life and health of the user (elderly person) whose cognitive function is being tested, such as a relative or caregiver. By using the cognitive function testing device 2701 (smartphone), the guardian can monitor the user's (elderly person's) cognitive function status in daily life from a remote location.

[0412] The data registered in the weird task data storage unit 103 can use the data in the smartphone's stored address book (telephone number, name, address, email address, etc.), photos recorded in the built-in memory or SD card, data recorded in the call log (telephone number, name, email address, voice, photo), or can use data newly sent from the guardian to register.

[0413] The measurement device 2703 is configured to include a communication unit 2704 and an electroencephalogram measurement unit 2705 .

[0414] The communication unit 2704 communicates with external devices via various networks (WiFi, Bluetooth, etc.).

[0415] The electroencephalogram measurement unit 2705 measures electroencephalograms of the user who is to be tested for cognitive function.

[0416] As described above, in the cognitive function test system of this embodiment, the cognitive function test device 2701 is, for example, a smartphone ( Figure 21B), tablet PC 2110, desktop PC, notebook PC, e-book, TV main body 2111, radio receiver main body 2214, etc.

[0417] In addition, the measuring device 2703 is a smart phone case ( Figure 20A 、 Figure 20B 、 Figure 20C ), frames for glasses or sunglasses ( Figure 21A ),earphone( Figure 22A ), hearing aids ( Figure 23A as well as Figure 23B ),mouse( Figure 24A ), TV remote control (the following TV remote control: Figure 25A )wait.

[0418] In addition, in the cognitive function test system of this embodiment, Figure 2 The hardware of the cognitive function testing / determination unit 102 described above, such as the electroencephalogram measurement electrodes 221, signal processing device 222, ADC 223, CPU 211, ROM 212, RAM 213, and storage device 214, is installed in either the cognitive function testing device 2701 or the measurement device 2703. Furthermore, the communication module 227 is installed in both devices.

[0419] However, the cognitive function testing device 2701 and the measurement device 2703 constituting the cognitive function testing system of this embodiment are not limited to the above-mentioned devices. In addition, the communication between the cognitive function testing device and the electroencephalogram measurement device may be wireless or wired.

[0420] The following describes the functional blocks and hardware configurations for each implementation example.

[0421] (Example of a smartphone case)

[0422] Figures 20A-20D This is an example of a case where the electroencephalogram measurement unit 2705 is attached to a smartphone case. Figure 1 The parts other than the electroencephalogram measurement unit 2705 are provided in the smartphone.

[0423] Figure 20A 、 Figure 20B 、 Figure 20C The back, side, and front surfaces of the smartphone case are shown respectively.

[0424] The smartphone case (back 2001, left side 2007, right side 2008, front 2015) is equipped with electrodes for measuring electroencephalograms (electrodes 2002 and 2003 on the back, and electrodes 2009 and 2010 on the side), a signal processing device 222, an ADC 223, and a communication module 227 for transmitting the detected potential. This communication module 227 is a wireless communication module.

[0425] The signal processing device 222 , the ADC 223 , and the communication module 227 for transmitting the detected potential are mounted on the back surface (reference numeral 2006 ). However, the mounting location is not limited to the position 2006 .

[0426] Electrode electrodes 2002 and 2003 are attached to two locations on the back surface 2001 of the smartphone case, and electrodes 2009 and 2010 are attached to two locations on the left side 2007 and the right side 2008 of the smartphone case.

[0427] The four electroencephalogram measurement electrodes, namely the electrodes 2002 and 2003 on the back and the electrodes 2009 and 2010 on the left and right sides, can be combined according to the potential detection conditions (two electrodes are required for measurement by bipolar sensing).

[0428] Furthermore, lights are provided on the back 2001, left side 2007, right side 2008, and front 2015 of the smartphone case to frame the electrodes. These lights are shown in the figure as lights 2004 and 2005 on the back, lights 2011, 2012, 2013, and 2014 on the side surfaces, and lights 2016 and 2017 on the front surface. The lights can be configured to change color. The lights illuminate in response to an incoming call, clearly indicating the location of the electroencephalogram (Electrodes 2002 and 2003 on the back, and electrodes 2010 and 2009 on the right side 2008 and left side 2007). Furthermore, the lights clearly indicate the location of the electroencephalogram (Electrodes 2002 and 2003 on the back, and electrodes 2010 and 2010 on the back) even in dark places. This allows the user to accurately identify the areas where the EEG measurement electrodes are located, namely, electrodes 2002 and 2003 on the side surfaces or electrodes 2009 and 2010 on the back surface. In addition, the lights 2004 and 2005 arranged on the back, the lights 2011, 2012, 2013 and 2014 arranged on the sides, and the lights 2016 and 2017 arranged on the front surface are installed on the back 2001, left side 2007, right side 2008 and front surface 2015 of the smartphone case, so no matter what state the smartphone is set in, the user can accurately know the incoming call and the location of the electrode.

[0429] Figure 20DThis is a diagram showing a smartphone case (back surface 2001, right side 2008, left side 2007, front surface 2015) attached to a smartphone 2018 and viewed from the front.

[0430] In the cognitive function inspection system based on the smartphone 2018 and the smartphone case (back surface 2001, right side 2008, left side 2007, front surface 2015), the alarm clock, page turning of electronic books, playback of video content, smartphone startup processing, temperature measurement, and games shown in the third embodiment can be implemented.

[0431] (Example of eyeglass frames)

[0432] Figure 21A This is an example of a case where the electroencephalogram measurement unit 105 in the cognitive function testing device 101 of the present invention is attached to a frame 2101 of glasses or sunglasses.

[0433] The following description uses glasses as an example. In glasses equipped with an electroencephalogram measuring unit 2705 , a frame 2101 includes electrodes ( 2102 , 2103 , 2104 , 2105 ) for measuring electroencephalograms, a signal processing device 222 , an ADC 223 , and a communication module 227 for wirelessly transmitting the detected potential.

[0434] Here, the four electrodes on the eyeglass frame can be combined to form bipolar electrodes, depending on the contact between the glasses and the body during wear. By contacting the body at least two locations, brain waves can be measured. The four electrodes (2102, 2103, 2104, and 2105) can measure up to three channels of brain waves (for example, one channel using the combination of 2102 and 2103, one channel using the combination of 2104 and 2105, or one channel using the combination of 2102 and either 2104 or 2105). Measuring three channels of brain waves requires all electrodes to be in contact with the body.

[0435] Since AD ​​begins to progress in the temporal lobe, the combination of electrodes 2102 and 2103 or the combination of electrodes 2104 and 2105 is prioritized for measurement. Alternatively, the measurement results of these combinations are prioritized. Signal processing device 222, ADC 223, and communication module 227, which wirelessly transmits detected potentials, are mounted on the end portions (2106 and 2107) of the frame. The mounting locations of signal processing device 222, ADC 223, and communication module 227 are not limited to 2106 and 2107.

[0436] The measured electroencephalogram potential is amplified and converted into a digital signal after signal processing, which is then transmitted to a pre-paired smartphone 2109 for processing. If the potential is not detected at all electrodes due to the way the glasses are worn, a warning is displayed on the screen of the smartphone 2109 to notify the user. Power is supplied by a small battery 2108 provided in the frame 2101.

[0437] As cognitive function testing devices that cooperate with the frame 2101, there are, in addition to smartphones, e-books, tablet PCs 2110, TVs, and PCs.

[0438] Figure 21C Tablet PC 2110 is shown cooperating with mirror frame 2101. Figure 21D An example of a television set (TV main body 2111 and remote control 2112 ) cooperating with a mirror frame 2101 is shown. The television set is configured to include a TV main body 2111 and a remote control 2112 .

[0439] In a cognitive function examination system including a frame 2101 and a smartphone 2109, an electronic book, a tablet PC 2110, a television (TV body 2111, remote control 2112), a PC (desktop PC, notebook PC, etc., not shown here), etc., the alarm clock, page turning of an electronic book, playback of image content, startup processing, temperature measurement, and games shown in the third embodiment can be implemented.

[0440] (Headphones example)

[0441] Figure 22A-22B This is an example of attaching the electroencephalogram measurement unit 105 of the cognitive function testing device 101 of the present invention to headphones. The headband 2201 of the headphones is equipped with electrodes (2202, 2203, 2204, 2205, 2206) for electroencephalogram measurement. Furthermore, the earbuds (2207, 2208) also have electrodes 2209. Cloth-type electrodes are used as the electrodes for the earbuds (2207, 2208). By providing a large number of electrodes, electroencephalograms can be measured over a wide area of ​​the head. Both covers (2210, 2211) contain a signal processing device, a potential amplifier, an analog-to-digital converter, and a wireless module (e.g., the portion attached to 2212. Similarly, the cover of 2211 is also attached).

[0442] The detected potential is processed by the signal processing device 222 and the ADC 223 provided in the cover ( 2210 , 2211 ), and is transmitted to the smartphone 2109 from the communication module 227 also provided in the cover ( 2210 , 2211 ).

[0443] In order to measure brain waves of multiple channels simultaneously, a buffer memory may be provided on the earphone side so that the measured brain waves can be temporarily buffered and then sent to the smartphone 2109 .

[0444] Figure 22A The earphones can select the electrodes used for measurement according to the detection method of the potential of the brain wave.

[0445] Both unipolar sensing and bipolar sensing are possible.

[0446] In monopolar sensing, electrodes 2209 and 2212, which are in contact with the earlobes, are used as the reference potential and can be combined with five electrodes worn on the headband. In this case, up to five channels of EEG measurement can be achieved (a combination of 2209 and 2202, 2203, 2204, 2205, and 2206).

[0447] In bipolar sensing, a maximum of four channels of brain waves can be measured (one channel by the combination of 2202 and 2203, one channel by the combination of 2203 and 2204, one channel by the combination of 2204 and 2205, and one channel by the combination of 2205 and 2206).

[0448] The earphones can measure multiple channels of electroencephalograms using the above-mentioned two-electrode combination. Electroencephalograms are measured using the two electrodes that are in a good state of potential detection.

[0449] As described above, the earphones can measure brain waves of up to five channels from a combination of multiple electrodes that detect potentials.

[0450] Since AD ​​begins to worsen in the parietal lobe, priority is given to measuring brain waves from electrodes 2203, 2204, and 2205. Specifically, priority is given to measuring the combination of electrodes 2203 and 2204, the combination of electrodes 2204 and 2205, or the combination of electrodes 2209 and electrodes 2203, 2204, and 2205. Furthermore, the measurement results at this point are prioritized and used in the examination.

[0451] The electrode 2209 of the pad 2207 can also be provided at 2208 in the same manner.

[0452] In this case, it is possible to select whether to use the electrode 2209 as the reference electrode or the electrode 2208 as the reference electrode according to the mounting state. Figure 22A ) Collaborative cognitive function testing devices, in addition to smartphones, for example Figure 22B Shown are a radio receiver (radio receiver main body 2214, remote controller 2215), a tablet PC 2110, a television (TV main body 2111, remote controller 2112), and a PC.

[0453] The cognitive function testing system using headphones can also implement the alarm clock, page turning of an electronic book, playback of video content, startup processing, temperature measurement, and games shown in the third embodiment.

[0454] (Example of hearing aids)

[0455] Figure 23A to Figure 23C This is an example of a case where the electroencephalogram measurement device 2703 of the present invention is attached to a hearing aid.

[0456] As Figure 23A to Figure 23C Devices that can cooperate with hearing aids include, in addition to smartphones, radio receivers (radio receiver main body 2214, remote control 2215), televisions (TV main body 2111, remote control 2112), tablet PCs 2110, PCs, etc.

[0457] Figure 23A This is the front side of the ear-hook hearing aid 2301 in which the electroencephalogram measurement unit 2705 is attached. Figure 23B This is the back side of the ear-hook hearing aid 2301. Figure 23A This is a diagram showing a person wearing an ear-hook type hearing aid 2301. The ear-hook type hearing aid 2301 is a device worn on the auricle.

[0458] The ear-hook hearing aid 2301 includes a hearing aid body 2302 and an ear mold 2303 .

[0459] Electroencephalogram measurement electrodes (2304, 2305) are located on the back of the ear-worn hearing aid body (the part that contacts the head). Furthermore, the hearing aid body 2302 includes a signal processing device 222, an ADC 223, and a communication module 227 for processing and amplifying the detected potential (these components are attached to the hearing aid body 2302, for example, at 2306).

[0460] It is possible to measure brain waves of one channel in bipolar sensing using two electrodes (2304, 2805).

[0461] Hearing aids can be used in pairs or individually. When used in pairs, the electrodes used for measurement can be selected based on the potential detection conditions. When used in pairs, up to two channels of EEG waves can be measured.

[0462] Figure 23C This figure shows an example of an ear-mounted hearing aid being installed. The ear-mounted hearing aid 2301 can be used alone or in pairs. Even when used alone, it measures brain waves and transmits the results to a pre-paired smartphone. In a cognitive function testing system that integrates the ear-mounted hearing aid 2301 with a smartphone, etc., it is also possible to implement the alarm clock, video content playback, startup processing, temperature measurement, and games described in the third embodiment.

[0463] (Mouse example)

[0464] Figure 24A as well as Figure 24B This is an example of a case where the electroencephalogram measuring unit 2705 in the electroencephalogram measuring device 2703 of the present invention is installed in a wireless mouse 2401. The mouse can be wireless or wired. The following description uses the wireless mouse 2401 as an example.

[0465] like Figure 24A as well as Figure 24B As shown, on the front surface of a wireless mouse 2401 , electroencephalogram measurement electrodes ( 2402 , 2403 ) are arranged at two locations on the skin on the inner side of the hand so as to reliably contact the hand during PC operation.

[0466] (Example of Incorporating the Electroencephalogram Measurement Unit 105 into the TV Remote Control 2501)

[0467] TV remote controller equipped with electroencephalogram measuring unit 2705 ( Figure 25A 、 Figure 25B Electroencephalogram (EE) measurement electrodes (2502, 2503, 2504, 2505) are placed at locations that are easily touched by the hand when using a TV remote control. EEEs are measured (using bipolar sensing) by detecting potentials from the electrodes at two locations (any combination of 2502, 2503, 2504, and 2505) that are touched by the hand when operating the remote control.

[0468] The TV remote controller 2501 cooperates with the TV main body operated by the remote controller. Specifically, the measured electroencephalogram potential is processed and amplified, and then converted into a digital signal, which is transferred to the pre-paired TV main body for processing.

[0469] If the potential is not detected by the electroencephalogram measurement electrodes 2502 , 2503 , 2504 , and 2505 due to the way the TV remote controller 2501 is held, a warning is output on the screen of the TV main body to notify the user.

[0470] In the cognitive function test system including the TV remote controller 2501 and the TV main body, the alarm clock, playback of video content, and games described in the third embodiment can be implemented.

[0471] (Example of a small robot)

[0472] Figure 26A-26B This is an example of a case where the cognitive function testing device 101 of the present invention is mounted on a small interactive robot 2601 .

[0473] Figure 26A This is the structure of robot 2601. Figure 26BThis is an example of measuring electroencephalograms using a robot 2601. A head 2602 of the robot 2601 is equipped with electroencephalogram measuring electrodes 2603 and 2604. A control device composed of hardware such as a CPU is built into the robot 2601, and this control device functions as a cognitive function testing device.

[0474] The portion (reference numeral 2605) where the electroencephalogram (EEG) electrodes are mounted is three-dimensional and easily accessible. Electroencephalogram (EEG) electrodes 2603 and 2604 are mounted on the surface of this three-dimensional portion (reference numeral 2605). EEG potentials are measured using bipolar sensing. The electrodes are not limited to bipolar. They are designed to facilitate operation as an interface (e.g., by stroking a child's head). The electrodes are positioned so that the user can operate them comfortably without feeling uncomfortable in daily life.

[0475] The front of the head 2602 of the robot 2601 is equipped with a display 2606 for operation and display, speakers (2607, 2608) for sound reproduction, a microphone 2609 for collecting the voice of the user, and a small camera 2610 for identifying the user.

[0476] When a hand touches the three-dimensional portion 2605 of the head 2602, electroencephalogram potentials are detected, and a strange task is displayed on a display 2606 showing the robot 2601's expression. Alternatively, the sound for the strange task is reproduced from speakers (2607, 2608). To enable the presentation of tasks that determine the directionality of the sound, speakers (2607, 2608) are located on the left and right sides of the operation / display display 2606. Furthermore, a microphone 2609 is attached below the display 2606. The locations of the microphone and speaker are merely examples and are not limited to these.

[0477] Figure 26B The operation during electroencephalogram measurement is shown. By touching the electroencephalogram measurement electrodes 2603 and 2604 on the head 2602 of the robot 2601 with a hand, the electroencephalogram potential is detected from the skin of the hand, and measurement begins. While performing the oddball task, the hand can continue to touch the electroencephalogram measurement electrodes 2603 and 2604.

[0478] The robot can also be used to communicate with the user while guiding them to touch the electrodes on the head when a call comes in, a game is played, etc. when performing strange tasks.

[0479] The small robot 2601 can perform the alarm clock functions described in the third embodiment, turn pages of an electronic book, play video content, perform startup processing, measure temperature, and play games.

[0480] <Fifth embodiment>

[0481] In the fifth embodiment, an example of a service utilizing the cognitive function testing device using the electroencephalogram technology of the above-described embodiment will be described.

[0482] (Application examples to monitoring / preventive services and medical services)

[0483] Figure 28 This section provides an overview of monitoring / preventive services and medical services. Users of this service are the individual (hereinafter referred to as "the individual" 2801) and their family members 2802 who receive services related to monitoring and maintenance / improvement of cognitive function. The services provided by the cognitive function testing device of the present invention have two purposes.

[0484] One is that by regularly measuring the cognitive function of healthy individuals who haven't yet developed dementia, measures can be implemented to detect cognitive decline early and prevent the onset of dementia. This type of medical treatment, which takes preventive measures before a disease develops, is called proactive medicine and is included in medical practice. Currently, proactive medicine utilizes big data, including not only the data measured by the cognitive function testing device of the present invention but also genetic data and lifestyle habits, to uncover new knowledge about the causes of disease and potential improvements.

[0485] Another purpose is to regularly measure cognitive function in order to observe the course of symptoms, therapeutic measures, and the course of treatment when a decrease in cognitive function is identified or when the onset of dementia is identified.

[0486] To achieve the former goal, a monitoring / prevention service is provided. The monitoring / prevention service consists of a dementia prevention service company 2803, the person receiving the service 2801, and their family 2802. Depending on the situation, a nursing service organization 2804 is added to this structure.

[0487] A person 2801 and a relative 2802 (either the person or just the relative) join a dementia prevention service company 2803, which monitors cognitive function based on cognitive function measurement results to monitor for abnormalities. Furthermore, as needed, the person 2801 and the relative 2802 also join a nursing service organization 2804. The service fees for the dementia prevention service company can be borne by either the person 2801 or the relative 2802. The relative 2802 acts as a guardian for the person 2801 and may or may not be aware of whether or not they are guardians of the person 2801.

[0488] Dementia prevention service company 2803 collects and analyzes data measured by the cognitive function testing device of the present invention to understand the cognitive function status of person 2801, and provides analysis results and relevant advice to person 2801 or their relative 2802. It also accepts consultations from person 2801 or their relative 2802 and provides responses thereto.

[0489] When the person 2801 joins a nursing service organization 2804, the nursing service organization 2804, with the permission of the person 2801 or their relative 2802, can provide the dementia prevention service company 2803 with data and information about the person 2801's daily life and receive care advice for the person 2801. Furthermore, the person can discuss dementia prevention measures, etc., as needed, and receive responses to the consultations from the dementia prevention service company 2803.

[0490] Nursing service organization 2804 provides nursing services to individual 2801 based on the recommendations received from dementia prevention service company 2803. For example, if daily exercise or recreational activities improve cognitive function, such nursing services will be implemented. Furthermore, to confirm the effectiveness of the nursing services on cognitive function after implementation, the results of cognitive function measurement obtained by the cognitive function testing device of the present invention will be provided to dementia prevention service company 2803, and information will also be provided to the individual's relatives. If the individual has no relatives or if the individual wishes, information can also be provided directly to the individual 2801.

[0491] In addition, the nursing service organization 2804 can also provide the relative 2802 with daily information about the person 2801, thereby receiving specific requests from the relative regarding the content of the nursing service.

[0492] The above is an example of applying the cognitive function test device and cognitive function test system of the present invention to a monitoring service ( Figure 28 to the right of the dotted line).

[0493] Next, in order to achieve the latter purpose mentioned above, medical services are provided.

[0494] Medical services are provided by a dementia prevention service company 2803 and a medical institution 2805 that provides examinations and treatment for healthy individuals with dementia, mild cognitive impairment, and cognitive impairment. Depending on the situation, a nursing care service institution 2804 is also added to this structure.

[0495] The dementia prevention service company 2803 and the medical institution 2805 obtain the consent of the individual 2801 and his / her relatives 2802 to share information related to the individual and provide services.

[0496] When abnormalities are detected in cognitive function, the person 2801 and his / her relatives 2802 (both parties, the person himself / herself, or only the relatives) cooperate with a medical institution 2805 and join a dementia prevention service company 2803 that provides advice to the person 2801 and his / her relatives 2802 for countermeasures.

[0497] If a decline in cognitive function is detected, the medical institution 2805 performs a detailed examination to diagnose the condition and implements treatment and preventive measures based on the diagnosis results.

[0498] The monitoring service described above is provided when a decrease in cognitive function, which is a major problem, has not been identified. In the monitoring service, a decrease in cognitive function is detected, and if an abnormality is detected, cooperation with medical institutions 2805 is initiated. The monitoring service is a screening service and does not provide a diagnosis. However, if a decrease in cognitive function is detected and it has not reached the stage of dementia, active countermeasures are taken in cooperation with medical institutions 2805.

[0499] The dementia prevention service company 2803 provides services tailored to its members based on the extensive data collected from them (the individual 2801 and their relatives 2802). However, medical treatment is provided in collaboration with medical institutions 2805.

[0500] Dementia prevention service company 2803 can also collect data on medical practices and the effectiveness of provided services. It can analyze this data to generate hypotheses about the mechanisms of dementia and countermeasures, which remain unclear, and provide them to medical institutions 2805. Currently, AI is increasingly taking on the role of big data analysis, and the potential for new knowledge discovery and hypothesis generation is expected.

[0501] Medical institution 2805 makes diagnoses and decides on countermeasures and treatments based on the analysis results of the expansive data and information using AI.

[0502] If the knowledge gained from analyzing data and information falls outside the scope of medical practice, it can be directly provided to members (the individual 2801 and their relatives 2802). Knowledge corresponding to medical practice is provided by medical institutions 2805. The boundary between medical practice and non-medical practice varies depending on the scope of medical practice for dementia and is not clear-cut. This is because the scope of medical practice can change over time.

[0503] Another example of an application for the cognitive function testing device of the present invention is to provide regular monitoring services for driving ability (based on cognitive function), primarily for the elderly. For example, in addition to renewing an elderly person's driver's license, regular checks are also needed to assess their response to stimuli and their ability to judge situations.

Claims

1. A method for presenting information for dementia examination, executed by an electronic device having a screen and a call function, characterized in that: include: Incoming steps, incoming calls; as well as a presenting step of randomly presenting information related to the caller of the call as information for the dementia test during the execution of the action for notifying the user of the electronic device of the incoming call, The information related to the caller of the call is a sound of reading the caller's name, and the information for the dementia test includes the sound and a predetermined incoming call sound. The presentation step includes the following steps: during the execution of the action for notifying the user of the electronic device of an incoming call, outputting information for the dementia examination from the speaker of the electronic device in a manner such that the frequency of occurrence of the sound is lower than the frequency of occurrence of the predetermined incoming call sound.

Citation Information

Patent Citations

  • Device and method for modulating electroencephalogram discrimination method

    JP2009268826A

  • Cognitive impairment determination apparatus, cognitive impairment determination system and program

    US9131889B2

  • Device for supporting everyday life of patients with cerebral dysfunction

    WO2016031405A1

  • Systems and methods for assessing cognitive function

    WO2016156867A1