Information processing device

Abstract

To provide a technology to acquire data necessary for cognitive function inspection without imposing a psychological burden on a subject.SOLUTION: There is provided a technology to acquire data necessary for cognitive function inspection without imposing a psychological burden on a subject. Electronic equipment for acquiring brain wave data on the subject and analyzing the data includes: a cognitive function inspection control unit for presenting inspection data used for cognitive function inspection of the subject when executing an operation for a purpose different from brain wave measurement, and a cognitive function analysis unit for extracting an index of a cognitive function of the subject from the brain wave data on the subject measured when the inspection data is presented.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention Information processing device In particular, cognitive function tests can be performed using electroencephalography (EEG) technology. Information processing device Regarding. [Background technology]

[0002] A relatively inexpensive brain measurement technique for dementia testing is the near-infrared spectroscopy described in Patent Document 1. Patent document 1 describes a method for measuring the brain activity while giving tasks to stimulate it. a data acquisition unit for acquiring biosignal data from a predetermined brain region of a subject; and a feature extraction unit for extracting feature amounts of the biological signal data acquired by the data acquisition unit. a feature extraction unit and a feature extraction method for extracting a feature from a feature of a cognitive impairment that has been previously obtained; a discrimination unit that discriminates the degree of cognitive impairment of the subject based on data used for the judgment; It states that "it is equipped with

[0003] Furthermore, as an example of an apparatus and method for adjusting an electroencephalogram discrimination method using P300, the technique described in Patent Document 2 is In Patent Document 2, there is a technique for adjusting the discrimination method of the electroencephalogram interface unit. This device is capable of detecting the P3 signal of event-related potentials obtained by stimulating a modality other than vision. a database specifying the correlation between the P3 component of the visual event-related potential and the P4 component of the visual event-related potential; a stimulus presentation unit that presents the stimulus to the subject, and an event-related potential included in the electroencephalogram signal after the stimulus presentation. an analysis unit that analyzes the P3 component of the analyzed event-related potential and the database; A feature of the user relating to the P3 component of the visual event-related potential is derived from the feature, and and a discrimination method adjusting unit for adjusting the electroencephalogram discrimination method in the electroencephalogram interface unit. It says, " [Prior art documents] [Patent documents]

[0004] [Patent Document 1] U.S. Patent No. 9,131,889 [Patent Document 2] Japanese Patent Application Laid-Open No. 2009-268826 Summary of the Invention [Problem to be solved by the invention]

[0005] The test in Patent Document 1 requires the subject to wear a near-infrared spectroscopic analyzer. In the test according to Patent Document 2, the subject is aware that he or she will be tested for cognitive function. Therefore, when carrying out the tests according to Patent Documents 1 and 2, it is necessary to have the subject undergo a cognitive function test. There are concerns that this is placing psychological stress on the

[0006] The present invention has been made in consideration of the above-mentioned circumstances, and is intended to provide a method for preventing a psychological burden from being imposed on a subject. The present invention aims to provide a technology for collecting data necessary for cognitive function testing without requiring the user to perform the test. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention has the configurations described in the claims. As an example, the present invention is an information processing device with a call function capable of communicating with a device for detecting electroencephalogram data of a subject, comprising a display unit, a control unit, and a storage unit, wherein the display unit, upon receiving an incoming call, displays a target image consisting of a face image of the caller, which is visual test data based on visual stimulation used in an electroencephalogram measurement test of the subject who is the recipient; The frequency of presenting the target imageand a standard image that is presented more frequently than a standard image, and the visual test data is displayed in parallel with an operation to notify an incoming call, the control unit stores the subject's EEG data detected by the detection device when the visual test data is displayed in the memory unit, extracts and analyzes potential waveforms that occur in relation to the occurrence of an event in the subject from the stored EEG data of the subject, and the display unit displays the subject's EEG data and the visual test data when confirming the results of the EEG measurement test. [Effects of the Invention]

[0008] According to the present invention, it is possible to carry out the necessary steps for cognitive function testing without imposing a psychological burden on the subject. The technology for collecting data can be provided. Other issues, configurations, and effects are as follows: This will be made clear in the description of the embodiment. [Brief explanation of the drawings]

[0009] [Figure 1] Functional block diagram of cognitive function testing device [Figure 2] Hardware configuration diagram of the cognitive function testing device smartphone [Figure 3A] Rear view showing an example of implementation of a cognitive function testing device on a smartphone [Figure 3B] Side view showing an example of implementation of a cognitive function testing device on a smartphone [Figure 3C] Front view showing an example of implementation of a cognitive function testing device on a smartphone [Figure 4] A diagram showing the basic waveform of an event-related potential [Figure 5A] Guardian table configuration diagram [Figure 5B] Standard table configuration diagram [Figure 6A] A diagram showing an example of how to use a smartphone when a call comes in (when a call comes in) [Figure 6B] A diagram showing an example of how to use a smartphone when receiving a call (in hand) [Figure 6C]A diagram showing an example of how to use a smartphone when receiving a call (visual stimulus) [Figure 6D] A diagram showing an example of how to use a smartphone when receiving a call (auditory stimulation) [Figure 7] Flow chart of initial setting test for creating test data [Figure 8] Flow chart of the inspection data creation section [Figure 9] A diagram showing the overall processing flow of cognitive function testing on a smartphone equipped with a dementia testing function. [Figure 10] A diagram showing an example of the structure of inspection data [Figure 11A] Example of test data for the oddball task (visual stimuli) [Figure 11B] Example of test data for the oddball task (auditory stimuli) [Figure 12] A diagram showing an example of the data structure of electroencephalogram data [Figure 13] A diagram showing an example of the structure of analytical data [Figure 14] A diagram showing an example of data structure (average over a period) of cognitive function analysis results [Figure 15] Flow diagram of the cognitive function analysis section [Figure 16] Example of cognitive function analysis results [Figure 17] Functional block diagram of a cognitive function testing device equipped with a priority sense analysis unit [Figure 18] Priority Sensation Analysis Flow Chart [Figure 19A] A diagram showing an example of how to use a smartphone alarm (when ringing / vibrating) [Figure 19B] An example of how to use a smartphone alarm (controlled state) [Figure 19C] A diagram showing an example of how to use a smartphone alarm (visual stimulus) [Figure 19D] An example of how to use a smartphone alarm (OFF button displayed) [Figure 20A] Rear view showing an example of implementation of a smartphone case for cognitive function testing equipment [Figure 20B]Side view showing an example of a smartphone case for cognitive function testing equipment [Figure 20C] Front view showing an example of implementation of a smartphone case for cognitive function testing equipment [Figure 20D] Front view showing an example of the implementation of the cognitive function testing device smartphone case (with smartphone attached) [Figure 21A] A diagram showing an example of implementation of an eyeglass or sunglasses frame equipped with an EEG measurement function [Figure 21B] Front view of cognitive function testing device (smartphone) linked to eyeglass or sunglasses frame [Figure 21C] Front view of cognitive function testing device (tablet PC) linked to eyeglass or sunglasses frame [Figure 21D] Front view of cognitive function testing device (TV set) connected to eyeglass or sunglasses frame [Figure 22A] Diagram showing headphones with brainwave measurement function [Figure 22B] A diagram showing a cognitive function testing device (radio set) linked to headphones equipped with an EEG measurement function. [Figure 23A] Surface view of a hearing aid with EEG monitoring functionality [Figure 23B] Back view of a hearing aid with EEG measurement function [Figure 23C] A diagram showing how a hearing aid equipped with an EEG measurement function is worn [Figure 24A] Surface view of a mouse equipped with EEG measurement capabilities [Figure 24B] A diagram showing how a mouse equipped with an EEG measurement function is used [Figure 25A] Rear view of a TV remote control with EEG measurement function [Figure 25B] A diagram showing how a TV remote control equipped with an EEG measurement function is used [Figure 26A] Front view showing an example of implementation of cognitive function testing device (robot) [Figure 26B] A diagram showing the usage of an example of a cognitive function testing device (robot) [Figure 27]Functional block diagram of a cognitive function testing system that incorporates EEG measurement functionality into the measurement device [Figure 28] Diagram showing examples of services using cognitive function testing devices and cognitive function testing systems DETAILED DESCRIPTION OF THE INVENTION

[0010] Alzheimer's disease (AD) accounts for approximately half of all cases of dementia. Neurophysiological biomarkers such as EEG are expected to be biomarkers for the early diagnosis of AD. A biomarker is a "signal that indicates a normal physiological process, a pathological process, or a therapeutic effect." "Objectively measured and evaluated characteristics as indicators of pharmacological response to intervention" U.S. This is the definition given by the National Institutes of Health.

[0011] EEG techniques include fMRI (functional magnetic resonance imaging) and MEG (mechanical electroencephalography). Compared to brain testing techniques such as magnetoencephalography (MEG), it can be measured using relatively inexpensive equipment. Furthermore, since the potential on the surface of the head is measured, there is little strain or restriction on the body during measurement. , not only in the medical field, but also in a wide range of fields such as consumer, healthcare and welfare, robots, and automotive. It is expected to be applied in the field.

[0012] One of the biomarkers in EEG is the event-related potential. It is the electrical activity of the brain that occurs in time relation to internal events, such as visual or auditory stimuli. Event-related potentials (ERPs) using external events are being applied to the examination of AD and mild cognitive impairment. The peak latency of the P300, which is the peak of the third waveform in the positive direction of the potential, is the time from the presentation of the stimulus to the P300. The time it takes for the markers to appear is used as a biomarker for testing for AD and mild cognitive impairment. In addition, oddball tasks are used as a tool to induce this P300. The task involves randomly presenting two types of stimuli to the subject, and asking them to pay attention to the stimulus that is presented less frequently. This is a task in which the subject is asked to point and respond by pressing a button. The low-frequency stimulus is called the target stimulus (hereafter referred to as "target"), and the high-frequency stimulus is called the standard stimulus. This is called the stimulus (hereafter referred to as the "standard").

[0013] Hereinafter, as an embodiment of the present invention, an oddball task as information for dementia testing will be described. The subject is presented with the image when performing a movement that has a purpose other than wave measurement. The brain wave data analysis system, information processing terminal, and In the following explanation, smartphones are mainly used as examples of electronic devices. However, as will be described in each embodiment below, The device is not limited to a smartphone. The present invention can be applied to PCs, tablets, e-books, etc. , home robots, audio equipment such as televisions and radios, electronic devices such as wearable devices is equally applicable to

[0014] First Embodiment In the first embodiment, a smartphone is used as the electronic device (hardware), and the present invention is applied to the smartphone. This is an example of a cognitive function testing device implemented according to the above.

[0015] (Explanation of the functional blocks of the cognitive function testing device) FIG. 1 is a functional block diagram of a cognitive function testing device.

[0016] The cognitive function testing device 101 includes a cognitive function measurement and assessment unit 102, an operation unit 114, a display unit 115, a communication unit 116, and a 6, the audio output unit 117, the audio input unit 118, and the timer 119.

[0017] The operation unit 114 receives operation input from a user (corresponding to a subject) to the cognitive function testing device 101. It receives force and outputs an operation signal.

[0018] The display unit 115 controls the display of an operation screen and various information to the user.

[0019] The communication unit 116 communicates with external devices via various networks such as telephone networks, Wi-Fi, and Bluetooth (registered trademark). Controls communication with devices.

[0020] The audio output unit 117 and the audio input unit 118 output audio via a speaker 225 and a microphone 226, which will be described later. Controls output and input. The timer 119 generates time information and outputs it to the cognitive function measuring and assessing unit 102 .

[0021] The cognitive function measurement and assessment unit 102 includes an oddball task data storage unit 103 and a caller assessment unit 104. , an electroencephalogram measuring unit 105, an electroencephalogram data storage unit 106, an examination data creating unit 107, and an examination data storage unit 108. , cognitive function test control unit 109, analysis data storage unit 110, cognitive function analysis unit 111, analysis result storage The information processing unit 110 includes a cognitive decline notification unit 112 and a cognitive decline notification unit 113.

[0022] The oddball task data storage unit 103 stores data for oddball tasks. The task data storage unit 103 stores, for example, a person (watcher) who watches over the user who is the subject of the cognitive function test. Information about the person watching over you, such as your phone number, name, email address, voice, and photos. Store information.

[0023] In this embodiment, the oddball task data storage unit 103 mainly stores information about the watcher. An example of the case where the data is stored will be described.

[0024] When receiving a call or e-mail via the communication unit 116, the caller determination unit 104 determines whether the caller is It is determined whether the watcher is registered in oddball task data storage unit 103.

[0025] The electroencephalogram measurement unit 105 is a device for acquiring electroencephalogram data of a user (subject) who is the subject of a cognitive function test. The electroencephalogram measurement unit 105 operates as an electroencephalogram data acquisition unit. It is provided with a detection sensor (in this embodiment, an electroencephalogram measuring electrode 221 as described later).

[0026] The electroencephalogram data storage section 106 stores the electroencephalogram data acquired by the electroencephalogram measurement section 105 .

[0027] The test data creation unit 107 generates the voice of the watcher stored in the oddball task data storage unit 103. You can use images such as photos, emojis, and ringtones that are pre-installed on your smartphone. This automatically generates data for cognitive function tests.

[0028] The test data storage unit 108 stores the test data created by the test data creation unit 107 .

[0029] The cognitive function test control unit 109 controls the electroencephalogram measurement unit 105 to detect the electroencephalogram. When the potential is detected from the electrode 221 and it is detected that the electroencephalogram can be measured, the test data storage unit 108 The test is started using the test data stored in the brain wave data storage unit 106. The cognitive function test control unit 109 stores all the components constituting the cognitive function measurement and assessment unit 102. In this example, the electroencephalogram measuring electrode 221 is used as the electroencephalogram detecting sensor. However, a magnetic sensor may also be used.

[0030] The analytical data storage unit 110 stores data for analyzing and evaluating cognitive functions.

[0031] The cognitive function analysis unit 111 analyzes the electroencephalogram data stored in the electroencephalogram data storage unit 106 and By comparing the data in the analysis data storage unit 110 that has been calculated in advance, the cognitive function distribution Perform analysis.

[0032] The analysis result storage unit 112 stores the analysis results of the cognitive function analysis unit 111 .

[0033] The cognitive function decline notification unit 113 detects a decline in cognitive function in the cognitive function analysis unit 111, If signs of dementia are detected (corresponding to when predetermined notification criteria are met), The notification is sent to a watcher who has been registered in advance in oddball task data storage unit 103.

[0034] The watcher registered in the oddball task data storage unit 103 is a user who is the subject of a cognitive function test. This refers to someone who quietly monitors the lifestyle and health of the elderly, such as the user's family or care manager. The watcher is a person who uses a smartphone to which a cognitive function testing device 101 is applied. By using this app, it is possible to monitor the cognitive function of elderly users in their daily lives even from a remote location. It is possible.

[0035] The data to be registered in the oddball task data storage unit 103 is the existing address of the smartphone. The data stored in the internal memory or SD card, such as phone numbers, names, addresses, and email addresses, You can use the photos, data, phone numbers, names, email addresses, and voices that are already in your account, or you can use new Registration may also be performed using data sent by the watcher.

[0036] (Hardware configuration description) Figure 2 shows the hardware of a smartphone to which the cognitive function testing device 101 described in Figure 1 is applied. FIG. 1 is a diagram showing the configuration.

[0037] The smartphone 201 includes a CPU (Central Processing Unit) that controls the entire system of the smartphone 201. Processing Unit (CPU) 211, which stores basic programs such as the OS used inside the smartphone. ROM (Read Only Memory) 212 temporarily stores programs and various data and caches them. Random Access Memory (RAM) 213 used as a database or work memory, cognitive function testing equipment 101 The program that realizes the functions, various data used in each function block, and brain wave measurement results a storage device 214 for storing the time when EEG is measured, ... The timer 215 (corresponding to the timer 119 in FIG. 1) and an external I / F 216 for connecting to external devices are included. Here, the storage device 214 is a non-volatile memory such as a hard disk drive (HDD) or a flash memory. In this example, the cognitive function test according to this embodiment is performed on a smartphone. Since the device 101 is applied, it is preferable that the storage device 214 is configured with a non-volatile memory. In addition, when the cognitive function testing device 101 according to this embodiment is applied to a PC, the storage device 214 is composed of an HDD or SSD (Solid State Drive) equipped with semiconductor memory such as flash memory will be done.

[0038] Furthermore, the smartphone 201 includes an electrode 221 for measuring the potential of an electroencephalogram, an electrode 222 for measuring the electroencephalogram, Noise is removed from the potential signal derived from the electrode 221, and the noise-removed signal is amplified. A signal processing unit 222 converts the analog signal processed by the signal processing unit 222 into a digital signal. ADC (Analog to Digital Converter) 223, a diagram for accepting or inputting user operations A touch panel that does not display images and has an operation / a display 224 (corresponding to the operation unit 114 and the display unit 115 in FIG. 1), a ring tone and a sound playback unit; a speaker 225 (corresponding to the audio output unit 117 in FIG. 1) for inputting audio; a microphone 226 (corresponding to the audio input unit 117 in FIG. 1) for inputting audio; 1) and a wired / wireless communication module 227 (corresponding to the communication module 118 in FIG. 1) for communicating with external devices. 116), an acceleration sensor 228 that detects data related to tilt, movement, vibration, and impact, and orientation a geomagnetic sensor 229 for measuring the receiver's location, and a GPS (Global Positioning System) g System) 230, a gyro sensor 231 that detects changes in rotation and orientation, and a temperature sensor that measures body temperature, etc. The temperature meter 232 transmits and receives data between the CPU 211 and each component in the smartphone 201. A system bus 233 is a data communication path for the communication, a battery 234 supplies electricity, and a call modem. It is composed of 235 modules.

[0039] The communication module 227 includes 3G, 4G, Wi-Fi, Bluetooth, infrared communication, and broadcasting service communication. This includes wireless communication functions such as wireless communication and wired communication functions such as wired LAN.

[0040] Here, among the functional blocks shown in FIG. 1, the EEG measurement electrodes 221, the signal processing device 222, and the AD The C223, the CPU 211, the ROM 212, the RAM 213, and the storage device 214 are hardware components that constitute the cognitive function measurement and assessment unit 102. The hardware 210 is a program that realizes the cognitive function measurement and assessment function. The functional blocks of the cognitive function measurement and assessment unit 102 shown in FIG. 1 are configured in cooperation with the program. do.

[0041] (Example of implementation of electrodes for measuring EEG on a smartphone) Next, an example of how the electroencephalogram measuring electrodes 221 are mounted on the smartphone 201 will be described with reference to FIG.

[0042] Generally, EEG is measured by electrodes placed on the scalp. Technology that can read the temperature from the surface of the skin on the arms and hands, such as BodyWave Technology, has been developed. Therefore, an example of an implementation utilizing this technology is shown in Figures 3A and 3B.

[0043] FIG. 3A shows a case where two electrodes 302 and 303 for measuring electroencephalograms are arranged on the back surface 301 of the smartphone 201. This is an example of a bipolar induction method, in which brain waves are measured by the potential difference derived from two electrodes. The electrodes are placed on the back where they are easily accessible. In Figure 3A, two electrodes are installed. It has two or more electrodes and automatically selects two points on the body where the hand touches to measure. That's fine.

[0044] FIG. 3B shows the left side 304 and the right side 305 of the smartphone relative to the front. In this example, electrodes 306 and 307 for measuring electroencephalograms are arranged on the respective sides.

[0045] The electrode placement is bipolar, similar to Figure 3A. The surface of the hand when holding a smartphone. The brain waves are measured by the potential difference between the two points. Two or more electrodes are placed and the hands are placed on the electrodes. The potential detected by touching the electrode detects that a hand has been touched, and the hand is connected. Two electrodes that have been touched may be automatically selected for measurement.

[0046] Here, it is possible to mount all the electrodes of both FIG. 3A and FIG. 3B. It is also possible to have a mixed configuration. For example, one on the back and one on the side, or one on the back. It is also possible to mix placement, such as two locations on one side and two locations on the other side.

[0047] FIG. 3C shows the electrode arrangement when electrodes capable of detecting potential in a non-contact state are used. Electrodes 310 and 311 are placed near the speaker 309 on the front surface 308 of the smartphone. Non-contact electrodes for rear networks have been developed. Therefore, when using this technology, An example of electrode placement is shown. When a call comes in, the speaker on the front of the smartphone 308 is placed near the ear. The potential can be detected by bringing the sensor 309 close to the head. The electrodes 310 and 311 are provided with an amplifier ADC and a communication module, and the derived potential is transmitted to the electrodes 310 and 311. It can transmit from one electrode to the other. In this case, there is no insulation between the electrode and the head. Electric potential can be derived even if an object is present.

[0048] Here, all of the electrodes shown in FIGS. 3A, 3B, and 3C may be mounted, or only the electrodes shown in FIGS. For example, a combination of Fig. 3C and Fig. 3B, or Fig. 3C and Fig. 3A, A combination is also possible.

[0049] (Explanation of the basic waveform of EEG and event-related potentials, characteristics of P300) Next, the electroencephalogram data acquired in this embodiment will be described with reference to FIG. The waves are stored electrical activity of the brain's neurons and are mainly transmitted through electrodes attached to the scalp. The potential changes derived from the brain are stored as waveforms over time. There are two types of EEG: spontaneous EEG and evoked EEG. Spontaneous EEG is always occurring regardless of the occurrence of a specific event. In contrast, evoked EEG is a potential that is generated by an event and is a sustained state of EEG. It is a potential that occurs in relation to an occurrence (hereinafter referred to as an event-related potential), and is related to the perception of visual, auditory, and somatic sensations. Exogenous factors originating from perception and endogenous factors related to mental phenomena such as expectation, attention, and decision-making. Here, we will briefly explain the basic waveform of the event-related potential of the electroencephalogram using Figure 4. 4 is an explanatory diagram showing the basic waveform of an event-related potential of an electroencephalogram.

[0050] The event-related potential is shown with the vertical axis representing potential in μV and the horizontal axis representing time in ms. is often written with the upper side as minus and the lower side as plus. In the case of external stimulation, it is indicated by 0 ms on the horizontal axis of the graph. The waveform around 0 μV is called the baseline. 401. In the diagram of the negative direction of EEG, an upward deflection is N (Negative), and in the diagram of the positive direction, a downward deflection is N (Negative). is called P (Positive), and numbers are added in the order of occurrence of each waveform (P1, P2, etc. in the figure). ), or the standard peak latency in ms. This is the time it takes for the peak to appear.

[0051] The P300 (code 402) evoked by the oddball task described above is the peak of the third waveform in the positive direction. It is also called P300 because its peak latency is approximately 300 ms. In this case, in addition to the peak latency, the peak-to-peak amplitude 404 and the baseline-based peak amplitude value 405 are also used. will be done.

[0052] The peak latency of P300 (403) is known as a biomarker for AD. Although the progression of AD generally slows with age, it is more pronounced in patients with AD than in those with aging. It is known that the longer the peak latency is, the more cognitive impairment is associated with AD patients. It is known that the decline in function is more pronounced in healthy individuals who are genetically at high risk for AD. It has been found that even if the P300 peak latency 403 is delayed, the peak latency 403 of the P300 (reference number 402) is delayed.

[0053] In the oddball task, when presenting multiple stimuli such as images and sounds to the user, The stimulus presented at low frequency is called the target, and the stimulus presented at high frequency is called the standard. cormorant.

[0054] P300 (code 402) appears more frequently when the frequency of the target among the presented stimuli becomes relatively high. It has been found that the frequency of these attacks is reduced and they tend to appear more easily when the target frequency is low. The occurrence of P300 (code 402) in response to target frequency varies among individuals, so each individual's characteristics are different. It is necessary to adjust the target frequency (the frequency with which targets are presented to the user) according to the user's gender.

[0055] In addition, P300 (code 402) was observed when attention to the target decreased during the oddball task. Therefore, maintaining attention to the target during task execution is also important.

[0056] Furthermore, the peak latency 403 of P300 is often calculated mainly by averaging event-related potentials. Evoked EEG also contains spontaneous EEG components, and these components occur randomly. To remove the influence of spontaneous EEG, the average is calculated. There is also a method for calculating the peak latency 403 of P300 (symbol 402) from the related potential, so the calculation method is arithmetic mean. is not limited to.

[0057] In this embodiment, the oddball task for generating the P300 (reference numeral 402) is performed on the electroencephalograph side. When performing an operation with a different purpose, such as answering an incoming call, The test is presented to the examiner, and the subject is given a mental burden by undergoing a cognitive function test. The following data is used for this purpose: We will explain about this.

[0058] (Example of a guardian table configuration) Next, using Figure 5A, data about the observer is stored in the oddball task data storage unit. 5 shows the configuration of table 501 (hereinafter referred to as the "watcher table") in this case.

[0059] The watcher table 501 includes the watcher's telephone number 502 [Tel_Num], name 503 [Name], email address Address 504 [Mail_Address], relationship to the user 505 [Relation], contact level data 506 [Information ation_Level], Photo Data Item 507, Audio Data Item 508, Select Sensory Stimulus 517 [Select_Stim ulus].

[0060] The relationship with the user 505 is data indicating the relationship with the user, for example, family relationship (son or daughter), Describes information about the care manager, doctor, and other people in charge of the monitoring service.

[0061] The notification level data 506 stores the level of notification of the analysis results of the measurement results, etc. If you are a family member, you will be notified of the results whenever they are available, regardless of whether symptoms are detected or not. and to inform relevant parties such as care managers when symptoms are detected. Alternatively, only the above-mentioned notification may be sent.

[0062] The photo data item 507 is the number 509 of the file storing the photo of the watcher [Picture_ File_N o], variable 510[Validity] indicating whether P300 was detected in the initial test described below, Frequency of presentation in the D-ball task (stored based on the results of the initial test, 20% or more) Below is a guideline), the interval to display the photo 512 [SInterval] (stored based on the results of the initial test, unit ms, 1.5 ms is a rough guideline), and the data for the photo size 518 [Size] displayed in the oddball task is stored. do.

[0063] Similarly, the voice data item 508 is a file number 513 [Voice_File] that stores the voice of the watcher. e_No], variable 514 [Validity] indicating whether P300 was detected in the initial test described below, Frequency of presentation in oddball task 515 [Frequency] (stored based on the results of the initial test, 20% The following is a guideline), the interval for playing the audio 516 [SInterval] (stored based on the results of the initial test, The time is ms, 1.5 ms is a rough guideline), and the volume 519 [Volume] used to play the audio in the oddball task is Holds data.

[0064] The selected sensory stimulus 517 holds the sensory stimulus used when conducting a cognitive function test. In the example, if visual photography is selected, enter "P"; if auditory audio is selected, enter "P"; Enter "V".

[0065] After selection, the selected sensory stimulus 517 is applied to all watchers in the same way.

[0066] The sensory settings used in the test can be adjusted by connecting the device to a smartphone when starting to use the cognitive function test device. The sensory stimuli (visual, audio, or vibration) that are used as the primary interface The user sets the value as a parameter (option) or sets the value by the method of the second embodiment described later.

[0067] If this process is performed when starting to use the cognitive function testing device, execute the initial setting flow shown in Figure 7. This is implemented immediately after the transaction is completed, but can be changed after that.

[0068] (Standard table configuration example) Next, using FIG. 5B, the standard data is stored in the oddball task data storage unit 103. 5 shows the configuration of a table 520 (hereinafter referred to as a "standard table") for this purpose.

[0069] The standard table 520 contains data related to the standards used in the oddball task. The standard table 520 stores the file identification number 521 [File_ID_No], Includes stimulus type 522 [Stimulus_Type] and data availability 523 [Validity].

[0070] File identification number 521 is the standard for photo and audio data files. It is an identification number.

[0071] The stimulus type 522 indicates the type of stimulus to be presented to the user, and may be a visual stimulus, image data, or the like. If so, enter "P" to indicate that it is an auditory stimulus, or "V" to indicate that it is audio data.

[0072] Data availability 523 [Validity] is a standard question asked during the initial test, as will be described later. If the device can be used without any problems, set it to "1" and the P300 will appear, which should not occur. If the data is not suitable for use, set it to "0".

[0073] (Explanation of how to use a smartphone equipped with a cognitive function testing device when receiving a call) Next, referring to FIG. 6, a smartphone equipped with the cognitive function testing device 101 of the present invention will be described. This shows how to use it when receiving a call.

[0074] FIG. 6 shows the smartphone 201 shown in FIG. 3A with electrodes 302 and 303 for measuring electroencephalograms arranged on the back side. This will be explained using the example below.

[0075] When the smartphone 201 receives a call from a watcher registered in the watcher table, The smartphone 201 notifies the user of an incoming call by ringing or vibrating (FIG. 6A). The subject holds the smartphone 201 in his / her hand and inserts two electrodes 302 and 303 for measuring electroencephalograms on the back 301 of the smartphone 201. When the surface of the hand touches the smartphone 201, the smartphone 201 starts the cognitive function test (FIG. 6B, symbol 601). .

[0076] When the cognitive function test is set as a "visual test," that is, when the watcher table 50 If the value of Select_Stimulus 517 [Select_Stimulus] is set to "P", the user will Look at the face to confirm who is calling (Figure 6C).

[0077] That is, an image such as an emoji selected as a standard is displayed on the screen 602 of the smartphone. The image 603 and the face photo (corresponding to a facial image) 604 of the target caller are randomly displayed. is shown.

[0078] The user looks at the face photo 604 displayed on the screen 602 from the series of images 605 displayed, and calls Check the person.

[0079] On the other hand, if the cognitive function test is set to "auditory test", the guardian table 50 The value of the Select_Stimulus 517 [Select_Stimulus] of the first user is set to "V". The user listens to the ringtone to identify the caller (Fig. 6D). When the surface of the hand is brought into contact with the electrodes 302 and 303 for measuring electroencephalograms on the back surface 301 of the phone, a ring tone called a ringing tone 606 is generated. The user hears a random voice reading the name of the caller 607. The caller is identified by listening to the call tone 608.

[0080] The user can identify who the caller is by looking at the caller's face photo 604 or by listening to the name being read aloud 607. After confirming that the call is valid, press the answer button to start the call.

[0081] The standard audio used in the oddball task was stored in advance on a smartphone. The ringtone can be a ringtone that has been saved, or the user can select any sound from the ringtones saved. It can also be set to

[0082] (Initial setting test flow) Here, the test flow at the time of initial setting is shown using Figure 7. This flow chart is for explaining the procedure when starting to use the cognitive function testing device 101 of the present invention. This is a processing flow at the time of initial setting.

[0083] This test flow selects standard and target data and tests the user's cognitive function. The purpose is to confirm whether it can be used for inspection.

[0084] Factors that affect the test include both stimulus data (standard and target) and suitability as a test subject, the frequency of the target in the test, and the target and standard presented to the user. The test flow includes the interval between presentations, and the quality of the stimulus (image size, audio volume, etc.). , plays a role in setting / adjusting these elements appropriately.

[0085] This initial setting test flow is executed by the cognitive function test control unit 109.

[0086] After confirming that the test was performed properly using this test flow, the cognitive function test system was established. The control unit 109 checks the effectiveness of the target used in the test in the photo data field of the watcher table. The validity is stored in the validity 510 of the item 507 or the validity 514 of the voice data item 508.

[0087] The results of this test process flow are shown in the photo data item 507 of the watcher table 501 and the audio data item 508. The data is stored in data item 508.

[0088] The watcher table 501 and the standard table 520 are created by the test data creation unit 107. Used to create data.

[0089] The test data created by the test data creation unit 107 is transmitted to the cognitive function test control unit 109. Used when conducting an inspection.

[0090] In this test flow, the data related to the watcher in the watcher table 501 is stored in advance in the user's It is assumed that this has been set by the user.

[0091] This is done, for example, by displaying a watcher registration screen to the user before executing this test flow, and then The phone numbers, email addresses, and photos of members that are pre-registered in the phone book of a smartphone This is achieved by selecting the watcher from among them. The selection result is shown in Figure 5. A's phone number 502, name 503, email address 504, and relationship to the user 505 are registered. ,The test flow at the initial setting will be detailed.

[0092] The flow in Figure 7 assumes that the types of data to be inspected are visual data and auditory data. However, in addition to these, there are other types of test data such as vibrations. This includes, but is not limited to, sensory stimulation data.

[0093] First, the cognitive function test control unit 109 selects one watcher (X n) Select and enter the photo data item 507 (visual data P) or the audio data item 508 (auditory data V). Select (step 701).

[0094] Next, the cognitive function test control unit 109 selects the visual data P or the auditory data P in step 701. In the case of visual data, one image or sound is selected from the data V (step 702). The photo data 509 [Picture_File_No] stored in the guardian table 501 is In this case, the voice data 513 [Voice_File_No] stored in the watcher table 501 is selected. do.

[0095] Next, the cognitive function test control unit 109 receives the following information that has been registered in advance on a smartphone or the like: A standard is selected from pictograms, icons, ringtones, etc. (step 703). For audio data, select pictograms or icons DPn, and for audio data, select incoming data DVn.

[0096] Next, the cognitive function test control unit 109 determines the initial number of target stimulus measurements Zn in the initial test. The number of target stimuli is set to a value (step 704). In order to confirm this, set the number of times, for example, three times. Also, set the number of times P300 appears, N, to the initial value = <Zn , for example, set it to 2 times.

[0097] Next, the cognitive function test control unit 109 sets the initial value of the target frequency Fn (step 705). The target frequency is generally about 20%. For example, if you prepare five images, One of them is used as the target stimulus image. Generally, the target frequency is presented to the user. The lower the frequency of the stimulus to which attention is directed, the more likely the P300 will appear. Since there are individual differences, start the test at 20% and if the P300 is poor, increase the frequency. Lower.

[0098] Next, the cognitive function test control unit 109 sets an initial value of the stimulation interval SIn at which stimulation is presented to the user. The stimulus interval is the time between the target and standard stimuli being presented to the user (step 706). In the oddball task, the standard and target are presented to the user. The target time between stimulations is 1.5 seconds. Because responses to stimulation vary from person to person, , this interval also needs to be adjusted.

[0099] Next, the cognitive function test control unit 109 uses the electroencephalogram measurement unit 105 to measure the electroencephalogram on the back of the smartphone. It is confirmed whether or not a potential is detected from the measuring electrodes 302 and 303 (step 707). If not (step 707 / No), the user is asked to touch the electrodes 302 and 303 for measuring the electroencephalogram. The user is warned (step 708). The display 224 is used to prompt the user to take caution on the screen of the smartphone, and the test is conducted using audio. If this occurs, the smartphone speaker 225 will issue an audio warning.

[0100] If a potential is detected from the electrode (step 707 / Yes), the cognitive function test control unit 109 The test is started (step 709).

[0101] The initial test process (step 709) is carried out using the standard and target selected in steps 702 and 703. The test set consists of a set of target stimulus measurements, target frequency, and stimulus interval. Specifically, the test is a series of operations as shown in FIGS. 6A to 6C. The following will be implemented in a simulated manner.

[0102] Next, the cognitive function test control unit 109 processes the electroencephalogram data measured in the initial test process (step 709). The P300 analysis is performed using (step 710).

[0103] The waveform and P300 analysis results (whether or not a waveform occurs) for each target stimulus during the test were analyzed. The function test control unit 109 temporarily stores the data in the buffer RAM 213 .

[0104] If the user shows a P300 response to all target stimuli during the test (stage (711 / Yes), the cognitive function test control unit 109 selects the image or Specifically, the validity variable in the watcher table 501 is set to enable audio (step 712). The value of the number 510 or 514 is set to 1. The value 1 of the Validity variable 510 or 514 means that it is usable.

[0105] Then, the target frequency Fn (set in step 705) and the stimulus interval SIn (set in step 706) are ) The size of the photo and the volume of the sound to be played are set to the target of the watcher table 501. The presentation frequency [Frequency] variable 511 or 515, the [SInterval] variable 512 or 516, the photo sample The size 518 and volume 519 are saved as variables (step 7) 13).

[0106] The values ​​of the variables for photo size 518 [Size] and volume 519 [Volume] are the default values ​​or In step 716, the adjusted value is input.

[0107] The data about the standards used in the last test is stored in the Standards Table 520. That is, the file number of the standard is stored in the file identifier of the standard table. Save the data in a separate file ID number [File ID No] and set the standard data type to Standard Table 52. 0 stimulus type [Stimulus_Type] 522 (if the standard is image data, save it as "p" If the standard is audio data, save "v" and check whether the data is valid. Enter "1" in [ity]523.

[0108] Next, another registered image or sound is selected (step 702).

[0109] In step 711, if the user does not show a P300 response to all target stimuli, If not (step 711 / No), it is checked whether P300 has appeared N times or more (step 714). If not (step 714 / No), the subject is reminded to concentrate on the test (step 715). However, if attention is lost, the image may not appear. After that, you can adjust the size and volume of the image or audio. Step 716), and then run the initial test again (step 709).

[0110] In step 714, if the appearance of P300 in response to the target stimulus is confirmed N times ( Step 717 / Yes), the cognitive function test control unit 109 determines whether the stimulation interval SIn=>2.0 or not (Step If SIn is not greater than 2.0 (step 717 / No), the stimulation interval SIn is increased by S (step 71 8) The variable S is set to, for example, 0.1.

[0111] In step 717, if the stimulation interval SIn=>2.0 (step 717 / Yes), the cognitive function test The scan control unit 109 determines whether the target frequency at that time is less than or equal to 0.05 (step 719), and If the get frequency is not <= 0.05 (step 719 / No), reduce the target frequency by T (step 7 20) For example, the variable T is set to -0.05%.

[0112] In step 719, if the target frequency is less than or equal to 0.05 (step 719 / Yes), The cognitive function test control unit 109 determines whether or not P300 appears relative to the standard (stage If the P300 appears in the standard, another image or sound is Select an emoji, icon, or ringtone that is pre-stored in the ), return to step 703.

[0113] Normally, the standard does not produce a P300 waveform, but the standard stimulus causes a P300 waveform to appear in the target. It is possible that P300 did not appear in the standard EEG. The waveform of the signal is confirmed.

[0114] If P300 does not appear in the standard (step 721 / Yes), the cognitive function test control unit 10 Step 9 sets the registered image or sound to be unusable and notifies the user of the result (step 723).

[0115] Specifically, the value of the Validity variable 510 or 514 in the watcher table 501 is set to 0. A value of 0 for the ty variable 510 or 514 means that it is disabled.

[0116] The user is notified that the registered guardian's data is not appropriate for the test. Upon receiving this notification, the user will need to register new data for the person they are watching over. The notification of the results will also include the details of the results.

[0117] Check whether all photos and audio have been checked (step 724), and if not, If step 724 / No, the process returns to step 702 and a new target is selected.

[0118] If all photos and audio are checked (step 724 / Yes), all monitoring It is checked whether the test was conducted on the person (step 725), and if the test was not conducted (step If step 725 / No), return to step 701 and select another watcher. If the test has been performed (step 725 / Yes), the test process ends.

[0119] Here, in step 717, the boundary value of SIn is set to 2.0, but it is not limited to this. do not have.

[0120] If P300 appears in the standard in step 721, then Standard Table 5 The file ID number 521 [File ID No] of 20 is the file of the data used as the standard. The standard number is entered in the stimulus type [Stimulus_Type] 522 of the standard table 520. If the standard is image data, enter "p", and if the standard is audio data, enter "v". Enter.

[0121] Also, "0" is entered in the data validity field 523 of the standard table 520.

[0122] (Example of test data (table) configuration) FIG. 10 shows an example of the structure of the test data table stored in the test data storage unit 108. As shown in FIG.

[0123] Table 1001 of the inspection data storage unit 108 (hereinafter referred to as "inspection data storage table") is ,Inspection data ID No. 1002, Image or audio file number used 1003, Target Frequency 1004 [Target_Frequency], Stimulus type 1005 [Stimulus_Type], Visual stimulus P or Auditory stimulus P Stimulus V, target and standard stimulus order 1006 [Or1, Or2, Or3, Or4, Or5, OrN] Includes the order of get and standard, and the stimulus presentation interval 1007 [SInt].

[0124] The image and audio file number 1003 is the target file number 1008 [Target_File_N o] and Standard File Number 1009 [Standard_File_No].

[0125] (Test data creation flow) Next, the processing flow of the test data creation unit 107 will be described with reference to FIG. Based on the results of the test flow in Figure 7, immediately after the test flow in Figure 7 is executed or When a call is received, the cognitive function test control unit 109 executes this.

[0126] If you want to execute the task when a call is received from the guardian, This can be done immediately after the call is made, or after the call from the watcher has ended.

[0127] The flow in Figure 8 shows an example of the process being performed immediately after receiving a call from the person watching over the patient. do.

[0128] The cognitive function test control unit 109 stores test data in the test data storage table. Check whether it is the first creation (step 801), and if it is the first creation (step 801 / Yes). A watcher Xn is selected from the watcher table 501 (step 802). This is performed immediately after the test flow in Figure 7 is executed.

[0129] Next, the test data creation unit 107 selects the type of stimulus for the test to be created (step 803). The extreme type is the watcher table 501 and the standard table in the oddball task data storage unit 103. Select one of the registered stimulus types by referring to the selection sensory stimulus 517 and stimulus type 522 of the rule 520. Select one of the following. The visual data (video data) and the audio data (audio data) are stored. In this case, select "P" or "V."

[0130] Next, the test data creation unit 107 creates the watcher table in the oddball task data storage unit 103. Refer to the file number of the target image or audio data. If the signal is a voice signal, 509 is selected, and if the signal is a voice signal, 513 is selected (step 804).

[0131] If vision is selected in step 803, the watcher's photo data item 507 is displayed. If hearing is selected, the watcher's photo data item 507 is displayed. In this case, the voice data item 508 of the guardian is selected. In this case, [Validity] 510 is selected for the photo. For audio, select the value of 514 as 1.

[0132] Next, the test data creation unit 107 creates the standard oddball task data stored in the oddball task data storage unit 103. The standard image or sound is selected by referring to the code table 520 (step 805). If visual data "P" is selected in step 803, the stimulus type in the standard table 520 is The value of Stimulus_Type 522 is "P" and the value of Validity 523 is 1. Select something.

[0133] Next, the test data creation unit 107 refers to the watcher table 501 and selects the time of the selected target. Set the target frequency Fn (Frequency511 for photos, Frequency515 for audio) Step 806).

[0134] Next, the oddball task is performed so that the target appears at the frequency Fn set in step 806. The order of presentation of the standard and target is determined (step 807).

[0135] Next, the order of presentation of the target and standard determined in step 807 is stored as test data. The result is stored in the stimulation order 1006 of the test data storage table 1001 in the unit 108 (step 808).

[0136] In the stimulus order 1006, for example, the symbol "T" indicates the target and the symbol "T" indicates the standard. The order of these sequences may be stored as the order of stimuli using the symbol "S".

[0137] Next, the stimulus presentation interval of the selected target (SInterval 512 for pictures, SI for sounds) Interval 516) is set to the stimulus presentation interval [ SInt] 1007 (step 809).

[0138] Other test data is stored in the test data storage table 1001 of the test data storage unit 108. (step 810).

[0139] Specifically, the file number of the target selected in step 804 is stored in the inspection data storage table. The image or audio file number used in the image or audio file is saved in Target_File_No. 1008 of the cable 1001. In addition, the file number of the standard selected in step 805 is stored in the inspection data storage table. Save the image or audio file number 1003 of cable 1001 in Standard_File_No1009. do.

[0140] The target frequency Fn set in step 806 is used as the target of the inspection data storage table 1001. The target frequency [Target_Frequency] 1004 is stored in the target frequency [Target_Frequency] 1004.

[0141] The stimulus type set in step 803 is stored in the test data storage table 1001 as the stimulus type [Stimulus _Type]1005. Save "P" for photos and "V" for audio.

[0142] Refer to the selected sensory stimuli 517 in the watcher table 501 and select all registered sensory stimuli. Check whether the operation has been performed (step 811), and if it has been performed in all senses (step 811 / Yes). , it is confirmed whether the process has been executed for all registered users in the watcher table (step 812 ).

[0143] If all registered users have executed the process (step 812 / Yes), the process ends. If the watcher is not currently running the watcher (step 812 / No), another watcher is selected (step 802).

[0144] Return to step 811 and check if you have performed it in all senses. If you have not performed it in all senses, If not (step 811 / No), another type of stimulation is selected (step 803).

[0145] Return to step 801 and check if it is the first time you have created it. If it is not the first time (step 801 / No), (step 813), and refer to the selected sensory stimulus 517 in the watcher table 501 to select the selected sensory stimulus. The power is confirmed (step 814).

[0146] Next, select the selected stimulus [File_NumberPicture_File_No] 509 selected in step 813 or [Voice e_File_No] 513, and based on the results, select the file number of the image or audio used. Refer to the [Target_File_No] 1008 of the number 1003 and check the ID with the inspection data [ID No] 1002 (step 815). Based on the test data of the examined test data ID (mainly target frequency 1004), The presentation order of the dots and targets is determined again (step 816).

[0147] The result of step 816 is saved and updated as the stimulation order 1006 in the test data storage table 1001. Then (step 817), the process ends.

[0148] (Overall processing flow for cognitive function testing) Next, the overall processing flow of the cognitive function test will be explained using Figure 9. The flow in Figure 9 is as follows: When the smartphone is started up, the cognitive function test control unit 109 executes the process.

[0149] 6, FIG. 6A corresponds to step 901, FIG. 6B corresponds to step 905, and FIG. 6C and FIG. 6D correspond to step 901, step 905, and step 905. corresponds to step 907.

[0150] When someone calls the user's smartphone, the smartphone will receive an incoming call. In response to this, the process flow receives the incoming call (step 901) and converts this incoming call into an event. Then, the caller determination process is executed (step 902).

[0151] Specifically, the watcher table 501 is referenced, and based on the telephone number at the time of the incoming call, the call is It is confirmed whether the person is a watcher by checking whether the person is registered in the table (step 903 ), if the person is not a watcher (step 903 / No), the process ends.

[0152] If the caller is a watcher (step 903 / Yes), the above-mentioned test data creation process is executed. The test data is generated (step 904).

[0153] Next, it is checked whether an electroencephalogram potential is detected (step 905), and if not detected (step 90 5 / No) The user is prompted to touch the electrodes by a display on the screen or by voice (step 906). To prevent users from receiving calls without checking who is calling, the caller must be a watcher. When it is determined that the caller is a A display or announcement may be made to encourage the driver's attention.

[0154] If an electroencephalogram potential is detected in step 905 (step 905 / Yes), the test is performed and an electroencephalogram measurement process is performed. The process is then executed (step 907).

[0155] Specifically, the cognitive function test control unit 109 stores the test data storage table of the test data storage unit 108. The test is performed by referring to the block 1001, and an instruction is given to the electroencephalogram measurement unit 105 to start electroencephalogram measurement. do.

[0156] Next, it is checked whether the receive button has been selected (step 908), and if the receive button has been selected ( Step 908 / Yes), the test and EEG measurement process is completed, and cognitive function analysis is performed (step 909).

[0157] The cognitive function analysis in step 909 is performed by the cognitive function analysis unit 111, and the cognitive function test control unit 109 Upon receiving an event caused by pressing the check-up button, an instruction is issued to the cognitive function analysis unit 111. This is performed by:

[0158] In addition, in the cognitive function analysis in step 909, the P300 value is calculated from the results of the EEG measurement. By comparing the values ​​with pre-set analytical data, signs of cognitive decline can be detected. Detect.

[0159] If the receive button is not selected in step 908 (step 908 / No), the inspection test is performed. The test and electroencephalogram measurement continue (step 907).

[0160] Next, it is confirmed whether or not signs of cognitive decline are detected from the analysis results of step 909 (step 910). If no sign of cognitive decline is detected (step 910 / No), the process ends. If the cognitive decline notification is received (step 910 / Yes), the cognitive decline notification process is executed (step 911), and the process is terminated. Complete.

[0161] The cognitive function decline notification in step 911 is handled by the cognitive function decline notification unit 113, and the cognitive function analysis unit 11 1 issues an instruction to the cognitive decline notification unit 113 in response to the detection of a sign of cognitive decline. This is executed by:

[0162] In addition, Step 911's cognitive decline notification will notify the caregiver registered in the caregiver table. The analysis results will be sent to the user via their registered email address. The analysis results are displayed on the display unit 115 to notify the person in question.

[0163] In the flow of FIG. 9, the cognitive decline notification unit 113 detects a symptom of cognitive decline. In response to this, we are issuing notifications regarding cognitive decline, but regardless of the results of the symptom detection, The results may be notified.

[0164] In this embodiment, email is used as a method of contacting the watcher, but this is not limited to this. It is not something that can be done.

[0165] In addition, if the result is close to the P300 value of an AD patient, the user is prompted to go directly to a hospital for a checkup. Alternatively, it may be possible to automatically notify a specialized department of a local government or the like.

[0166] In this flow, the detection and confirmation of the electroencephalogram potential in step 905 is performed after the test in step 904. This may be performed before the data is created or before the caller is determined in step 902 .

[0167] In addition, the test data created in step 904 is used when the next call comes in after the previous call. The test data to be used is generated in advance and stored in the test data storage unit 108. The data may be read out.

[0168] (Example of test data for oddball task) Next, referring to FIG. 11, the odometer used in the execution of the test and EEG measurement in step 907 of FIG. An example of performing the ball task will be described.

[0169] FIG. 11A shows the results of the visual test data, i.e., the oddball test using visual stimulus images. In this example, a standard image (Figure 11A) is used as the test data. The star mark and the person in the target image (Fig. 11A, 1104) are displayed at a predetermined time interval. This section provides an example of how this can be achieved.

[0170] In FIG. 11A, the horizontal axis represents time in ms, and the vertical axis represents potential in μV. The upper part of the graph represents negative potential. The upper part of the graph 1101 indicates the timing of the presentation of the test data image. This shows the

[0171] The interval between images is 1.5 seconds (reference number 1102). This is the standard interval. The presentation interval is not limited to this time. It is set based on the value described in the stimulation interval 1007 .

[0172] The measurement range of EEG for the target and standard stimulus images was The period of 1.5 seconds (reference number 1103) including the 100 ms before the (This does not mean that

[0173] In order to be able to verify the validity of the test results later, the EEG measurement was performed on the target The results are saved. Therefore, it is possible to measure and store only the brain waves of the target.

[0174] The images of the standard and the target are stored in the inspection data storage unit 108 shown in FIG. The stimulus order 1006 stored in the storage table 1001 and the stimulus presentation interval 1007 in the same table 1001 FIG. 11A shows an example in which the stimulus presentation interval 1007 is set to 1.5 seconds. do.

[0175] The bottom of the graph shows an example of the brain waves measured when the test data image is presented. In the example of Figure 11A, a photo of the target watcher is presented third and the receive button is pressed immediately afterwards. In the example of FIG. 11A, the brain waves are The EEG for the fourth and fifth standards is measured. Not yet.

[0176] In the example of FIG. 11A, when the third target image is presented, the electroencephalogram 1104 (symbol 11 1107, in which P300 appears in the waveform shown in 05, is the first and second standard image. When this was presented, no P300 was observed in the EEG.

[0177] In the example of Figure 11A, the measurement results of the EEG when the target was presented show that the target stimulus 1.5 s from 100 ms before presentation to 100 ms before the next standard stimulus (point 1108) The waveform during this period (the waveform during the period indicated by reference numeral 1105) is used by the cognitive function analysis unit 111. .

[0178] In the example of Figure 11A, the brain wave measurement ends when the user selects the receive button. However, the measurement continues at least until the end point 1108 of the measurement period of the EEG for the target. Therefore, even if the receive button is selected before the end point 1108, Measurements will continue until step 1108.

[0179] Figure 11B shows the test data type as auditory data, i.e., oddball test data with audio auditory stimuli. This is an example of a problem.

[0180] In this example, the test data is the standard voice (Fig. 11B) "lean" The target voice (Figure 11B, 1114) reads the name of the person watching over the person. 1 shows an example in which the voice recorded is output at predetermined time intervals.

[0181] As in Figure 11A, the horizontal axis represents time in ms and the vertical axis represents potential in μV. The image 1111 at the top of the graph indicates the presentation time of the test data voice. This shows timing.

[0182] The interval between stimuli is 1.5 seconds (reference number 1112). This is the standard interval. It is not limited to this time.

[0183] The presentation interval is the value described in the stimulus presentation interval 1007 of the test data storage table 1001. It is set based on

[0184] The EEG measurement range for the target and standard stimulus sounds was measured before the stimulus was presented. The period is 1.5 seconds, including the 100 ms (reference number 1113). is not limited to.

[0185] In order to be able to verify the validity of the test results later, EEG measurements were performed only on the target. The results are also saved. Therefore, it is possible to measure and store only the brain waves of the target.

[0186] The standard and target sounds are stored in the test data storage table 1001. The stimulus is reproduced according to the stimulus order 1006 and the stimulus presentation interval 1007 of the table 1001. This is an example in which the stimulus presentation interval 1007 is set to 1.5 seconds.

[0187] The test data stored in the test data storage table 1001 of the test data storage unit 108 in FIG. Play according to the order of 1006.

[0188] The lower part of the graph shows the electroencephalogram measured when the test data is presented.

[0189] In the example shown in Figure 11B, the third voice read out the name of the target watcher. This is an example of the case where the receive button is pressed immediately after the message.

[0190] In the example of Figure 11B, brain waves are measured until the receive button is selected. Therefore, EEG data for the fourth and fifth presented standards were not measured. In the example of B, the brain waves when the third target sound 1114 was presented (period indicated by 1115) P300 appears in the waveform (code 1117), but the first and second standard sounds are presented. In this case, the P300 did not appear in the EEG.

[0191] The part used in the cognitive function analysis unit 111 as the brain wave when the target is presented is the target From 100 ms before the presentation of stimulus 1114 to 100 ms before the presentation of the next standard stimulus (point 1108) The waveform is for a period of 1.5 seconds up to the time indicated by reference numeral 1115.

[0192] In the example of Figure 11B, the EEG measurement ends when the user selects the receive button. However, measurement continues at least until the end point 1118 of the EEG measurement period for the target. Therefore, even if the receive button is selected before the end point 1118, Measurements will continue until 11:18.

[0193] (Example of table configuration for EEG data storage) Next, referring to FIG. 12, an example of the configuration of the electroencephalogram data table stored in the electroencephalogram data storage unit 106 will be described. We will explain about this.

[0194] The EEG data table 1201 includes the ID No. 1202, the name of the caller (watcher) 1203 [Name], Stimulus type 1204 [image [P] or audio [V]], measurement time 1205 [measurement start time 1206 and measurement end time Time 1207], measurement data 1208 (μV, per 5ms), target and standard file number 120 9[Target_File_No1210, Standard_File_No1211], Target Frequency 1212[Target_Frequency ], stimulus order 1213 [Or1, Or2, Or3, Or4, Or5··, OrN], and stimulus interval 1214 [SInt].

[0195] The measurement data 1208 is received from the result of measurement by the electroencephalogram measurement unit 105 and is relayed by the cognitive function test control unit 109. The waveform is stored in real time at 5 ms intervals (however, it is sufficient if a waveform equivalent to or greater than this can be measured). intervals).

[0196] Target and Standard File No. 1209 [Target_File_No1210, Standard_File_N o1211] stores the file numbers of the targets and standards used during the inspection.

[0197] The target frequency 1212 stores the target frequency at the time of inspection.

[0198] Stimulus order 1213 stores the order of playing the target and standard files. For example, The symbols may be expressed in the order of "t" for target and "s" for standard.

[0199] The stimulus interval 1214 stores the interval at which the stimulus was presented during the test.

[0200] (Example of table configuration for analytical data storage) Next, with reference to FIG. 13, the analytical data storage table stored in the analytical data storage unit 110 will be described. A configuration example of the above will be described.

[0201] The analytical data storage table 1301 includes an ID No. 1302, a data type 1303, and a calculation data for analytical data. Measurement period of the data 1304, average peak latency of P300 1305 (ms), average peak latency period in the past The latency from the mean was 1306 (%), and the peak latency of P300, used to judge the presence or absence of symptoms, was 1307 (ms). Here, the required number of samples 1308 is the target EEG The number of EEG data samples required to calculate P300 by averaging is shown below.

[0202] In the example of FIG. 13, three types are set as the analytical data type [DataType] 1303.

[0203] One is the analytical data derived from the user's past test results. The value of the variable [DataType] 1 (defined in SelfLog) (code 1309). The measurement period is the measurement period 1304 for the data used to calculate the analysis data. The P300 peak latency average value for the period is stored in the P300 peak latency average value 1305. The signs of decline in performance were based on the average peak latency of the P300 (1305) set at a certain delay ratio. This delay ratio is the delay rate 1306 (%) from the average period of past peak latency. In addition, the average peak latency of P300 1305 was calculated by multiplying the delay rate 1306 (%) from the average peak latency period in the past. The value obtained by this calculation is the peak latency of P300 (1307 ms) used to determine whether or not symptoms are present.

[0204] The remaining two are set as general data.

[0205] One is the average age of the users. It is indicated by the value 2 (defined by AgeAve) of the variable [DataType]. This value is stored in the peak latency 1307 of P300, which is used to determine whether or not a symptom is present. The measurement period for the data used for analysis was 1304, the average peak latency of P300 was 1305, and the average peak latency was The delay rate 1306 (%) from the average value of the time period, and the required number of samples 1308 are related to SelfLog 1309. Since these values ​​are used, set them all to 0.

[0206] The other is the average age of AD patients, represented by the variable [DataType] value 3 (defined as ADAgeAve). (Code 1311).

[0207] This value is stored in the peak latency 1307 of P300, which is used to determine whether or not symptoms are present.

[0208] Measurement period 1304 of the data used to calculate the data for analysis, mean P300 peak latency 1305, mean peak The delay rate 1306 (%) from the mean latency period and the required number of samples 1308 are related to SelfLog 1309. Therefore, set all of these values ​​to 0.

[0209] The measurement period 1304 for the data used to calculate the analysis data begins on the date 1312 [Start: YYYY-MM-DD] and ends on the date Consists of the date 1313 [YYYY-MM-DD].

[0210] An example of data entry in the SelfLog 1309 of the data type 1303 is shown in 1314.

[0211] An example of data entry for AgeAve 1310 of data type 1303 is shown in 1315.

[0212] An example of data entry for ADageAve 1311 of data type 1303 is shown in 1316.

[0213] Here, the average age for each age group is 1310 [AgeAve] and the average age for Alzheimer's disease patients is 1311 [ADAge Ave] is calculated based on the average data stored in the device from the beginning, according to the user's age. Selected data may be stored, or when network connectivity is available, medical data may be It is also possible to access the database and store search results according to the user's age. stomach.

[0214] The data type 1303 to be compared may be set by initial setting or mode change. This will be set in advance.

[0215] (Example of table configuration for storing cognitive function analysis results) An example of the structure of a table stored in the analysis result storage unit 112 will be described with reference to FIG. .

[0216] The cognitive function analysis result storage table 1401 contains the ID No. 1402 of the analysis result, the peak latency of P300, Calculate the average time of the data calculation period 1403, caller 1404, stimulus type 1405, average P300 Average peak latency 1406, type of analysis data used for symptom detection 1407, symptom presence / absence determination result 1408 Includes.

[0217] The calculation period 1403 for the data for calculating the average time of the peak latency of P300 is the start date and time 1409 and the end date and time It consists of 1410.

[0218] The stimulus type 1405 is a visual stimulus [P] 1411 or an auditory stimulus [V] 1412 .

[0219] The mean peak latency 1406 of P300 is the average within the data calculation period and is expressed in ms.

[0220] For the [DataType] of the analysis data type 1407, use the peak latency of your past P300. ,(SelfLog1413) Store the value 1 and use the average value of P300 peak latency for user age (AgeAv e1414) Store the value 2 and use the average P300 peak latency of age-averaged patients with Alzheimer's disease. In this case (ADAgeAve1415), the value 3 is stored.

[0221] In the [Result] 1416 of the symptom presence / absence judgment result 1408, if a symptom is present, 1 is set 1417, and if not, 1 is set 1418. In this case, set it to 0 (code 1418).

[0222] (Processing flow of cognitive function analysis unit) Next, the processing contents of the cognitive function analysis unit 111 of the present invention will be described with reference to FIG.

[0223] In this embodiment, the explanation will be given on the assumption that the data analysis period is determined in advance. For example, it may be the last day of the month, or the last day of a period specified by the user. stomach.

[0224] The cognitive function analysis unit 111 performs data analysis of cognitive functions on the electroencephalogram data. The timer 119 is used to manage the schedule. For example, the next data analysis period to be performed If it has not been reached (step 1501 / No), the process is End the process.

[0225] If the data analysis period has arrived (step 1501 / Yes), the data stored within the analysis period A watcher Xn having the above condition is selected (step 1502).

[0226] Next, data for each type of stored data is extracted from the stored data within the analysis period (step Specifically, the name 1203 of the caller (watcher) in the EEG data table 1201 is The selected watcher is searched for and data is extracted for each stimulus type 1204 from the corresponding results (S Step 1503).

[0227] Next, it is determined whether the data extracted in step 1503 contains the minimum necessary data samples. It is determined whether or not the

[0228] For the minimum required data sample, select SelfLog1309 in the analysis data storage table 1301. Then, the required number of samples, 1308, is checked by referring to the value.

[0229] If there is a sample (step 1504 / Yes), the order of the stimulation data is referred to, and the stored EEG The measured waveform data that appeared in response to the target stimulus is extracted from the data and temporarily stored in a buffer. (step 1505).

[0230] The order of the stimulation data is determined by referring to the stimulation order 1213 in the EEG data table 1201. Then, calculate the time when "t" appears from the stimulus interval. For example, if "t" is the third and the inter-stimulus interval is 1.5 seconds, If the target was presented after about 3 seconds, the measurement data for 3 to 4.5 seconds would be The data to be analyzed is actually from 0.1 ms before the stimulus is presented. However, since the measurement data was also taken 0.1 seconds before the stimulus presentation, the measurement data was extracted from 3 to 4.5 seconds. Just put it out.

[0231] The buffer is provided on the RAM 213 and is managed by the cognitive function analysis unit 111 .

[0232] Next, from the results extracted in step 1503, it is confirmed whether waveform extraction for the target period has been completed. If it is not completed (step 1506 / No), the target measurement waveform data is The data is extracted and the result is temporarily stored in a buffer (step 1505). Wave ID number [Wave_No], caller / watcher [Name], stimulus type [P] or [V], measurement time (measurement Start time: [Start_Time], measurement end time: [Start_Time]), target waveform data μV, per 5ms , the stimulation interval [SInt] is stored and saved.

[0233] In step 1506, from the results extracted in step 1503, the waveform of the target period is If the extraction is complete (step 1506 / Yes), the target stored in the extracted buffer is The electroencephalogram data of the stimuli is used to calculate the arithmetic mean of the P300 peak latency (step 1507).

[0234] Next, the calculation result of the arithmetic mean of P300 within the set period is stored in the analysis result storage unit 112 as the average peak latency of P300. The data is saved at time 1406 (step 1508).

[0235] Next, data to be compared is selected from the analytical data storage table 1301 in the analytical data storage unit 110. The data type 1303 is selected (step 1509).

[0236] Next, the value of the peak latency 1307 of the P300 used to determine whether or not the selected data type 1303 has a symptom is and the average peak latency of P300 during the analysis period calculated in step 1507 (step (P1510).

[0237] In step 1510, the P300 used to determine whether or not the selected data type 1303 has a symptom is If the value is equal to or less than the peak latency 1307 (step 1511 / No), it is determined that there is no symptom and is used as a comparison target. The type of data to be analyzed and the results are stored in table 1401 in the analysis result storage unit 112 ( Step 1512).

[0238] In step 1510, the P300 used to determine whether or not the selected data type 1303 has a symptom is If the value is greater than the peak latency 1307 (step 1511 / Yes), it is determined that there is a symptom, and the comparison The results are stored in the table 1401 of the analysis result storage unit 112 together with the type of data used for analysis. The 300 average vertex latencies 1406 are saved (step 1513).

[0239] Check whether all data types 1303 in the analysis data storage table 1301 have been compared (Step 1 514), if not compared (step 1514 / No), it is set as a comparison target in the analysis data storage unit 110. The type of data is selected (step 1509).

[0240] In the example of FIG. 13, three data types are registered. In this case, in step 1514, Check whether the three data types were compared.

[0241] It is checked whether it has been compared with all data types 1303, and if it has been compared (step 1514 / Yes), all It is checked whether the data of all the watchers has been analyzed (step 1515), and if so (step 151 5 / Yes) End the process.

[0242] Refer to the name 1203 of the caller (watcher) in the EEG data table 1201, and Check whether the data of the person has been analyzed (step 1515). If not (step 1515 / No), A watcher Xn who has data stored within the analysis period is selected (step 1502).

[0243] The analysis of the EEG measurement data for each watcher is carried out by using the user as the data stimulus used during the measurement. This is because the pictures and sounds presented to the viewer are different for each viewer. The analysis of EEG data for each sensory perception is based on the peak latency of P300, which varies depending on the type of stimulation used. This is because the trends are different.

[0244] (Example of cognitive function analysis results) Figure 16 shows an example of the cognitive function analysis results for a specific watcher. In this example, the average calculation period is set to one month, and the peak latency of P300 is analyzed for each month. The horizontal axis shows the time of measurement in months, and the vertical axis shows the peak latency of P300.

[0245] In the example in Figure 16, the average peak latency of P300 per month was 15% lower than the results for the previous three months. % or more slowing down is a sign of cognitive decline. It is set in advance.

[0246] May 2016 (code 1602) was more than 15% slower than the average peak latency of P300 for the past three months (code 1603). Since the symptom is present (code 1604), it is determined that the symptom is present.

[0247] The results in Figure 16 are calculated for each watcher. There are cases where people are judged to have symptoms and cases where people are judged not to have symptoms. If so, you may decide that there are signs, or the results for all registered guardians may be When a symptom is detected, it may be finally determined that a symptom is present.

[0248] The analysis of the peak latency of the P300, as shown in Figure 16, indicates that the peak latency is observed when the symptom is detected or A specific watcher may be notified each time a result is calculated through monthly analysis. .

[0249] According to this embodiment, an oddball task is automatically generated and the task is automatically executed. In addition, by incorporating a function to automatically measure brain waves while performing the task, The cognitive function status of the user (subject) can be examined. For example, an oddball task is presented during a task that has a different purpose from the task of answering a phone call. Since the brainwave data is acquired, the user is not aware that they are undergoing a cognitive function test. This will reduce the psychological burden felt by users when undergoing cognitive function tests. can.

[0250] Furthermore, by providing a function to automatically analyze test results, the state of the user's cognitive function can be monitored periodically. can be checked.

[0251] Furthermore, according to this embodiment, a cognitive function test is performed using a database that stores stimuli for oddball tasks. The data for the brain wave measurement can be automatically generated. It detects that the person has been diagnosed with a cognitive disorder and automatically generates cognitive function test data for that person. The brain waves at that time can be measured and stored. In addition, the cognitive function test can be performed according to the user's preference. These can be used to improve cognitive function in the elderly in their daily lives. The test can be easily and continuously performed. In this case, the test results will be sent to the person in question or to a watcher of a related user who has registered in advance. may be notified.

[0252] Second Embodiment The smartphone having the function of the cognitive function test described in the first embodiment is The recipient will be able to see who is calling and be alerted by a picture or sound. This is a common telephone behavior, where you confirm that the caller is an acquaintance before answering the phone. It is used as an oddball task, and when a call comes in from the caregiver, the patient responds based on the oddball task. The automatically generated incoming call image or incoming call sound is displayed or played to the user, and Examining the user's cognitive function by measuring and analyzing the P300 brain wave evoked by the user's reaction It is characterized by the fact that

[0253] As mentioned above, the stimuli that induce P300 in oddball tasks include auditory, visual, and somatosensory stimuli. Generally, people have a sense that they use preferentially among these (dominant sense), and this is It is different for each person. For this reason, people who are auditory dominant will hear sounds, and people who are visual dominant will hear sounds. By using images in oddball tasks, we can improve user convenience and enable more frequent cognitive function testing. It is expected that an investigation will be carried out.

[0254] The three sense dominances analyze predicates (verbs, adjectives, adverbs) in everyday language. This invention utilizes this to distinguish the differences in individual priorities. After analyzing the results, the type of stimulus to be used in the cognitive function test, such as visual or auditory, can be selected. More specifically, the content of the subject's past utterances and sent emails are recorded. The predicates contained in the sentences are extracted, and the frequency of use of visual expressions and auditory expressions shown in the predicates are calculated. If the frequency of visual expression is high, the type of stimulus presented to the subject and the If the frequency of auditory stimuli is high, the subject will be presented with visual stimuli. It is decided to use auditory stimuli as the type of stimulus for the test data.

[0255] To analyze the above predicates, we use a set of "corpora" available on the Internet. Analyzing predicates using a text database for linguistic research and identifying the dominance of users' senses Analyze.

[0256] In this embodiment, data such as emails or phone calls is analyzed by focusing on predicates. This allows the user's sensory dominance to be determined, and the type of sensory data to be used in the test is determined based on the results. For example, in a device that is both visual and audio-enabled, the user may decide whether to use visual images or audio. It is characterized by being equipped with a mechanism that determines whether to

[0257] (Example of cognitive function analysis results) FIG. 17 is a functional block diagram of the cognitive function testing device (smartphone) used in this embodiment. is.

[0258] The difference from FIG. 1 of the first embodiment is that the information connected to the external network through the communication unit 116 is The data is stored in the memory of the information device (smartphone 1702, PC or tablet 1703) or on the cloud 1704. Obtain stored user data related to emails and calls (sent emails and call records) and The device is provided with a priority sense analysis unit 1701 for analyzing the priority sense.

[0259] There are an increasing number of cases where individuals own multiple devices, such as smartphones, PCs, and tablets. In line with this, cloud computing is becoming increasingly popular in order to change devices and share various data between devices. Use the service to upload information such as emails, address books, images, and audio. In addition, there are increasing numbers of people who are reusing their smartphones, such as by changing their phone model, to play back call records and content. In this embodiment, the user's behavior history, such as a raw history, may remain. This information is used to determine the user's sense of dominance.

[0260] In addition, when analyzing the priority sense by predicates (verbs, adverbs, adjectives), Use the 1705.

[0261] The processing of the priority sense analysis unit 1701 is executed at the time of initial setting.

[0262] The cognitive function testing device 1706 of this embodiment communicates with an externally connected information device ( 1702, 1703) or cloud 1704, user data related to emails and calls (sent emails) The priority sense analysis unit 1701 analyzes the priority sense of the user from the information such as the phone number, the phone number, and the call record. The functional blocks have the same block configuration as in Figure 1.

[0263] In the example of Figure 17, the corpus 1705 is from the Internet. Since it takes time to search for vocabulary in general-purpose corpora on the Internet, Using corpora, etc., we create a corpus for visual and auditory vocabulary analysis and store it in the device. It may be provided.

[0264] The data is registered in the oddball task data storage unit 103 if the user has already registered the data in the smartphone. The address book data stored in the memory, the photos stored in the album, and the call history The data to be registered in the oddball task data storage unit 103 (the data of the watcher) is You can extract and register the information (phone number, name, email address, voice, photo) or You may register using data sent by the guardian.

[0265] In addition, data stored on other smartphones that can be connected to the network or on the cloud can be It may also be possible to register using

[0266] (Priority sense analysis processing flow) Next, referring to FIG. 18, the priority sense analysis executed by the priority sense analysis unit 1701, which is a feature of the present invention, will be described. The details of the analysis process will be explained below.

[0267] At the time of initial setting in this embodiment, the priority sense analysis unit 1701 communicates with an external device ( 1702, 1703) or attempts to connect to the cloud 1704 (step 1801). The device checks whether it can connect to an external device or cloud (step 1802), and if it cannot connect (step Step 1802 / No), check whether the test has failed N times or more (Step 1803), and if it has not failed N times or more (Step 18 03 / No), then try to connect to an external device or cloud (step 1801). If it fails N times or more, If so (step 1803 / Yes), the process ends.

[0268] The priority sense analysis unit 1701 checks whether connection is possible (step 1802), and checks whether the connected external device or Check whether the user's past sent emails exist on the cloud (step 1802 / Yes). If there is an outgoing mail (step 1804 / Yes), the outgoing mail is Then, a part-of-speech analysis is performed on the target (step 1805). Then, predicates (verbs, The words (adjectives, adverbs) are extracted (step 1806).

[0269] Next, we refer to 1705 corpora on the Internet to extract vocabulary for visual and auditory expressions, and These are classified by visual and auditory senses and the frequency of occurrence of each sense is analyzed (Step 1 807).

[0270] Here, examples of visual expressions include seeing, reflecting, bright, shining, and dazzling. Examples of auditory expressions include "hear," "say," "resonate," "noisy," and "quiet." The pass can be used as it is on the Internet, or it can be used as a pass on the Internet. Using the data from the corpus on the These may be provided within the device 1706.

[0271] Next, in step 1807, the priority sense analysis unit 1701 analyzes the frequency of appearance of visual and auditory expression vocabulary. Based on the analysis results, it is checked whether the frequency of appearance of the visual expression vocabulary is high (step 1808). (Step 1808 / Yes), the cognitive function test control unit 109 is set to an image-based test and the process is completed. On the other hand, if the frequency of appearance of the visual expression vocabulary is not high (step 1808 / N o) The test is set to voice inspection (step 1810) and the process ends.

[0272] In step 1804, if there is no previously sent mail from the user (step 180 4 / No), and check whether there is a past call voice record (step 1811). If a record exists (step 1811 / Yes), a part-of-speech analysis is performed (step 1805) and the preferred sense is Before conducting call analysis, the data must be converted into text. The conversion to the audio data is performed on smartphones 1702, PCs, tablets 1703, and computers. A voice-to-text converter on the computer 1704 may be used, or the device of the present invention may be used to convert the voice to text. Conversion software may be implemented to perform the conversion.

[0273] If there is no past call voice record of the user in step 1811 (step 1811 / N o) Check whether there is a created sentence (step 1812). If there is a created sentence (step 1812 / Yes), A part of speech analysis is performed on the target (step 1805) to analyze the priority sense. If no document exists (step 1812 / No), the process ends. Cognitive function tests using predefined default stimuli may be performed. The stimulus may be visual or auditory.

[0274] In Figure 18, the priority sense was analyzed by analyzing predicates, but the frequency of content playback was also analyzed. The priority sense may be analyzed according to the degree of playback of the video content and the audio content. If the playback frequency of the video content is high, the system will set it to image inspection. If the playback frequency of the audio content is higher, the audio inspection is set. do.

[0275] In addition, a questionnaire was presented to analyze the sense of priority, and the answers to the questions were analyzed. Based on the results, the type of stimulation data to be used in the cognitive function test is selected. It may be possible to set the

[0276] As described above, the type of stimulation data to be used in cognitive function tests is determined based on the preferred sense. However, the type of stimulus data (image or audio) used in the cognitive function test is automatically selected depending on the surrounding situation. For example, if you are in a situation where making noise is a nuisance to those around you, In this situation, the system changes to use visual (image) data. The surroundings are manually set by the user. You can set it from location information using information such as GPS. You may do so.

[0277] From the above, the cognitive function testing device 1706 of this embodiment is equipped with the priority sense analysis unit 1701. This allows cognitive function testing to be performed using data from the user's preferred sense. It is possible.

[0278] Third Embodiment The smartphone equipped with the cognitive function test function described in the first and second embodiments is The cognitive function test was conducted using a situation / timing that everyone engages in daily, such as receiving a phone call from a This has led to an investigation into the user's, especially the elderly, attitude towards taking cognitive function tests. This will enable early detection of dementia easily during daily activities without placing any mental burden on the patient. do.

[0279] In this embodiment, a cognitive function test is performed using daily activities other than receiving a phone call. The smartphone used in this embodiment has the structure shown in FIGS. It shall be equipped with the necessary equipment.

[0280] (Example of how to use the alarm) Using Figure 19, we will explain how to operate the alarm (including alarm clocks and schedules) using cognitive The following shows an example of how to use the function test. The alarm function is executed by the timer 119. The user , an application that uses a timer 119 (e.g., an alarm clock application, a scheduler, etc.) ) to set the alarm.

[0281] When the time (or event) preset by the user is reached, the timer 119 will sound an alarm. An alarm sound is reproduced or vibration is generated via the voice output unit 117, and the cognitive function test control unit 109 (Figure 19A).

[0282] The user holds the smartphone in his / her hand and inserts the electrodes 302, 303 for measuring electroencephalograms on the back of the smartphone. When the surface of the hand touches the electrodes 306 and 307 for measuring EEG on the side or the 303, the cognitive function test control The unit 109 detects that the brain wave can be measured using the brain wave measurement unit 105 via the electrodes, and Test data is created using the data creation unit 107, and the test data is displayed on the display unit 115. The cognitive function test begins (Figure 19B).

[0283] To turn off the alarm, the user must display the test data created by the test data creation unit 107. The screen displayed on the display unit 115 is shown (FIG. 19C). Randomly, a stimulus image such as an emoji 1901 and a target switch OFF icon 1902 were used. The switch OFF icon 1902 is displayed infrequently, as in the first embodiment. The user can select the switch OFF icon 1902 from the series of screens 1903 that are displayed. When the switch OFF icon 1902 appears, the switch OFF icon 19 Touch 02 to turn off the alarm (Figure 19D). When the alarm is turned off, the timer 11 9 notifies the cognitive function test control unit 109 of this fact, and the cognitive function test control unit 109 The method for analyzing the signs of dementia using the measurement results is described in the first experiment. This is the same as the embodiment.

[0284] In addition to the alarm operations described above, cognitive function tests are also possible.

[0285] The user can read e-books using an e-book application or the like installed on the smartphone of the present invention. Each time you flip through the pages, you will find pages that are likely to interest you or specific pages. (Table of contents, section / chapter headings, pages with illustrations or photos, etc.) Display characters, popups, or change the color. Then open the book. The brain waves during reading are measured from the time the page is opened to the time it is closed, and changes in the page are recorded. In this case, the frequency of pages that are likely to be of interest is a constant value. It needs to be set as follows:

[0286] In this case, the target image is a pre-determined character or This is the page screen that displays the popup together with the image to be used as the standard. is a page screen that does not display characters or popups.

[0287] In addition, the cognitive function test was conducted by running an e-book app on a smartphone and using electrodes to measure EEG. If any two of 302, 303, 306, or 307 are touched, the e-book app will close. That's it.

[0288] In addition, when viewing video content on the smartphone of this embodiment, the viewer Viewed between standard videos in the oddball task repository that were unrelated to the auditory content Videos related to the content you are trying to view (e.g., the title of the content) are displayed infrequently. Mix and play.

[0289] When you change the content you are watching, the same video playback occurs immediately after the content change. Follow the steps above to set up the video playback application on your smartphone. The brain waves were measured when the user was watching the content, and when the video related to the content was played, Cognitive function is tested by analyzing the P300 EEG.

[0290] In this case, the image used as the target is, for example, the content that the user is about to view. The standard image is the title of the content. The data is stored in the standard management table in the repository. You can also use footage that has been stored in your smartphone.

[0291] In addition, the cognitive function test is performed by connecting the electroencephalogram measurement electrodes 302, 303, and 306 when the content playback application is started. , 307, and then play or change the content. Until the change is complete.

[0292] You can also register your favorite images or sounds as wallpaper or startup sounds, and then use them when starting up or shutting down the device. When the device is turned off, it will play after any unrelated images or sounds. When you set the method, the brain waves at startup are measured, and the above favorite wallpaper and startup sound are played. Cognitive function is analyzed by analyzing the P300 EEG at the time of birth.

[0293] In this case, the target image or sound will be the same as the image or sound already set as wallpaper. The standard images and sounds are stored in the oddball task data storage area. The data in the standard management table is stored in the It is possible to play videos and audio that are not registered in the app but are pre-stored on your smartphone. May be used.

[0294] In addition, the cognitive function test is performed by connecting the electrodes 302, 303, 306, and 307 for measuring electroencephalograms when the smartphone is turned on. When you place your hands on either of these two buttons, your favorite wallpaper or startup sound will be displayed or displayed when the device starts up or finishes. will continue until playback begins.

[0295] Also, when taking a measurement using a thermometer, etc., unrelated screens or sounds may be displayed shortly before the measurement results are displayed. Display or play the results and then display a screen that displays the results, or have the results read aloud Play. Temperature measurement when the temperature measurement app on the smartphone is set up as above. Measure the brain waves during the test and measure the brain waves when the measurement results are displayed or read out. Analyzes and tests the P300 of the waves. The temperature sensor is connected to a smartphone. It may be implemented internally.

[0296] In this case, the image or sound used as the target is the body temperature measurement result (image or sound). The data stored in the oddball task data storage unit 103 is used as the standard. The data (image or audio) in the standard management table is used. Images or sounds that are pre-stored in the smartphone may also be used.

[0297] In addition, the cognitive function test is performed by connecting any of the electrodes 302, 303, 306, and 307 for measuring electroencephalograms at the start of body temperature measurement. The time from when your hand is placed on the device to when the temperature measurement results are displayed or played back.

[0298] In addition, as a game, images such as characters are displayed in low frequency between images such as symbols. When the character appears, you can touch the screen or use the The brain waves are measured while playing this game on a smartphone, and the Cognitive function is tested by analyzing the P300 brain waves when the character appears on the screen.

[0299] As a game, it features a variety of sounds (musical instruments, human voices, bird calls, vehicle sounds) in between single sounds. The system randomly mixes sounds (such as horns) at low frequencies and detects abnormal sounds. Press the buttons and move your arms and legs. When playing this game on your smartphone The brain waves of the subjects were measured, and the P300 of the brain waves was analyzed when a strange sound was played to test their cognitive function. do.

[0300] In this case, the target is an image of a character or other object, and the standard The standard management data stored in the oddball task data storage unit is used as the code. This is an image of the table. The standard is also stored in the smartphone. It can also be an image.

[0301] In addition, the cognitive function test is performed by using one of the electrodes 302, 303, 306, and 307 for measuring electroencephalograms at the start of the game. From the moment you place your hands on the two pieces until the game ends.

[0302] The above mainly describes applications on smartphones to which the present invention can be applied. However, the scope of application of the present invention is not limited to the above. It can also be used as a display device for checking visitors, such as an intercom at the entrance. The same function can be performed as when a call comes in on the smartphone of the present invention.

[0303] <Fourth embodiment> In the above-described embodiment, the cognitive function testing device is a smartphone-based device. In the present embodiment, other shapes and configurations will be described below.

[0304] First, the cognitive function testing system of the present invention, in which the electroencephalogram measuring unit 105 of FIG. 1 is implemented in a measuring device, The functional block diagram of the above will be explained.

[0305] Figure 27 shows the functional block diagram of a cognitive function testing system consisting of a cognitive function measuring device and an electroencephalogram measuring device. This is a diagram.

[0306] Figure 27 shows a smartphone case (Figure 20), glasses, or sunglasses with an EEG measurement function. frame (Fig. 21A), headphones (Fig. 22A), hearing aids (Fig. 23A and Fig. 23B), mice (Figure 24A), TV remote controller (hereafter referred to as TV remote control: Figure 25A) and cognitive function test function Smartphones (Figure 21B), tablet PCs (2110), desktop PCs, and laptops The present invention is realized as a system consisting of an electronic book TV main body (2111), a radio main body (2214), etc. The mouse is an example of an information input device, and the The device is an information processing device, such as a PC, that operates according to operation information input from a mouse. do.

[0307] The main difference from the functional block diagram (FIG. 1) according to the first embodiment is that the electroencephalogram measurement unit 105 is not an external device. The measuring device 2703 is provided with an electroencephalogram measuring unit 2705. The measuring device 2703 is also provided with a communication unit 2704, and the cognitive function testing device such as a smartphone 2701 and a measuring device 2703 equipped with an electroencephalogram measuring unit 2705 are configured to cooperate with each other via a communication unit 2704. This is currently being achieved.

[0308] The following explanation uses a smartphone (Figure 21B) as an example of a cognitive function testing device. do.

[0309] The communication between the cognitive function testing device 2701 and the measuring device 2703 equipped with the electroencephalogram measuring unit 2705 is It may be wired or wireless.

[0310] The cognitive function testing system of the present invention comprises a cognitive function testing device 2701 and a measuring device 2703. do.

[0311] The cognitive function testing device 2701 includes a cognitive function measurement and assessment unit 2702, an operation unit 114, a display unit 115, a communication unit 116, an audio output unit 117, an audio input unit 118, and a timer 119.

[0312] The operation unit 114 allows the user to input operations to the cognitive function testing device 2701 .

[0313] The display unit 115 displays an operation screen and various information to the user.

[0314] The communication unit 116 communicates with external devices via various networks (telephone network, WiFi, Bluetooth, etc.). In this embodiment, the communication unit 116 also operates as an electroencephalogram data acquisition unit.

[0315] The audio output unit 117 and the audio input unit 118 output and input audio via a microphone and a speaker. cormorant.

[0316] The timer 119 measures time, such as a clock, alarm, or stopwatch.

[0317] The cognitive function measurement and assessment unit 2702 includes an oddball task data storage unit 103 and a caller assessment unit 104. , EEG data storage unit 106, test data creation unit 107, test data storage unit 108, cognitive function test Control unit 109, analysis data storage unit 110, cognitive function analysis unit 111, analysis result storage unit 112, cognitive function The device includes a degradation notification unit 113 .

[0318] The oddball task data storage unit 103 is a unit that stores data for oddball tasks. .

[0319] The oddball task data storage unit 103 stores, for example, a person ( Information about the person watching over you, such as the person watching over you, their phone number, name, email address, voice, Stores information such as photos.

[0320] When receiving a call or e-mail via the communication unit 116, the caller determination unit 104 determines whether the caller is It is determined whether the watcher is registered in the oddball task data storage unit 103 or not.

[0321] The electroencephalogram data storage unit 106 records the electroencephalograms measured by the measuring device 2703 .

[0322] The test data creation unit 107 creates the oddball task data of the watcher stored in the oddball task data storage unit 103. Audio, photos, images such as emojis pre-recorded on the smartphone, and ringtones is used to automatically generate data for cognitive function tests.

[0323] The inspection data storage unit 108 stores the inspection data created by the inspection data creation unit 107. do.

[0324] The cognitive function test control unit 109 detects potentials from electrodes in the measuring device 2703 and detects brain waves. When it is detected that measurement is possible, the test data stored in the test data storage unit 108 is used. This is the part that starts the test and records the measured electroencephalogram in the electroencephalogram data storage unit 106. It controls all the parts that make up the cognitive function measurement and evaluation unit 2702.

[0325] The analytical data storage unit 110 stores data for analyzing and evaluating cognitive functions.

[0326] The cognitive function analysis unit 111 analyzes the electroencephalogram measurement results recorded in the electroencephalogram data storage unit 106, By comparing with the data in the analysis data storage unit 110 calculated in advance, Conduct a functional analysis.

[0327] The analysis result storage unit 112 records the analysis results of the cognitive function analysis unit 111 .

[0328] The cognitive function decline notifying unit 113 notifies the user that the cognitive function analysis unit 111 has detected a decline in cognitive function. When a symptom of dementia is detected, the oddball task data storage unit 103 stores the data in advance. The registered guardian will be notified.

[0329] Here, the watcher to be registered in the oddball task data storage unit 103 is a person who has undergone a cognitive function test. It is a person who discreetly monitors the life and health of the target user (elderly person). For example, The caregiver may be a family member or a care manager. By using a smartphone, it is possible to remotely monitor the cognitive function of the user (elderly person) in their daily life. You can monitor the situation.

[0330] The data to be registered in the oddball task data storage unit 103 is the existing address of the smartphone. Recorded data (phone number, name, address, email address, etc.) in the built-in memory or SD card Photos, data recorded in call logs (phone number, name, email address, You can also register using data sent by the new guardian. That's fine.

[0331] The measuring device 2703 includes a communication unit 2704 and an electroencephalogram measuring unit 2705 .

[0332] The communication unit 2704 communicates with external devices via various networks (WiFi, Bluetooth, etc.). .

[0333] The electroencephalogram measuring section 2705 measures the electroencephalogram of the user who is the subject of the cognitive function test.

[0334] As described above, in the cognitive function testing system of this embodiment, the cognitive function testing device 27 01 is, for example, a smartphone (Figure 21B), a tablet PC 2110, a desktop PC, a notebook PC , e-books, TV units 2111, radio units 2214, etc. The measuring device 2703 also measures the smartphone case (FIGS. 20A, 20B, and 20C), eyeglasses, and Or sunglasses frames (Fig. 21A), headphones (Fig. 22A), hearing aids (Fig. 23A and Fig. 23B), mouse (Fig. 24A), TV remote controller (hereinafter referred to as TV remote control: Fig. 25A), etc. is.

[0335] In addition, in the cognitive function testing system of this embodiment, the cognitive function testing and judgment described in FIG. The hardware constituting the measurement unit 102, for example, the electroencephalogram measurement electrodes 221, the signal processing device 222, the ADC 223 The CPU 211, the ROM 212, the RAM 213, and the storage device 214 are either the cognitive function testing device 2701 or the measurement device 2703. The communication module 227 is mounted on both devices.

[0336] However, the cognitive function testing device 2701 and the measurement device constituting the cognitive function testing system according to this embodiment The measurement device 2703 is not limited to the above-mentioned devices. Communication between the device and the sensor may be wireless or wired.

[0337] Below, we will explain the functional blocks and hardware configuration for each implementation example.

[0338] (Example of a smartphone case) FIG. 20 shows an example in which the electroencephalogram measuring unit 2705 is mounted in a smartphone case. The parts other than the electroencephalogram measuring unit 2705 are provided in the smartphone.

[0339] 20A, 20B, and 20C show the back, side, and front of the smartphone case, respectively. Shows.

[0340] The smartphone cases (back 2001, left side 2007, right side 2008, front 2015) are for measuring brain waves. Electrodes (electrodes 2002 and 2003 installed on the back, and electrodes 2009 and 2010 installed on the sides) and signal processing The device includes a processing unit 222, an ADC 223, and a communication module 227 for transmitting the detected potential. Module 227 is a wireless communication module.

[0341] The signal processing device 222, the ADC 223, and the communication module 227 for transmitting the detected potential are mounted on the rear surface. (Reference numeral 2006) However, the location of implementation is not limited to the position 2006.

[0342] The electrodes for measuring EEG are electrodes 2002 and 2003 mounted on the back of the smartphone case 2001. In addition, electrodes 2009 and 2010 are mounted on two locations on the left side surface 2007 and the right side surface 2008.

[0343] The four electrodes for measuring EEG are electrodes 2002 and 2003 on the back, and electrodes 2003 on the left and right sides. The installed electrodes 2009 and 2010 can be combined depending on the potential detection situation (bipolar induction). (Two electrodes are required for measurement.)

[0344] Furthermore, the back of the smartphone case (2001), the left side (2007), the right side (2008), The front 2015 is equipped with a light. In the figure, the rear lights 2004 and 2005 and the side lights The lights shown are 2011, 2012, 2013, and 2014, and the lights 2016 and 2017 are installed in the front. The light can have different colors. The light turns on when an incoming call comes in and Measurement electrodes (electrodes 2002 and 2003 installed on the back, electrodes 2008 on the right side, and electrodes 2007 on the left side) The position of the poles (2010, 2009) is clearly indicated. Also, lighting allows for EEG measurement even in the dark. The location of the electrodes can be clearly indicated, so the user can be sure that the electrodes are correctly positioned for EEG measurement. The part where the electrodes are arranged, i.e., the electrodes 2002 and 2003 arranged on the side or the electrodes 2003 arranged on the back, The electrodes 2009 and 2010 can be controlled. The lights installed on the side 2011, 2012, 2013, 2014, and the lights installed on the front 2016, 2017 , are mounted on the back 2001, left side 2007, right side 2008, and front 2015 of the smartphone case. Therefore, no matter how the smartphone is placed, it can receive calls and detect the location of the electrodes. The user can be informed accurately.

[0345] FIG. 20D shows a smartphone case (back 2001, right side 2008, left side 2007, front 2015). This is a view from the front when attached to a smartphone 2018.

[0346] Smartphone 2018 and smartphone case (back 2001, right side 2008, left side 2007, front In the cognitive function testing system by the above (2015), the alarm and e-book functions shown in the third embodiment are Turning pages in a book, playing video content, starting up a smartphone, measuring temperature, playing games, The program is feasible.

[0347] (Example of eyeglass frames) FIG. 21A shows the electroencephalogram measuring unit 105 in the cognitive function testing device 101 of the present invention, with the use of glasses or sunglasses. This is an example of implementation in a frame 2101 of the ras.

[0348] The following explanation will be given using glasses as an example. The glasses equipped with the electroencephalogram measuring unit 2705 are attached to a frame 2101. Electrodes (2102, 2103, 2104, 2105) for measuring electroencephalograms, a signal processing device 222, an ADC 223, a detector It is equipped with a communication module 227 that wirelessly transmits the emitted potential.

[0349] Here, the four electrodes on the eyeglass frame are used for bipolar measurement depending on the contact state with the body when worn. They can be used in combination as electrodes. At least two points must be in contact with the body. EEG can be measured by four electrodes (2102, 2103, 2104, 2105). Nell's EEG (for example, 2102 and 2103 are combined for one channel, 2104 and 2105 are combined for 1 channel, 2102 and 2104 or 2105 combined for 1 channel) To measure three-channel EEG, all electrodes must be in contact with the body. There is.

[0350] Since it is known that deterioration begins in the temporal lobe in AD, the combination of electrodes 2102 and 2103 The combination of electrodes 2104 and 2105 should be given priority for measurement. The signal processing device 222, the ADC 223, and the detected potential are transmitted wirelessly. The communication module 227 for transmitting the signal is provided at the end of the frame (2106, 2107). The mounting locations of the processing unit 222, the ADC 223, and the communication module 227 are not limited to 2106 and 2107. do not have.

[0351] The measured electroencephalogram potential is converted into a digital signal after signal processing and amplification. The data is transferred to the paired smartphone 2109 and processed. If no potential is detected at any of the electrodes, a warning message appears on the screen of the smartphone 2109. The power is supplied by a small battery 2108 mounted in the frame 2101. do.

[0352] In addition to smartphones, cognitive function testing devices that work with Frame 2101 include There are children's books, tablet PC 2110, TV, and PC.

[0353] FIG. 21C shows a tablet PC 2110 that cooperates with the frame 2101, and FIG. 21D shows a tablet PC 2110 that cooperates with the frame 2101. The TV set is an example of a TV set (TV main body 2111, remote control 2112). It is configured to include Con2112.

[0354] Frame 2101 and smartphone 2109, e-book, tablet PC 2110, TV set (TV body 2 111, remote control 2112), PC (desktop PC, notebook PC, etc., not shown here), etc. In the cognitive function testing system, the alarm shown in the third embodiment, the page turning of an electronic book, It is possible to play video content, perform startup processes, measure temperature, and play games.

[0355] (Headphone example) FIG. 22 shows a cognitive function testing device 101 in accordance with the present invention, in which the electroencephalogram measuring unit 105 is mounted on headphones. This is an example of a case where electrodes for measuring electroencephalograms (2202, 2203, 2204) are attached to a headband 2201 of the headphones. The earbuds (2207, 2208) also have electrodes 2209. The electrodes of the pads (2207, 2208) are cloth type. Both housings (2210, 2211) can measure brain waves over a wider area of ​​the head. It is equipped with a signal processing device, a potential amplifier, an analog-to-digital converter, and a wireless module. (For example, mount it on the 2212 part. Also mount it on the 2211 housing.)

[0356] The detected potential is input to a signal processor 222 and an ADC 223 provided in the housing (2210, 2211). and is transmitted to the smart phone from a communication module 227 also provided in the housing (2210, 2211). The message is sent to the smartphone 2109.

[0357] In order to simultaneously measure multiple channels of EEG, a buffer memory is provided on the headphones. The determined brain waves may be buffered and then transmitted to the smartphone 2109. stomach.

[0358] In the headphones shown in Figure 22A, the electrodes used during measurement are determined by the method of detecting the brain wave potential. You can choose.

[0359] Both unipolar and bipolar leads are possible.

[0360] In monopolar induction, electrodes 2209 and 2212 in contact with the earlobe are used as the reference potential, and electrodes attached to the headband are used as the reference potential. In this case, a maximum of five channels of EEG measurement can be performed. This is possible (2209 and combinations of 2202, 2203, 2204, 2205, and 2206).

[0361] In bipolar leads, up to four channels of EEG can be measured (by combining 2202 and 2203). 1 channel for each combination, 1 channel for the combination of 2203 and 2204, and 1 channel for the combination of 2204 and 2205. channel, 2205 and 2206 combined to form one channel).

[0362] With headphones, the brain waves are measured using a combination of two electrodes as described above, and multiple channels are measured. Yes, it is possible. EEG is measured using two electrodes that are in a good condition for detecting electrical potential.

[0363] As mentioned above, the headphones detect potentials from a combination of multiple electrodes, resulting in a maximum of 5 It is possible to measure the brain waves of the channel.

[0364] Since it is known that deterioration begins in the parietal lobe in AD, electrodes 2203, 2204, and 2205 were used. The combination of 2203 and 2204, and the combination of 2204 and 2205 are given priority. Priority is given to measurements using a combination of electrodes 2209, 2203, 2204, and 2005. The measurement results at that time will be used as a priority for testing.

[0365] The electrode 2209 of the pad 2207 may also be provided on 2208 in the same manner.

[0366] In this case, depending on the wearing condition, use the 2209 electrode as the reference electrode or the 2208 electrode. You can choose whether to use it as a reference electrode or not. In addition to smartphones, the scanning device may be, for example, a radio (radio main body 2214, There is a remote control 2215), a tablet PC 2110, a TV set (TV unit 2111, remote control 2112), and a PC.

[0367] In the cognitive function testing system using headphones, the alarm and electronic It can turn pages in books, play video content, perform boot processes, measure temperature, and play games. is.

[0368] (Example of a hearing aid) FIG. 23 shows an example in which an electroencephalogram measuring device 2703 of the present invention is implemented in a hearing aid.

[0369] In addition to smartphones, devices that can be connected to the hearing aids in Figure 23 include radio sets (radio books). TV set (TV body 2111, remote control 2112), tablet PC 2110, PC etc.

[0370] Fig. 23A shows the surface of a behind-the-ear hearing aid 2301 equipped with an electroencephalogram measuring unit 2705. 23A is a diagram showing the back of the behind-the-ear hearing aid 2301. FIG. 23B is a diagram showing the behind-the-ear hearing aid 2301 when worn. The behind-the-ear hearing aid 2301 is worn by hanging the device on the helix.

[0371] The behind-the-ear hearing aid 2301 includes a hearing aid body 2302 and an earmold 2303 .

[0372] The back of the behind-the-ear hearing aid body (which contacts the head) is provided with electrodes (2304, 2305) for measuring brain waves. The hearing aid main body 2302 also includes a signal processor 222 that processes and amplifies the detected potential, an ADC 223, The communication module 227 is mounted on the hearing aid body 2302. partially implemented).

[0373] Two electrodes (2304, 2805) allow for bipolar induction and one channel of EEG measurement.

[0374] Hearing aids can be used in pairs or individually. In this case, the electrodes to be used during measurement may be selected depending on the detection conditions of the potential. When this is done, up to two channels of brain waves can be measured.

[0375] FIG. 23C shows an example of how to wear a behind-the-ear hearing aid. The behind-the-ear hearing aid 2301 can be worn on one side. Although it can be used alone or in pairs, it can also measure brain waves when used alone. The results of the measurement are sent to a pre-paired smartphone. The alarm shown in the third embodiment can also be used in a cognitive function testing system linked to a smartphone or the like. It is possible to play video content, perform startup processing, measure temperature, and play games.

[0376] (Example of a mouse) 24A and 24B show an electroencephalogram measuring unit 2705 in an electroencephalogram measuring device 2703 of the present invention, which is This is an example of implementation in a mouse 2401. The mouse may be wireless or wired. In the following, the wireless mouse 2401 will be described as an example.

[0377] As shown in FIGS. 24A and 24B, the surface of the wireless mouse 2401 is provided with electrodes for measuring electroencephalograms (240 2, 2403) are positioned so that they come into firm contact with the skin on the inside of the hand at two points when using a PC. There are.

[0378] (An example in which the electroencephalogram measuring unit 105 is implemented in a TV remote control 2501) The TV remote control (FIGS. 25A and 25B) 2501 equipped with the electroencephalogram measurement unit 2705 has electrodes for measuring electroencephalograms (2 502, 2503, 2504, 2505) are placed in areas where they are likely to come into contact with the hand when using the TV remote control. The two electrodes (2502, 2503, 2504, 2505) that your hand touches when you operate the remote control. The brain waves are measured by detecting electrical potentials from either the brain or the brainstem (measured using bipolar leads).

[0379] The TV remote control 2501 is linked to the TV itself, which is operated by the remote control. The potential of the electroencephalogram is processed and amplified, then converted into a digital signal and The data is transferred to the connected TV and processed.

[0380] Depending on how the TV remote control 2501 is held, the potential is generated by the electrodes 2502, 2503, 2504, and 2505 for measuring electroencephalograms. If it is not detected, a warning is displayed on the TV screen to notify the user.

[0381] In the cognitive function testing system consisting of the TV remote control 2501 and the TV main body, It is possible to use alarms, play video content, and play games.

[0382] (Example of a small robot) FIG. 26 shows a case where the cognitive function testing device 101 of the present invention is implemented in a small interactive robot 2601. This is an example.

[0383] FIG. 26A shows the configuration of the robot 2601, and FIG. 26B shows the configuration of the robot 2601 when measuring electroencephalograms. The robot 2601 has electrodes 2603 and 2604 for measuring electroencephalograms on its head 2602. Inside the 01, a control device consisting of hardware such as a CPU is built in, and this control device controls the cognitive It functions as a performance testing device.

[0384] The part where the electrodes for measuring EEG are mounted (reference number 2605) is three-dimensional, making it easy to place your hand on it. Electrodes 2603 and 2604 for measuring electroencephalograms are mounted on the surface of this three-dimensional part (reference numeral 2605). The potential of the EEG is measured using bipolar induction. The electrodes to be placed are not limited to two poles. It is easy to use as an interface (putting your hand on it as if you were stroking a child's head). We aim to create an environment where users can operate the device comfortably and enjoyably in their daily lives. Electrodes are placed at the locations.

[0385] In front of the head 2602 of the robot 2601, there is a display 2606 for operation / display, a speaker for audio playback, and Speakers (2607, 2608), a microphone 2609 for collecting voice from the user, and a It is equipped with a small camera 2610.

[0386] When a hand is placed on the three-dimensional part 2605 of the head 2602, an electroencephalogram potential is detected and the facial expression of the robot 2601 changes. The oddball task is displayed on the display 2606. Alternatively, the speaker (260 The audio for the oddball task was played from the audio source (7, 2608). To enable this, the speakers (2607, 2608) are placed between the operation / display display 2606. It is equipped with two microphones, one on the left and one on the right. Also, a microphone 2609 is mounted on the bottom of the display 2606. The peaker locations are examples and are not limiting.

[0387] 26B shows the operation during electroencephalogram measurement. By placing your hands on electrodes 2603 and 2604, the potential of the brain waves is detected from the skin of your hands and measurement begins. During the oddball task, the subjects were asked to keep their hands on the EEG measurement electrodes 2603 and 2604.

[0388] The robot performs oddball tasks while conversing with the user, answering calls, playing games, etc. When using the device, the user may be guided to place their hands on the electrodes on their head.

[0389] The small robot 2601 can perform the alarm shown in the third embodiment, turn the page of an electronic book, It is possible to play video content, perform startup processes, measure temperature, and play games.

[0390] Fifth Embodiment In the fifth embodiment, a cognitive function testing device using the electroencephalogram technology of the above embodiment is used. An example of the service is shown below.

[0391] (Examples of application to monitoring / preventive services and medical services) Figure 28 shows an overview of the monitoring / prevention service and medical service. The person receiving services related to monitoring, maintaining, and improving the state of cognitive function (hereinafter referred to as the person, 2 801) and their family 2802. There are two.

[0392] One is to periodically measure the cognitive function of healthy people who have not developed dementia. To enable early detection of functional decline and the implementation of measures to prevent the onset of dementia This kind of medical treatment that takes measures before the onset of a disease is called preemptive medical treatment. Today, in preemptive medicine, data measured by the cognitive function testing device of the present invention is included. Furthermore, by utilizing big data including genetic data and lifestyle habits, it is possible to identify the causes of diseases and It is hoped that new insights into areas for improvement will be discovered.

[0393] Another purpose is to provide a treatment plan for patients who are diagnosed with cognitive decline or dementia. When a patient is diagnosed with a cognitive impairment, cognitive functioning may be monitored to monitor the progression of symptoms and the response to therapeutic measures and treatment. The key is to measure it regularly.

[0394] To achieve the former goal, we provide monitoring / preventive services. It consists of dementia prevention service companies 2803, service recipients 2801 and their families 2802. Depending on the situation, a care service organization 2804 may be added to this configuration.

[0395] The individual 2801 and their family 2802 (both, the individual, or only the family) Based on the measurement results, the state of cognitive function is monitored to check for any abnormalities in cognitive function, preventing dementia. The person 2801 and his / her family 2802 may also subscribe to a care service company 2803. The individual 2801 will also be a member of the service agency 2804. The service fee to the dementia prevention service company will be paid by the individual 2801. The family 2802 can bear the cost. The family 2802 is in a position to watch over the individual 2801. The person 2801 may or may not be aware that he or she is being watched.

[0396] The dementia prevention service company 2803 collects data measured by the cognitive function testing device of the present invention. By analyzing the data, the state of cognitive function of the individual 2801 can be understood, and the individual 2801 or The person 2801 provides the analysis results and advice to the person's family 2802. The company also receives consultations from the family members 2802 and provides answers to their questions.

[0397] If the person 2801 is a member of a care service institution 2804, the care service institution 2804 With the permission of 2801 or his / her family 2802, the person 2801 may provide the dementia prevention service company 2803 with the permission of the person 2801. The service provides data and information on the daily life of the individual 2801 and provides advice on caring for the individual 2801. In addition, if necessary, we can provide advice on measures to prevent dementia and You can get answers to your questions from the preventive service company 2803.

[0398] Based on the advice received from the dementia prevention service company 2803, the nursing care service organization 2804 Provide care services to people 2801. For example, daily exercise and recreation If it is possible to improve cognitive function, such care services will be implemented. In order to confirm the effect on cognitive function after care service, the cognitive function testing device of the present invention was used. The results of the cognitive function measurement will be provided to the dementia prevention service company 2803 and the family If the person has no family, or if the person wishes, the information will be provided directly to the person. You may provide information to 01.

[0399] The care service agency 2804 may also provide routine information about the individual 2801 to the family 2802. This allows us to receive specific requests from families regarding the content of care services.

[0400] The above is a description of the cognitive function testing device and cognitive function testing system of the present invention applied to a monitoring service. This is an example of the case where the dashed line in Figure 28 corresponds to this.

[0401] Secondly, medical services are provided to achieve the latter objective. Preventive service company 2803, dementia and its precursor, mild cognitive impairment and cognitive decline It is provided by medical institutions 2805 that conduct examinations and treatments for healthy individuals. In this case, nursing care service organizations 2804 are added to this structure.

[0402] Dementia prevention service company 2803 and medical institution 2805 obtain consent from the individual 2801 and their family 2802. The information is shared with the individual 2801 and their family 2802 (both of which are available) to provide services. If abnormalities in cognitive function are found, the person (or the person himself / herself or his / her family) shall consult with a medical institution2805. Dementia prevention services that provide advice to individuals 2801 and their families 2802 in cooperation with the Joins company 2803.

[0403] If a decline in cognitive function is detected, the medical institution 2805 will conduct a detailed examination and make a diagnosis. In addition, treatment and prevention measures will be implemented depending on the results of the diagnosis.

[0404] The monitoring service explained above is mainly for cases where there is no evidence of a decline in cognitive function. The monitoring service detects decline in cognitive function and takes immediate action if an abnormality is detected. The company will start collaborating with medical institutions 2805 for the first time. The monitoring service is positioned as a screening service. However, it is not a diagnostic test that detects cognitive decline and indicates the onset of dementia. If the disease has not yet reached the stage of illness, proactive measures will be taken in cooperation with medical institutions2805. .

[0405] Dementia prevention service company 2803 obtained the information from service members (individuals 2801 and their families 2802). Based on the vast amount of data, we provide appropriate services to members. This will be implemented in cooperation with medical institutions2805.

[0406] Dementia prevention service company 2803 also reported on the effectiveness of medical procedures and the services provided. By collecting data and analyzing it, we will be able to understand the mechanisms of dementia onset, which have not yet been elucidated. Hypotheses about countermeasures can be generated and provided to medical institutions 2805. AI is increasingly being used to analyze data, and it is expected to uncover new knowledge and generate hypotheses.

[0407] Medical institution 2805 will make diagnoses and take measures based on the results of AI-based analysis of huge amounts of data and information. and make decisions about treatment.

[0408] The findings obtained from the analysis of data and information are within the scope of medical treatment. It can also be provided directly to the member (the member 2801 and his / her family 2802). The boundary between medical and non-medical treatment is the medical treatment for dementia. The scope of medical treatment varies over time and is unclear. This is because the information may change over time.

[0409] Another application example of the cognitive function testing device of the present invention is a car driving ability testing device that is primarily targeted at elderly people. cognitive function-based testing / periodic monitoring services. For example, elderly driving In addition to when renewing a driver's license, we regularly check their reactions to stimuli and their ability to make judgments in different situations. It is necessary. [Explanation of symbols]

[0410] 101 Cognitive function testing device 102 Cognitive Function Measurement and Judgment Department 103 Oddball task data storage section 104 Caller Identification Unit 105 Electroencephalogram Measurement Unit 106 EEG data storage unit 107 Inspection Data Creation Department 108 Inspection data storage unit 109 Cognitive Function Test Control Unit 110 Analysis data storage unit 111 Cognitive Function Analysis Department 112 Analysis result storage section 113 Cognitive Decline Notification Department

Claims

1. An information processing device with a calling function capable of communicating with a device for detecting electroencephalogram data of a subject, A display unit; A control unit; a storage unit, When receiving an incoming call, the display unit processes and displays visual test data by visual stimulation used in an electroencephalogram measurement test of the subject who is the recipient, the visual test data including a target image consisting of a face image of the caller and a standard image that is presented more frequently than the target image, in parallel with an operation for notifying the caller of the incoming call; the control unit stores in the storage unit electroencephalogram data of the subject detected by the detection device when the visual test data is displayed, and extracts and analyzes potential waveforms generated in relation to the occurrence of an event in the subject from the stored electroencephalogram data of the subject; the display unit displays the electroencephalogram data and the visual test data of the subject when the result of the electroencephalogram measurement test is confirmed.

1. An information processing device comprising:

2. 2. The information processing device according to claim 1, The control unit controlling the display of the target image and the standard image randomly as the visual inspection data; 1. An information processing device comprising:

3. An information processing device with a calling function capable of communicating with a device for detecting electroencephalogram data of a subject, A display unit; A control unit; A memory unit; an audio output unit; when receiving an incoming call, the audio output unit processes and outputs audio test data by auditory stimulation used in an electroencephalogram measurement test of the subject who is the recipient, the audio test data including a voice reading out the name of the caller and a predetermined ringtone that is output at a higher frequency than the output frequency of the voice reading out the name of the caller, in parallel with an operation for notifying the caller of the incoming call; the control unit stores in the storage unit electroencephalogram data of the subject detected by the detection device when the voice test data is output, and extracts and analyzes potential waveforms generated in relation to the occurrence of an event in the subject from the stored electroencephalogram data of the subject; When checking the result of the electroencephalogram measurement test, the display unit displays the electroencephalogram data of the subject, and the audio output unit outputs the audio test data.

1. An information processing device comprising:

4. 4. The information processing device according to claim 3, The control unit controlling the audio output unit to randomly output the name of the caller and the predetermined ringtone as the audio test data; 1. An information processing device comprising:

Images