Computer program, information processing device, and information processing method

Abstract

Provided are a computer program with which the privacy of a subject can be protected, an information processing device, and an information processing method.　This computer program causes a computer to execute processing for acquiring brain wave data of a subject from a brain wave sensor attached to the subject, determining whether the brain waves of the subject are normal or abnormal on the basis of the acquired brain wave data, setting a watching unit for watching over the subject to an ON state in accordance with the brain wave determination result, and executing a determination test for determining brain dysfunction using watching data acquired from the watching unit.

Description

Computer Program, Information Processing Apparatus, and Information Processing Method

[0001] The present invention relates to a computer program, an information processing apparatus, and an information processing method.

[0002] Patent Document 1 discloses a monitoring system including a local terminal device installed in a subject's home to be monitored, the local terminal device including a camera, a microphone, etc., and a monitoring system connectable to the local terminal device. When a doctor or a nurse selects a subject, voice and image communication is performed, and the subject's image and voice are checked to detect an abnormality (disease).

[0003] On the other hand, a simple electroencephalograph for acquiring and utilizing electroencephalograms to improve the quality of daily life such as stress reduction, sleep improvement, and increased concentration has been commercialized. The simple electroencephalograph has various forms of devices such as an ear-hung type, an earphone type, and a headgear type, and can acquire electroencephalogram data.

[0004] Japanese Patent Application Laid-Open No. 2017-58900

[0005] In order to monitor an abnormality (e.g., a brain dysfunction such as a cerebral infarction) of a subject in a monitoring system, a monitoring unit such as a camera needs to operate, and appropriate biological monitoring needs to be performed daily. However, the monitoring by the monitoring unit cannot protect the privacy of the subject.

[0006] The present disclosure has been made in view of such circumstances, and an object thereof is to provide a computer program, an information processing apparatus, and an information processing method capable of protecting the privacy of a subject.

[0007] (1) The computer program according to the present disclosure causes a computer to execute a process of acquiring electroencephalogram data of a subject from an electroencephalogram sensor worn by the subject, determining whether the electroencephalogram of the subject is normal or abnormal based on the acquired electroencephalogram data, setting an on state for a monitoring unit that monitors the subject according to the determination result of the electroencephalogram, and executing a determination test for determining a brain dysfunction using monitoring data acquired from the monitoring unit.

[0008] Herein, an embodiment of the present disclosure is as follows: (2) The computer program described in (1) above causes the computer to perform the following process: select a required judgment test from among multiple judgment tests for determining brain dysfunction according to the results of the electroencephalogram (EEG) determination, and execute the selected judgment test using the acquired monitoring data.

[0009] (3) The computer program described in (1) or (2) above causes the computer to perform a process that determines whether the subject's brainwaves are normal or abnormal based on the difference between the left and right brainwave data acquired.

[0010] (4) If any one of the computer programs described in (1) to (3) above determines that the brainwaves are abnormal, it causes the computer to perform a process to set the monitoring unit to the ON state.

[0011] (5) If any one of the computer programs described in (1) to (4) above determines that the brainwaves are normal, it causes the computer to perform the process of setting the monitoring unit to the OFF state.

[0012] (6) If any one of the computer programs described in (1) to (5) above is abnormal, the computer will perform a process to prioritize the test items in the assessment test according to the location of the brain damage.

[0013] (7) If any one of the computer programs described in (1) to (6) above is abnormal and the brain damage is in the motor cortex, the computer will be instructed to perform a test related to the motor cortex as a priority.

[0014] (8) If any one of the computer programs described in (1) to (7) above is abnormal and the brain damage is in the language area, the computer will be instructed to perform a test related to the language area as a priority.

[0015] (9) Any one of the computer programs described in (1) to (8) above, the monitoring unit includes at least one of a camera and a microphone.

[0016] (10) The computer program relating to this disclosure acquires brainwave data of the subject from an electroencephalogram sensor attached to the subject, determines whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data, and causes the computer to perform the following processes: set the monitoring unit that monitors the subject to be on or off according to the brainwave determination result.

[0017] (11) The computer program described in (10) above causes the computer to perform a process to set the monitoring unit to the ON state if it determines that the brain waves are abnormal.

[0018] (12) The computer program in (10) or (11) above causes the computer to perform a process in which, if the monitoring unit includes a camera, determines that the brainwaves are abnormal, and the subject is outside the camera's field of view, it notifies the subject or a cohabitant to move the subject into the field of view.

[0019] (13) Any one of the computer programs described in (10) to (12) above causes the computer to perform the following process: if the monitoring unit includes a camera, and it is determined that the brainwaves are abnormal, and the subject is outside the camera's field of view, the computer adjusts the orientation of the camera so that the subject is within the field of view.

[0020] (14) Any one of the computer programs described in (10) to (13) above causes the computer to perform a process in which, if the monitoring unit includes a microphone and it is determined that the brainwaves are abnormal and the subject is outside the sound pickup range of the microphone, the computer notifies the subject or a cohabitant to move the subject into the sound pickup range.

[0021] (15) If any one of the computer programs described in (10) to (14) above cannot acquire the brainwave data of the subject, the computer program will cause the computer to perform the process of setting the monitoring unit to the ON state.

[0022] (16) The information processing device relating to the present disclosure includes a control unit, which acquires brainwave data of a subject from an electroencephalogram sensor attached to the subject, determines whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data, sets a monitoring unit that monitors the subject to the ON state according to the brainwave determination result, and performs a determination test to determine brain dysfunction using monitoring data acquired from the monitoring unit.

[0023] (17) The information processing device relating to the present disclosure includes a control unit, which acquires brainwave data of a subject from an electroencephalogram sensor attached to the subject, determines whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data, and sets a monitoring unit that monitors the subject to be on or off according to the brainwave determination result.

[0024] (18) The information processing method relating to this disclosure acquires brainwave data of a subject from an electroencephalogram sensor attached to the subject, determines whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data, sets a monitoring unit that monitors the subject to the ON state according to the brainwave determination result, and performs a determination test to determine brain dysfunction using monitoring data acquired from the monitoring unit.

[0025] (19) The information processing method relating to this disclosure acquires brainwave data of a subject from an electroencephalogram sensor attached to the subject, determines whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data, and sets the monitoring unit that monitors the subject to be on or off according to the brainwave determination result.

[0026] According to this disclosure, it is possible to determine brain dysfunction in subjects while protecting their privacy.

[0027] This figure shows an example of the configuration of the information processing system of this embodiment. This figure shows an example of a method for determining brain dysfunction in a subject by the information processing device. This figure shows an example of electroencephalogram (EEG) data. This figure shows an example of brain dysfunction. This figure shows a determination method using CPSS. This figure shows a determination method using ELVO. This figure shows a first example of a processing procedure by the information processing device. This figure shows a second example of a processing procedure by the information processing device. This figure shows a third example of a processing procedure by the information processing device. This figure shows a fourth example of a processing procedure by the information processing device.

[0028] Embodiments of the present disclosure will be described below. Figure 1 is a diagram showing an example of the configuration of the information processing system of this embodiment. The information processing system includes an information processing device 50. A monitoring unit 10, an electroencephalogram detection device 20, and a terminal device 30 are connected to the information processing device 50 via a communication network 1. The information processing system may further include a monitoring unit 10 and an electroencephalogram detection device 20.

[0029] The monitoring unit 10 includes a camera 11 and a microphone 12. Although Figure 1 shows one monitoring unit 10, there may be multiple monitoring units 10. Alternatively, the monitoring unit 10 may include only a camera 11 or only a microphone 12, and there may be configurations that include a monitoring unit 10 with a camera 11 and a monitoring unit 10 with a microphone 12. The monitoring unit 10 is installed in the subject's home, but the installation location is not limited to the home and may be a place where the subject spends their daily life. The operation of the monitoring unit 10 can be controlled by a switch (not shown) provided on the monitoring unit 10, and the monitoring unit 10 can also be remotely controlled on (on state) and off (off state) from the information processing device 50. The camera 11's field of view direction can be adjusted, and the field of view direction may be adjusted by operating the camera 11 itself, or it can be adjusted remotely from the information processing device 50. The monitoring unit 10 may include at least one of the camera 11 and the microphone 12.

[0030] The monitoring unit 10 can transmit image data (video or still images) captured by the camera 11 to the information processing device 50. The monitoring unit 10 can also transmit audio data detected by the microphone 12 to the information processing device 50.

[0031] The electroencephalogram (EEG) detection device 20 is a wearable device that can be attached to the head, forehead, or ears of a subject, and comes in various types such as headgear, band, behind-the-ear, and earphone depending on the device's shape. The EEG detection device 20 includes an EEG sensor, a communication module, memory, and a control module (none of which are shown). The EEG detection device 20 is attached to a subject and can transmit EEG data detected by the EEG sensor to the information processing device 50. The EEG detection device 20 stores an ID to identify itself, and by registering subject information, it stores subject information in memory in association with the ID. Subject information includes gender, age, etc. When the EEG detection device 20 is attached to a subject, it can transmit information indicating that it is attached and subject information to the information processing device 50. The EEG detection device 20 may also be incorporated into a device such as a hearing aid worn by the elderly, or it may be an implantable device embedded near the brain.

[0032] The terminal device 30 can be, for example, a smartphone, a tablet, or a personal computer. Although Figure 1 shows one terminal device 30, there may be multiple terminal devices 30. The terminal device 30 is equipped with a camera and a microphone and is used by the subject or a cohabitant (family member, etc.). The terminal device 30 may also be used by medical professionals, paramedics, or third parties. Under the control of the information processing device 50, the terminal device 30 can output test instructions for the subject to perform a diagnostic test to determine brain dysfunction. The test instructions can be displayed on a screen and output audibly. The output of test instructions includes both "instruction output that allows the subject to follow the instructions and perform the diagnostic test" and "instruction output that allows someone other than the subject to see the instructions and present the diagnostic test to the subject."

[0033] The information processing device 50 includes a control unit 51 that controls the entire device, a communication unit 52, a memory 53, a notification unit 54, and a storage unit 55.

[0034] The control unit 51 may be configured by incorporating a required number of CPUs (Central Processing Units), MPUs (Micro-Processing Units), GPUs (Graphics Processing Units), etc. Alternatively, the control unit 51 may be configured by combining DSPs (Digital Signal Processors), FPGAs (Field-Programmable Gate Arrays), etc.

[0035] The communication unit 52 is equipped with a communication module and has the function of communicating with the monitoring unit 10, the electroencephalogram detection device 20, and the terminal device 30 via the communication network 1.

[0036] The notification unit 54 notifies the subject and their cohabitants (family) of the results of the assessment test conducted on the subject to determine brain dysfunction.

[0037] The memory unit 55 can be made up of semiconductor memory or a hard disk, and stores a computer program 56 (program product), a brain function disorder assessment test 57, and other necessary information.

[0038] The memory unit 55 stores reference electroencephalogram (EEG) data. The reference EEG data includes EEG data of healthy individuals associated with gender and age (or age group). The control unit 51 identifies the corresponding reference EEG data based on the gender and age included in the subject's information, and can determine if the subject's EEG is abnormal by comparing the subject's EEG data obtained from the EEG detection device 20 with the reference EEG data. For example, if the frequency of the subject's EEG is higher than the frequency of the reference EEG, there is a possibility of brain function abnormality. Also, if the amplitude of the subject's EEG is lower than the amplitude of the reference EEG, there is a possibility of brain function abnormality.

[0039] The computer program 56 can be read by a recording medium (e.g., an optically readable disc storage medium such as a CD-ROM) M using a recording medium reading unit (not shown) and stored in a storage unit 55. The computer program 56 may also be read by a recording medium such as a storage device (semiconductor memory such as an SSD (Solid State Drive)) connected by a standard for connecting to a computer (e.g., USB (Universal Serial Bus) or other standards) and stored in the storage unit 55. Alternatively, the computer program 56 may be downloaded from an external device via a communication unit 52 and stored in the storage unit 55. The computer program 56 can be deployed to run on a single computer or on multiple computers interconnected by a communication network.

[0040] The memory 53 can be composed of semiconductor memory such as SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), or flash memory. The computer program 56 can be loaded into the memory 53, and the control unit 51 can execute the computer program 56. The control unit 51 can execute the processing defined in the computer program 56. In other words, the processing performed by the control unit 51 is also the processing performed by the computer program 56.

[0041] Brain function impairment assessment test 57 includes screening methods such as ELVO (Emergent Large Vessel Occlusion) and CPSS (Cincinnati Prehospital Stroke Scale). Details of ELVO and CPSS will be described later. Brain function impairment assessment test 57 may also include screening methods such as RACE, FAST-ED, and VAN.

[0042] FIG. 2 is a diagram showing an example of a method for determining a brain dysfunction of a subject by the information processing apparatus 50. When the electroencephalogram detection device 20 is attached to the subject, the electroencephalogram sensor detects electroencephalogram data and transmits the detected electroencephalogram data to the information processing apparatus 50. Since the monitoring unit 10 needs to consider the privacy of the subject, the user can select the state each time. For example, in order to prioritize privacy, the monitoring unit 10 can be turned off.

[0043] When the information processing apparatus 50 (control unit 51) determines that an abnormality in the electroencephalogram has occurred based on the acquired electroencephalogram data, it switches the state of the monitoring unit 10 to the on state, that is, even when the user selects a specification that prioritizes privacy, it switches to prioritize the determination of brain dysfunction. As a result, the monitoring unit 10 transmits the image data of the subject captured by the camera 11 and the voice data of the subject detected by the microphone 12 (the image data and the voice data are collectively referred to as monitoring data) to the information processing apparatus 50.

[0044] When the information processing apparatus 50 (control unit 51) acquires the monitoring data, it executes a determination test to determine the brain dysfunction of the subject.

[0045] As described above, the control unit 51 acquires the electroencephalogram data of the subject from the electroencephalogram sensor attached to the subject, determines whether the electroencephalogram of the subject is normal or abnormal based on the acquired electroencephalogram data, and according to the determination result of the electroencephalogram, sets the monitoring unit 10 that monitors the subject to the on state, and can execute a determination test for determining brain dysfunction using the monitoring data acquired from the monitoring unit 10. Until an abnormality in the electroencephalogram of the subject is detected, the monitoring unit 10 can be turned off, so that the privacy of the subject can be protected (maintained). In addition, when an abnormality in the electroencephalogram of the subject is detected, a determination test for determining brain dysfunction can be executed using the acquired monitoring data, so that the brain dysfunction of the subject can be determined while protecting the privacy of the subject.

[0046] In addition, the control unit 51 acquires the electroencephalogram data of the subject from the electroencephalogram sensor worn by the subject, determines whether the electroencephalogram of the subject is normal or abnormal based on the acquired electroencephalogram data, and sets the monitoring unit 10 that monitors the subject to an on state or an off state according to the determination result of the electroencephalogram. Specifically, when it is determined that the electroencephalogram is normal, the monitoring unit 10 can be set to the off state, and when it is determined that the electroencephalogram is abnormal, the monitoring unit 10 can be set to the on state. Thereby, it is possible to protect the privacy of the subject unless an abnormality in the electroencephalogram is detected. On the other hand, when an abnormality in the electroencephalogram is detected, it is possible to prioritize the determination of the brain dysfunction of the subject because it is more important and urgent to determine the brain dysfunction of the subject than to protect the privacy, and it is possible to determine the brain dysfunction of the subject while protecting the privacy of the subject.

[0047] FIG. 3 is a diagram showing an example of electroencephalogram data. The electroencephalogram (electroencephalogram data) is obtained by recording the spontaneous electrical activity of the brain, which changes moment by moment, with electrodes on the scalp. The electroencephalogram is classified into α waves (8 to 13 Hz), β waves (14 to 30 Hz), θ waves (4 to 7 Hz), and δ waves (0.5 to 3 Hz) according to frequency components. The amplitude of the electroencephalogram is usually 5 to 150 V. One of the points to note as the background activity of the electroencephalogram is the dominant rhythm. The dominant rhythm is the frequency component that appears most frequently over time among various frequency components that make up all the background activities of the electroencephalogram. In healthy adults, it is usually the α wave that appears predominantly in the occipital region. The activity of the brain can be judged by the frequency, amplitude, presence or absence of the left-right difference, etc. of the α wave.

[0048] For example, the fluctuation of the frequency of the α wave is usually within 1 Hz, and when the frequency increases (for example, 1 Hz or more), it suggests a decline in brain function. For example, when the left-right difference in frequency is 1 Hz or more, there is a possibility of brain dysfunction. Also, when the amplitude decreases, it similarly suggests a decline in brain function, and particularly when the left-right difference in amplitude is 50% or more, there is a possibility of brain dysfunction.

[0049] The control unit 51 can determine whether the subject's brainwaves are normal or abnormal based on the difference between the left and right brainwave data acquired. Furthermore, if the control unit 51 determines that the brainwaves are abnormal, it can set the monitoring unit 10 to the ON state, and if it determines that the brainwaves are normal, it can set the monitoring unit 10 to the OFF state.

[0050] If the amplitude of the electroencephalogram (EEG) decreases in the central part of the brain, while the amplitude remains unchanged in the surrounding areas, a major cerebral artery infarction should be suspected. Furthermore, as time passes after a major cerebral artery infarction occurs, the amplitude of the EEG may decrease in the central part of the brain, and the amplitude may also decrease in the surrounding areas.

[0051] Figure 4 shows an example of brain dysfunction. Brain dysfunction includes impairments of motor function, sensation, visual field, and language, and includes, for example, ocular deviation, aphasia, hemispatial neglect, facial paralysis, upper and lower limb paralysis, and dysarthria. Ocular deviation is a condition in which both eyeballs are turned to one side, or in which the eye cannot turn to the other side when asked to track a finger. Aphasia is a condition in which the person cannot understand or speak words. Hemispatial neglect is a condition in which one side of the body is ignored, such as only being able to recognize two or three fingers when shown four. Facial paralysis is a condition in which the face is distorted or one side does not move like the other side. Upper and lower limb paralysis is a condition in which one side of the arm or leg does not move, or moves less than the other side, or is numb, or is unable to maintain a certain posture. Dysarthria is a condition in which the person has difficulty speaking clearly or has unclear speech. Furthermore, ocular deviation, aphasia, and hemispatial neglect often indicate a severe degree of brain dysfunction. On the other hand, if ocular deviation, aphasia, or hemispatial neglect are absent, but facial paralysis, upper or lower limb paralysis, or dysarthria are present, the brain dysfunction is often moderate to severe or mild.

[0052] Next, I will explain the tests used to assess brain dysfunction.

[0053] Figure 5 shows the assessment method using the CPSS. The CPSS assessment items are: facial distortion (showing teeth or smiling), upper limb elevation (eyes closed, upper limbs elevated for 10 seconds), and dysarthria (the patient is asked to speak). To determine whether it is normal or abnormal, in the case of facial distortion, if the screen is symmetrical, it is considered normal; if one side does not move like the other, it is considered abnormal. In the case of upper limb elevation, if both sides are elevated equally or not elevated at all, it is considered normal; if one side is not elevated, or is elevated less than the other side, it is considered abnormal. In the case of dysarthria, if the patient can speak clearly and accurately, it is considered normal; if the words are unclear, incorrect, or not spoken at all, it is considered abnormal. If even one of the three assessment items is abnormal, the probability of stroke is 72%.

[0054] Figure 6 shows the assessment method using ELVO. The ELVO screening test is performed in the following order: eye deviation (conjugate deviation), aphasia, and hemispatial neglect. In the ELVO screen, the eye deviation test checks whether the subject has any deviation in their eyes. For the aphasia test, the subject is shown objects such as glasses or a watch and asked, "What is this?" and it is checked whether the subject can name the object. For the hemispatial neglect test, the subject is shown four fingers and asked how many fingers there are, and it is checked how many the subject answers.

[0055] The control unit 51 can prioritize the execution of diagnostic tests related to the language area if the electroencephalogram (EEG) is abnormal and the brain damage is located in the language area. As shown in Figure 6, if there is a possibility of damage to the language area, the control unit 51 can select aphasia tests, which are tests for language-specific functions, and omit the hemispatial neglect test. In this case, the tests (screening) can be performed in the order of eye deviation (conjugate deviation) and aphasia.

[0056] Furthermore, if the electroencephalogram (EEG) is abnormal and the brain damage is in the motor cortex, the control unit 51 can prioritize the execution of diagnostic tests related to the motor cortex. As shown in Figure 6, if there is a possibility of damage to the motor cortex, the aphasia test, which is a test of language-specific functions, can be omitted, and the tests (screening) can be performed in the order of eye deviation (conjugate deviation) and hemispatial neglect.

[0057] As described above, if the electroencephalogram (EEG) is abnormal, the control unit 51 can prioritize the test items within the assessment test according to the location of the brain damage. This allows for prioritizing the execution of necessary test items and eliminating unnecessary ones, thereby shortening the time required to assess brain dysfunction.

[0058] Next, the processing procedure of the information processing device 50 will be described.

[0059] Figure 7 shows a first example of the processing procedure by the information processing device 50. In this first example, the monitoring unit 10 is equipped with a camera 11. It is also assumed that the camera 11 is initially set to the off state. The control unit 51 determines whether or not the electroencephalogram detection device 20 is attached to the subject (S11). If it is not attached (NO in S11), it continues the processing of step S11. If the electroencephalogram detection device 20 is attached to the subject (YES in S11), it obtains the subject's information based on the ID of the electroencephalogram detection device 20 (S12). The subject information includes, for example, the subject's gender and age.

[0060] The control unit 51 determines whether or not it has received the subject's electroencephalogram (EEG) data (S13). If it has not received EEG data (NO in S13), it continues the process in step S11. If it has received EEG data (YES in S13), the control unit 51 compares the received EEG data with reference EEG data based on the subject's information (S14), and compares the left brain EEG data with the right brain EEG data based on the received EEG data (S15). In step S14, the possibility of an abnormality in the subject's brain is determined by comparing the subject's EEG data with reference EEG data, and in step S15, the possibility of an abnormality in the subject's brain is determined by focusing on the left-right difference in EEG from the subject's EEG data.

[0061] The control unit 51 determines whether or not there is an abnormality in the electroencephalogram (EEG) based on the processing results of steps S14 and S15 (S16). If there is no abnormality (NO in S16), it continues processing from step S14 onwards. If there is an abnormality in the EEG (YES in S16), the control unit 51 sets the monitoring unit 10 to the ON state (S17). As a result, the information processing device 50 can acquire monitoring data from the monitoring unit 10. An abnormality in the EEG includes, for example, when the difference from the reference EEG is greater than a threshold, or when the difference between the left and right EEGs is greater than a threshold.

[0062] The control unit 51 determines whether the subject is outside the field of view of the camera 11 (S18). Whether the subject is outside the field of view of the camera 11 can be determined by whether the subject is present in the image captured by the camera 11. If the subject is outside the field of view of the camera 11 (YES in S18), the control unit 51 prompts the subject to enter the field of view, or adjusts the orientation of the camera 11 so that the subject enters the field of view (S19), and then performs the process of step S20 described later.

[0063] If the subject is not outside the field of view of camera 11 (NO in S18), the control unit 51 acquires monitoring data (image data) (S20) and performs a brain function disorder assessment test (S21). The brain function disorder assessment test may be CPSS or ELVO as illustrated in Figures 5 and 6, or other screen methods such as RACE, FAST-ED, or VAN. The assessment test can be output to a terminal device 30 used by the subject or family members (cohabitants), for example, and performed on the terminal device 30. If it is difficult for the subject to perform the test themselves, a cohabitant or other person can assist the subject in performing it.

[0064] The control unit 51 determines whether or not there is an abnormality in the subject's brain, i.e., whether or not there is brain dysfunction (S22). If there is no abnormality (NO in S22), and if the monitoring unit 10 was switched from the off state to the on state in step S17, the control unit 51 switches the monitoring unit 10 back to the off state and continues processing from step S14 onwards. If there is an abnormality (YES in S22), the control unit 51 notifies the abnormality (S23) and terminates processing. If the abnormality is, for example, a symptom such as ocular deviation, hemispatial neglect, or aphasia, and it is determined that the brain dysfunction is severe, an emergency call can be made to arrange for an ambulance or to notify an emergency medical center with specialists. If the brain dysfunction is moderate to severe, such as unilateral facial paralysis, unilateral upper or lower limb paralysis, or dysarthria, a hospital or clinic can be notified, and if it is mild, the subject or their family can be notified.

[0065] As described above, the control unit 51 can select a required judgment test from among several judgment tests for determining brain dysfunction according to the results of the electroencephalogram (EEG) analysis, and execute the selected judgment test using the acquired monitoring data. The selected judgment test may be ELVO, CPSS, or other screening methods. This allows the required judgment test to be executed.

[0066] Furthermore, as described above, the monitoring unit 10 includes a camera 11, and the control unit 51 can notify the subject or a cohabitant to bring the subject into the camera's field of view if it determines that the brainwaves are abnormal and the subject is outside the camera's field of view. In addition, if the control unit 51 determines that the brainwaves are abnormal and the subject is outside the camera's field of view, it can adjust the orientation of the camera 11 so that the subject is within the field of view. This ensures that monitoring data of the subject is reliably acquired.

[0067] Figure 8 shows a second example of the processing procedure by the information processing device 50. In this second example, the monitoring unit 10 is equipped with a microphone 12. It is also assumed that the microphone 12 is initially set to the OFF state. The control unit 51 determines whether or not the electroencephalogram detection device 20 is attached to the subject (S31). If it is not attached (NO in S31), the processing in step S31 continues. If the electroencephalogram detection device 20 is attached to the subject (YES in S31), the control unit 51 obtains the subject's information based on the ID of the electroencephalogram detection device 20 (S32).

[0068] The control unit 51 determines whether or not it has received the subject's electroencephalogram (EEG) data (S33). If it has not received EEG data (NO in S33), it continues the process in step S31. If it has received EEG data (YES in S33), the control unit 51 compares the received EEG data with reference EEG data based on the subject's information (S34), and then compares the left brain EEG data with the right brain EEG data based on the received EEG data (S35).

[0069] The control unit 51 determines whether or not there is an abnormality in the electroencephalogram (EEG) based on the processing results of steps S34 and S35 (S36). If there is no abnormality (NO in S36), it continues processing from step S34 onwards. If there is an abnormality in the EEG (YES in S36), the control unit 51 sets the monitoring unit 10 to the ON state (S37). As a result, the information processing device 50 can acquire monitoring data from the monitoring unit 10.

[0070] The control unit 51 determines whether the subject is outside the sound pickup range of the microphone 12 (S38). Whether the subject is outside the sound pickup range of the microphone 12 can be determined based on the audio data detected by the microphone 12, for example, by whether or not the subject's voice can be acquired. If the subject is outside the sound pickup range of the microphone 12 (YES in S38), the control unit 51 prompts the subject to move into the sound pickup range of the microphone 12 (S39) and performs the process of step S40 described later.

[0071] If the subject is not outside the sound pickup range of the microphone 12 (NO in S38), the control unit 51 acquires monitoring data (voice data) (S40) and performs a brain function disorder determination test (S41). The control unit 51 determines whether or not there is an abnormality in the subject's brain, i.e., whether or not there is a brain function disorder (S42). If there is no abnormality (NO in S42), and if the monitoring unit 10 was switched from the off state to the on state in step S37, the control unit 51 switches the monitoring unit 10 back to the off state and continues processing from step S34 onwards.

[0072] If an abnormality is detected (YES in S42), the control unit 51 notifies the system of the abnormality (S43) and terminates the process. The notification of the abnormality is the same as in the first example.

[0073] As described above, the monitoring unit 10 includes a microphone 12, and the control unit 51 can notify the subject or a cohabitant to move the subject into the microphone's pickup range if it determines that the brainwaves are abnormal and the subject is outside the microphone's pickup range. This ensures that monitoring data of the subject is reliably acquired.

[0074] Figure 9 shows a third example of the processing procedure by the information processing device 50. In this third example, when acquiring electroencephalogram (EEG) data and there is no abnormality in the brain, the monitoring unit 10 is set to the off state. If EEG data cannot be acquired or if there is an abnormality in the brain, the monitoring unit 10 is set to the on state. In the example in Figure 9, the monitoring unit 10 is configured to include a camera 11, but it may also include a microphone 12.

[0075] The control unit 51 determines whether the electroencephalogram detection device 20 is attached to the subject (S51). If it is not attached (NO in S51), it continues the process of step S51. If the electroencephalogram detection device 20 is attached to the subject (YES in S51), it obtains the subject's information based on the ID of the electroencephalogram detection device 20 (S52). The subject information includes, for example, the subject's gender and age.

[0076] The control unit 51 determines whether or not it has received the subject's electroencephalogram (EEG) data (S53). If it has received EEG data (YES in S53), it sets the monitoring unit 10 to the off state (S54). The control unit 51 compares the reference EEG data based on the subject's information with the received EEG data (S55), and based on the received EEG data, it compares the EEG data of the left brain with the EEG data of the right brain (S56).

[0077] The control unit 51 determines whether or not there is an abnormality in the electroencephalogram (EEG) based on the processing results of steps S54 and S55 (S57). If there is no abnormality (NO in S57), it continues processing from step S55 onwards. If there is an abnormality in the EEG (YES in S57), the control unit 51 sets the monitoring unit 10 to the ON state (S58). As a result, the information processing device 50 can acquire monitoring data from the monitoring unit 10.

[0078] The control unit 51 determines whether the subject is outside the field of view of the camera 11 (S59). If the subject is outside the field of view of the camera 11 (YES in S59), the control unit 51 prompts the subject to enter the field of view, or adjusts the orientation of the camera 11 so that the subject enters the field of view (S60), and then performs the process of step S61 described below.

[0079] If the subject is not outside the field of view of camera 11 (NO in S59), the control unit 51 acquires monitoring data (image data) (S61) and performs a brain function disorder assessment test (S62). If electroencephalogram data is not received (NO in S53), the control unit 51 performs the process in step S58 to set the monitoring unit 10 to the ON state.

[0080] The control unit 51 determines whether or not there is an abnormality in the subject's brain, that is, whether or not there is a brain dysfunction (S63). If there is no abnormality (NO in S63), and if the monitoring unit 10 was switched from the off state to the on state in step S58, the control unit 51 switches the monitoring unit 10 back to the off state and continues processing from step S55 onwards. If there is an abnormality (YES in S63), the control unit 51 notifies the abnormality (S64) and terminates processing. The notification of the abnormality is the same as in the first example.

[0081] As described above, the control unit 51 can set the monitoring unit 10 to the ON state if it is unable to acquire the subject's electroencephalogram (EEG) data. This is because, even when prioritizing the subject's privacy, if the monitoring unit 10 is left OFF when EEG data cannot be acquired, there is a risk of missing the occurrence of brain dysfunction in the subject and losing the opportunity for treatment. Therefore, by setting the monitoring unit 10 to the ON state, a system can be established that can quickly detect brain dysfunction in the subject.

[0082] Figure 10 shows a fourth example of the processing procedure by the information processing device 50. In the fourth example, the location of brain damage is identified based on electroencephalogram (EEG) data. The monitoring unit 10 is assumed to be equipped with a camera 11 and a microphone 12. It is also assumed that the camera 11 and microphone 12 are initially set to the off state. The control unit 51 determines whether or not the EEG detection device 20 is attached to the subject (S71). If it is not attached (NO in S71), the processing of step S71 continues. If the EEG detection device 20 is attached to the subject (YES in S71), the subject information of the subject is obtained based on the ID of the EEG detection device 20 (S72). The subject information includes, for example, the subject's gender and age.

[0083] The control unit 51 determines whether or not it has received the subject's electroencephalogram (EEG) data (S73). If it has not received EEG data (NO in S73), it continues the process in step S71. If it has received EEG data (YES in S73), the control unit 51 compares the received EEG data with reference EEG data based on the subject's information (S74), and then compares the left brain EEG data with the right brain EEG data based on the received EEG data (S75).

[0084] The control unit 51 determines whether or not there is an abnormality in the electroencephalogram (EEG) based on the processing results of steps S74 and S75 (S76). If there is no abnormality (NO in S76), it continues processing from step S74 onward. If there is an abnormality in the EEG (YES in S76), the control unit 51 identifies the location of the brain damage (S77). Normally, the type of damage can be estimated depending on which brain function the damaged area (damaged area) controls. For example, the left hemisphere of the brain is the area that controls language function, so abnormal EEG data that differs more from the reference EEG data is used to identify whether the left or right hemisphere is abnormal. If it is determined that there is a possibility of damage in the left brain region based on the difference between the left and right EEGs, it can be determined that there is a high possibility of damage in the language area. On the other hand, if it is determined that there is a possibility of brain damage in the right brain region that controls motor function based on the difference between the left and right EEGs, it can be determined that there is a high possibility of damage in the motor area. Specifically, in step S75, the control unit 51 further compares each with reference electroencephalogram (EEG) data (S74). If the difference between the left and right EEG data is greater than a threshold (indicating an abnormality in the EEG) (YES in S76), it identifies whether the abnormal EEG data differs more from the reference EEG data in the left or right hemisphere. If the EEG data in the left brain is abnormal, it is determined that there is a possibility of brain damage in the left brain. If the EEG data in the right brain is abnormal, it is determined that there is a possibility of brain damage in the right brain. Since most people have language function in the left hemisphere of their brain, if an abnormality is detected in the EEG data in the left brain, the brain area affected can be determined to be the language area. If an abnormality is detected in the EEG data in the right brain, the brain area affected can be determined to be the motor area.

[0085] The control unit 51 prioritizes the test items within the brain dysfunction assessment test according to the location of the brain damage (S78). For example, as illustrated in Figure 6, in the case of the ELVO screening test, if there is a possibility of damage to the language area, the tests related to aphasia can be prioritized, and if there is a possibility of damage to the motor area, the tests related to hemispatial neglect can be prioritized.

[0086] The control unit 51 determines whether the brain lesion is in the motor cortex or the language cortex (S79). If it is in the motor cortex (motor cortex in S79), it sets the camera 11 to ON and acquires image data from the camera 11 (S80), and prioritizes executing a judgment test related to the motor cortex (S81). If the brain lesion is in the language cortex (language cortex in S79), the control unit 51 sets the microphone 12 to ON and acquires audio data from the microphone 12 (S83), and prioritizes executing a judgment test related to the language cortex (S84).

[0087] The control unit 51 determines whether or not there is an abnormality in the subject's brain, that is, whether or not there is a brain dysfunction (S82). If there is no abnormality (NO in S82), and the camera 11 was switched from the off state to the on state in step S80, the control unit 51 switches the camera 11 back to the off state and continues processing from step S74 onwards. Similarly, if the microphone 12 was switched from the off state to the on state in step S83, the control unit 51 turns the microphone 12 back to the off state and continues processing from step S74 onwards. On the other hand, if there is an abnormality (YES in S82), the control unit 51 notifies the abnormality (S85) and terminates processing. The notification of the abnormality is the same as in the first example.

[0088] 1. Communication network 10. Monitoring unit 11. Camera 12. Microphone 20. Electroencephalogram detection device 30. Terminal device 50. Information processing device 51. Control unit 52. Communication unit 53. Memory 54. Notification unit 55. Storage unit 56. Computer program 57. Brain function impairment assessment test

Claims

1. A computer program that causes a computer to perform the following processes: acquire brainwave data from an electroencephalogram (EEG) sensor attached to the subject; determine whether the subject's brainwaves are normal or abnormal based on the acquired EEG data; set a monitoring unit that monitors the subject to the ON state according to the EEG determination result; and execute a judgment test to determine brain dysfunction using the monitoring data acquired from the monitoring unit.

2. A computer program according to claim 1, which causes a computer to perform the following processes: selecting a required diagnostic test from among several diagnostic tests for determining brain dysfunction based on the results of electroencephalogram (EEG) analysis, and executing the selected diagnostic test using the acquired monitoring data.

3. The computer program according to claim 1, which causes a computer to perform a process to determine whether the brainwaves of the subject are normal or abnormal based on the difference between the left and right brainwave data acquired.

4. A computer program according to any one of claims 1 to 3, which causes a computer to perform a process of setting the monitoring unit to the ON state when it is determined that the brainwaves are abnormal.

5. A computer program according to any one of claims 1 to 3, which causes a computer to perform a process to set the monitoring unit to an off state when it is determined that the brainwaves are normal.

6. A computer program according to any one of claims 1 to 3, which causes a computer to perform a process to prioritize test items within a diagnostic test according to the location of brain damage when an abnormal brainwave is detected.

7. A computer program according to any one of claims 1 to 3, which causes a computer to perform a process that prioritizes the execution of a diagnostic test related to the motor cortex when an electroencephalogram is abnormal and the brain region affected is the motor cortex.

8. A computer program according to any one of claims 1 to 3, which causes a computer to perform a process that prioritizes the execution of a diagnostic test related to the language area if the electroencephalogram is abnormal and the damaged area of ​​the brain is the language area.

9. The monitoring unit includes at least one of a camera and a microphone, the computer program according to any one of claims 1 to 3.

10. A computer program that causes a computer to perform the following processes: acquire brainwave data from an electroencephalogram (EEG) sensor attached to the subject; determine whether the subject's brainwaves are normal or abnormal based on the acquired EEG data; and set the monitoring unit that monitors the subject to an ON state or an OFF state according to the EEG determination result.

11. The computer program according to claim 10, which causes a computer to perform a process of setting the monitoring unit to the ON state when it is determined that the brainwaves are abnormal.

12. The monitoring unit includes a camera, and if it is determined that the brainwaves are abnormal and the subject is outside the camera's field of view, the computer program according to claim 10 or 11 causes the computer to perform a process to notify the subject or a cohabitant to move the subject into the field of view.

13. The monitoring unit includes a camera, and if it is determined that the brainwaves are abnormal and the subject is outside the field of view of the camera, the computer program causes the computer to perform a process of adjusting the orientation of the camera so that the subject comes into the field of view.

14. The monitoring unit includes a microphone, and if it is determined that the brainwaves are abnormal and the subject is outside the sound pickup range of the microphone, the computer program according to claim 10 or 11 causes the computer to perform a process to notify the subject or a cohabitant to move the subject into the sound pickup range.

15. A computer program according to claim 10 or 11 that causes a computer to perform a process of setting the monitoring unit to the ON state if it is not possible to obtain brainwave data of the subject.

16. An information processing device comprising a control unit, the control unit acquires brainwave data of a subject from an electroencephalogram sensor attached to the subject, determines whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data, sets a monitoring unit that monitors the subject to the ON state according to the brainwave determination result, and executes a determination test to determine brain dysfunction using monitoring data acquired from the monitoring unit.

17. An information processing device comprising a control unit, wherein the control unit acquires brainwave data of a subject from an electroencephalogram sensor attached to the subject, determines whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data, and sets a monitoring unit that monitors the subject to be ON or OFF according to the brainwave determination result.

18. An information processing method comprising: acquiring brainwave data of a subject from an electroencephalogram sensor attached to the subject; determining whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data; setting a monitoring unit that monitors the subject to the ON state according to the brainwave determination result; and executing a determination test to determine brain dysfunction using monitoring data acquired from the monitoring unit.

19. An information processing method comprising: acquiring brainwave data of a subject from an electroencephalogram sensor attached to the subject; determining whether the subject's brainwaves are normal or abnormal based on the acquired brainwave data; and setting a monitoring unit that monitors the subject to an ON state or an OFF state according to the brainwave determination result.

Images