Biological information recording device and biological information recording program
Patent Information
- Application Number
- JP2024028777
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-09-07
- Filing Date
- 2024-02-28
- Publication Date
- 2025-09-11
AI Technical Summary
Conventional biological information sensors struggle to easily associate and record biometric information with tasks performed by subjects, especially during mentally or physically taxing activities.
A biological information recording device and program that includes an acquisition processing unit to detect biological information, a recording processing unit to record tasks in association with the information, and a display processing unit to guide user interactions for easy task designation and event/event noise management.
Enables easy and real-time association and recording of biometric information and tasks, allowing for efficient identification and management of noise artifacts, thereby enhancing work efficiency and accuracy.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a biometric information recording device and a biometric information recording program. [Background technology]
[0002] 2. Description of the Related Art Conventionally, there has been known a biological information sensor such as an electroencephalograph that is attached to the head of a subject so as to detect the subject's brain waves. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] U.S. Patent No. 9,867,571 Summary of the Invention [Problem to be solved by the invention]
[0004] Conventional biometric sensors as described above may be used to record biometric information of a subject performing one or more tasks, such as tests or tasks that may be mentally or physically taxing, for example to check cognitive function, etc. In this case, it is desirable to be able to easily associate and record the biometric information with the tasks.
[0005] Therefore, one of the problems to be solved by the present disclosure is to provide a biometric information recording device and a biometric information recording program that are capable of simply associating and recording biometric information with a task. [Means for solving the problem]
[0006] A biometric information recording device as an example of the present disclosure includes an acquisition processing unit that acquires biometric information of a subject detected by a biometric information sensor, and a recording processing unit that records the biometric information acquired by the acquisition processing unit, and, if a designation operation for designating a task to be performed by the subject is performed by an observer observing the subject while the biometric information is being recorded, further records the task in association with the biometric information.
[0007] As another example of a biometric information recording program of the present disclosure, a computer is configured to acquire biometric information of a subject detected by a biometric information sensor, record the acquired biometric information, and, if a designation operation for designating a task to be performed by the subject is performed by an observer observing the subject while the biometric information is being recorded, further record the task in association with the biometric information. Effect of the Invention
[0008] According to the biometric information recording device and the biometric information recording program of the present disclosure, biometric information and tasks can be easily associated and recorded. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is an exemplary schematic diagram showing an overview of an electroencephalogram recording device and an electroencephalograph according to an embodiment. [Diagram 2] FIG. 2 is an exemplary schematic block diagram showing the functions of the electroencephalogram recording device according to the embodiment. [Diagram 3] FIG. 3 is an illustrative schematic diagram showing an example of a top image according to the embodiment. [Figure 4] FIG. 4 is an illustrative schematic diagram showing an example of a preparation image according to the embodiment. [Diagram 5] FIG. 5 is an illustrative schematic diagram showing an example of a recorded image for a right-handed person according to an embodiment. [Figure 6] FIG. 6 is an illustrative schematic diagram showing an example of a recorded image for a left-handed person according to an embodiment. [Figure 7] FIG. 7 is an illustrative schematic diagram showing an example of a history image according to an embodiment. [Figure 8] FIG. 8 is an illustrative schematic diagram showing an example of a confirmation image according to the embodiment. [Figure 9] FIG. 9 is an illustrative schematic diagram showing an example of a data recording format according to the embodiment. [Figure 10] FIG. 10 is an exemplary schematic diagram showing an example of a task recording format according to the embodiment. [Figure 11] FIG. 11 is an exemplary schematic flowchart showing the process executed when the top image is displayed in the embodiment. [Figure 12] FIG. 12 is an exemplary schematic flow chart showing the process executed when a preparatory image is displayed in the embodiment. [Figure 13] FIG. 13 is an exemplary schematic flow chart showing the process executed when a recorded image is displayed in the embodiment. [Figure 14] FIG. 14 is an exemplary schematic flowchart showing a process executed when a history image is displayed in the embodiment. [Figure 15] FIG. 15 is an exemplary schematic flowchart showing a process executed when a confirmation image is displayed in the embodiment. [Figure 16] FIG. 16 is an illustrative schematic block diagram showing an example of a hardware configuration of a computer that realizes the electroencephalogram recording device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of a biometric information recording device and a biometric information recording program according to the present disclosure will be described with reference to the drawings. The configuration of the embodiment described below and the actions and effects brought about by the configuration are merely examples and are not limited to the contents described below.
[0011] In addition, in this disclosure, ordinal numbers such as "first" and "second" are used as necessary, but these ordinal numbers are used for convenience of identification and do not indicate any particular priority order.
[0012] <Embodiment> 1 is an exemplary schematic diagram showing an overview of an electroencephalogram recording device 100 and an electroencephalogram 200 according to an embodiment. The electroencephalogram recording device 100 is an example of a "biological information recording device" of the present disclosure, and the electroencephalogram 200 is an example of a "biological information sensor" of the present disclosure.
[0013] 1, an electroencephalogram recording device 100 and an electroencephalograph 200 are configured to wirelessly communicate with each other. The electroencephalogram recording device 100 is configured as a mobile terminal having a display screen 101, such as a smartphone. The electroencephalograph 200 is configured as a wearable terminal that is worn on the head of a subject X, for example.
[0014] In an embodiment, the electroencephalography device 100 is used to record electroencephalograms as biometric information of a subject X who is performing one or more tasks, such as tests or tasks that may be mentally or physically taxing, for example, to check cognitive functions. The electroencephalography device 100 has functions as shown in the following FIG. 2.
[0015] 2 is an exemplary schematic block diagram showing functions of the electroencephalogram recording device 100 according to the embodiment. As shown in FIG. 2, the electroencephalogram recording device 100 according to the embodiment includes an input receiving unit 110, an acquisition processing unit 120, a recording processing unit 130, and a display processing unit 140.
[0016] The input receiving unit 110 receives an input of an operation for the electroencephalogram recording device 100. The operation is input, for example, by a user (for example, an observer observing the subject X) who uses the electroencephalogram recording device 100 via a touch panel (not shown) provided on the display screen 101.
[0017] The acquisition processing unit 120 acquires the electroencephalogram of the subject X detected by the electroencephalograph 200. Then, the recording processing unit 130 records the electroencephalogram acquired by the acquisition processing unit 120.
[0018] Here, in the embodiment, the display processing unit 140 is configured to be able to display images such as those shown in the following FIGS. 3 to 8 on the display screen 101.
[0019] First, when a connection (pairing) between the electroencephalogram recording device 100 and the electroencephalograph 200 is established, the display processing unit 140 displays a top image 300 as shown in the following FIG.
[0020] 3 is an exemplary schematic diagram showing an example of a top image 300 according to an embodiment. As shown in FIG. 3, the top image 300 includes at least five regions 310, 320, 330, 340, and 350.
[0021] In the area 310, a user interface (button) 311 is displayed that accepts an input for an operation to disconnect the electroencephalogram recording device 100 and the electroencephalograph 200. In the area 320, a user interface (button) 321 is displayed that accepts an input for an operation to switch the currently displayed top image 300 to a preparation image 400 (see FIG. 4) described later. In the area 330, a user interface (button) 331 is displayed that accepts an input for an operation to switch the currently displayed top image 300 to a history image 700 (see FIG. 7) described later.
[0022] Also, in the area 340, a user interface is displayed that accepts input of an operation for setting an event that may occur in the subject X performing a predetermined task. An event is a specific occurrence that occurs in the subject X while performing a task and may cause noise in the recorded electroencephalogram. In the example shown in FIG. 3, five events, such as blinking, body movement, yawning, conversation, and laughter, are set. By inputting a predetermined operation through the area 340, the user of the electroencephalogram recording device 100 can additionally set a new event different from the blinking, body movement, yawning, conversation, and laughter, or change at least one of the blinking, body movement, yawning, conversation, and laughter to another event.
[0023] Also, in the area 350, a user interface is displayed that accepts input of an operation for setting a task to be performed by the subject X when recording an electroencephalogram. In the example shown in FIG. 3, at least five events are set, such as eyes closed-rest, eyes open-rest, HAM-D, MADRS, and N-back task. By inputting a predetermined operation through the area 350, the user of the electroencephalogram recording device 100 can additionally set a new task different from the eyes closed-rest, eyes open-rest, HAM-D, MADRS, and N-back task, or change at least one of the eyes closed-rest, eyes open-rest, HAM-D, MADRS, and N-back task to another task.
[0024] In an embodiment, when the user interface (button) 321 displayed in the area 320 is operated, the display processing unit 140 switches from the top image 300 to a preparatory image 400 as shown in the following FIG. 4 on the display screen 101.
[0025] 4 is an exemplary schematic diagram showing an example of a preparation image 400 according to an embodiment. As shown in FIG. 4, the preparation image 400 includes at least six regions 410, 420, 430, 440, 450, and 460.
[0026] In the area 410, a user interface (button) 411 is displayed for receiving an input for an operation to return the currently displayed preparation image 400 to the top image 300 (see FIG. 3).
[0027] Also displayed in area 420 is a user interface (button) that accepts input of a designation operation for designating a task to be performed by subject X when recording electroencephalograms. By performing a designation operation by selecting the user interface in area 420, the user of electroencephalogram recording device 100 can select one task from the tasks set in area 350 (see FIG. 3) of the top image 300 and a task "no task" for not having the subject perform any task. After selecting one task via area 420, the user of electroencephalogram recording device 100 instructs subject X to perform that one task.
[0028] Moreover, a user interface for receiving an input for an operation to set a measurement option related to recording of an electroencephalogram is displayed in area 430, and a user interface for receiving an input for an operation to select a preset of a measurement option is displayed in area 440. By inputting a predetermined operation via areas 430 and 440, the user of the electroencephalogram recording device 100 can set the on / off, time constant, HPF frequency, and LPF frequency of a notch filter used when recording an electroencephalogram.
[0029] Also, in the area 450, a user interface (button) 451 is displayed that accepts input of an operation to select the handedness of the user of the electroencephalogram recording device 100. The area 450 is an example of a "fifth area" in the present disclosure, and the user interface 451 is an example of a "third user interface" in the present disclosure. By inputting a predetermined operation via the user interface 451 in the area 450, the user of the electroencephalogram recording device 100 can selectively switch between displaying a recording image 500 for right-handed people (see FIG. 5) described later on the display screen 101 or displaying a recording image 600 for left-handed people (see FIG. 6) described later on the display screen 101 when recording electroencephalograms, tasks, and events.
[0030] Also displayed in area 460 is a user interface (button) 461 for switching the currently displayed preparatory image 400 to a recording image 500 (see FIG. 5) or a recording image 600 (see FIG. 6) described below for recording brain waves, tasks, and events.
[0031] For example, in an embodiment, when a user selects that the user's dominant hand is right via the user interface 451 in the area 450 and then inputs an operation to the user interface 461 in the area 460, the display processing unit 140 switches from the preparation image 400 to a recording image 500 as shown in the following Fig. 5 on the display screen 101. Accordingly, the recording processing unit 130 starts recording the electroencephalogram.
[0032] 5 is an exemplary schematic diagram showing an example of a right-handed recorded image 500 according to an embodiment. As shown in FIG. 5, the recorded image 500 includes at least five regions 510, 520, 530, 540, and 550.
[0033] In the area 510, the time-dependent changes in the electroencephalogram of the subject X are displayed in the form of a graph. The area 510 is an example of the "first area" of the present disclosure. In the example shown in FIG. 5, two types of time-dependent changes, that is, the time-dependent changes in the electroencephalogram of the right brain and the time-dependent changes in the electroencephalogram of the left brain, are displayed in the area 510. This means that in the embodiment, as an example, the electroencephalogram 200 including two electrodes, an electrode for detecting the electroencephalogram of the right brain and an electrode for detecting the electroencephalogram of the left brain, is used. The recording processing unit 130 records the electroencephalogram showing the time-dependent changes displayed in the area 510 while the recording image 500 is displayed on the display screen 101.
[0034] Moreover, the name of the current task is displayed in the area 520. The area 520 is an example of the "second area" of the present disclosure. The name of the task displayed in the area 520 is designated by a designation operation via the area 420 of the preparation image 400, and corresponds to the name of the task that the user of the electroencephalogram recording device 100 instructed the subject X to perform. Moreover, the name of the task displayed in the area 520 is displayed in a form that allows the timing at which the task started to be identified on the graph showing the time-dependent change in the electroencephalogram displayed in the area 510. In the embodiment, the recording processing unit 130 records the task displayed in the area 520 in association with the electroencephalogram while the recording image 500 is displayed on the display screen 101.
[0035] Also, in the area 530, a user interface (button) 531 is displayed for receiving an input of a judgment operation for judging an event occurring in the subject X performing the task. The area 530 is an example of a "third area" in the present disclosure, and the user interface 531 is an example of a "first user interface" in the present disclosure. In the example shown in FIG. 5, five events similar to those in the example shown in FIG. 1 are displayed in the area 530. The user of the electroencephalogram recording device 100 can observe the subject X performing the task, and select a user interface 531 corresponding to the event each time an event occurs in the subject X. In this case, the recording processing unit 130 records the event corresponding to the selected user interface 531 in association with the electroencephalogram and the task each time the user interface 531 is selected. Note that the name of the event judged by the judgment operation is displayed on the graph showing the time-dependent change in the electroencephalogram displayed in the area 510 in a form that allows the timing of the event occurrence to be identified.
[0036] Also, in the area 540, a user interface (button) 541 is displayed that accepts input of a change operation (task change operation) for changing the task so as to newly specify the task to be performed by the subject X. The area 540 is an example of a "fourth area" in the present disclosure, and the user interface 541 is an example of a "second user interface" in the present disclosure. When a new task is specified by inputting a task change operation via the user interface 541, the record processing unit 130 records the new task in association with the electroencephalogram.
[0037] Also, a user interface (button) 551 for receiving an input of an end operation is displayed in the area 550. When an end operation is input via the user interface 551, the recording processing unit 130 ends recording of the electroencephalogram, the task, and the event.
[0038] In an embodiment, when the user's dominant hand is selected as the left hand via user interface 451 in area 450 in preparatory image 400 (see FIG. 4) and an operation is input to user interface 461 in area 460, display processing unit 140 switches preparatory image 400 to display recorded image 600 as shown in the following FIG. 6 on display screen 101, instead of recorded image 500 described above.
[0039] 6 is an illustrative and schematic diagram showing an example of a left-handed recorded image 600 according to an embodiment. As shown in FIG. 6, the recorded image 600 is basically the same as the recorded image 500 (see FIG. 5) described above, except that the arrangement of some areas is different.
[0040] That is, the recorded image 600 includes at least five areas 610, 620, 630, 640, and 650 that are similar to the above-mentioned five areas 510, 520, 530, 540, and 550 (see FIG. 5), respectively. User interfaces (buttons) 631, 641, and 659 displayed in the areas 630, 640, and 650, respectively, are also similar to the user interfaces 531, 541, and 551 displayed in the areas 530, 540, and 550, respectively (see FIG. 5).
[0041] Here, in the recorded image 600, an area 630 in which a user interface 631 for accepting input of a determination operation is displayed, and an area 650 in which a user interface 651 for accepting input of a termination operation is displayed are located to the left of an area 610 in which a time-dependent change in electroencephalogram is displayed. This is the opposite of the left-right positional relationship of the areas 510, 530, and 650 in the recorded image 500 described above (see FIG. 5). The positional relationship as shown in FIG. 6 makes it easy for a left-handed user to perform a determination operation and a termination operation, and the positional relationship as shown in FIG. 5 makes it easy for a right-handed user to perform a determination operation and a termination operation.
[0042] Returning to FIG. 3, in an embodiment, when the user interface (button) 331 displayed in the area 330 is operated, the display processing unit 140 switches from the top image 300 to a history image 700 as shown in the following FIG. 7 and displays it on the display screen 101.
[0043] 7 is an exemplary schematic diagram showing an example of a history image 700 according to an embodiment. As shown in FIG. 7, the history image 700 includes at least two regions 710 and 720.
[0044] In the area 710, a user interface (button) 711 is displayed for receiving an input for an operation to return the currently displayed history image 700 to the top image 300 (see FIG. 3).
[0045] Also, a list of recorded data is displayed in an area 720. The user of the electroencephalogram recording device 100 can input a predetermined operation via the area 720 and select one piece of data from the list of data displayed in the area 720. In this case, the display processing unit 140 switches from the history image 700 to a confirmation image 800 as shown in the following Fig. 8 on the display screen 101 so that the user can confirm the contents of the selected data.
[0046] 8 is an exemplary schematic diagram showing an example of a confirmation image 800 according to an embodiment. As shown in FIG. 8, the confirmation image 800 includes at least four regions 810, 820, 830, and 840.
[0047] In area 810, a user interface (button) 811 is displayed that accepts input of an operation to return the currently displayed confirmation image 800 to the history image 700 (see FIG. 7). In area 820, at least a part of the contents of the data selected in the history image 700 (for example, the correspondence between electroencephalograms, tasks, and events) is displayed in the form of a graph. In the example shown in FIG. 8, (at least a part of) the recorded electroencephalograms are displayed in the form of a graph, and the recorded tasks and events are displayed on the graph in a form that allows identification of the timing at which the tasks started and the timing at which the events occurred.
[0048] Furthermore, in areas 830 and 840, user interfaces 831 and 841 are displayed, respectively, which accept input of an operation to change the data displayed in area 810. For example, the user of the electroencephalogram recording device 100 can select how many seconds of data to display in area 810 by inputting a predetermined operation via user interface 841 in area 840, and can display data that is not currently within the range of area 810 within the range of area 810 by inputting a predetermined operation via user interface 831 in area 830.
[0049] In the embodiment, the recording processing unit 130 records various data in a format as shown in FIG.
[0050] FIG. 9 is an illustrative schematic diagram showing an example of a data recording format according to the embodiment.
[0051] 9, the record processing unit 130 records various data in a format like table 900. In the example shown in Fig. 9, a total of six items of data are associated in table 900: a left brain electroencephalogram value (Ch1-Left), a right brain electroencephalogram value (Ch2-Right), a task identification number (Task Number), an event name (Event), the presence or absence of noise (Noise), and the timing (Time Stamp) at which these five items of data were acquired.
[0052] In addition, in the table 900 shown in Fig. 9, the names of the tasks are not directly recorded, but the identification numbers of the tasks are recorded. Therefore, in the embodiment, the correspondence between the identification numbers of the tasks and the names of the tasks is recorded in the format shown in the following Fig. 10.
[0053] FIG. 10 is an exemplary schematic diagram showing an example of a task recording format according to the embodiment.
[0054] 10, in the embodiment, task identification numbers (Task Number) and task names (Task Name) are associated with each other in the form of a table 1000. The display processing unit 140 displays the above-mentioned confirmation image 800 (see FIG. 8) on the display screen 101 based on this table 1000 and the above-mentioned table 900 (see FIG. 9).
[0055] In this way, the electroencephalogram recording device 100 of the embodiment can display various images on the display screen 101 and accept input operations by a user (an observer observing subject X), thereby recording the correspondence between electroencephalograms, tasks, and events, and allowing the user to check the recorded data.
[0056] The flow of processing executed by the electroencephalogram recording device 100 according to the embodiment will be described below.
[0057] FIG. 11 is an exemplary schematic diagram showing the process executed when the top image 300 (see FIG. 3) is displayed in the embodiment.
[0058] 11, first, in step S1101, the input receiving unit 110 determines whether or not a disconnection operation has been input. The disconnection operation is an operation for releasing the connection between the electroencephalogram recording device 100 and the electroencephalograph 200, which is input via the user interface 311 in the area 310 in the top image 300 (see FIG. 3).
[0059] If it is determined in step S1101 that a disconnection operation has been input, the process ends. On the other hand, if it is determined in step S1101 that a disconnection operation has not been input, the process proceeds to step S1102.
[0060] Then, in step S1102, the input receiving unit 110 determines whether or not an operation to transition to the preparatory image 400 (see FIG. 4) has been input. The operation to transition to the preparatory image 400 is an operation input via the user interface 321 of the area 320 in the top image 300 (see FIG. 3).
[0061] If it is determined in step S1102 that an operation to transition to the preparatory image 400 (see FIG. 4) has been input, the process proceeds to step S1103. Then, in step S1103, the display processing unit 140 switches the image to be displayed on the display screen 101 from the currently displayed top image 300 (see FIG. 3) to the preparatory image 400. Then, when the switching to the preparatory image 400 is completed, the process shown in FIG. 11 ends, and the process transitions to the process shown in FIG. 12 (details of which will be described later).
[0062] On the other hand, if it is determined in step S1102 that a transition operation to the preparation image 400 (see FIG. 4) has not been input, the process proceeds to step S1104. Then, in step S1104, the input receiving unit 110 determines whether or not a transition operation to the history image 700 (see FIG. 7) has been input. The transition operation to the history image 700 is an operation input via the user interface 331 of the area 330 in the top image 300 (see FIG. 3).
[0063] If it is determined in step S1104 that an operation to switch to the history image 700 (see FIG. 7) has been input, the process proceeds to step S1105. Then, in step S1105, the display processing unit 140 switches the image to be displayed on the display screen 101 from the currently displayed top image 300 (see FIG. 3) to the history image 700. Then, when the switching to the history image 700 is completed, the process shown in FIG. 11 ends, and the process proceeds to the process shown in FIG. 14 (details of which will be described later).
[0064] On the other hand, if it is determined in step S1104 that the operation to transition to the history image 700 (see FIG. 7) has not been input, the process proceeds to step S1106. Then, in step S1106, the input receiving unit 110 determines whether or not other setting change operations have been input. Other setting change operations refer to operations input via areas 340 and 350 in the top image 300 (see FIG. 3), etc.
[0065] If it is determined in step S1106 that a setting change operation has not been input, the process returns to step S1101. On the other hand, if it is determined in step S1106 that a setting change operation has been input, the process proceeds to step S1107. Then, in step S1107, the display processing unit 140 changes the settings in accordance with the input setting change operation, and changes the display content of the top image 300 (see FIG. 3) as necessary. Then, the process returns to step S1101.
[0066] FIG. 12 is an exemplary schematic diagram showing the process performed when the preparatory image 400 (see FIG. 4) is displayed in the embodiment.
[0067] 12, first, in step S1201, the input receiving unit 110 determines whether or not a back operation has been input. The back operation is an operation input via the user interface 411 of the area 410 in the preparation image 400 (see FIG. 4).
[0068] If it is determined in step S1201 that a back operation has been input, the process proceeds to step S1202. Then, in step S1202, the display processing unit 140 switches the image to be displayed on the display screen 101 from the currently displayed preparation image 400 (see FIG. 4) to the top image 300 (see FIG. 3). Then, when the switching to the top image 300 is completed, the process shown in FIG. 12 ends, and the process proceeds to the process shown in FIG. 11.
[0069] On the other hand, if it is determined in step S1201 that a return operation has not been input, the process proceeds to step S1203. Then, in step S1203, the input receiving unit 110 determines whether or not a recording start operation has been input. The recording start operation is an operation input via the user interface 461 of the area 460 in the preparation image 400 (see FIG. 4).
[0070] If it is determined in step S1203 that a recording start operation has been input, the process proceeds to step S1204. Then, in step S1204, the display processing unit 140 switches the image to be displayed on the display screen 101 from the currently displayed preparation image 400 (see FIG. 4) to the recording image 500 (see FIG. 5) or the recording image 600 (see FIG. 6). Then, when the switching to the recording image 500 or 600 is completed, the process shown in FIG. 12 ends, and the process proceeds to the process shown in FIG. 13 (details of which will be described later).
[0071] On the other hand, if it is determined in step S1203 that the recording start operation has not been input, the process proceeds to step S1205. Then, in step S1205, the input receiving unit 110 determines whether or not a designation operation has been input. The designation operation is an operation input via the area 420 in the preparation image 400 (see FIG. 4).
[0072] If it is determined in step S1205 that a designation operation has been input, the process proceeds to step S1206. In step S1206, the display processing unit 140 sets a task to be recorded in association with the measurement value of the electroencephalogram that will be recorded in response to a future recording start operation, and changes the display content of the preparation image 400 (see FIG. 4) as necessary. Then, the process returns to step S1201.
[0073] On the other hand, if it is determined in step S1205 that the designation operation has not been input, the process proceeds to step S1207. Then, in step S1207, the input receiving unit 110 determines whether or not other setting change operations (including a switching operation) have been input. The other setting change operations refer to operations input via the areas 430, 440, and 450 in the preparation image 400 (see FIG. 4). Here, the operation input via the user interface 451 in the area 450 is expressed as a switching operation in the sense that it is an operation for switching between displaying a right-handed recording image 500 (see FIG. 5) or a left-handed recording image 600 (see FIG. 6) on the display screen 101 when recording electroencephalograms, tasks, and events.
[0074] If it is determined in step S1207 that a setting change operation has not been input, the process returns to step S1201. On the other hand, if it is determined in step S1207 that a setting change operation has been input, the process proceeds to step S1208. Then, in step S1208, the display processing unit 140 changes the settings in accordance with the input setting change operation, and changes the display content of the preparation image 400 (see FIG. 4) as necessary. Then, the process returns to step S1201.
[0075] 13 is an exemplary schematic diagram showing a process executed when the recorded image 500 (see FIG. 5) or the recorded image 600 (see FIG. 6) is displayed in the embodiment. As described above, whether the recorded image 500 or 600 is displayed is switched according to the switching operation input in step S1207 in FIG. 12, for example.
[0076] In the example shown in Fig. 13, first, in step S1301, the record processing unit 130 records the measurement value of the electroencephalogram acquired by the acquisition processing unit 120 in association with the task designated by the designation operation input, for example, in step S1205 of Fig. 12. At this time, the display processing unit 140 displays the data being recorded in area 510 of the recorded image 500 (see Fig. 5) or area 610 of the recorded image 600 (see Fig. 6).
[0077] Then, in step S1302, the input receiving unit 110 determines whether or not a termination operation has been input. The termination operation is an operation input via the user interface 551 of the area 550 in the recorded image 500 (see FIG. 5) or the user interface 651 of the area 650 in the recorded image 600 (see FIG. 6).
[0078] If it is determined in step S1302 that the end operation has been input, the process proceeds to step S1303. In step S1303, the recording processing unit 130 stores the results of recording data up to the present time in a format such as the above-mentioned table 900 (see FIG. 9). Then, the process ends.
[0079] On the other hand, if it is determined in step S1302 that the end operation has not been input, the process proceeds to step S1304. Then, in step S1304, the input receiving unit 110 determines whether or not a determination operation has been input. The determination operation is an operation input via the user interface 531 of the area 530 in the recorded image 500 (see FIG. 5) or the user interface 631 of the area 630 in the recorded image 600 (see FIG. 6).
[0080] If it is determined in step S1304 that a determination operation has been input, the process proceeds to step S1305. Then, in step S1305, the record processing unit 130 records the event determined by the determination operation in association with the measurement value of the electroencephalogram being recorded and the task. At this time, the display processing unit 140 displays the recorded event in the area 510 of the recorded image 500 (see FIG. 5) or in the area 610 of the recorded image 600 (see FIG. 6). Then, the process returns to step S1301.
[0081] On the other hand, if it is determined in step S1305 that the determination operation has not been input, the process proceeds to step S1306. Then, in step S1306, the input receiving unit 110 determines whether or not a task change operation has been input. The task change operation is an operation input via the user interface 541 of the area 540 in the recorded image 500 (see FIG. 5) or the user interface 641 of the area 640 in the recorded image 600 (see FIG. 6).
[0082] If it is determined in step S1306 that a task changing operation has not been input, the process returns to step S1301. On the other hand, if it is determined in step S1306 that a task changing operation has been input, the process proceeds to step S1307. Then, in step S1307, the recording processing unit 130 changes the recorded task, and the display processing unit 140 changes the display content in the area 520 of the recorded image 500 (see FIG. 5) or the area 620 of the recorded image 600 (see FIG. 6). At this time, the display processing unit 140 also changes the task to be displayed in the area 510 of the recorded image 500 or the area 610 of the recorded image 600. Then, the process returns to step S1301.
[0083] FIG. 14 is an exemplary schematic diagram showing the process executed when the history image 700 (see FIG. 7) is displayed in the embodiment.
[0084] 14, first, in step S1401, the input receiving unit 110 determines whether or not a back operation has been input. The back operation is an operation input via the user interface 711 of the area 710 in the history image 700 (see FIG. 7).
[0085] If it is determined in step S1401 that a back operation has been input, the process proceeds to step S1402. Then, in step S1402, the display processing unit 140 switches the image to be displayed on the display screen 101 from the currently displayed history image 700 (see FIG. 7) to the top image 300 (see FIG. 3). Then, when the switching to the top image 300 is completed, the process shown in FIG. 14 ends, and the process proceeds to the process shown in FIG. 11.
[0086] On the other hand, if it is determined in step S1401 that a return operation has not been input, the process proceeds to step S1403. Then, in step S1403, the input receiving unit 110 determines whether or not a selection operation has been input. The selection operation is an operation input via the area 720 in the history image 700 (see FIG. 7).
[0087] If it is determined in step S1403 that a selection operation has not been input, the process returns to step S1401. On the other hand, if it is determined in step S1403 that a selection operation has been input, the process proceeds to step S1404. Then, in step S1404, display processing unit 140 switches the image to be displayed on display screen 101 from currently displayed history image 700 (see FIG. 7) to confirmation image 800 (see FIG. 8). Then, when the switching to confirmation image 800 is completed, the process shown in FIG. 14 ends, and the process proceeds to the next process shown in FIG. 15.
[0088] FIG. 15 is an exemplary schematic diagram showing the process executed when the check image 800 (see FIG. 8) is displayed in the embodiment.
[0089] 15, first, in step S1501, input receiving unit 110 determines whether or not a back operation has been input. A back operation is an operation input via user interface 811 of area 810 in confirmation image 800 (see FIG. 8).
[0090] If it is determined in step S1501 that a back operation has been input, the process proceeds to step S1502. Then, in step S1502, the display processing unit 140 switches the image to be displayed on the display screen 101 from the currently displayed confirmation image 800 (see FIG. 8) to the history image 700 (see FIG. 7). Then, when the switching to the history image 700 is completed, the process shown in FIG. 15 ends, and the process proceeds to the process shown in FIG. 14.
[0091] On the other hand, if it is determined in step S1501 that a return operation has not been input, the process proceeds to step S1503. Then, in step S1503, input receiving unit 110 determines whether or not an operation to change other display contents has been input. The operation to change other display contents refers to an operation input via user interface 831 of area 830 and user interface 841 of area 840 in confirmation image 800 (see FIG. 8).
[0092] If it is determined in step S1503 that an operation to change the display content has not been input, the process returns to step S1501. On the other hand, if it is determined in step S1503 that an operation to change the display content has been input, the process proceeds to step S1504. Then, in step S1504, display processing unit 140 changes the display content in area 820 of confirmation image 800 (see FIG. 8) in response to the input operation to change the display content. Then, the process ends.
[0093] As described above, the electroencephalogram recording device 100 according to the embodiment includes the acquisition processing unit 120 and the recording processing unit 130. The acquisition processing unit 120 acquires the electroencephalogram of the subject X detected by the electroencephalograph 200. The recording processing unit 130 records the electroencephalogram acquired by the acquisition processing unit 120, and when a designation operation for designating a task to be performed by the subject X is performed by an observer observing the subject X during the recording of the electroencephalogram, the recording processing unit 130 further records the task in association with the electroencephalogram.
[0094] According to the above configuration, unlike cases where, for example, it is necessary to record retrospectively which task was performed at what timing after the completion of EEG recording, it is possible to easily associate and record EEG with tasks by simply performing a designation operation in real time while recording EEG.
[0095] In addition, in the embodiment, when the observer performs a determination operation to determine an event occurring in the subject X while the electroencephalogram and the task are being recorded, the record processing unit 130 further records the event in association with the electroencephalogram and the task.
[0096] According to the above configuration, unlike a case where which event occurred at what timing after the recording of the electroencephalogram and the task is completed, it is possible to simply perform a judgment operation in real time while recording the electroencephalogram and the task, and to easily record the events in association with the electroencephalogram and the task. That is, one observer can have the subject perform a task such as a cognitive test while simultaneously recording the events (e.g., blinking) that occurred in the subject in real time. Therefore, noise or artifacts can be easily identified in the recording of the electroencephalogram. In addition, in this case, the observer can work while watching both the electroencephalograph and the behavior or action of the subject, thereby improving the work efficiency.
[0097] In the embodiment, the electroencephalogram recording device 100 includes a display processing unit 140. The display processing unit 140 displays, on the display screen 101, a recorded image 500 (or 600) including an area 510 (or 610) displaying a time-dependent change in electroencephalogram, an area 520 (or 620) displaying the name of the task, and an area 530 (or 530) displaying a user interface 531 (or 631) for accepting input of a judgment operation, during recording of the electroencephalogram and the task.
[0098] According to the above configuration, it is possible to visually and easily determine events that should be recorded in association with electroencephalograms and tasks.
[0099] In addition, in an embodiment, the recorded image 500 (or 600) further includes an area 540 (or 640) in which a user interface 541 (or 641) is displayed, which accepts input of a change operation for changing the task so as to perform a new specified operation.
[0100] According to the above configuration, it is possible to visually and easily change the task to be recorded in association with the electroencephalogram.
[0101] Also, in an embodiment, before displaying the recorded image 500 (or 600) on the display screen 101, the display processing unit 140 displays the preparatory image 400 on the display screen 101, which includes an area 450 in which a user interface 451 is displayed that accepts input for a switching operation to switch whether the area 530 (or 630) is positioned to the left or right of the area 510 (or 620) in the recorded image 500 (or 600).
[0102] According to the above configuration, by performing a switching operation using the preparatory image 400, it is possible to easily select between the recorded image 500 on which a right-handed user can easily perform a judgment operation and the recorded image 600 on which a left-handed user can easily perform a judgment operation.
[0103] Finally, a description will be given of the hardware configuration of the electroencephalogram recording device 100 according to the above-mentioned embodiment. The electroencephalogram recording device 100 according to the embodiment is realized by a computer 1600 having a hardware configuration as shown in the following FIG.
[0104] FIG. 1 is an exemplary schematic block diagram showing a hardware configuration of a computer 1600 that realizes the electroencephalogram recording device 100 according to an embodiment.
[0105] 16, a computer 1600 includes a processor 1610, a memory 1620, a storage 1630, an input / output interface (I / F) 1640, and a communication interface (I / F) 1650. These hardware components are connected to a bus 1660.
[0106] The processor 1610 is configured as, for example, a CPU (Central Processing Unit), and performs overall control of the operations of each part of the computer 1600 .
[0107] Memory 1620 includes, for example, Read Only Memory (ROM) and Random Access Memory (RAM), and provides volatile or non-volatile storage of various data such as programs executed by processor 1610, and provides a working area for processor 1610 to execute programs.
[0108] The storage 1630 includes, for example, a hard disk drive (HDD) or a solid state drive (SSD), and stores various types of data in a non-volatile manner.
[0109] The input / output interface 1640 controls the input of data to the computer 1600 from input devices (not shown), such as a keyboard and mouse, and the output of data from the computer 1600 to output devices (not shown), such as a display and speakers.
[0110] The communications interface 1650 allows the computer 1600 to perform wired or wireless communications with other devices.
[0111] The functions (see FIG. 2) of the electroencephalogram recording device 100 according to the embodiment are realized as a group of functional modules in cooperation with hardware and software as a result of the processor 1610 executing an electroencephalogram recording program pre-stored in the memory 1620 or the storage 1630. However, in the embodiment, some or all of the group of functional modules shown in FIG. 2 may be realized only by hardware such as a dedicated circuit.
[0112] The electroencephalogram recording program described above does not necessarily need to be stored in advance in the memory 1620 or the storage 1630. For example, the electroencephalogram recording program described above may be provided as a computer program product recorded in an installable or executable format on a computer-readable medium such as various magnetic disks such as a flexible disk (FD) or various optical disks such as a digital versatile disk (DVD).
[0113] The electroencephalogram recording program may be provided or distributed via a network such as the Internet. That is, the recording program may be provided in a state where it is stored on a computer connected to a network such as the Internet and is available for download via the network.
[0114] <Modification> In the above-described embodiment, the configuration in which the recorded biological information is an electroencephalogram is illustrated. However, the technology of the present disclosure is also applicable to a configuration in which biological information other than an electroencephalogram, such as a heart rate, is recorded.
[0115] In the above-described embodiment, the electroencephalogram recording device 100 configured as a mobile terminal such as a smartphone is exemplified as an example of a bioinformation recording device. However, in the technology of the present disclosure, the electroencephalogram recording device 100 may be configured as a non-mobile terminal.
[0116] In the above embodiment, the case where the designation operation for designating the task to be performed by the subject during recording of the biometric information is performed by the observer observing the subject has been shown, but the subject performing the designation operation is not limited to the observer, and may be performed by a mechanical device. The mechanical device includes, for example, a camera that captures an overall image of the subject, and a computer including at least one processor. The processor performs the designation operation by, for example, arbitrarily designating the task to be performed by the subject, displays the designated task on an input / output interface (I / F) of the computer, and transfers and records information on the task to a recording processing unit. This allows the information on the task to be recorded accurately.
[0117] In the above embodiment, the observer performs the judgment operation to judge an event occurring in the subject during recording of the bio-information and the task. However, this judgment operation may be performed by a mechanical device instead of the observer, as in the above-mentioned designation operation. The mechanical device includes, for example, a camera that captures an overall image of the subject, and a computer including at least one processor. The processor performs the judgment operation by judging an event occurring in the subject based on the image from the camera, and transfers the judgment operation to a recording processor for recording. This allows the event judgment operation to be accurately recorded.
[0118] Although some embodiments and modifications of the present disclosure have been described above, these embodiments and modifications are presented as examples and are not intended to limit the scope of the invention. These new embodiments and modifications can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]
[0119] 100 Biometric information recording device 101 Display screen 120 Acquisition processing unit 130 Recording processing section 140 Display processing unit 200 Electroencephalograph 400 Preparation Images 450 area (5th area) 451 User Interface (Second User Interface) 500, 600 Recorded images 510, 610 area (first area) 520, 620 area (second area) 530, 630 area (3rd area) 531, 631 User Interface (First User Interface) 540, 640 area (4th area) 541, 641 User Interface (Second User Interface)
Claims
1. an acquisition processing unit that acquires biological information of the subject detected by the biological information sensor; a recording processing unit that records the biometric information acquired by the acquisition processing unit, and, when a designation operation for designating a task to be performed by the subject is performed by an observer observing the subject at any timing during the recording of the biometric information, further records the task in association with the biometric information; A biological information recording device comprising:
2. When the observer performs a determination operation to determine a predetermined event occurring in the subject while the subject is performing the task at any timing during the recording of the biological information, the recording processing unit further records the event in association with the biological information and the task. The biological information recording device according to claim 1 .
3. a display processing unit that displays, on a display screen, a recorded image including a first area in which a change in the biological information over time is displayed, a second area in which a name of the task is displayed, and a third area in which a first user interface for receiving an input of the determination operation is displayed, while the biological information and the task are being recorded; The biological information recording device according to claim 2 .
4. the recorded image further includes a fourth area in which a second user interface is displayed that accepts an input of a change operation to change the task so as to perform the specified operation again. The biological information recording device according to claim 3 .
5. and before displaying the recorded image on the display screen, the display processing unit displays a preparatory image on the display screen, the preparatory image including a fifth area in which a third user interface is displayed, the third user interface receiving an input of a switching operation for switching whether the third area is to be positioned to the left or right of the first area in the recorded image. The biological information recording device according to claim 3 .
6. Before displaying the recorded image on the display screen, the display processing unit displays a preparatory image on the display screen, the preparatory image including a fifth area in which a third user interface is displayed that accepts input of a switching operation to switch whether the third area is positioned to the left or right of the first area in the recorded image. The biological information recording device according to claim 4.
7. the biological information includes an electroencephalogram detected by an electroencephalograph serving as the biological information sensor; The biometric information recording device according to any one of claims 1 to 6.
8. acquiring biological information of the subject detected by a biological information sensor; recording the acquired biometric information, and when a designation operation for designating a task to be performed by the subject is performed by an observer observing the subject at any timing during the recording of the biometric information, further recording the task in association with the biometric information; A biometric information recording program that causes a computer to execute the above.
9. When the observer performs a determination operation to determine a predetermined event occurring in the subject while the subject is performing the task at any timing during the recording of the biometric information, the event is further recorded in association with the biometric information and the task.
9. The biological information recording program according to claim 8, for causing the computer to execute the following.
10. During recording of the biological information and the task, a recording image including a first area in which a change over time in the biological information is displayed, a second area in which a name of the task is displayed, and a third area in which a first user interface for receiving an input of the determination operation is displayed is displayed.
10. The biological information recording program according to claim 9, for causing the computer to execute the following.
11. the recorded image further includes a fourth area in which a second user interface is displayed that accepts an input of a change operation to change the task so as to perform the specified operation again. The biological information recording program according to claim 10.
12. before displaying the recorded image on the display screen, a preparatory image including a fifth area in which a third user interface is displayed, which receives an input of a switching operation for switching whether to arrange the third area on the left side or the right side of the first area in the recorded image, is displayed on the display screen. The biological information recording program according to claim 10, for causing the computer to execute the following.
13. Before displaying the recorded image on the display screen, a preparatory image including a fifth area in which a third user interface is displayed that accepts input of a switching operation to switch whether the third area is positioned to the left or right of the first area in the recorded image is displayed on the display screen. The biological information recording program according to claim 11, for causing the computer to execute the following.
14. the biological information includes an electroencephalogram detected by an electroencephalograph serving as the biological information sensor; The biological information recording program according to any one of claims 8 to 13.