Method for providing behavioral analysis devices, behavioral analysis systems, behavioral analysis methods, and reports.

Abstract

This invention provides a behavioral analysis device that can provide analytical comments related to the subject's behavior and changes in their autonomic nervous system. [Solution] The behavioral analysis device comprises a vital data acquisition unit 321 that acquires vital data including pulse wave information of the subject, a behavioral data acquisition unit 322 that acquires behavioral data related to the subject's actions, an autonomic nerve estimation processing unit 323 that generates autonomic nerve data showing the temporal transition of the autonomic nerves based on the vital data, an analysis processing unit 324 that analyzes the state of the autonomic nerves in the actions and generates report data based on the behavioral data and autonomic nerve data, and a report generation unit 325 that generates a report including analysis comments related to the actions and the state of the autonomic nerves based on the report data.

Description

TECHNICAL FIELD

[0001] The present invention relates to a behavior analysis device, a behavior analysis system, a behavior analysis method, and a report providing method. BACKGROUND ART

[0002] Conventionally, there is a known method of evaluating the concentration state of a subject from the temporal transition of the subject's autonomic nerve based on the subject's vital data (see, for example, Patent Document 1). The method described in Patent Document 1 acquires the pulse wave of the subject, and evaluates the concentration state of the subject using rMSSD (root Mean Square of Successive Differences) calculated from the acquired pulse wave as the temporal transition of the subject's autonomic nerve. PRIOR ART DOCUMENTS PATENT DOCUMENTS

[0003] PATENT DOCUMENT 1 Japanese Unexamined Patent Application Publication No. 2024-76102 SUMMARY OF THE INVENTION PROBLEMS TO BE SOLVED BY THE INVENTION

[0004] However, the correlation between the behavior content of the subject and the state of the subject's autonomic nerve is difficult to understand, and evaluation including what kind of autonomic nerve state the subject was in while performing the behavior could not be achieved. MEANS FOR SOLVING THE PROBLEMS

[0005] A behavioral analysis device according to a first aspect of the present disclosure comprises: a vital data acquisition unit that acquires vital data including pulse wave information of a subject; a behavioral data acquisition unit that acquires behavioral data relating to the subject's behavior; an autonomic nerve estimation processing unit that generates autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the vital data; an analysis processing unit that analyzes the state of the autonomic nerves in the behavior and generates report data based on the behavioral data and the autonomic nerve data; and a report generation unit that generates a report including analysis comments related to the behavior and the state of the autonomic nerves based on the report data.

[0006] A behavioral analysis system according to a second aspect of the present disclosure comprises a vital device that measures the pulse wave of a subject and stores it as vital data, a behavioral acquisition device that acquires behavioral data relating to the subject's behavior, and an information processing device, the information processing device comprising: a vital data acquisition unit that acquires the vital data from the vital device; a behavioral data acquisition unit that acquires the behavioral data from the behavioral acquisition device; an autonomic nerve estimation processing unit that generates autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the vital data acquired by the vital data acquisition unit; an analysis processing unit that analyzes the state of the autonomic nerves in the behavior and generates report data based on the behavioral data and the autonomic nerve data; and a report generation unit that generates a report including analysis comments related to the behavior and the state of the autonomic nerves based on the report data.

[0007] A third aspect of the present disclosure is a behavioral analysis method for analyzing the behavior of a subject, comprising: a first step in which a vital device measures the pulse wave of the subject and stores it as vital data; a second step in which a behavioral acquisition device acquires behavioral data relating to the subject's behavior; a third step in which an information processing device acquires the vital data from the vital device; a fourth step in which the information processing device acquires the behavioral data from the behavioral acquisition device; a fifth step in which the information processing device generates autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the acquired vital data; a sixth step in which the information processing device analyzes the state of the autonomic nerves in the behavior and generates report data based on the behavioral data and the autonomic nerve data; and a seventh step in which the information processing device generates a report including analysis comments related to the behavior and the state of the autonomic nerves based on the report data.

[0008] A fourth aspect of the present disclosure is a method for providing a report, wherein a computer provides a report including analytical comments related to a subject's behavior and autonomic nervous system state, using a vital device, an action acquisition device, and an information processing device, wherein the computer acquires vital data including the subject's pulse wave from the vital device, acquires behavioral data relating to the subject's behavior from the action acquisition device, generates autonomic nervous system data showing the temporal transition of the subject's autonomic nervous system from the vital data, analyzes the state of the autonomic nervous system in the behavior based on the behavioral data and the autonomic nervous system data and generates report data, and generates a report including analytical comments related to the behavior and the state of the autonomic nervous system based on the report data. [Brief explanation of the drawing]

[0009] [Figure 1] A block diagram showing the schematic configuration of a behavioral analysis system according to one embodiment of the present disclosure. [Figure 2] This diagram illustrates an example of inputting behavioral data in the above embodiment. [Figure 3]An explanatory diagram showing the table data of the above embodiment. [Figure 4] An explanatory diagram showing an example of a graph of the above embodiment. [Figure 5] An example of displaying analysis comments that analyze the relationship between autonomic nervous system data and behavioral data in the above embodiment. [Figure 6] A flowchart illustrating the operation of the vital device in the above embodiment. [Figure 7] A flowchart illustrating the operation of the behavior acquisition device according to the above embodiment. [Figure 8] A flowchart illustrating the operation of the information processing device according to the above embodiment. [Figure 9] A flowchart illustrating the operation of the behavior acquisition device according to the above embodiment. [Modes for carrying out the invention]

[0010] The following describes the positional embodiments of this disclosure. Figure 1 is a block diagram showing the configuration of the behavioral analysis system 1 of this embodiment. The behavioral analysis system 1 comprises a vital device 2, an information processing device 3, and a behavioral acquisition device 4.

[0011] The vital device 2 is configured, for example, as a wearable device that can be attached to the human body, and comprises a sensor unit 21 and a communication unit 22. The sensor unit 21 acquires vital data of the subject. In this embodiment, the vital data is, for example, pulse wave data and body movement data, and the sensor unit 21 includes a pulse wave sensor and a body movement sensor. Here, the pulse wave data is, for example, data including the subject's pulse wave and the time at which the pulse wave was acquired. The body movement data is, for example, data including the subject's body movement and the time at which the body movement was acquired.

[0012] When detecting pulse waves, a photoelectric sensor, for example, including a light-receiving unit and a light-emitting unit, is used as the pulse wave sensor. In this photoelectric sensor, light emitted from the light-emitting unit is irradiated onto a living body (for example, the subject's wrist), and the reflected or transmitted light is received by the light-receiving unit, which outputs a signal corresponding to the amount of light received. Here, since the amount of light reflected or absorbed by the living body changes according to the blood flow rate in the blood vessels, the magnitude of the signal output from the photoelectric sensor increases or decreases in accordance with the pulsation. As a result, the photoelectric sensor outputs a pulse wave signal whose signal value increases or decreases over time. Here, the photoelectric sensor may be other sensors such as an electrocardiograph or an ultrasound sensor.

[0013] Furthermore, when detecting body movement, the body movement sensor may be, for example, an acceleration sensor that detects the movement of the subject. The body movement sensor detects the movement of the subject's body by detecting the acceleration at the location where it is attached. The body movement data obtained from the body movement includes at least one of the following parameters: a parameter indicating the intensity of the body movement, a parameter indicating the duration for which body movement of a predetermined intensity continued, and a parameter indicating the frequency per unit time of body movement of a predetermined intensity. The parameter indicating the intensity of the body movement varies depending on the subject's body movements, such as walking, running, sitting, and lying down. The parameter indicating the duration for which body movement of a predetermined intensity continued indicates the duration for which the measured body movement fell within a predetermined level range, based on pre-classified levels of the subject's body movement. The parameter indicating the frequency per unit time of body movement of a predetermined intensity indicates the number of times body movement within a predetermined level range occurred within a unit time. Furthermore, the motion sensor may also be a sensor that detects position.

[0014] The communication unit 22 communicates with the communication unit 33 of the information processing device 3 to send and receive data. The communication unit 22 may also be able to communicate with the action acquisition device 4, and may communicate with other devices via the internet or the like. The communication method used by the communication unit 22 is not particularly limited, but wireless communication via the internet is more preferable.

[0015] The behavior acquisition device 4 is configured by a terminal device such as a computer or a smartphone, for example, and includes a behavior input unit 41, a communication unit 42, and a display unit 43. The behavior acquisition device 4 may be the same terminal device as the vital device 2. In the behavior input unit 41, behavior data indicating behavior categories 411 such as desk work, meeting, movement, exercise, and meal, and the time when the behavior was performed, is input by the subject. FIG. 2 is an example of an input screen when behavior data is input. The input screen is displayed on the display unit 43, for example. Further, the input screen may be displayed on the screen of the vital device 2 (not shown). As shown in FIG. 2, the behavior data includes, for example, a plurality of preset behavior categories 411, and each behavior category 411 may be displayed as an icon or the like. Further, in addition to the behavior categories 411, detailed notes serving as supplementary data 412 may be added to the behavior data. The content of the supplementary data 412 can supplement the state of the subject during the meeting, such as "presentation", "brainstorming", or "just listening", when the behavior category 411 is "meeting", for example. Further, for example, when the behavior category 411 is "meal", the content is the details of the meal such as "pork cutlet", the presence or absence of alcohol consumption, and the like. The supplementary data 412 is data that can be arbitrarily input by the subject.

[0016] The communication unit 42 communicates with the communication unit 33 of the information processing device 3 to transmit and receive data. Specifically, the communication unit 42 performs, for example, receiving a behavior data request from the information processing device 3, transmitting behavior data to the information processing device 3, and receiving a report from the information processing device 3. The display unit 43 is configured by a monitor, a terminal screen, or the like, and displays an input screen for the subject's behavior data as shown in FIG. 2, and a report received from the information processing device 3 as shown in FIG. 5.

[0017] The information processing device 3 is the behavior analysis device of the present disclosure, which is configured by a computer or the like, and includes, for example, an information storage unit 31, an arithmetic circuit unit 32, and a communication unit 33. The information storage unit 31 stores various programs and various types of information for controlling the information processing device 3. The arithmetic circuit unit 32 includes, for example, a CPU (Central Processing Unit) or the like, and realizes predetermined functions by reading and executing the programs stored in the information storage unit 31. In the present embodiment, the information storage unit 31 is provided with a vital data storage unit 311, a behavior data storage unit 312, an autonomic nerve storage unit 313, and a report data storage unit 314. In addition, the arithmetic circuit unit 32 functions as a vital data acquisition unit 321, a behavior data acquisition unit 322, an autonomic nerve estimation processing unit 323, an analysis processing unit 324, and a report generation unit 325 by reading and executing programs. Note that although an example is shown here in which the arithmetic circuit unit 32 functions as the vital data acquisition unit 321, the behavior data acquisition unit 322, the autonomic nerve estimation processing unit 323, the analysis processing unit 324, and the report generation unit 325 by reading and executing programs, for example, any or all of these functional configurations may be realized by a predetermined hardware configuration.

[0018] The information storage unit 31 is an information recording device configured by, for example, a memory, a hard disk, or the like.

[0019] The vital data storage unit 311 stores the vital data received by the vital data acquisition unit 321. The vital data storage unit 311 includes a pulse wave data storage unit 311A and a body motion data storage unit 311B. The pulse wave data storage unit 311A stores pulse wave data, and the body motion data storage unit 311B stores body motion data, respectively. The body movement data storage unit 311B may also pre-store body movement analysis data along with the body movement data. The body movement analysis data may include, for example, data used to classify exercise intensity levels, or data for estimating behavior based on fluctuations in body movement data, such as walking, running, lying down, and vehicle movement. The analysis processing unit 324 may use the body movement analysis data to classify the intensity of body movement into levels. Furthermore, the analysis processing unit 324 may process the body movement data into one of the following formats: a parameter indicating the intensity of body movement, a parameter indicating the duration of body movement at a predetermined intensity, or a parameter indicating the frequency of body movement at a predetermined intensity per unit time.

[0020] The behavior data storage unit 312 stores the behavior data received by the behavior data acquisition unit 322. The behavioral data storage unit 312 may store behavioral analysis data in addition to the behavioral data entered by the subject. The behavioral analysis data stores the behavioral state predicted by the state of the autonomic nervous system for the entered behavior. For example, the data for the behavioral state may include states such as being focused, lacking focus, or feeling sleepy during desk work or studying, or states such as being relaxed or tense during a meeting, and states related to the changes in the autonomic nervous system that can be expected depending on the behavior.

[0021] The autonomic nerve memory unit 313 stores autonomic nerve data generated by the autonomic nerve estimation processing unit 323, which will be described later. Furthermore, the autonomic nervous system memory unit 313 may also store autonomic nervous system analysis data in addition to pulse wave data and rMSSD data. Here, autonomic nervous system analysis data is data used to determine states such as relaxation and tension, which are classified based on fluctuations in autonomic nervous system data. The analysis processing unit 324 may use the autonomic nervous system analysis data to evaluate the state of the autonomic nervous system over time. For example, the content of this evaluation may include determining that a state of tension is observed if the sympathetic nervous system is increasing and the parasympathetic nervous system is decreasing, or that a state of relaxation is observed if the sympathetic nervous system is decreasing and the parasympathetic nervous system is increasing.

[0022] The report data storage unit 314 stores the report data generated by the analysis processing unit 324, which will be described later.

[0023] The communication unit 33 communicates with the communication unit 22 of the vital device 2 and the communication unit 42 of the behavior acquisition device 4 to send and receive data. The communication unit 33 may be connected to a network and may communicate with devices other than the vital device 2 and the behavior acquisition device 4.

[0024] The vital data acquisition unit 321 requests the vital device 2 to transmit vital data via the communication unit 33. When vital data is transmitted from the vital device 2, the vital data acquisition unit 321 receives the vital data from the communication unit 33 and stores the received vital data in the vital data storage unit 311.

[0025] The behavior data acquisition unit 322 requests the behavior acquisition device 4 to transmit behavior data via the communication unit 33. When behavior data is transmitted from the behavior acquisition device 4, the behavior data acquisition unit 322 receives the behavior data from the communication unit 33 and stores the received behavior data in the behavior data storage unit 312.

[0026] The autonomic nervous system estimation processing unit 323 generates autonomic nervous system data based on pulse wave data stored in the vital data storage unit 311. The autonomic nervous system data includes indicators for the parasympathetic nervous system and indicators for the sympathetic nervous system, and shows the temporal transition of the subject's autonomic nervous system. The indicators for the parasympathetic nervous system are generated, for example, by calculating rMSSD (root Mean Square of Successive Differences) based on the pulse interval. Specifically, rMSSD is the square root of the average of the squared differences between adjacent pulse intervals over a predetermined time period, and is a value that indicates the degree of change in the pulse interval over a predetermined time period. The autonomic nervous system estimation processing unit 323 may perform data processing as appropriate, such as selecting data by removing values ​​that may be abnormal (noise values) from the calculated rMSSD data set. The indicators for the sympathetic nervous system are generated, for example, by calculating from the average heart rate over a predetermined time period. Furthermore, the autonomic nerve data generated by the autonomic nerve estimation processing unit 323 is stored in the autonomic nerve memory unit 313.

[0027] The analysis processing unit 324 analyzes the state of the autonomic nervous system in relation to each action of the subject, based on the data stored in the body movement data storage unit 311B, the behavior data storage unit 312, and the autonomic nervous system storage unit 313, respectively.

[0028] Specifically, the analysis processing unit 324 performs a process to align and synchronize the time axes of the autonomic nervous system data, body movement data, and behavioral data. That is, the analysis processing unit 324 identifies the time when each behavior included in the behavioral data was performed. Then, the analysis processing unit 324 extracts the autonomic nervous system data and body movement data acquired during the same time period as the behavior from the autonomic nervous system memory unit 313 and the body movement data memory unit 311B, and associates them with each behavior. The data generated by the analysis processing unit 324, that is, the data including the behavior of each behavioral data and the autonomic nervous system data and body movement data associated with that behavior, is stored as report data in the report data storage unit 314.

[0029] The report generation unit 325 comprises a graph generation unit 325A and a comment generation unit 325B. The graph generation unit 325A generates a graph showing the relationship between changes in body movement data, autonomic nervous system data, and behavioral data, with time elapsed on the horizontal axis. Figure 4 shows an example of a graph generated by the graph generation unit 325A. In the upper section of Figure 4, the dotted line shows the change in heart rate, and the thick line shows the change in rMSSD. In the lower section of Figure 4, the thin line shows the change in body movement. The graph generation unit 325A also displays behavioral classifications 411, such as desk work, breaks, and meetings, within the graph for each corresponding time period. Supplementary data 412, such as presentations and brainstorming, is also displayed together with the behavioral classifications 411.

[0030] The comment generation unit 325B generates analysis comments and advice comments for each behavior analyzed by the analysis processing unit 324. Specifically, it generates analysis comments and advice comments based on the contents stored in the report data storage unit 314. The analysis comments may include the results of a correlation analysis between autonomic nervous system data and behavioral data. For example, table data containing analytical comments and advice comments for combinations of behavioral classification 411 (behavioral category), content of behavioral memos, changes in the sympathetic and parasympathetic nervous systems, and the degree of body movement is pre-stored in the information storage unit 31. Here, analysis comments are comments indicating the subject's state in relation to their behavior, derived from behavior classification 411, behavior memos, autonomic nervous system status changes, and degree of physical movement. On the other hand, advice comments, for example as shown in Figure 3, suggest improvements to the subject's behavior and autonomic nervous system state, such as, "After feeling nervous, try taking a break or a walk to help reset your autonomic nervous system," when tension is observed during a meeting.

[0031] Figure 3 shows an example of table data. The table data is a hierarchical (or tree) structured data that associates multiple behavioral notes (including items without behavioral notes), multiple sympathetic nervous system transition patterns, multiple parasympathetic nervous system transition patterns, and multiple body movement intensity patterns for each of the 411 behavioral classifications. Note that in Figure 3, for display purposes, only four combinations of behavioral notes, sympathetic nervous system transitions, parasympathetic nervous system transitions, body movement (intensity of body movement), and state (subject's mental state) are shown for each behavioral category. In reality, more combinations of behavioral notes (including those without notes), sympathetic nervous system transitions, parasympathetic nervous system transitions, and body movement intensity are stored for each behavioral category. Furthermore, for each of these combinations of behavioral classifications (411 behavioral categories), behavioral note content, sympathetic and parasympathetic nervous system transitions, and body movement intensity, the subject's mental state, analysis comments, and advice comments are stored. The comment generation unit 325B then creates comments based on the behavior data, which is associated with autonomic nervous system data and body movement data by the analysis processing unit 324, and the table data described above. Specifically, it extracts behavior memo analysis corresponding to the behavior classification 411 of the behavior data, the words included in the supplementary data 412, the changes in the autonomic nervous system (sympathetic and parasympathetic nerves) included in the autonomic nervous system data, analysis comments that match the degree of body movement included in the body movement data, and advice comments. The behavior memo is data arbitrarily entered by the subject, and the system detects whether it contains the same words as the behavior memo stored in the table data. If there is no behavior memo corresponding to the words included in the supplementary words, the system selects data without a behavior memo. The comment generation unit 325B extracts analysis comments from the table data based on the content of the report data as described above, and generates analysis comments for the report as shown in Figure 5. Although the report shown in Figure 5 is an example that includes only analysis comments, the comment generation unit 325B may also include advice comments.

[0032] Furthermore, the report generation unit 325 outputs the generated report (graphs, analysis comments, and advice comments) to a predetermined output device at a predetermined timing. Here, the predetermined output device can be set as appropriate by the subject. For example, the behavior acquisition device 4 may be set as the output device, the vital device 2 may be set, or any other device specified by the subject may be set. The timing for outputting the report generated by the report generation unit 325 can be set by the user as appropriate. For example, the system may be configured to send a report at the end time of a specified action (the end time set in relation to the action classification 411), or within a predetermined time from that end time. In this case, the subject inputs their future action plans and the start and end times of those actions as action data. As a result, the report generation unit 325 sends a report at the end time of that action, or within a predetermined time from that end time. When the report generation unit 325 outputs a report after an action, for example, after an action such as a meeting, travel, or sleep is input, it can output a report that associates that action with autonomic nervous system data. Here, at least one action data is sufficient for the report to be generated. For example, if one action data, such as a meeting, is input, it can generate analytical comments about the state of the autonomic nervous system during the meeting, such as whether the person was relaxed or showed signs of tension. This allows the system to understand the activity of the subject's sympathetic and parasympathetic nervous systems during the meeting after it has ended, and to grasp what kind of changes in the subject's autonomic nervous system occur in different situations. Furthermore, if one wants to know the effect of a meal on the sympathetic nervous system after eating, or check the changes in the parasympathetic nervous system due to walking or resting, the report can be easily reviewed.

[0033] Furthermore, if the information processing device 3 is collecting body movement data in real time, it may be configured to send a report at a time when the intensity of body movement falls below a predetermined level, within a predetermined time period from the end time of a predetermined activity. By monitoring vital data, it is possible to determine when the intensity of body movement falls below a predetermined level. Specifically, when body movement decreases after running or commuting, the system determines that the activity has ended and sends a report generated by the report generation unit 325. This allows users to review reports after exercise, or, for office workers, to detect when they are not walking and send a report notification.

[0034] Alternatively, the system can be configured to send reports at predetermined intervals. Examples of predetermined intervals include every night at 9 PM, every Sunday, or the 1st of every month. It could also be a time specified in advance by the user, such as 3 PM tomorrow. This allows for understanding the relationship between the autonomic nervous system and behavior within a defined time frame. Furthermore, it enables comparison of changes in the autonomic nervous system over multiple days, even for the same behavioral classification 411.

[0035] Furthermore, the report generation unit 325 may, for example, send the generated report to a predetermined output device such as the behavior acquisition device 4 when it receives a request to send a report from that output device. This allows the subject to review the report at any time that is convenient for them.

[0036] [Control method for behavioral analysis systems] Here, the control method of the behavioral analysis system 1 of this embodiment will be described. Figure 6 is a flowchart showing the operation of the vital device 2 of this embodiment. First, when the vital device 2 is attached to a person's body, it acquires the vital data of the subject (step S101). The vital data is stored in a memory unit (not shown) of the vital device 2. Next, the vital device 2 determines whether or not there is a request for vital data from the information processing unit 3 (step S102). If there is a request for vital data from the information processing unit 3, it determines YES. If there is no request for vital data from the information processing unit 3, it determines NO. If it is determined to be NO in step S102, it continues to perform step S102 and waits until there is a request for vital data from the information processing unit 3. If it was YES in step S102, in step S103, it transmits the vital data stored in the memory unit to the information processing unit 3 and terminates its operation. Note that the acquisition of vital data in step S101 may continue even during the operation from step S102 onward.

[0037] Next, we will explain the operation of the behavior acquisition device 4. Figure 7 is a flowchart showing the operation of the behavior acquisition device 4. First, the behavior acquisition device 4 acquires behavior data entered by the subject, as shown in Figure 2 (step S201). The behavior data acquired in step S201 is stored in a memory unit (not shown). Next, it determines whether or not there is a request for behavior data from the information processing unit 3 (step S202). If there is a request for behavior data from the information processing unit 3, it determines YES in step S202. If there is no request for behavior data from the information processing unit 3, it continues to perform step S202 and waits until there is a request for behavior data from the information processing unit 3. If it is determined to be YES in step S202, in step S203, it transmits the behavior data stored in the memory unit to the information processing unit 3 and terminates the operation.

[0038] Next, we will explain the operation of the information processing device 3. Figure 8 is a flowchart showing the operation of the information processing device 3. First, when the information processing device 3 receives a request for analysis processing from the subject, the vital data acquisition unit 321 requests the vital device 2 to transmit vital data via the communication unit 33 (step S301). Next, in response to the request in step S301, the vital device 2 transmits vital data in step S103, and the vital data acquisition unit 321 receives the vital data via the communication unit 33 (step S302). Here, the vital data consists of two types of data: pulse wave data over time and body movement data over time. Also in step S302, the vital data acquisition unit 321 stores the received vital data in the vital data storage unit 311. At this time, the pulse wave data is stored in the pulse wave data storage unit 311A, and the body movement data is stored in the body movement data storage unit 311B. Next, the autonomic nerve estimation processing unit 323 generates autonomic nerve data (step S303). Specifically, the autonomic nerve estimation processing unit 323 handles the pulse wave data stored in the pulse wave data storage unit 311A ​​and calculates rSMMD, which is an index of parasympathetic nerve displacement over time. The pulse wave data and the calculated rSMMD data are stored in the autonomic nerve storage unit 313 as autonomic nerve data. Next, the behavior data acquisition unit 322 sends a request for behavior data to the behavior acquisition device 4 (step S304). In response to the request in step S304, the behavior acquisition device 4 transmits behavior data in step S203, and the behavior data acquisition unit 322 receives the behavior data from the behavior acquisition device 4 via the communication unit 33 (step S305). The received behavior data is then stored in the behavior data storage unit 312. Next, the analysis processing unit 324 generates report data. Here, the analysis processing unit 324 performs a process to match the time at which the behavioral classification 411 of the behavioral data was performed with the time transitions of the autonomic nervous system data and body movement data (step S306). Specifically, the analysis processing unit 324 extracts autonomic nervous system data and body movement data acquired during the same time period as the time at which the behavioral classification 411 of the behavioral data was performed from the autonomic nervous system memory unit 313 and the body movement data memory unit 311B, and generates report data associated with each behavior. The report data generated in step S306 is stored in the report data memory unit 314. Next, the graph generation unit 325A generates a graph (as shown in Figure 4) that shows the subject's body movements, pulse wave, rSMMD, and behavioral content over time, based on the body movement data, autonomic nervous system data, and behavioral data (step S307). This graph may be generated for each behavior in the report data generated in step S306, or a graph along a time series that includes multiple behaviors or time axes where no behavioral data has been entered may be generated. Next, the comment generation unit 325B generates analysis comments based on the report data stored in the report data storage unit 314 (step S308). As described above, the comment generation unit 325B generates mental state, analysis comments, and advice comments for each behavior included in the behavior data, based on pre-set table data, for each combination of behavior classification 411, behavior memo, autonomic nervous system changes, and degree of body movement. The comment generation unit 325B may also generate advice comments in addition to analysis comments.

[0039] After this, the report generation unit 325 determines whether or not the timing for outputting the generated report, which has been set in advance for the target person, has arrived (step S309). Users of the behavioral analysis system 1 disclosed herein can, for example, during initial setup, send and register the output device to which the generated report will be sent, and the timing of the report's transmission, to the information processing device 3. This allows the report generation unit 325 to determine whether or not the report's output timing specified by the user has arrived. As mentioned above, the transmission timing to be set may be, for example, the end time of each action, or within a predetermined time from the end time of said action, or after the end time of each action when the intensity of the subject's body movement falls below a predetermined value, or it may be a predetermined cycle. Alternatively, it may be the timing when the subject operates a predetermined output device such as the action acquisition device 4 and requests the information processing device 3 to send a report.

[0040] If the result in step S309 is determined to be NO, the report generation unit 325 continues step S309 and waits until it is time to output. If the result in step S309 is determined to be YES, the report generation unit 325 sends the generated report (the graph generated in step S307 and the analysis comments and advice comments generated in step S308) to a predetermined output device registered by the subject, such as the behavior acquisition device 4 (step S310), and terminates the operation of the flowchart.

[0041] Next, we will explain the operation of the behavior acquisition device 4 when the output device to which the report is output is the behavior acquisition device 4. Figure 9 is a flowchart showing the operation of the behavior acquisition device 4. First, the behavior acquisition device 4 determines whether or not it has received a report output from the information processing device 3 at a predetermined output timing specified by the subject (step S401). If a report is received from the information processing device 3 in step S401, it determines YES. If a report is not received from the information processing device 3 in step S401, it determines NO and continues to wait until a report is received from the information processing device 3 in step S401. Next, the display unit 43 displays the report received in step S401 (step S402). Specifically, it displays the graph generated in step S307 and the analysis comments and advice comments generated in step S308 in a format that the user can recognize.

[0042] This concludes the flowcharts shown in Figures 6 to 9, and thus the control method for the behavioral analysis system 1 of this embodiment is complete.

[0043] [Effects of this embodiment] The information processing device 3 in the behavioral analysis system 1 of this embodiment includes a vital data acquisition unit 321 that acquires vital data including pulse wave information of the subject, a behavioral data acquisition unit 322 that acquires behavioral data related to the subject's behavior, an autonomic nerve estimation processing unit 323 that generates rMSSD, which is the square root of the average of the squared differences in adjacent pulse intervals at predetermined time intervals, as autonomic nerve data indicating the temporal transition of the subject's autonomic nerves based on the vital data, an analysis processing unit 324 that analyzes the state of the autonomic nerves in the behavior and generates report data based on the behavioral data and autonomic nerve data, and a report generation unit 325 that generates a report including analysis comments related to the behavior and the state of the autonomic nerves based on the report data. This information processing device 3 generates comments that relate the subject's behavior to the state of their autonomic nervous system. Therefore, it can facilitate an understanding of the subject's autonomic nervous system state in relation to their behavior.

[0044] In this embodiment, the analysis comments include the results of a correlation analysis between autonomic nervous system data and behavioral data. According to this behavioral analysis system 1, it is possible to generate analytical comments that make it easier to understand changes in the autonomic nervous system in response to behavior.

[0045] In this embodiment, vital data includes body movement data indicating the subject's body movements, and analysis comments are generated based on autonomic nervous system data, behavioral data, and body movement data. This behavioral analysis system 1 allows for the understanding of the autonomic nervous system state by considering the subject's body movements. It also enables the analysis of the relationship between behavioral data and body movement data. Therefore, it can provide more accurate analytical comments.

[0046] In this embodiment, the body movement data includes at least one of the following: a parameter indicating the intensity of body movement, a parameter indicating the duration of body movement at different intensities, and a parameter indicating the frequency per unit time at different intensities. This behavioral analysis system 1 can generate analytical comments tailored to the intensity of a subject's body movements. Furthermore, by generating analytical comments using data on the duration of each intensity of body movement, it can create comments that correlate the duration of each intensity of body movement with the subject's behavior. For example, if a period of low body movement continues for a long time, it can generate analytical comments indicating whether the subject is concentrating on desk work. Additionally, by using a parameter indicating frequency per unit of time, it can create analytical comments that correlate, for example, the frequency of exercise with behavior.

[0047] In this embodiment, the report generation unit 325 generates advice comments based on the report data that suggest improvements to behavior and autonomic nervous system status. This behavioral analysis system 1 can not only grasp information related to behavior and the autonomic nervous system, such as when a subject is stressed or tense, and when they are relaxed, but it can also encourage improvements in various situations. For example, it can generate advice comments on improving lifestyle and work based on the subject's autonomic nervous system state, such as regarding diet or work efficiency.

[0048] In this embodiment, the behavioral data includes data indicating a behavioral classification 411 related to the subject's behavior, from among a plurality of pre-set behavioral classifications 411. In this behavioral analysis system 1, analysis comments can be generated according to the behavioral classification 411 related to the subject's behavior. If the system uses the subject's input keywords instead of the behavioral classification 411 (i.e., the type of behavior) as behavioral data, differences in the expressions entered by each subject will occur, necessitating the analysis of the entered keywords, and increasing the data capacity of the table data used to generate comments on the behavior. In this embodiment, by pre-setting the behavioral classification 411, the subject's behavior can be appropriately determined and appropriate comments can be generated.

[0049] In this embodiment, the behavioral data includes behavioral classification 411, as well as supplementary data 412 that supplements the subject's state in behavioral classification 411. In this behavioral analysis system 1, the availability of supplemental behavioral data 412 allows for more detailed analysis based on the supplemental data 412, enabling the generation of more accurate analytical comments.

[0050] In this embodiment, the report generation unit 325 outputs the generated report to a predetermined output device (e.g., behavior acquisition device 4) at a timing predetermined by the subject. At this point, the report may be output within a specified time frame from the end time set in relation to behavior classification 411. In this case, the behavioral analysis system 1 can generate a report, for example, when the behavior is completed, allowing the subject to view the report in real time.

[0051] In this embodiment, the report generation unit 325 may output a report based on the body movement data when the intensity of the subject's body movement is below a predetermined intensity. In this type of behavioral analysis system 1, for example, a report can be generated and notified to the subject at a time when the behavior has settled down, such as when exercise has finished and the subject has calmed down, making it easier to encourage them to review the contents of the report.

[0052] In this embodiment, the report generation unit 325 may output reports at a predetermined interval. In such a behavioral analysis system 1, for example, it is possible to specify a time when the target person is most likely to review the report, and then provide the report at a desired time each day, such as generating the report at a specific time.

[0053] [Differentiation] The present invention is not limited to the embodiments described above, but also includes the following modifications to the extent that the objectives of the present invention can be achieved. For example, in the above embodiment, the terminal performing steps S201 to S203 in Figure 7 and the terminal performing steps S401 to S402 in Figure 9 may be the same or different terminals. Also, the terminal performing steps S301 to S310 in Figure 8 and the terminal of the action acquisition device 4 may be the same.

[0054] Furthermore, while an example was shown where the subject registers the report output timing in the information processing device 3 in advance as the timing for receiving the report in step S401, the method is not limited to this. For example, a predetermined output device, such as the behavior acquisition device 4, may determine the timing of report reception and, if it determines that it is time to receive the report, send request information to the information processing device 3 requesting the transmission of the report. In this case, the information processing device 3 transmits the generated report in response to the request information from the output device.

[0055] Furthermore, while the report content was generated based on data stored in the report data storage unit 314, the method of generating the report is not limited to this. For example, a generation AI may be used to generate a report relating the autonomic nervous system and behavior from pulse wave, rSMMD, and behavioral information.

[0056] Furthermore, in the above-described embodiment, the behavioral data was input by the subject, but it may also be generated by inferring the subject's behavior from vital data. That is, the information processing device 3 selects a behavioral classification 411 based on the subject's autonomic nervous system data and body movement data. For example, the subject's behavioral data may be generated as data representing a pre-defined behavioral classification 411, as shown in Figure 2, based on autonomic nervous system data and body movement data. Alternatively, the behavioral data may be inferred from pulse wave data and body movement data, such as running, sitting, sleeping, walking, or eating.

[0057] Furthermore, behavioral data may be inferred in combination with location information obtained from GPS (registered trademark), etc. Behavioral data may be generated, for example, by inferring the subject's actions, such as whether they are traveling by train or bicycle, based on GPS location information and body movement data. In addition, the behavioral classification 411 may be inferred by determining the location information from the Wi-Fi information to which the behavioral data acquisition unit 322 is connected. For example, if the behavioral acquisition device 4 is connected to the conference room's Wi-Fi, it may be considered that the person is in a meeting; if it is connected to the cafeteria's Wi-Fi, it may be considered that the person is eating. This allows for the generation of analytical comments relating behavior and the autonomic nervous system, even without inputting the subject's actions.

[0058] Furthermore, in the above-described embodiment, the information processing device 3 received vital data before receiving behavioral data, but this is not limited to this. For example, the information processing device 3 may receive behavioral data before receiving vital data. Also, vital data may be received and monitored periodically. In addition, the information processing device 3 may acquire behavioral data indicating future planned activities from the activity acquisition device 4. In this case, the information processing device 3 or the activity acquisition device 4 may request the vital device 2 to measure vital data and transmit the vital data to the information processing device 3 at the start time of the activity data, and request the cessation of vital data measurement and transmission to the information processing device 3 at the end time.

[0059] Furthermore, in the above-described embodiment, the subject input the behavioral classification 411 and supplementary data 412, but this is not limited to this, and someone other than the subject may input the subject's behavior. For example, in a patient monitoring system at a medical institution, a medical professional or other administrator may input the data, or in a performance management tool for athletes, a manager may input the data.

[0060] Furthermore, although the above embodiments were described using examples such as meetings and meals, the behavioral analysis system 1 of the present invention may be used in other situations as well. The behavioral analysis system 1 of the present invention may be applied, for example, as a health management application or as a stress management tool. In these cases, it can be used for the health and stress management of the subject, such as encouraging them to refresh themselves when they have been under stress for a long period of time, or notifying them if they have eaten a fatty meal or drunk excessively. Furthermore, the behavioral analysis system 1 of the present invention may be used, for example, as a patient monitoring system in a medical institution, or as a performance management tool for athletes. In these cases, the report results may be output to an output device held by staff such as doctors, rather than to the patient, who is the subject of the acquisition of vital data and behavioral data. This allows the results to be used for patient treatment or to improve the performance of athletes. Furthermore, in such cases, in addition to the pre-set behavioral classification 411, specialized behavioral classifications 411 may be pre-set for each field, such as exercise training menus, rehabilitation content, and types of medication. This allows for the output of highly accurate reports specialized in various fields.

[0061] [Summary of this disclosure] The behavioral analysis device according to this disclosure comprises: a vital data acquisition unit that acquires vital data including pulse wave information of a subject; a behavioral data acquisition unit that acquires behavioral data relating to the subject's behavior; an autonomic nerve estimation processing unit that generates autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the vital data; an analysis processing unit that analyzes the state of the autonomic nerves in the behavior and generates report data based on the behavioral data and the autonomic nerve data; and a report generation unit that generates a report including analysis comments related to the behavior and the state of the autonomic nerves based on the report data. This allows us to provide reports that show the relationship between the subject's behavior and the state of their autonomic nervous system.

[0062] In the behavioral analysis device according to the above embodiment, the analysis comments include the content obtained by correlation analysis between the autonomic nervous system data and the behavioral data. This allows us to provide easy-to-understand reports on changes in the autonomic nervous system in response to behavior.

[0063] In the behavioral analysis device according to the above embodiment, the vital data includes body movement data indicating the body movements of the subject, and the analysis comments are generated based on the autonomic nervous system data, the behavioral data, and the body movement data. This allows us to understand changes in the autonomic nervous system that take body movement into account, and to provide more accurate reports that capture both behavior and changes in the autonomic nervous system that take body movement into account.

[0064] In the behavioral analysis device according to the above embodiment, the body movement data includes at least one of the following: a parameter indicating the intensity of the body movement, a parameter indicating the duration of the body movement for each intensity, and a parameter indicating the frequency per unit time for each intensity of the body movement. This allows for the analysis of autonomic nervous system and behavior by classifying the intensity of the subject's body movements, the time progression of each intensity level, or the frequency of each intensity level, thereby providing a more accurate report.

[0065] In the behavioral analysis device according to the above embodiment, the report generation unit generates advice comments based on the report data that suggest improvements to the behavior and the state of the autonomic nervous system. This allows us to encourage improvement in the subject's behavior based on the changes in the autonomic nervous system caused by their actions.

[0066] In the behavioral analysis device according to the above embodiment, the behavioral data includes data indicating the behavioral classification relating to the subject's behavior from among a plurality of pre-set behavioral classifications. This allows participants to select from pre-defined behavioral categories and input behavioral data. Furthermore, it can provide reports that correlate the selected behavioral category with changes in the autonomic nervous system.

[0067] In the behavioral analysis device according to the above embodiment, the behavioral data includes data indicating a behavioral classification selected based on the subject's autonomic nervous system data and body movement data. This allows for the generation of behavioral data by inferring the subject's actions, eliminating the need for the subject to input their own behavioral data. Therefore, it reduces the burden on the subject.

[0068] In the behavioral analysis device according to the above embodiment, the behavioral data includes supplementary data that supplements the state of the subject in the behavioral classification, in addition to the behavioral classification. This allows for the generation of reports that incorporate supplementary data, enabling the provision of reports that analyze behavioral and autonomic nervous system changes in more detail.

[0069] In the behavioral analysis apparatus according to the above embodiment, the report generation unit outputs the generated report to a predetermined output device within a predetermined time from the end time of the behavior. This allows for real-time monitoring of behavior and changes in the autonomic nervous system.

[0070] In the behavioral analysis device according to the above embodiment, the vital data includes body movement data indicating the body movements of the subject, and the report generation unit outputs the generated report to a predetermined output device at a timing when the intensity of the subject's body movements is less than a predetermined intensity, based on the body movement data. This allows reports to be provided at a time when the subject is more likely to review them, such as when they have calmed down after exercise.

[0071] In the behavioral analysis method according to the above embodiment, the report generation unit outputs the generated report to a predetermined output device at a predetermined interval. This allows reports to be provided at the time desired by the target audience, making it easier to encourage them to review the reports.

[0072] The behavioral analysis system relating to this disclosure comprises a vital device that measures the pulse wave of a subject and stores it as vital data, a behavioral acquisition device that acquires behavioral data relating to the subject's behavior, and an information processing device, the information processing device comprising: a vital data acquisition unit that acquires the vital data from the vital device; a behavioral data acquisition unit that acquires the behavioral data from the behavioral acquisition device; an autonomic nerve estimation processing unit that generates autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the vital data acquired by the vital data acquisition unit; an analysis processing unit that analyzes the state of the autonomic nerves in the behavior and generates report data based on the behavioral data and the autonomic nerve data; and a report generation unit that generates a report including analysis comments related to the behavior and the state of the autonomic nerves based on the report data. This allows us to provide reports that show the relationship between the subject's behavior and the state of their autonomic nervous system.

[0073] The behavioral analysis method relating to this disclosure is a behavioral analysis method for analyzing the behavior of a subject, comprising: a first step in which a vital device measures the pulse wave of the subject and stores it as vital data; a second step in which a behavioral acquisition device acquires behavioral data relating to the subject's behavior; a third step in which an information processing device acquires the vital data from the vital device; a fourth step in which the information processing device acquires the behavioral data from the behavioral acquisition device; a fifth step in which the information processing device generates autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the acquired vital data; a sixth step in which the information processing device analyzes the state of the autonomic nerves in the behavior and generates report data based on the behavioral data and the autonomic nerve data; and a seventh step in which the information processing device generates a report including analysis comments related to the behavior and the state of the autonomic nerves based on the report data. This allows us to provide reports that show the relationship between the subject's behavior and the state of their autonomic nervous system.

[0074] The method for providing a report relating to this disclosure is a method for providing a report that includes analytical comments related to the behavior and autonomic nervous system state of a subject, using a vital device, an action acquisition device, and an information processing device, wherein the computer acquires vital data including the pulse wave of the subject from the vital device, acquires action data relating to the subject's actions from the action acquisition device, generates autonomic nervous system data showing the temporal transition of the subject's autonomic nervous system from the vital data, analyzes the state of the autonomic nervous system in the actions based on the action data and the autonomic nervous system data and generates report data, and generates a report that includes analytical comments related to the actions and the state of the autonomic nervous system based on the report data. This allows us to provide reports that show the relationship between the subject's behavior and the state of their autonomic nervous system. [Explanation of Symbols]

[0075] 1...Behavioral analysis system, 2...Vital device, 21...Sensor unit, 22...Communication unit, 3...Information processing unit, 31...Information storage unit, 311...Vital data storage unit, 311A...Pulse wave data storage unit, 311B...Body movement data storage unit, 312...Behavioral data storage unit, 313...Autonomic nerve storage unit, 314...Report data storage unit, 32...Calculation circuit unit, 321...Vital data acquisition unit, 322...Behavioral data acquisition unit, 323...Autonomic nerve estimation processing unit, 324...Analysis processing unit, 325...Report generation unit, 325A...Graph generation unit, 325B...Comment generation unit, 33...Communication unit, 4...Behavioral acquisition device, 41...Behavioral input unit, 411...Behavioral classification, 412...Supplementary data, 42...Communication unit, 43...Display unit.

Claims

1. A vital data acquisition unit that acquires vital data including pulse wave information of the subject, A behavioral data acquisition unit that acquires behavioral data related to the actions of the subject, An autonomic nerve estimation processing unit that generates autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the vital data, An analysis processing unit analyzes the state of the autonomic nervous system during the behavior and generates report data based on the behavioral data and autonomic nervous system data, A behavioral analysis device comprising: a report generation unit that generates a report including analytical comments related to the behavior and the state of the autonomic nervous system based on the report data.

2. The aforementioned analysis comments include the results of a correlation analysis between the autonomic nervous system data and the behavioral data. The behavioral analysis device according to claim 1.

3. The aforementioned vital data includes motion data showing the body movements of the subject, The aforementioned analysis comments are generated based on the autonomic nervous system data, the behavioral data, and the body movement data. The behavioral analysis device according to claim 2.

4. The aforementioned body movement data includes at least one of the following: a parameter indicating the intensity of the body movement, a parameter indicating the duration of the body movement at different intensities, and a parameter indicating the frequency per unit time at different intensities. The behavioral analysis device according to claim 3.

5. The report generation unit generates advice comments based on the report data, suggesting improvements to the behavior and the state of the autonomic nervous system. The behavioral analysis device according to claim 4.

6. The behavioral data includes data indicating the behavioral classification relating to the subject's behavior, from among a plurality of pre-set behavioral classifications. The behavioral analysis device according to claim 5.

7. The behavioral data includes data indicating a behavioral classification selected based on the subject's autonomic nervous system data and body movement data. The behavioral analysis device according to claim 5.

8. The behavioral data includes, in addition to the behavioral classification, supplementary data that supplements the status of the subject in the behavioral classification. The behavioral analysis device according to claim 6 or 7.

9. The report generation unit outputs the generated report to a predetermined output device within a predetermined time from the end time of the action. The behavioral analysis device according to claim 1.

10. The aforementioned vital data includes motion data showing the body movements of the subject, The report generation unit outputs the generated report to a predetermined output device at a timing when the intensity of the subject's body movement is below a predetermined intensity, based on the body movement data. The behavioral analysis device according to claim 1.

11. The report generation unit outputs the generated report to a predetermined output device at a predetermined interval. The behavioral analysis device according to claim 1.

12. A vital signs device that measures the pulse wave of a subject and stores it as vital data, A behavioral data acquisition device that acquires behavioral data regarding the actions of the subject, Equipped with an information processing device, The information processing device includes a vital data acquisition unit that acquires the vital data from the vital device, A behavioral data acquisition unit that acquires behavioral data from the behavioral data acquisition device, An autonomic nerve estimation processing unit generates autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the vital data acquired by the vital data acquisition unit, An analysis processing unit analyzes the state of the autonomic nervous system during the behavior and generates report data based on the behavioral data and autonomic nervous system data, A behavioral analysis system comprising: a report generation unit that generates a report including analytical comments related to the behavior and the state of the autonomic nervous system based on the report data.

13. A behavioral analysis method for analyzing the behavior of subjects, The vital device measures the pulse wave of the subject and stores it as vital data in the first step, The second step involves the behavioral data acquired by the behavioral data acquisition device for the subject's behavior, The information processing device performs a third step of acquiring the vital data from the vital device, The information processing device performs a fourth step of acquiring the behavior data from the behavior acquisition device, The fifth step involves the information processing device generating autonomic nerve data showing the temporal transition of the subject's autonomic nerves based on the acquired vital data, The information processing device performs a sixth step of analyzing the state of the autonomic nervous system during the behavior and generating report data based on the behavioral data and the autonomic nervous system data, A behavioral analysis method comprising: a seventh step in which the information processing device generates a report based on the report data, which includes analytical comments relating to the behavior and the state of the autonomic nervous system.

14. A method for providing a report that includes analytical comments related to a subject's behavior and autonomic nervous system state, using a vital sign device, an action acquisition device, and an information processing device, wherein a computer provides a report that includes analytical comments related to the subject's behavior and autonomic nervous system state. The computer acquires vital data, including the pulse wave of the subject, from the vital device. The behavioral data relating to the subject's behavior is acquired from the behavioral acquisition device. From the aforementioned vital data, autonomic nerve data showing the temporal transition of the subject's autonomic nerves is generated. Based on the aforementioned behavioral data and autonomic nervous system data, the state of the autonomic nervous system during the behavior is analyzed and report data is generated. A method for providing a report that generates a report including analytical comments related to the behavior and the state of the autonomic nervous system, based on the report data.

Images