Information processing program, information processing method, and information processing device

Abstract

To improve the accuracy of correction of vital data.SOLUTION: An information processing program causes a computer to execute: acquiring position data representing the position of a target person and vital data of the person, measured in time series by a radar; specifying a second period in which the magnitude of body movement satisfies a condition among a first period in which it is determined that the person has body movement, on the basis of the position data; and correcting the vital data corresponding to the second period among the vital data.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing program, an information processing method, and an information processing device. [Background technology]

[0002] The technology of measuring vital data such as heart rate and breathing using measuring devices such as sensors is called vital sensing. For example, contact sensors such as wearable devices and non-contact sensors such as cameras and radars are used for vital sensing.

[0003] Vital data may contain noise due to body movement. In the prior art, a technique is known that estimates whether or not noise has occurred based on data acquired from a non-vital sensor, and corrects vital data for a period in which it is estimated that noise has occurred. In addition, a technique is known that, when a portion of vital data is missing due to noise, interpolates the missing portion. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-137038 A [Patent Document 2] JP 2018-083014 A [Patent Document 3] JP 2020-195709 A Summary of the Invention [Problem to be solved by the invention]

[0005] Body movement is the movement of the body of a person to be measured. Body movement can be, for example, large body movement involving movement, or small body movement involving moving a part of the body in place without movement, depending on the magnitude of the body movement. However, in the conventional technology, regardless of the magnitude of the body movement, the vital data corresponding to the period in which the body movement occurred or the period in which the loss occurred is the subject of correction. Therefore, for example, the accuracy of the correction may be reduced, for example, the vital data corresponding to the period in which the large body movement occurred is corrected based on the vital data corresponding to the period in which the small body movement occurred.

[0006] In one aspect, the present invention aims to provide an information processing program, an information processing method, and an information processing device that can improve the accuracy of correcting vital data. [Means for solving the problem]

[0007] In one aspect, an information processing program is provided that causes a computer to execute a process of acquiring location data indicating the location of a target person and vital data of the person measured in a time series by radar, identifying a second period within a first period during which it has been determined that the person is moving based on the location data, in which the magnitude of the body movement satisfies a condition, and correcting the vital data corresponding to the second period.

[0008] In one aspect, there is provided an information processing method in which a computer executes a procedure similar to the processing based on the information processing program.

[0009] In one aspect, an information processing device that executes a process similar to the process based on the above information processing program is provided. Effect of the Invention

[0010] In one aspect, the accuracy of correction of vital data can be improved. [Brief description of the drawings]

[0011] [Figure 1]FIG. 1 is a diagram illustrating an example of a configuration of a vital sensing system according to an embodiment. [Diagram 2] FIG. 2 is an example of a functional block diagram illustrating a functional configuration of the information processing device according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of a period information DB according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the position of a person to be measured according to the embodiment. [Figure 5A] FIG. 5A is a diagram illustrating an example of a process for identifying a second period according to the embodiment. [Figure 5B] FIG. 5B is a diagram illustrating an example of a process for correcting vital data according to the embodiment. [Figure 5C] FIG. 5C is a diagram illustrating an example of a process for correcting vital data according to the embodiment. [Figure 6A] FIG. 6A is a diagram illustrating an example of an analysis of a psychological load according to the embodiment. [Figure 6B] FIG. 6B is a diagram illustrating an example of an analysis of a psychological load according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a screen displaying an analysis result according to the embodiment. [Figure 8] FIG. 8 is an example of a flowchart illustrating a process flow according to the embodiment. [Figure 9] FIG. 9 is an example of a flowchart illustrating a process flow according to the embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a hardware configuration of an information processing device according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an information processing program, an information processing method, and an information processing device according to the present invention will be described in detail with reference to the drawings. Note that these examples are merely examples for carrying out the present invention, and do not limit the present invention. In addition, in this embodiment, an embodiment for analyzing psychological stress from vital data showing changes in heart rate is described, but the vital data and the subject of analysis are not limited to the contents of this embodiment. EXAMPLES

[0013] [System Description] A vital sensing system according to the present embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining an example of the configuration of the vital sensing system according to the present embodiment. A vital sensing system 13 in which an information processing device 10 and a radar 11 are communicably connected via a network 12 is, for example, a system for acquiring vital data of a person 14 to be measured indoors, such as in a company or hospital.

[0014] The network 12 may be a wired or wireless communication network such as the Internet, an intranet, etc. As an example, the network 12 may be configured by a plurality of intranets, or the Internet and an intranet, etc., via a device such as a gateway.

[0015] The radar 11 is a device that emits a transmission wave toward a measurement target and receives the reflected wave to acquire information about the measurement target. In this embodiment, the radar 11 is a millimeter wave radar of a Frequency Modulated Continuous Wave (FMCW) type. In this embodiment, the radar 11 is a Multiple-input-multiple-output (MIMO) type that uses multiple transmission antennas and receiving antennas to virtually increase the number of receiving antennas. The radar 11 generates an Intermediate Frequency (IF) signal based on the transmission wave and the received reflected wave, converts the signal from an analog signal to a digital signal, and acquires In-Phase / Quadrature-Phase (IQ) data.

[0016] The radar 11 performs signal processing such as Fast Fourier Transform (FFT) on the acquired IQ data to acquire distance data, angle data, and speed data. As an example, the distance data is data indicating a time series change in the distance from the radar 11 to the reflection position of the reflected wave. The angle data is data indicating a time series change in the angle of the reflection position of the reflected wave as seen by the radar 11. The speed data is data indicating a time series change in the relative speed between the radar 11 and the reflection position of the reflected wave.

[0017] The radar 11 acquires vital data related to the heart rate and respiration of the person being measured. When the person being measured is stationary, the phase fluctuation of the time series of IQ data reflects minute movements of the skin caused by the heart rate, respiration, etc. Since the phase fluctuation includes fluctuations due to multiple causes such as the heart rate and respiration, the radar 11 calculates the phase fluctuation of the time series of IQ data and acquires individual vital data such as the heart rate and respiration by performing filter processing, frequency analysis, etc.

[0018] Unlike contact sensors such as wearable devices, non-contact sensors such as the radar 11 do not need to be attached to the body of the person to be measured. Therefore, the radar 11 is useful for measuring vital data for a long period of time without the person to be measured forgetting to wear it or the difficulty and inconvenience caused by wearing it. However, when the person to be measured moves, the radar 11 may not be able to obtain accurate vital data during the period when the body movement occurs. Body movement is the body movement of the person to be measured. The radar 11 measures the minute movement of the skin caused by breathing and heartbeat by calculating the amount of phase change between signals received in a time series, so that accurate vital data can be obtained when the person to be measured is almost stationary, but when body movement occurs, accurate phase change may not be calculated. Therefore, the radar 11 considers vital data during the period when body movement occurs to be missing, as an example. The radar 11 transmits the obtained distance data, angle data, and vital data to the information processing device 10.

[0019] The information processing device 10 is a device that acquires data such as vital data from the radar 11, corrects the vital data, and analyzes the corrected vital data. As an example, the information processing device 10 is a personal computer, a smartphone, a tablet terminal, or the like. The information processing device 10 acquires distance data, angle data, and vital data from the radar 11 via the network 12. The information processing device 10 acquires position data of the person to be measured based on the distance data and angle data. The information processing device 10 identifies a second period in which the magnitude of the body movement satisfies a condition among a first period in which it is determined that there is a body movement based on the position data. The information processing device 10 corrects the vital data corresponding to the second period. The information processing device 10 analyzes the psychological stress state of the person to be measured based on the corrected vital data.

[0020] [Functional configuration of information processing device 10] 2 is an example of a functional block diagram showing a functional configuration of the information processing device 10 according to the embodiment. The functional configuration of the information processing device 10 according to the embodiment will be described with reference to Fig. 2. The information processing device 10 has a communication unit 20, a control unit 21, a storage unit 22, and an output unit 23.

[0021] The communication unit 20 is a processing unit that controls communication with other devices, and is realized by a communication interface such as a network interface card (NIC). Through the communication unit 20, for example, distance data, angle data, position data, vital data, feature amount data, period information, corrected vital data, and analysis results are input and output.

[0022] The output unit 23 is a processing unit that controls the output from the information processing device 10 to the user, and is realized by, for example, a display. As an example, the analysis unit 212 displays an image showing the analysis result to the user via the output unit 23. As an example, the user is a user who obtains the analysis result such as the psychological stress of the person to be measured.

[0023] The storage unit 22 stores various data or various programs executed by the control unit 21. The storage unit 22 is realized by a main storage device such as a Random Access Memory (RAM) or an auxiliary storage device such as a Hard Disk Drive (HDD). The storage unit 22 stores, for example, a distance data DB220, an angle data DB221, a position data DB222, a vital data DB223, a feature amount data DB224, a period information DB225, a corrected vital data DB226, and an analysis result DB227.

[0024] The distance data DB 220 is a database that stores distance data. The distance data is time-series data including information indicating the distance from the radar 11 to the reflection position of the reflected wave. As an example, the distance is the distance in the depth direction of the reflection position of the reflected wave as seen from the radar 11.

[0025] The angle data DB 221 is a database that stores angle data. The angle data is data that indicates a time series change in the angle of the reflection position of the reflected wave as seen by the radar 11. As an example, the angle is the angle of the elevation angle and the azimuth angle of the reflection position of the reflected wave as seen by the radar 11.

[0026] The position data DB 222 is a database that stores position data. The position data is time-series data that represents the spatial position of the person to be measured in time series by the radar 11 in three-dimensional coordinates. As an example, the position data is data that indicates the position of the person to be measured when the abdomen of the person to be measured is set as the center of gravity of the point cloud. The position data will be described in detail later.

[0027] The vital data DB223 is a database that stores vital data. The vital data is data that indicates time series changes in the biological signals of the person being measured, measured in time series by the radar 11. As an example, the vital data is data that indicates the displacement of the skin due to the heartbeat or breathing of the person being measured. As an example, the vital data is data that indicates the phase displacement of the reflected wave due to the heartbeat or breathing of the person being measured. As an example, the vital data is waveform data. As an example, the vital data is vital data in which vital data corresponding to a first period is missing.

[0028] The feature amount data DB 224 is a database that stores feature amount data. The feature amount data is data that indicates a time series change in a feature amount of the vital data. As an example, when the vital data is waveform data, the feature amount data is data that indicates a time series change in a period, an amplitude, etc. of the waveform.

[0029] The period information DB225 is a database that stores information on a first period, a second period, and a third period. The first period is a period determined by the correction unit 211 to have a body movement. The second period is a period determined by the correction unit 211 to have a magnitude of the body movement satisfying a condition within the first period. As an example, the second period is a period determined by the correction unit 211 to have a small body movement. The second period is a period that is subject to correction by the correction unit 211. The third period is a period determined by the correction unit 211 to have a magnitude of the body movement that does not satisfy a condition. As an example, the third period is a period determined by the correction unit 211 to have a large body movement. The corrected vital data corresponding to the third period is excluded from the target of analysis by the analysis unit 212.

[0030] FIG. 3 is an example of a table stored in the period information DB 225. As an example, the table stored in the period information DB 225 stores in the date and time 30 the date and time corresponding to the period determined by the correction unit 211 to be the first period, and stores in the flag 31 a flag indicating whether each period corresponds to the second period or the third period. As an example, the flag is "second period: 0, third period: 1". As an example, the first period is a predetermined period including the date and time stored in the date and time 30 when the position data is generated every predetermined period. FIG. 3 is an example of a case where the predetermined period is 1 second. As an example, the first period is a period formed by consecutive dates and times when the dates and times determined to be the first period are consecutive. As an example, the second period is a predetermined period including the date and time corresponding to the second period among the dates and times stored in the date and time 30. As an example, the second period is a period formed by consecutive dates and times corresponding to the second period among the dates and times stored in the date and time 30. As an example, the third period is a predetermined period including a date and time that falls within the third period among the dates and times stored in date and time 30. As an example, the third period is a period formed by consecutive dates and times that fall within the third period among the dates and times stored in date and time 30.

[0031] The corrected vital data DB 226 is a database that stores corrected vital data. The corrected vital data is vital data obtained by correcting the vital data acquired from the radar 11 by the correction unit 211. The corrected vital data is vital data obtained by correcting the vital data for the second period by the correction unit 211.

[0032] The analysis result DB 227 is a database that stores the analysis results. The analysis results are data indicating the analysis results of the corrected vital data analyzed by the analysis unit 212. As an example, the analysis results are time-series data of the psychological stress state of the person to be measured.

[0033] Next, the control unit 21 will be described. The control unit 21 controls the overall processing of the information processing device 10. The control unit 21 is realized by a processor such as a Central Processing Unit (CPU), a Graphical Processing Unit (GPU), or a Digital Signal Processor (DSP) reading a program stored in a storage device, and expanding and executing the program in a main storage device such as a RAM. The control unit 21 may be realized by including an integrated circuit such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA). The control unit 21 has a data processing unit 210, a correction unit 211, and an analysis unit 212.

[0034] The data processing unit 210 is a processing unit that acquires various data from the radar 11. As an example, the data processing unit 210 acquires distance data from the radar 11 and stores it in the distance data DB 220. As an example, the data processing unit 210 acquires angle data from the radar 11 and stores it in the angle data DB 221. As an example, the data processing unit 210 acquires vital data from the radar 11 and stores it in the vital data DB 223. The data processing unit 210 is a processing unit that generates position data that indicates the position of a person to be measured. As an example, the data processing unit 210 acquires distance data from the distance data DB 220, acquires angle data from the angle data DB 221, and generates position data based on the distance data and the angle data. The data processing unit 210 stores the generated position data in the position data DB 222. Details of the position data will be described later.

[0035] The correction unit 211 acquires position data indicating the position of the person to be measured from the position data DB 222, and vital data of the person to be measured from the vital data DB 223. The correction unit 211 identifies a second period in which the magnitude of the body movement of the person to be measured satisfies a condition from the first period in which it is determined that the person to be measured has a body movement based on the position data, and corrects the vital data corresponding to the second period. As an example, the correction unit 211 determines that the person to be measured has a body movement based on the fluctuation of the coordinate values ​​of the position data, and identifies the first period. As an example, the correction unit 211 identifies a period in which the magnitude of the body movement of the person to be measured satisfies a condition that is equal to or less than a threshold as the second period. As an example, the correction unit 211 generates a sine wave corresponding to the second period based on feature amount data indicating the feature amount of the vital data, and corrects the vital data corresponding to the second period using the generated sine wave. As an example, when the vital data corresponding to the first period is missing, the correction unit 211 corrects the vital data corresponding to the second period among the missing data. As an example, the correction unit 211 identifies a third period in which the magnitude of the body movement does not satisfy the condition within the first period. As an example, the correction unit 211 does not correct the vital data corresponding to the third period among the vital data corresponding to the first period. The process of identifying the second period and the process of correcting the vital data corresponding to the second period will be described in detail later.

[0036] The analysis unit 212 is a processing unit that performs an analysis based on the corrected vital data. As an example, the analysis unit 212 acquires an analysis result obtained by analyzing the psychological stress state of the person to be measured based on the corrected vital data. As an example, the analysis unit 212 acquires corrected vital data from the corrected vital data DB 226 and information on the third period from the period information DB 225, and performs an analysis by excluding vital data corresponding to the third period from the corrected vital data. The analysis unit 212 stores the acquired analysis result in the analysis result DB 227. The analysis unit 212 acquires the analysis result from the analysis result DB 227, and displays an image showing the analysis result on a display or the like via the output unit 23. As an example, the analysis unit 212 displays the analysis result at a position where the person to be measured exists on a screen showing a space in which the person exists. Details of the process of analyzing the psychological stress state and the screen displaying the analysis result will be described later.

[0037] [About location data] The position data will be described with reference to FIG. 4 and FIG. 5A. The position data is time series data that represents the position of a person to be measured in space in three-dimensional coordinates. First, an example of the position of a person to be measured in space will be described with reference to FIG. 4. FIG. 4 is an example of a diagram that represents the space in which a person to be measured exists in three-dimensional coordinates. In this embodiment, in the space in which a person to be measured exists, the direction parallel to the radar 11 is the x-axis, the direction perpendicular to the radar 11 is the y-axis, and the direction that is the depth of the radar 11 is the z-axis. As an example, if the abdomen of the person 14 is the position 40 that is the center of gravity of the point cloud, the x-coordinate, y-coordinate, and z-coordinate corresponding to the position 40 are coordinates that represent the position of the person 14, and the position data DB 222 stores the values ​​of each coordinate of the position 40. As an example, the graph 50 in FIG. 5A is an example of a graph that represents the time change of the x-coordinate of the position data, where the horizontal axis indicates time t and the vertical axis indicates the coordinate of the x-axis.

[0038] [Process to identify the second period] With reference to Fig. 5A, a process of identifying a first period from the presence or absence of body movement based on position data in correction unit 211 and identifying a second period in which the magnitude of body movement satisfies a condition based on the position data will be described. Fig. 5A is a diagram illustrating an example of a process of identifying a second period according to an embodiment. First, a process of identifying a first period by correction unit 211 will be described. Graph 50 in Fig. 5A is an example of a graph showing a time change in the x-coordinate of the position data. Since the position data is three-dimensional data, the relationship between the position data and body movement will be described using the time change on the x-axis as an example.

[0039] When there is no body movement of the person to be measured, in other words, when the person to be measured is almost still, there is no change in the position of the person to be measured, and the x coordinate shows a constant value as in period 500 and period 502. On the other hand, when there is body movement of the person to be measured, the position of the person to be measured changes, and therefore the x coordinate changes as in period 501 and period 503. In this way, the correction unit 211 determines whether or not there is body movement of the person to be measured based on the change in the coordinate value. As an example, the correction unit 211 determines that there is body movement of the person to be measured when there is a change in the value of at least one of the x coordinate, the y coordinate, and the z coordinate. The correction unit 211 specifies the period in which it is determined that there is body movement as a first period, and stores the date and time corresponding to the first period in the date and time 30 of the period information DB 225.

[0040] Graph 51 in FIG. 5A is a graph showing an example of vital data, and is a graph showing the time variation of the heart rate. The horizontal axis indicates time, and the vertical axis indicates the displacement of the skin due to the heart rate. In graph 51, the waveform of the vital data appears in periods 500 and 502 when the person to be measured is almost still. Meanwhile, in graph 51, the vital data corresponding to periods 501 and 503, which are the first periods, is missing. In this embodiment, the graph of the missing portion is drawn so that the value immediately before the missing period and the value immediately after the missing period are continuous.

[0041] Next, the process of the correction unit 211 for identifying the second period will be described. The correction unit 211 determines the magnitude of the body movement of the person to be measured based on the position data during the first period in which it is determined that there is a body movement. As an example, the correction unit 211 determines large body movement and small body movement. As an example, the large body movement is a body movement that accompanies the movement of the person to be measured. As an example, the large body movement is a body movement caused by a walking motion or a running motion. As an example, the small body movement is a body movement that does not accompany the movement of the person to be measured. As an example, the small body movement is a body movement caused by a motion of stretching an arm or a motion of swinging a leg.

[0042] As an example, the correction unit 211 calculates the total amount of body movement per predetermined period, the distance traveled per predetermined period, the length of the period during which body movement occurred within the predetermined period, the difference in coordinate values ​​before and after body movement when body movement occurred, and the like based on the position data, and determines the magnitude of body movement. As an example, the correction unit 211 specifies a period as a period during which small body movement occurred when the position deviation from the position of the previous predetermined period is equal to or less than a threshold. As an example, the threshold is 30 cm. As an example, the correction unit 211 calculates the total amount of body movement from the total amount of positional fluctuation during the predetermined period, and determines that small body movement occurred during the period when the total amount of body movement is equal to or less than the threshold. The correction unit 211 specifies the period during which it is determined that small body movement occurred as the second period. In this way, the correction unit 211 determines whether or not a condition regarding the magnitude of body movement is satisfied, and specifies the period as the second period when the condition is satisfied. As an example, the correction unit 211 specifies the period as the second period when the magnitude of body movement is equal to or less than a threshold. 5A, period 501 is an example of the second period. Correction unit 211 refers to period information DB 225 and sets a flag of "0" to the date and time corresponding to the identified second period.

[0043] When the magnitude of the body movement does not satisfy the condition, the correction unit 211 specifies the period as a third period. In Fig. 5A, a period 503 is an example of the third period. The correction unit 211 refers to the period information DB 225 and sets a flag of "1" to the date and time corresponding to the specified third period.

[0044] [Regarding the process of correcting vital data] 5B and 5C, a process of correcting vital data corresponding to the second period in the correction unit 211 will be described. FIGs. 5B and 5C are diagrams for explaining an example of a process of correcting vital data according to an embodiment.

[0045] The correction unit 211 acquires vital data from the vital data DB 223. The correction unit 211 generates feature amount data indicating the feature amount of the vital data based on the vital data. As an example, the feature amount is the interval between peaks of the heartbeat (RR interval), or the period and amplitude of a waveform indicating breathing or the heartbeat. Graph 52 in FIG. 5B is an example of a graph of feature amount data, and is a graph indicating the period of the heartbeat. Since the feature amount data is generated based on the vital data, the feature amount data corresponding to the first period that is missing in the vital data is missing. The correction unit 211 stores the generated feature amount data in the feature amount data DB 224.

[0046] The correction unit 211 generates feature amount data for the second period based on feature amount data for a predetermined period before and after the second period. As an example, the correction unit 211 generates feature amount data corresponding to the second period by performing spline interpolation or linear interpolation using feature amount data for a predetermined period before and after the second period. Graph 53 in FIG. 5C is an example of a graph in which feature amount data corresponding to the second period is generated.

[0047] The correction unit 211 generates a sine wave corresponding to the second period based on the feature amount data corresponding to the second period, and corrects the vital data corresponding to the second period. As an example, the correction unit 211 generates a sine wave for the second period based on the continuity of the period and amplitude represented in the feature amount data, and corrects the vital data by using the generated sine wave as the vital data for the second period. The graph 54 in FIG. 5C is an example of a graph in which the vital data corresponding to the second period is corrected. As an example, the correction unit 211 does not correct the vital data corresponding to the third period. The correction unit 211 stores the corrected vital data, which is the vital data after correction, in the corrected vital data DB 226.

[0048] [About analysis processing] 6A and 6B are diagrams for explaining an example of a process for analyzing vital data according to the embodiment. An example of a process for analyzing vital data in the analysis unit 212 will be described with reference to FIG. 6A and FIG. 6B. In this embodiment, an analysis for estimating psychological stress by frequency analysis of heart rate fluctuations is described. As an example, the analysis unit 212 separates the heart rate fluctuations into a low frequency (LF, Low Frequency) component of 0.04 to 0.15 Hz and a high frequency (HF, High Frequency) component of 0.15 to 0.40 Hz, and estimates psychological stress using the area ratio of the regions of each component as an index value. FIG. 6A is an example of a power spectrum diagram obtained by performing FFT on time series data of heart rate fluctuations. Region 60 indicates the region of the LF component, and region 61 indicates the region of the HF component. As an example, the index value of psychological stress is calculated by Equation (1).

[0049] Index value = area of ​​LF component region / area of ​​HF component region Equation (1) 6B is an example of time series data of index values ​​of psychological stress. The horizontal axis indicates time, and the vertical axis indicates index values. As an example, if the threshold 62 at which the sympathetic nervous system is determined to be dominant is 2.0, the index value in a period 63 exceeds 2.0, and therefore, it is estimated that the psychological stress is high during that period.

[0050] Thus, to calculate an index value from the time series data of heart rate fluctuations, continuous data of up to 25 seconds, which corresponds to 0.04 Hz, the cutoff frequency of the LF component, is required. However, the vital data acquired by the radar 11 will be missing during periods of bodily movement. Since small bodily movements such as shaking the body tend to occur more frequently than large bodily movements such as walking, there are frequent gaps in data due to small bodily movements, and it may not be possible to acquire continuous data for the period required for analyzing the psychological stress state.

[0051] In the prior art, a technique is known that estimates whether noise has occurred based on data acquired from a non-vital sensor, and corrects vital data for a period in which noise is estimated to have occurred. Also, a technique is known that, when a portion of vital data is missing due to noise, interpolates the missing portion.

[0052] However, in the conventional technology, the period in which the body movement occurred or the period in which the loss occurred is the subject of correction regardless of the magnitude of the body movement. Therefore, for example, the accuracy of the correction may be reduced, for example, by correcting vital data corresponding to a period in which a large body movement occurred based on vital data corresponding to a period in which a small body movement occurred.

[0053] On the other hand, the information processing device 10 identifies a period of small body movement based on the position data, and corrects the vital data for the period corresponding to the period of small body movement based on the vital data before and after the period of small body movement. The information processing device 10 does not correct the vital data for the period of large body movement, and does not use it for analysis. This allows the information processing device 10 to improve the accuracy of the correction of the vital data. Even when using vital data in which loss occurs due to body movement, the information processing device 10 can correct the data and estimate the psychological stress state. The information processing device 10 can improve the accuracy of the analysis of the vital data.

[0054] [Screen example] With reference to FIG. 7, an example of a screen displaying the analysis result according to the embodiment will be described. FIG. 7 is a diagram for explaining an example of a screen displaying the analysis result according to the embodiment. As an example, the analysis unit 212 visualizes the psychological stress state of employees in a company using the analysis result. By visualizing the psychological stress of an employee, a user can estimate the suitability of the employee for the current work, such as whether the current work is suitable for the employee, and the quality of the work environment. With reference to FIG. 7, an example of a usage scene in which a user estimates the quality of the work environment by visualizing the psychological stress will be described. As an example, the user is an employee of a department that manages the work environment. FIG. 7 is an example of a screen in which the psychological stress of employees in the workplace is visualized. FIG. 7 is an example of a schematic diagram of a workplace viewed from the ceiling direction, in which each circle 73 indicates the position of an employee, and the pattern of the circles indicates the psychological stress of each employee, in other words, the stress state. As an example, as shown in Table 71, the stress state of each employee is expressed in five stages, and the higher the number, the higher the stress.

[0055] The analysis unit 212 displays on a display or the like a screen that visualizes the position of each employee and the stress state of each employee based on the analysis results, as shown in Fig. 7. Based on the visualized analysis results, the user can estimate the influence that the work environment has on the psychology of employees, for example, that employees closer to the door 72 have high stress and employees closer to the window 70 have low stress. By removing the estimated causes of psychological stress, the user can improve the work environment, leading to improved mental health of employees.

[0056] As an example, the analysis unit 212 uses the analysis results to visualize the psychological stress state of an inpatient in a hospital or a resident in a nursing home. Inpatients and residents need to live with others in an environment different from the environment they have been living in, and this may increase their psychological stress. By visualizing the psychological stress, the user can identify the event that is causing the psychological stress and remove the event, thereby reducing the impact of the psychological stress on the health of the inpatient or resident. As an example, the user is an employee of a hospital or a nursing home. In addition, in hospitals and nursing homes, vital data such as heart rate and breathing are also useful for detecting abnormalities in inpatients and residents. By using this embodiment, continuous vital data can be obtained by correction even when small body movements occur, such as when going to bed. In this embodiment, position data can also be obtained by the sensor that obtains the vital data, so that behavior of the person to be measured, such as falling from the bed or moving from the bed, can also be detected. In addition, when vital data is constantly measured, this embodiment does not obtain video, so consideration can be given to privacy, and psychological resistance to installing a camera can be reduced.

[0057] [flowchart] 8 and 9 are examples of flowcharts illustrating the flow of processing according to the embodiment. First, with reference to Fig. 8, the overall flow of processing in which the information processing device 10 corrects and analyzes vital data will be described.

[0058] The data processing unit 210 acquires distance data, angle data, and vital data from the radar 11, and stores them in the distance data DB 220, angle data DB 221, and vital data DB 223 (step S100).

[0059] The data processing unit 210 acquires distance data from the distance data DB 220 and angle data from the angle data DB 221, and generates position data (step S101). The data processing unit 210 stores the generated position data in the position data DB 222.

[0060] The correction unit 211 identifies a second period from the position data, and corrects the vital data corresponding to the second period (step S200). The details of the process flow of step S200 will be described later. The correction unit 211 stores the corrected vital data in the corrected vital data DB 226.

[0061] The analysis unit 212 acquires the corrected vital data from the corrected vital data DB 226 and performs the analysis of the psychological stress (step S102). The analysis unit 212 refers to the period information DB 225, and performs the analysis by excluding the vital data corresponding to the period corresponding to the third period, in other words, the period in which the flag of the flag 31 is "1". As an example, an analysis using the vital data of the heart rate fluctuation will be described. The analysis unit 212 performs frequency analysis on the vital data of the heart rate fluctuation and separates it into an LH component and an HF component. The analysis unit 212 calculates an index value based on the ratio of the area of ​​the LF component region to the area of ​​the HF component region, and generates an analysis result that estimates the psychological stress state of the person to be measured. The analysis unit 212 stores the analysis result in the analysis result DB 227. As an example, the analysis unit 212 performs the analysis when a predetermined time comes. As an example, the analysis unit 212 performs the analysis when the corrected vital data for a predetermined period such as 24 hours is accumulated. The analysis unit 212 acquires the analysis results from the analysis result DB 227, and displays a screen showing the analysis results on a display or the like via the output unit 23.

[0062] Next, an example of the process flow of step S200 will be described with reference to Fig. 9. First, the correction unit 211 acquires position data from the position data DB 222 (step S201).

[0063] Based on the position data, the correction unit 211 determines whether or not there is a body movement during the period during which the data was acquired, in other words, whether or not the period is a first period (step S202). When the correction unit 211 determines that there is no body movement during the period, in other words, that the period is not a first period (step S202 No), the correction unit 211 acquires vital data for the period from the vital data DB 223 and calculates a feature amount of the vital data (step S203). The correction unit 211 stores the calculated feature amount in the feature amount data DB 224 as feature amount data.

[0064] The correction unit 211 refers to the period information DB 225 and determines whether the period before the period is the second period (step S204). When the period before the period is the second period, in other words, when the flag of the flag 31 is "0" (step S204 Yes), the correction unit 211 acquires feature amount data from the feature amount data DB 224, generates feature amount data corresponding to the second period, and generates a sine wave corresponding to the second period (step S205). As an example, when a period corresponding to the second period is continuous up to the period before the period, the correction unit 211 generates feature amount data corresponding to the continuous period and generates a sine wave corresponding to the second period. The correction unit 211 inserts the generated sine wave into the data corresponding to the second period of the vital data and corrects it to generate corrected vital data (step S206). The correction unit 211 stores the generated corrected vital data in the corrected vital data DB 226.

[0065] Correction unit 211 ends the process of step S200 if the period before the relevant period is not the second period, in other words, if the flag of flag 31 is "1" or if it is not stored in date and time 30 (step S204 No).

[0066] When the correction unit 211 determines based on the position data that the period during which the data was acquired is the first period (Yes in step S202), the correction unit 211 stores the date and time corresponding to the period in the date and time 30 of the position information DB, and determines whether the magnitude of the body movement during the period satisfies a condition (step S207). As an example, the correction unit 211 determines whether the magnitude of the body movement during the period is small. As an example, when the correction unit 211 determines that the magnitude of the body movement satisfies the condition (Yes in step S207), in other words, when the correction unit 211 determines that the magnitude of the body movement is equal to or smaller than a threshold and is small, it specifies the period as the second period. The correction unit 211 sets the flag of "0" for the period in the flag 31 of the period information DB 225, and sets the period as the second period (step S208). When the correction unit 211 determines that the magnitude of the body movement does not satisfy the condition (step S207 No), in other words, when the correction unit 211 determines that the magnitude of the body movement is greater than the threshold and is not a small body movement, it specifies the period as the third period. The correction unit 211 sets the flag of the period in the flag 31 of the period information DB 225 to "1" and sets the period as the third period (step S209).

[0067] As an example, the information processing device 10 repeats the process from step S100 to step S200 every predetermined period based on radar data measured every predetermined period. As an example, the radar acquires various data every 0.1 seconds, and the information processing device 10 repeats the process from step S100 to step S200 every second.

[0068] [Variations] Although the embodiments of the present invention have been described above, the present invention may be embodied in various different forms other than the above-described embodiments.

[0069] The radar 11 is not limited to the millimeter wave radar of the type used in this embodiment. The radar 11 may be a millimeter wave radar of another type, or may be a radar using microwaves. The information processing device 10 may directly acquire various data from the radar through a communication interface such as Wi-Fi (registered trademark) or Universal Serial Bus (USB) without going through a network. The information processing device 10 may acquire IQ data from the radar, perform signal processing, and acquire distance data, angle data, speed data, and vital data. The period in which the body movement of the vital data occurs may include noise instead of missing data. The information processing device 10 may acquire speed data from the radar 11 and use it to calculate position data, etc. The analysis of the vital data may be performed by a device other than the information processing device 10. The analysis result may be output from a device other than the information processing device 10.

[0070] [effect] As described above, the information processing device 10 acquires position data indicating the position of the target person and vital data of the target person measured in time series by the radar 11. Based on the position data, the information processing device 10 identifies a second period in which the magnitude of the body movement satisfies a condition among the first period in which it is determined that the target person has a body movement. The information processing device 10 corrects the vital data corresponding to the second period among the vital data. As a result, the information processing device 10 can correct the vital data corresponding to the second period based on the vital data acquired while the person is stationary, and therefore the accuracy of the correction of the vital data can be improved. Even when using vital data in which a loss occurs due to body movement, the information processing device 10 can correct the data and estimate the psychological stress state. The information processing device 10 can improve the accuracy of the analysis of the vital data. In addition, by using a radar as a sensor, the position data and vital data can be acquired from one sensor device. The information processing device 10 enables measurement with privacy secured compared to the case of installing a camera.

[0071] The information processing device 10 may specify, as the second period, a period that satisfies a condition that the magnitude of the body movement is equal to or less than a threshold value. This allows the information processing device 10 to specify, as the second period, a period in which the body movement is small.

[0072] As an example, the position data is data in which the position of a person in a space in which the person exists is expressed by three-dimensional coordinates, and the first period is a period during which it is determined that the person has a body movement based on the fluctuation of the coordinate values. This allows the information processing device 10 to determine the presence or absence of a body movement from the position data.

[0073] As an example, the information processing device 10 may generate a sine wave corresponding to the second period based on feature amount data indicating the feature amount of the vital data, and correct the second period using the generated sine wave. This allows the information processing device 10 to estimate a waveform corresponding to the second period based on the state of change in the vital data, and perform correction. This allows the information processing device 10 to improve the accuracy of correction.

[0074] The information processing device 10 identifies a third period in which the magnitude of body movement does not satisfy the condition within the first period based on the position data, and does not need to correct the vital data corresponding to the third period among the vital data corresponding to the first period. This allows the information processing device 10 to improve the accuracy of correction and analysis.

[0075] As an example, the vital data is vital data in which vital data corresponding to a first period is missing, and the information processing device 10 may correct the vital data corresponding to a second period from among the missing periods. This allows the information processing device 10 to obtain vital data with reduced missing data.

[0076] The information processing device 10 may obtain a result of analyzing the psychological stress of the target person based on the corrected vital data. The information processing device 10 may display the analysis result at the position where the target person exists on a screen showing the space where the target person exists. In this way, the information processing device 10 can visualize the psychological stress state of the target person.

[0077] [Hardware configuration] Fig. 10 is a diagram illustrating an example of a hardware configuration of an information processing device according to an embodiment. An example of the hardware configuration of the information processing device 10 will be described with reference to Fig. 10. As illustrated in Fig. 10, the information processing device 10 includes, as an example, a CPU 100, a RAM 101, an input / output interface 102, a communication interface 103, and a HDD 104 as components, and these components are connected via a bus 105.

[0078] The CPU 100 is a processor that operates a process that executes each function of the control unit 21. Specifically, the CPU 100 reads out a program that executes the same functions as the data processing unit 210, the correction unit 211, and the analysis unit 212 from the HDD 104 or the like, develops the program in the RAM 101 or the like, and executes a process that executes the functions of the data processing unit 210, the correction unit 211, and the analysis unit 212. The CPU 100 may obtain the above program and data used when executing the above program from a medium reading device, or may obtain the data via the communication interface 103. The CPU 100 may have one or more processor cores. The information processing device 10 may be provided with a processor other than a CPU, or may be provided with multiple types of processors.

[0079] The RAM 101 operates as a main storage device of the information processing device 10, and stores programs read from an auxiliary storage device such as the HDD 104, data used to execute the programs, etc. The information processing device 10 may include a memory other than the RAM, or may include multiple memories.

[0080] The input / output interface 102 is an interface that inputs signals to the information processing device 10 and outputs signals from the information processing device 10. As an example, the input / output interface 102 receives signals from input devices such as a keyboard or a mouse connected to the information processing device 10, and transmits signals such as images to output devices such as a display connected to the information processing device 10. A plurality of input devices and output devices may be connected to the information processing device 10 via the input / output interface 102.

[0081] The communication interface 103 is an interface for connecting the information processing device 10 to a network. As an example, the standard of the communication interface 103 may be a communication standard for a wired LAN such as Ethernet (registered trademark), a communication standard for a wireless LAN such as WiFi, or a wireless standard for mobile communication such as local 5G.

[0082] The HDD 104 operates as an auxiliary storage device for storing programs for executing the functions of the operating system (OS) and the control unit 21 of the information processing device 10 and data used by the programs. The information processing device 10 may be provided with an auxiliary storage device other than an HDD, such as a solid state drive (SSD), or may be provided with multiple auxiliary storage devices.

[0083] Although the embodiments of the present invention have been described above, the embodiments of the present invention are not limited to those described above. The present invention may be embodied in various different forms other than the above-described embodiments.

[0084] The processing procedures, processing methods, names of parts, various data, etc. shown in the embodiments and drawings are merely examples and may be changed arbitrarily unless otherwise specified.

[0085] The functional configurations and hardware configurations shown in the embodiments and drawings are merely examples, and therefore may not necessarily be configured or arranged as shown in the drawings, and may be changed as desired unless otherwise specified. For example, the components of the functional configurations and hardware configurations may be distributed or integrated in any unit, such as a function.

[0086] The information processing program according to the embodiment is not limited to being executed by the information processing device 10. For example, the information processing program according to the embodiment may be executed across a plurality of devices.

[0087] The information processing program according to the embodiment may be distributed via a network such as the Internet. The information processing program according to the embodiment may be recorded on a computer-readable recording medium and sold. Examples of the computer-readable recording medium include a Compact Disc Read Only Memory (CD-ROM), a Digital Versatile Disc (DVD), a USB memory, a floppy disk, and a Magneto-Optical Disk (MO). The information processing program according to the embodiment may be read from the computer-readable recording medium by a computer and executed by the computer. [Explanation of symbols]

[0088] 10. Information processing device 11. Radar 12 Network 13 Vital Sensing System 14 People 20 Communications Department 21 Control section 22 Memory section 23 Output section 210 Data Processing Unit 211 Correction section 212 Analysis Department 220 Distance Data DB 221 Angle Data DB 222 Location Data DB 223 Vital Data DB 224 Feature Data DB 225 Period information DB 226 Corrected Vital Data DB 227 Analysis result DB

Claims

1. acquiring position data indicating the position of a target person and vital data of the person, the position data being measured in time series by a radar; identifying a second period during which a magnitude of the body movement of the person satisfies a condition from a first period during which the person's body movement is determined to occur based on the position data; Among the vital data, the vital data corresponding to the second period is corrected. An information processing program that causes a computer to execute processing.

2. The condition is a condition in which the magnitude of the body movement is equal to or smaller than a threshold value. The information processing program according to claim 1 .

3. the position data is data expressing a position of the person in a space in which the person exists, using three-dimensional coordinates; The first period is a period during which it is determined that the person has a body movement based on a change in the coordinate value. The information processing program according to claim 1 .

4. The correction process is a process of generating a sine wave corresponding to the second period based on feature amount data indicating a feature amount of the vital data, and correcting the vital data corresponding to the second period using the sine wave. The information processing program according to claim 3.

5. identifying a third period within the first period in which the magnitude of the body movement does not satisfy the condition based on the position data; In the correction process, among the vital data corresponding to the first period, the vital data corresponding to the third period is not corrected. The information processing program according to claim 1 .

6. The vital data is vital data in which vital data corresponding to the first period is missing, The correction process is a process of correcting vital data corresponding to the second period of the loss. The information processing program according to claim 1 .

7. obtaining an analysis result of the psychological stress of the person based on the corrected vital data; The analysis result is displayed at a position where the person exists on a screen showing a space where the person exists. The information processing program according to claim 1 .

8. acquiring position data indicating the position of a target person and vital data of the person, the position data being measured in time series by a radar; identifying a second period during which a magnitude of the body movement of the person satisfies a condition from a first period during which the person's body movement is determined to occur based on the position data; Among the vital data, the vital data corresponding to the second period is corrected. An information processing method in which processing is performed by a computer.

9. acquiring position data indicating the position of a target person and vital data of the person, the position data being measured in time series by a radar; identifying a second period during which a magnitude of the body movement of the person satisfies a condition from a first period during which the person's body movement is determined to occur based on the position data; Among the vital data, the vital data corresponding to the second period is corrected. An information processing device having a control unit.

Images