Information processing method and information processing system

Abstract

The information processing method comprises the following steps: receiving a variation coefficient of a CVRR, namely an R-R interval, of a user and LF / HF, namely low frequency / high frequency, of the user, or calculating the CVRR and the LF / HF; and performing, by a processor, a determination process of determining which of a convergent thinking state, a divergent thinking state, and a relaxed state is a state related to thinking of the user based on the CVRR and the LF / HF.

Description

Technical Field

[0001] The present disclosure relates to an information processing method and an information processing system. Background Art

[0002] In recent years, research and development related to the sensing of human states has been widely carried out. The state of a person as a sensing object is, for example, an emotional state or a mental state, which is related to cognitive function. If a person's mental state can be estimated through sensing, it is expected that the productivity of a person's work can be further improved.

[0003] For example, Patent Document 1 discloses a technology for determining the creativity of speakers and listeners at a party using heartbeat data (CVRR (Coefficient of Variation of RR interval) or LF / HF (Low Frequency / High Frequency)).

[0004] Patent Document 2 discloses a technology that estimates the user's concentration level by combining information about the indoor environment in which the user is located with heart rate or brain waves detected from an image of the user.

[0005] Prior Art Literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2019-191824

[0008] Patent Document 2: Japanese Patent Application Publication No. 2020-8278

[0009] Patent Document 3: Japanese Patent Application Publication No. 2021-108021

[0010] Non-patent literature

[0011] Non-patent literature 1: R. Orita, M. Hattori, and Y. Nishida. "Development of a Japanese Remote Associates Task as insight problems", Japanese J. Psychol. 89, 376-386, (2018).

[0012] Non-patent literature 2: LEMatzen, ZOBenz, KRDixon, J.Posey, JKKroger, andA.E.Speed. "Recreating Raven's: Software for generating systematically largenumbers of Raven-like matrix problems with normed properties", Behav.Res.Methods 42, 525-541, 2010

[0013] Non-patent document 3: Koichiro Tomomoto, Yu Hashiura, Kozo Tsuji, Takeki Kimura, "ワーカのcreativity no upward purpose"したオオフィス Illumination システム-クリエイティブオフィスのシーンにAdaptable した lighting conditions research-(with Office Lighting System Aimed at Improving Workers' Creativity - Research on Lighting Conditions Suitable for Creative Office Scenes)", Proceedings of Lectures at the Kansai Branch Conference of the Japan Institute of Human Engineering 2009, pp. 171-174, December 5, 2009 Summary of the invention

[0014] The present disclosure provides an information processing method and the like capable of determining a state related to a subject's thoughts with higher accuracy.

[0015] An information processing method involved in one embodiment of the present invention includes: accepting a user's CVRR (Coefficient of Variation of RR interval) and the user's LF / HF (Low Frequency / High Frequency), or calculating the CVRR and the LF / HF; and a processor performing a determination process based on the CVRR and the LF / HF to determine whether a state related to the user's thinking is a convergent thinking state, a divergent thinking state, or a relaxed state.

[0016] In addition, this general or specific method can also be implemented by a system, device, integrated circuit, computer program or a computer-readable recording medium such as a CD-ROM, or by any combination of a system, device, integrated circuit, computer program and recording medium.

[0017] According to the information processing method of the present disclosure, the state related to the subject's thoughts can be determined with higher accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1A This is an explanatory diagram showing an electrocardiogram waveform.

[0019] Figure 1B It is an explanatory diagram showing a continuous electrocardiogram waveform.

[0020] Figure 1C It is an explanatory diagram showing the spectrum of heartbeat fluctuation.

[0021] Figure 2A It is an explanatory diagram showing the configuration of an information processing system according to an embodiment.

[0022] Figure 2B This is a flowchart showing a first example of processing of the information processing system according to the embodiment.

[0023] Figure 3 This is a flowchart showing a second example of the processing of the information processing system according to the embodiment.

[0024] Figure 4 This is a flowchart showing a third example of the processing of the information processing system according to the embodiment.

[0025] Figure 5 It is an explanatory diagram showing an example of a state determined by the information processing system according to the embodiment.

[0026] Figure 6 This is a flowchart showing an example of processing related to updating of threshold information according to the embodiment.

[0027] Fig. 7A It is an explanatory diagram of a first example of presentation of determination results according to the embodiment.

[0028] Figure 7B It is an explanatory diagram of a second example of presentation of determination results according to the embodiment.

[0029] Figure 7C It is an explanatory diagram of a third example of presentation of determination results according to the embodiment.

[0030] Fig.7D It is an explanatory diagram of a fourth example of presentation of determination results according to the embodiment.

[0031] Fig. 7E It is an explanatory diagram of a fifth example of presentation of determination results according to the embodiment.

[0032] Figure 7F It is an explanatory diagram of a sixth example of presentation of determination results according to the embodiment.

[0033] Figure 7G It is an explanatory diagram of a seventh example of presentation of determination results according to the embodiment.

[0034] Figure 8This is a flowchart showing an example of a process of controlling lighting according to a determination result according to the embodiment.

[0035] Fig. 9 It is an explanatory diagram showing the relationship between the illuminance and color temperature of lighting and the state of the user in the lighting control according to the embodiment.

[0036] Fig.10 This is a diagram showing an example of transmission of a plurality of biological information in the information processing device according to the embodiment.

[0037] Fig.11 This is a diagram showing an information processing device as a modified example of the information processing device according to the embodiment. DETAILED DESCRIPTION

[0038] (Knowledge that is the basis of this disclosure)

[0039] The inventor of the present application attempts to investigate the performance of the heartbeat of a user in a divergent thinking state based on information related to the heartbeat of a subject when performing a task that induces the subject to enter a divergent thinking state. Similarly, the inventor of the present application attempts to investigate the performance of the heartbeat of a user in a convergent thinking state based on information related to the heartbeat of a subject when performing a task that induces the subject to enter a convergent thinking state.

[0040] In one experiment, the subjects performed 6 tasks. Among the 6 tasks, 2 were tasks that induced the subjects to enter a convergent thinking state, and the remaining 4 were tasks that induced the subjects to enter a divergent thinking state. In order to reduce the impact of fatigue caused by the tasks, the subjects were allowed to rest for about 1 minute between each task. The order of performing the 6 tasks was designed to be balanced so as to suppress the influence of the order effect. In addition, before performing each of the 6 tasks, the subjects received an explanation about each task and performed a practice task corresponding to each task for about 1 minute.

[0041] The subjects performed the task according to the process of saying nonsense words for 1 minute, then performing the task for about 3 minutes, and then saying nonsense words for 1 minute. The subjects performed each of the 6 tasks according to the above process. In order to make the subject's thinking state a neutral state, the subjects were asked to say nonsense words. In addition, for each of the 6 tasks, in order to prevent the subjects from knowing whether the task is a task that induces the subjects to become a convergent thinking state or a task that induces the subjects to become a divergent thinking state, the names of task A, task B, task C, and task D are used to explain the task to the subjects.

[0042] Of the two tasks that induced the subjects to enter a convergent thinking state, one was a language task, using the Japanese version of the Remote Association Task (RAT), and the other was a non-language task, using the Raven Task (Raven).

[0043] RAT can be a task of presenting three words that seem to have no commonality to the subject, and requiring the subject to find the common words associated with each word. For example, it can be a task of presenting the three words Pure, Blue, and Fall to the subject, and requiring the subject to find words such as Water as the common words associated with them. In this experiment, RAT was used with reference to Non-Patent Document 1.

[0044] Raven may be a task in which, for example, a profile image is presented to a subject and the user is asked to select a graphic that matches the profile from a plurality of candidate graphics. In this experiment, Raven, which refers to Non-Patent Document 2, was used.

[0045] Among the four tasks that induce the subjects to enter a divergent thinking state, two are language tasks using the Unusual Uses Test (UUT). In addition, among the above four tasks, the remaining two tasks are non-language tasks using the Figural Divergent Task (FDT).

[0046] UUT may be, for example, a task that requires the subject to give a large number of unique uses of things. In this experiment, a task that requires the subject to give as many different uses of table tennis balls as possible within 3 minutes was used as UUT.

[0047] For example, FDT can be a task in which a silhouette image is presented to a subject, and the subject is required to answer as many possible questions as possible within 3 minutes about the objects that the silhouette image may represent.

[0048] In this experiment, as FDT, a task was used in which the subject was asked to answer as many possible questions about the object that a figure "+" (in other words, a figure consisting of a horizontal line segment and line segments orthogonal to the line segment) could represent within 3 minutes.

[0049] According to the results of this experiment, when a person is in a convergent thinking state, the CVRR tends to be low, and when a person is in a divergent thinking state or a relaxed state, the CVRR tends to be high.

[0050] In addition, according to the results of this experiment, when a person is in a divergent thinking state, LF / HF tends to be high, and when a person is in a convergent thinking state, LF / HF tends to be low.

[0051] From the above, if the known method that the relaxation degree of the subject can be determined based on the values ​​of CVRR and LF / HF (see Patent Document 3) is combined with the above experimental results, it is possible to determine that the subject is in a convergent thinking state when the CVRR is lower than a certain value, and in a divergent thinking state or a relaxed state when it is higher than a certain value. In addition, LF / HF can be used to determine whether the subject is in a divergent thinking state or a relaxed state, and it is possible to determine that the subject is in a relaxed state when the LF / HF is lower than a certain value, and in a divergent thinking state when it is higher than a certain value.

[0052] Therefore, the information processing system according to the present embodiment determines the state related to the subject's thinking, etc., as follows, more specifically, determines whether the subject is in a convergent thinking state, a divergent thinking state, or a relaxed state.

[0053] (1) Use CVRR to determine whether the subject is in a convergent thinking state.

[0054] (2) Use CVRR and LF / HF to determine whether the subject is in a divergent thinking state.

[0055] (3) Using at least N biological information including HR (heart rate), pulse rate, LF / HF, HF, skin temperature, and skin electrical activity, determine whether the subject is in a convergent thinking state, a divergent thinking state, or a relaxed state. Wherein N is an integer greater than 1, for example, N is 2.

[0056] Here, biological information is explained. Biological information is information corresponding to a person's physiological indicators. Examples of biological information include an electrocardiogram waveform, a heart rate (heart rate), a pulse waveform, a pulse rate (pulse rate), a heart beat interval (RRI: RR interval), CVRR, LF / HF, skin temperature, and skin electrical activity. In other words, a plurality of biological information may also include an electrocardiogram waveform, a heart rate (heart rate), a pulse waveform, a pulse rate (pulse rate), a heart beat interval (RRI: R-R interval), CVRR, LF / HF, skin temperature, and skin electrical activity.

[0057] Figure 1A is an illustration showing an electrocardiogram waveform. Figure 1AThe horizontal axis represents time, and the vertical axis represents potential difference. The ECG waveform is also called an electrocardiogram. The ECG waveform consists of the P wave that reflects the electrical excitation of the atria, the Q wave that reflects the electrical excitation of the ventricles, the R wave and the S wave, and the T wave that reflects the repolarization process of the myocardial cells of the ventricles after excitation. Among these waves, the R wave has the largest wave height (i.e., potential difference) and is the most robust to noise such as myoelectric potential.

[0058] The heart rate interval (RRI: RR interval) is the time interval between two consecutive R waves in the electrocardiogram waveform. In addition, the heart rate is, for example, the number of beats per minute. That is, (heart rate) = 60 / (heart rate interval). In addition, the R wave can also be detected using a known method such as the Pan & Tompkins method.

[0059] Figure 1B This is an explanatory diagram showing an electrocardiogram waveform. Figure 1B This is a graph showing an electrocardiogram waveform, in which the horizontal axis represents time and the vertical axis represents potential difference.

[0060] like Figure 1B As shown, the ECG waveform includes a plurality of R waves as a series of R i , R i+1 , R i+2 , ···, and R i+5 . As the adjacent R wave R i With R i+1 The time interval between the peaks is the RRI i , as the adjacent R wave R i+1 With R i+2 The time interval between the peaks is the RRI i+1 , as the adjacent R wave R i+2 With R i+3 The time interval between the peaks is the RRI i+2 , ···, as the adjacent R wave R i+4 With R i+5 The time interval between the peaks is the RRI i+4 These time intervals RRI i , RRI i+1 , RRI i+2 、···、RRI i+4 Each is a heartbeat interval. These heartbeat intervals RRI i , RRI i+1 , RRI i+2 、···、RRI i+4 The heart rate is not equal. In other words, these heartbeat intervals vary. These changes in heartbeat intervals are also called heartbeat fluctuations or heartbeat fluctuations.

[0061] CVRR is the coefficient of variation of heart rate fluctuations. CVRR is calculated by dividing the standard deviation of the heartbeat interval by the average value of the heartbeat interval (see (Formula 1)). The standard deviation of the heartbeat interval and the average value of the heartbeat interval can also be calculated based on a plurality of heartbeat intervals included in a specified period in the electrocardiogram waveform. CVRR can also be calculated by performing time domain analysis processing on the component of reflected light generated by the irradiation light irradiated to the subject.

[0062] CVRR = (Standard deviation of heartbeat intervals) / (Average value of heartbeat intervals) (Formula 1)

[0063] It is known that RRI reflects the action of the autonomic nervous system. Specifically, it is known that the change in the RR interval is small when there is stress, and the change in the RR interval is large when there is relaxation. Therefore, the size of CVRR corresponds to the degree of relaxation. In other words, the larger the CVRR, the higher the degree of relaxation.

[0064] HR is the number of beats per unit time (eg, 1 minute) of a subject.

[0065] Figure 1C This is a graph showing a spectrum of heartbeat fluctuations, in which the horizontal axis represents frequency and the vertical axis represents power.

[0066] HF and LF are calculated based on the power spectral density, which is obtained by performing frequency analysis on the equally spaced time series data of heartbeat fluctuations using Fast Fourier Transform (FFT). In addition, a power spectrum can also be used instead of the power spectral density. HF is the integral value of the power spectral density in the high-frequency domain (for example, 0.14Hz to 0.4Hz), and is believed to reflect the activity of the parasympathetic nerves. In addition, LF is the integral value of the power spectral density in the low-frequency domain (for example, 0.04Hz to 0.14Hz), and is believed to reflect the activity of the sympathetic and parasympathetic nerves. In addition, the frequency transformation of FFT can be performed at intervals of 5 seconds or at any time interval.

[0067] LF / HF is considered to represent the overall balance between the sympathetic and parasympathetic nerves (Patent Document 3). It can also be LF / HF = (the integral value of the above-mentioned power spectrum density at 0.04 Hz to 0.14 Hz) / (the integral value of the above-mentioned power spectrum density at 0.14 Hz to 0.4 Hz). Specifically, when LF / HF, which is a stress index, is high, the subject is in a state where the sympathetic nerves are dominant. When LF / HF, which is a stress index, is low, the subject is in a state where the parasympathetic nerves are dominant and relaxed.

[0068] During the determination of (1) and (2) above, the subject wears a sensor capable of measuring the heartbeat or pulse. The sensor obtains biological information of the subject (e.g., an electrocardiogram waveform), and analyzes the obtained electrocardiogram waveform using a waveform analysis program, thereby calculating the heartbeat or pulse. In addition, the sensor may not be worn by the subject, but may be measured in a non-contact manner. HF and LF may also be calculated by performing frequency analysis processing on the component of reflected light generated by the irradiated light irradiated to the subject. The information processing system determines at any timing or at any time interval whether the subject is in a convergent thinking state, a divergent thinking state, or a relaxed state. The determination result may be displayed to the subject or not. In the determination, a threshold value may be used for binary determination.

[0069] In the judgment of (3) above, when the subject is more relaxed when in the task execution state than when in the rest state, it is judged whether the subject is in one of the convergent thinking state, the divergent thinking state and the relaxed state. The judgment result may be displayed to the subject or not. In addition, when it is judged that the subject is more relaxed when in the task execution state than when in the rest state, when it is judged that the subject is in one of the convergent thinking state, the divergent thinking state and the relaxed state, the judgment of (1) and (2) above may be performed.

[0070] Hereinafter, the technology obtained based on the disclosure of this specification will be exemplified, and the effects etc. obtained based on the technology will be described.

[0071] (1) An information processing method, comprising: receiving a user's CVRR and the user's LF / HF, or calculating the CVRR and the LF / HF; and a processor executing a determination process based on the CVRR and the LF / HF to determine whether a state related to the user's thinking is a convergent thinking state, a divergent thinking state, or a relaxed state.

[0072] According to the above method, the state related to the user's thinking can be determined based on the CVRR and LF / HF obtained from the user as a subject. In the past, there was no technology for determining the state related to the user's thinking based on information related to the user's heartbeat. According to the above information processing method, the state related to the user's thinking can be determined with higher accuracy based on the CVRR and LF / HF as information related to the user's heartbeat. In this way, according to the above information processing method, the state related to the subject's thinking, etc. can be determined with higher accuracy.

[0073] (2) In the information processing method described in (1), in the determination process, when the CVRR is smaller than a first threshold value, it is determined that the user is in the convergent thinking state.

[0074] According to the above aspect, by using the user's CVRR and the first threshold value, it is possible to easily determine whether the user is in a convergent thinking state. In this way, according to the above information processing method, it is possible to more easily and more accurately determine the state related to the subject's thinking, etc.

[0075] (3) In the information processing method described in (1) or (2), in the determination process, when the CVRR is greater than or equal to a first threshold value and the LF / HF is greater than or equal to a second threshold value, it is determined that the user is in the divergent thinking state.

[0076] According to the above method, by using the size determination of the user's CVRR and the first threshold value, and the size determination of the user's LF / HF and the second threshold value, it is possible to easily determine whether the user is in a divergent thinking state. In this way, according to the above information processing method, it is possible to more easily and more accurately determine the state related to the subject's thinking, etc.

[0077] (4) In the information processing method described in any one of (1) to (3), in the determination process, when the CVRR is greater than or equal to a first threshold and the LF / HF is less than a second threshold, it is determined that the user is in the relaxed state.

[0078] According to the above method, by using the size determination of the user's CVRR and the first threshold value, and the size determination of the user's LF / HF and the second threshold value, it is possible to easily determine whether the user is in a relaxed state. In this way, according to the above information processing method, it is possible to more easily and more accurately determine the state related to the subject's thinking, etc.

[0079] (5) An information processing method as described in any one of (1) to (4), wherein the information processing method further includes: before the judgment processing, the processor performs a preliminary judgment processing of determining whether the user's state is one of the convergent thinking state, the divergent thinking state and the relaxed state based at least on the LF / HF, and if it is determined in the preliminary judgment processing that the user's state is one of the states, the judgment processing is performed.

[0080] According to the above method, after determining in the pre-determination process whether the state related to the user's thinking is one of the convergent thinking state, the divergent thinking state, and the relaxed state based on the CVRR and LF / HF obtained from the user as the subject, it is determined which of the above three states the state related to the user's thinking is, so that the determination result of the state related to the user's thinking can be made more appropriate. If, if the pre-determination process is not performed, and it is determined which of the above three states the state related to the user's thinking is, then in the case where the state related to the user's thinking is not any of the above three states, an inappropriate determination result may be output. According to the above method, after determining in the pre-determination process whether the state related to the user's thinking is one of the above three states, it is determined which of the above three states the state related to the user's thinking is, so that the output of an inappropriate determination result as described above can be suppressed. Therefore, according to the above information processing method, the state related to the subject's thinking, etc. can be determined more appropriately and with higher accuracy.

[0081] (6) An information processing method as described in any one of (1) to (4), wherein the information processing method further includes: before the judgment processing, the processor performs a preliminary judgment processing to determine whether the user's state is one of the convergent thinking state, the divergent thinking state and the relaxed state based on at least one of the user's heart rate, pulse rate, LF / HF, HF, skin temperature and skin electrical activity; if the preliminary judgment processing determines that the user's state is one of the states, the judgment processing is performed.

[0082] According to the above method, after determining that the state related to the user's thinking is one of the convergent thinking state, the divergent thinking state, and the relaxed state based on the biological information (i.e., at least one of the heart rate, pulse rate, LF / HF, HF, skin temperature, and skin electrical activity) obtained from the user as the subject in the pre-determination process, it is determined which of the above three states the state related to the user's thinking is, so that the determination result of the state related to the user's thinking can be made more appropriate. If, if the pre-determination process is not performed and it is determined which of the above three states the state related to the user's thinking is, an inappropriate determination result may be output in the case where the state related to the user's thinking is not any of the above three states. According to the above method, after determining that the state related to the user's thinking is one of the above three states in the pre-determination process, it is determined which of the above three states the state related to the user's thinking is, so that the output of an inappropriate determination result as described above can be suppressed. Therefore, according to the above information processing method, the state related to the subject's thinking, etc. can be determined more appropriately and with higher accuracy.

[0083] (7) In the information processing method described in (1), the CVRR and the LF / HF correspond to the first period included in a plurality of periods, and in the determination process, the determination process of the state related to the user's thinking in the period is performed based on the CVRR and LF / HF respectively corresponding to the plurality of periods. The information processing method further includes: in the determination process, generating a graph showing the proportions of the periods determined to be the convergent thinking state, the periods determined to be the divergent thinking state, and the periods determined to be the relaxed state among the plurality of periods; and displaying the graph.

[0084] According to the above method, a graph showing the ratio of the state related to the user's thinking in each of the multiple periods is displayed, so that the viewer of the graph can summarize and grasp the state related to the user's thinking across the multiple periods. Therefore, according to the above information processing method, the state related to the subject's thinking, etc. across the multiple periods can be determined and displayed with higher accuracy, and the viewer can easily grasp the state.

[0085] (8) The information processing method described in (2), further comprising: obtaining identification information for identifying the user; and obtaining threshold information corresponding to the identification information, wherein the first threshold is determined based on the threshold information.

[0086] According to the above method, the first threshold used in determining the size of the user's CVRR is determined based on the threshold information, so that the first threshold can be made more appropriate, and it can be appropriately determined whether the state related to the user's thinking is a convergent thinking state. Therefore, according to the above information processing method, the state related to the subject's thinking, etc. can be determined more appropriately and with higher accuracy.

[0087] (9) An information processing method as described in (8), further comprising: obtaining evaluation information obtained by evaluating a state related to the user's thinking by a method different from the determination processing; and updating the threshold information based on the determined state of the user and the state of the user represented by the evaluation information.

[0088] According to the above aspect, the first threshold is updated based on the evaluation information obtained by evaluating the state related to the user's thinking by a method different from the determination processing included in the information processing method, thereby helping to make the subsequent determination result of the state related to the user's thinking closer to the evaluation result obtained by the above different method. Therefore, according to the above information processing method, the state related to the subject's thinking, etc. can be determined with higher accuracy, close to the evaluation result obtained by the different method.

[0089] (10) The information processing method as described in (3) or (4) further includes: obtaining identification information for identifying the user; and obtaining threshold information corresponding to the identification information, the first threshold and the second threshold being determined based on the threshold information.

[0090] According to the above aspect, the first threshold used in determining the size of the user's CVRR and the second threshold used in determining the size of the user's LF / HF are determined based on the threshold information, so that the first threshold and the second threshold can be made more appropriate, and it can be appropriately determined whether the state related to the user's thinking is a convergent thinking state or a relaxed state. Therefore, according to the above information processing method, the state related to the subject's thinking, etc. can be determined more appropriately and with higher accuracy.

[0091] (11) An information processing method as described in (10), further comprising: obtaining evaluation information obtained by the user evaluating a state related to the user's thinking; and updating the threshold information based on the determined state of the user and the state of the user represented by the evaluation information.

[0092] According to the above method, the first threshold is updated based on the subjective evaluation information obtained by the user's own evaluation of the state related to the user's thinking, which helps to make the subsequent determination result of the state related to the user's thinking closer to the user's evaluation. Therefore, according to the above information processing method, the state related to the subject's thinking, etc. can be determined with higher accuracy close to the subjective evaluation of the subject.

[0093] (12) An information processing method as described in (2), further comprising: after executing the determination processing, for a lighting device that illuminates the vicinity of the user, (i) controlling the lighting light to have its color temperature lowered and its illuminance increased, or (ii) controlling the lighting light to have its color temperature lowered and its illuminance decreased.

[0094] According to the above method, when the state related to the user's thinking is determined to be a convergent thinking state, the lighting device can be used to appropriately induce the user to a divergent thinking state or a relaxed state. Thus, according to the above information processing method, the state related to the subject's thinking, etc. can be determined with higher accuracy, and the user determined to be in a convergent thinking state can be induced to a divergent thinking state or a relaxed state.

[0095] (13) An information processing method as described in (3), further comprising: after executing the determination processing, for a lighting device that illuminates the vicinity of the user, (i) controlling the lighting light to have its color temperature increased and its illuminance increased, or (ii) controlling the lighting light to have its color temperature decreased and its illuminance decreased.

[0096] According to the above method, when the state related to the user's thinking is determined to be a divergent thinking state, the lighting device can be used to appropriately induce the user to a convergent thinking state or a relaxed state. Thus, according to the above information processing method, the state related to the subject's thinking, etc. can be determined with higher accuracy, and the user determined to be in a divergent thinking state can be induced to a convergent thinking state or a relaxed state.

[0097] (14) An information processing method as described in (4), further comprising: after executing the determination processing, for a lighting device that illuminates the vicinity of the user, performing control such as (i) lowering the color temperature of the lighting light and increasing the illuminance, or (ii) increasing the color temperature of the lighting light and increasing the illuminance.

[0098] According to the above method, when the state related to the user's thinking is determined to be a relaxed state, the lighting device can be used to appropriately induce the user to a convergent thinking state or a divergent thinking state. Thus, according to the above information processing method, the state related to the subject's thinking, etc. can be determined with higher accuracy, and the user determined to be in a relaxed state can be induced to a convergent thinking state or a divergent thinking state.

[0099] (15) An information processing method, comprising: using a processor to obtain target information representing a target state set as a target by a user; obtaining biological information of the user; based on the biological information, determining a state related to the user's thinking; comparing the target state represented by the target information with the determined state related to the user's thinking; and when a result of the comparison is that the target state is different from the determined state related to the user's thinking, controlling to change the characteristics of illumination light irradiated by an illumination device that illuminates the vicinity of the user.

[0100] According to the above method, when the state related to the user's thinking determined based on the user's biological information is different from the target state, the state related to the user's thinking can be appropriately induced to the target state using the lighting device. Thus, according to the above information processing method, the creative thinking state of the subject can be objectively evaluated, and the state related to the user's thinking can be induced to the target state.

[0101] (16) An information processing system comprising a light source for irradiating an irradiation light to a user, a detector for detecting reflected light generated by the irradiation light, a processing circuit, a storage device, and a display device, wherein the processing circuit performs time domain analysis processing on the component of the reflected light detected by the detector in each unit period, thereby calculating the CVRR corresponding to the fluctuation of the heartbeat or pulse of the user, performs frequency analysis processing on the component of the reflected light detected by the detector in each unit period, thereby calculating the LF / HF corresponding to the fluctuation of the heartbeat or pulse of the user, and obtains from the storage device a signal indicating a first threshold value and a second threshold value. The device further comprises: receiving threshold information of a value, executing a first determination process for determining whether the average value of the CVRR in the unit period is above the first threshold value, executing a second determination process for determining whether the average value of the LF / HF in the unit period is above the second threshold value, executing a third determination process for determining whether the user is in a divergent thinking state, a convergent thinking state, and a relaxed state in the unit period based on the first determination process and the second determination process, generating an image associated with the state of the user determined in the third determination process, and displaying the generated image on the display device.

[0102] According to the above aspect, the same effects as those of the above information processing method are achieved.

[0103] The embodiments described below all represent general or specific examples. The numerical values, shapes, materials, constituent elements, configuration positions and connection methods of constituent elements, steps and the order of steps shown in the following embodiments are examples, and their main purpose is not to limit the technology disclosed in the present invention. Among the constituent elements in the following embodiments, the constituent elements that are not recorded in the independent claims representing the highest concept are described as arbitrary constituent elements. Each figure is a schematic diagram and is not necessarily a strict illustration. Furthermore, in each figure, the same mark is attached to the constituent elements that are substantially the same or similar. Sometimes repeated descriptions are omitted or simplified.

[0104] In the present disclosure, all or part of a circuit, unit, device, component or part, or all or part of a functional module in a block diagram, for example, can be performed by a semiconductor device, a semiconductor integrated circuit (IC), or one or more electronic circuits including LSI (large-scale integration). LSI or IC can be integrated into one chip or composed of a combination of multiple chips. For example, functional modules other than storage elements can also be integrated into one chip. It is called LSI or IC here, but the name changes depending on the degree of integration, and it can also be called a system LSI, VLSI (very large scale integration) or ULSI (ultra large scale integration). A field programmable gate array (FPGA, Field Programmable Gate Array) programmed after the manufacture of LSI or a reconfigurable logic device (reconfigurable logic device) that can reconstruct the bonding relationship inside LSI or set the circuit division inside LSI can also be used for the same purpose.

[0105] The implementation method described below assumes that the subject is an office worker, a learner in an educational facility or a learning environment, etc. The office worker in the assumption is not doing physical labor that requires work results through physical movement, but is doing desk work that requires intellectual productivity, such as document preparation, information management, classification work, thinking of new ideas, or proposing new planning schemes. In addition, the work performed by the office worker in the assumption includes intellectual productivity work performed by an individual, and may also include intellectual productivity work of multiple people represented by brainstorming. In addition, in the case of desk work, it is not necessarily limited to work performed while sitting in a seat, and includes work such as creative discussions performed while standing, and may also include work of multiple people.

[0106] Intellectual productivity is affected not only by the knowledge or skills of an individual or multiple people, but also by the state of mind. Specifically, intellectual productivity requires both convergent and divergent thinking.

[0107] Convergent thinking is the thinking used to think or reason based on known information and get a solution based on logic. Specifically, thinking about problems with correct answers such as crossword puzzles and calculation problems is equivalent to convergent thinking. In addition, thinking that summarizes ideas that come up in brainstorming and draws one or more conclusions is equivalent to convergent thinking. Convergent thinking can also be called critical thinking.

[0108] On the other hand, divergent thinking is thinking that develops various thoughts based on known information and generates new ideas. Specifically, thinking that generates new ideas without a correct answer is equivalent to divergent thinking. In addition, thinking used when coming up with ideas during brainstorming is equivalent to divergent thinking. Divergent thinking can also be called creative thinking.

[0109] The inventor of the present application has conceived a method of having a subject perform tasks that require convergent thinking and tasks that require divergent thinking, and based on biological information during and before and after the intellectual task, being able to determine whether the person is in a convergent thinking state, a divergent thinking state, or a relaxed state.

[0110] In this specification, the convergent thinking state refers to the state in which a person performs convergent thinking. Here, the convergent thinking state may also include the state in which a person concentrates. The divergent thinking state refers to the state in which a person performs divergent thinking. Here, the divergent thinking state may also include the state in which a person exerts creativity.

[0111] In addition, the subjects are not limited to office workers, but may also be learners in schools or at home.

[0112] The information processing device of this embodiment measures biological information during intellectual productivity work in order to determine convergent thinking and divergent thinking in intellectual productivity work. Biological information includes various indicators such as heartbeat, electrocardiogram, pulse, skin potential, skin electrodermal activity or skin temperature. Biological information is physiological data that can be measured when the intellectual productivity worker is working. The above-mentioned information processing device calculates evaluation information related to the convergent thinking state, divergent thinking state or relaxation state based on the characteristic quantity obtained from the biological information including CVRR and LF / HF among these biological information.

[0113] Intellectual productivity work is also called a task, and the task can be the subject's daily business or a cognitive subject used in a psychological experiment, etc. The information processing system calculates evaluation information on whether the subject is in a convergent thinking state, a divergent thinking state, or a relaxed state based on the biological information of each subject.

[0114] Figure 2A 1 is an explanatory diagram showing the configuration of the information processing system 10 according to the present embodiment, and shows the configuration of conceptual functional units of the information processing system 10 .

[0115] In addition, the functional unit generally refers to a component such as software (computer program) or hardware that can be logically separated. Therefore, the functional unit in the present embodiment refers not only to a module in a computer program, but also to a module in a hardware configuration. Therefore, the present embodiment also serves as an explanation of a computer program (a program for causing a computer to execute various processes, a program for causing a computer to function as various means, a program for causing a computer to realize various functions), a system, and a method for making these functional units function. Among them, for the sake of convenience of explanation, the terms "store", "cause it to store", or equivalents thereof are used, and these terms mean: in the case where the functional unit of the present embodiment is a module in a computer program, a storage device is made to store or a control is performed so that the storage device is stored.

[0116] In addition, the functional unit may correspond to the program one-to-one, but in the installation, one program may constitute one functional unit, one program may constitute multiple functional units, or conversely, multiple programs may constitute one module. In addition, multiple functional units may be executed by one computer, or one functional unit may be executed by multiple computers using computers in a distributed or parallel environment. In addition, one module may also include other modules.

[0117] In addition, below, "connection" is used for logical connection (data exchange, indication, reference relationship between data, login, etc.) in addition to physical connection. "Predetermined" means determined before the processing as the object, and of course it can be used before the processing involved in this embodiment starts. It also includes the following meaning: even after the processing involved in this embodiment starts, as long as it is determined before the processing as the object, according to the current situation or state or according to the situation or state so far. In the case of multiple "predetermined values", they can be different values, or two or more values ​​can be the same (of course, all values ​​are the same).

[0118] In addition, the description "if A is the case, perform B" is used in the sense of "determine whether it is A, and if it is determined to be A, perform B". However, the case where it is not necessary to determine whether it is A is excluded. In addition, when things are listed such as "A, B, C", unless otherwise specified, it is an example list, including the case of selecting only one of them (for example, selecting only A).

[0119] In addition, a system or device includes a case where a system or device is implemented by a single computer, hardware, device, etc., in addition to being composed of multiple computers, hardware, devices, etc. connected by a network (including one-to-one communication connection). "Device" and "system" are used as synonyms. Of course, "system" does not include a social "mechanism" (social system) that is merely arranged by humans.

[0120] In addition, for each process performed by each functional unit, or for each process performed in a functional unit, information as an object is read from the storage device, and after the process is performed, the process result is written to the storage device. Therefore, the description of reading from the storage device before processing or exporting to the storage device after processing is sometimes omitted. In addition, the storage device herein may also include a hard disk, a RAM (Random Access Memory), an external storage medium, a storage device via a communication line, a register in a CPU (Central Processing Unit), etc.

[0121] like Figure 2A As shown, the information processing system 10 includes an information processing device 100 and a measuring device 150 .

[0122] The information processing apparatus 100 determines whether a state related to the thinking of a user as a subject (also simply referred to as a state) is a convergent thinking state, a divergent thinking state, or a relaxed state.

[0123] The information processing device 100 is, for example, Figure 2AAs shown, the system includes an acquisition unit 110 , a calculation unit 120 , a determination unit 130 , and a presentation unit 140 .

[0124] The information processing device 100 may be a dedicated device, but can be implemented by a general-purpose computer executing a program. The computer may be a tablet terminal, a smartphone, or a game console capable of changing programs, in addition to a desktop or notebook computer.

[0125] When the information processing apparatus 100 is included in a notebook computer, a tablet terminal, a smartphone, or a game console, the device may include the acquisition unit 110 , the presentation unit 140 , or the acquisition unit 110 and the presentation unit 140 .

[0126] The acquisition unit 110 may be configured to measure a plurality of pieces of biometric information at a time, or may be configured to measure a plurality of pieces of biometric information sequentially at a predetermined time or order with a time difference.

[0127] The measuring device 150 measures the biological information of the user. The measuring device 150 includes a measuring unit 11 as a sensor for measuring the biological information of the user. The measuring device 150 inputs the measured biological information of the user to the acquisition unit 110. The sensor includes an electrocardiogram sensor, a skin temperature sensor, or an EDA sensor.

[0128] In addition, the skin temperature can be measured by a thermocouple attached to the user's middle finger with surgical tape. The skin temperature can also be measured by the skin temperature of the facial part (forehead or nose, etc.) or the body part. In addition, the skin temperature can also be measured using a thermal imaging camera, an RGB camera, or an infrared camera.

[0129] There may be a plurality of measuring devices 150 or a single measuring device. There may be a plurality of measuring units 11 included in the measuring device 150 or a single measuring unit. There may be a single acquiring unit 110 or a plurality of acquiring units 110.

[0130] The information processing system 10 is used in an office, a school, a cram school, or a home, for example, and is assumed to be used for work, study, reading, etc., but is not limited thereto.

[0131] In order to obtain the evaluation information value related to the user's state (i.e., convergent thinking state, divergent thinking state, and relaxed state), feature quantities of biological information such as CVRR (Coefficient of Variation of R-R intervals) and LF / HF (Low Frequency / High Frequency) are extracted. The type or number of feature quantities is not particularly limited.

[0132] The information processing device 100 includes: a device with a processor that operates according to a program, and a device for an interface for connecting an external device, as main hardware elements. The device with a processor may be a microcomputer (microcontroller) in addition to a microprocessor. The device for the interface has at least a function of connecting the calculation unit 120 and the determination unit 130. The device for the interface preferably has a function of performing data communication. The program executed by the processor can be provided by being pre-written into a ROM (Read Only Memory), or it can be provided via an electrical communication line such as the Internet, or by a recording medium that can be read by a computer. The information processing system 10 can also be said to be a processing circuit. The information processing system 10 can also be provided with a storage device.

[0133] The acquisition unit 110 is connected to the calculation unit 120. The acquisition unit 110 acquires the biological information of the user measured by the measurement device 150. Here, the biological information is, for example, a heartbeat or a pulse, and this case is used as an example for explanation, but it can also be skin electrical activity (EDA (ElectroDermal Activity)) or skin temperature. EDA can be either a skin potential level or a skin potential reflection.

[0134] The calculation unit 120 is connected to the acquisition unit 110 and the determination unit 130. The calculation unit 120 acquires biological information such as heart rate fluctuations and calculates CVRR and LF / HF at a certain time. The calculation unit 120 includes the calculated CVRR and LF / HF in the biological information and provides it to the determination unit 130. The calculation unit 120 may also receive the heart rate, pulse rate, skin temperature, and EDA from the acquisition unit 110 and provide the received heart rate, pulse rate, skin temperature, and EDA to the determination unit.

[0135] For example, the calculation unit 120 calculates CVRR based on the heartbeat interval or the pulse interval. In addition, the calculation unit 120 performs FFT (Fast Fourier Transform) processing on the heartbeat interval or the pulse interval for a certain period of time and calculates LF / HF.

[0136] In addition, the calculation unit 120 may calculate CVRR and LF / HF after the user performs a task or during the user performs a task.

[0137] The determination unit 130 is connected to the calculation unit 120. Furthermore, the determination unit 130 may be connected to the presentation unit 140. The determination unit 130 performs determination processing to determine whether the user's thinking state is a convergent thinking state, a divergent thinking state, or a relaxed state based on the acquired biological information.

[0138] Specifically, the determination unit 130 determines whether CVRR and LF / HF exceed threshold values, and determines the state of the user.

[0139] In the above-mentioned determination process, the determination unit 130 may determine that the user is in a convergent thinking state when the CVRR is smaller than the first threshold value.

[0140] In the above determination process, the determination unit 130 may determine that the user is in the divergent thinking state when CVRR is equal to or greater than the first threshold and LF / HF is equal to or greater than the second threshold.

[0141] In the above determination process, the determination unit 130 may determine that the user is in a relaxed state when CVRR is equal to or greater than the first threshold and LF / HF is less than the second threshold.

[0142] Note that the determination by the determination unit 130 may be performed after the user executes the task or during the execution of the task.

[0143] Here, the user refers to a person who is the measurement target of the information processing device 100. Generally, the user performs a task. However, the user may be a person who performs the task absent-mindedly or a person who meditates as a task, for example.

[0144] In addition, the indicator used by the determination unit 130 to determine the user's state may be at least partially different for each determination. For example, different indicators or the same indicator may be used as indicators for determining the user's state in the first half of the task and the second half of the task.

[0145] In addition, when determining the state of the same user, different thresholds may be used in the first half of the task and the second half of the task. In addition, for example, regarding the state of the user, the proportion may be obtained by accumulating the time of a certain state of the user in a unit time interval and dividing it by the unit time.

[0146] The prompting unit 140 prompts the user's state determined by the determination unit 130. The prompting unit 140 has, for example, a display device, and prompts the user's state by displaying an image representing the user's state on a display screen (liquid crystal display, etc.). In this way, the prompting unit 140 visualizes the user's state. The content prompted by the prompting unit 140 will be described later.

[0147] The prompting unit 140 can not only use the display of the display screen to give prompts, but also use the lighting of the lighting device, the audio output of the audio device, or the air conditioning of the air conditioning device to give prompts. In addition, the prompting unit 140 can give prompts after the user performs the task or during the task.

[0148] For example, the prompting unit 140 may also maintain the past plots on the graph representing the user's state by the determination unit 130 in a visualized state, and represent the trajectory of the user's state transition together with the current state. In addition, in addition to displaying to the display device, the prompting may also include output as a 3D (3-dimensional, 3-Dimensions) image, and further, it may also be a combination of printing by a printing device such as a printer, sound output by a sound output device such as a speaker, or vibration by a vibration generating device such as a motor. In addition, the prompting unit 140 may also be a general-purpose device such as a smart phone, a tablet terminal, a personal computer, or a game console.

[0149] The measuring unit 11 and the measuring device 150 may be connected via wireless communication, and the measuring device 150 and the information processing device 100 may be connected via wireless communication.

[0150] The measuring unit 11 may also be a heart rate meter. The heart rate meter measures the user's heartbeat by attaching a heart rate sensor to the user's chest. The heart rate meter may also measure the user's heartbeat by a non-contact sensor such as a camera. The heart rate meter may also photograph the user's finger close to the camera, and measure the user's pulse based on changes in the chromaticity of the skin of the photographed finger. The camera may also photograph the user's face, and may also measure the pulse based on changes in the chromaticity of the facial skin. The heart rate meter may also measure the pulse or blood pressure changes, etc., using a wristband (watch) type pulse meter or a pulse meter clipped on the ear or finger. The heart rate meter may also be a device (also called a detector) that measures the pulse by irradiating light from a light source to the user and detecting reflected light generated by the irradiated light.

[0151] The information processing device 100 receives the biological information of the user provided by the measuring device 150, and determines the state of the user. The information processing device 100 may also prompt the user with the result of the determination. The prompt may be performed in real time or after the task is completed. In addition, the user using the information processing device 100 may be a researcher, a supervisor of the user, or the user himself. The other party to whom the result of the determination by the information processing device 100 is prompted may be the user or another user using the information processing device 100.

[0152] Figure 2B This is a flowchart showing a first example of processing of the information processing system 10 according to the present embodiment. Figure 2B The flowchart shown shows an outline of the flow of processing of the information processing system 10 .

[0153] In step S101 , the acquisition unit 110 acquires biological information from the measurement device 150 .

[0154] In step S102 , the calculation unit 120 and the determination unit 130 determine the state of the user.

[0155] In step S103, the prompting unit 140 prompts information related to the user's state. Specifically, the prompting unit 140 prompts the determination result of step S102 as information related to the user's state. The user's state can be prompted in the form of a chart such as a pie chart, a line chart, or a bar chart, or can be prompted using a numerical value or language. In addition, the prompting unit 140 may not prompt information related to the user's state.

[0156] Later, refer to Figure 3 and Figure 4 The processing of the information processing system 10 will be described in detail.

[0157] Figure 3 This is a flowchart showing a second example of the information processing system 10 according to the present embodiment.

[0158] Figure 3 An example of a process in which the information processing system 10 determines whether the user's state is one of the three states of divergent thinking state, convergent thinking state, and relaxed state. Specifically, the information processing system 10 performs (a) a determination process (also referred to as a pre-determination process) of determining whether the user's state is one of the three states of divergent thinking state, convergent thinking state, and relaxed state, and if the pre-determination process determines that the user's state is one of the above states, the information processing system 10 performs (b) a determination process of determining whether the user's state is one of the three states of divergent thinking state, convergent thinking state, and relaxed state. In addition, the pre-determination process includes at least steps S204, S205, and S211 (described later).

[0159] In step S201, the measuring device 150 measures at least two of the user's heart rate, pulse rate, LF / HF, HF, skin temperature, and EDA, and provides the biometric information to the information processing device 100. The information processing device 100 (acquisition unit 110) acquires the provided biometric information.

[0160] In step S202, the determination unit 130 determines the biological information of the user in a quiet state based on the biological information acquired by the acquisition unit 110 in step S201. For example, the determination unit 130 determines the biological information of the user in a quiet state by determining the biological information included in the period in which the user is determined to be in a quiet state from the biological information acquired by the acquisition unit 110 in step S201, thereby determining the biological information of the user in a quiet state. The period in which the user is determined to be in a quiet state may be a date different from the date on which the user performs the task, or a time period in the date on which the user performs the task that is different from the time period in which the task is performed. In other words, the time for measuring the quiet state may be set to be measured just before the task is started, or the time for measuring the quiet state may be set to be measured on a date different from the date on which the task is performed.

[0161] In step S203, the determination unit 130 identifies the biometric information of the user in the task execution state from the biometric information acquired by the acquisition unit 110 in step S201. For example, the determination unit 130 identifies the biometric information included in the period in which the user is determined to be in the task execution state from the biometric information acquired by the acquisition unit 110 in step S201, thereby identifying the biometric information of the user in the task execution state.

[0162] In step S204, the determination unit 130 determines, with respect to at least two of the biological information among the heart rate, pulse rate, LF / HF, HF, skin temperature, and EDA, whether (i) the value in the task execution state indicates that the user is more relaxed than the value in the resting state, or (ii) the value in the resting state is of the same degree as the value in the task execution state.

[0163] In addition, the at least two biometric information used in the above determination is an example of at least N biometric information. The larger N is, the more accurate the determination of user relaxation can be improved. The smaller N is, the more the processing amount of the processor can be reduced and the user relaxation can be determined.

[0164] For example, a lower heart rate indicates that the user is relaxed. Regarding the heart rate, if (the heart rate of the user in a resting state)×(the first specified value)≥(the heart rate of the user in a task execution state), it can also be determined that the user is relaxed. The first specified value can also be determined by using the heart rates of an appropriate number of subjects. The first specified value can also be smaller than 1.

[0165] A lower LF / HF indicates that the user is relaxed. Regarding LF / HF, if (LF / HF determined based on the user's heart rate when in a resting state)×(second specified value)≥(LF / HF determined based on the user's heart rate when in a task execution state), it can also be determined that the user is relaxed. The second specified value can also be determined by using LF / HF determined based on the heart rates of an appropriate number of subjects. The second specified value can also be greater than 1.

[0166] A higher HF indicates that the user is relaxed. Regarding HF, if (HF determined based on the heart rate of the user in a resting state)×(third specified value)≤(HF determined based on the heart rate of the user in a task execution state), it can also be determined that the user is relaxed. The third specified value can also be determined by using the HF determined by the heart rates of an appropriate number of subjects. The third specified value can also be smaller than 1.

[0167] A higher skin temperature indicates that the user is relaxed. Regarding the skin temperature, if (the skin temperature of the user in a resting state)×(the fourth specified value)≤(the skin temperature of the user in a task execution state), it can also be determined that the user is relaxed. The fourth specified value can also be determined by using the skin temperatures of an appropriate number of subjects. The fourth specified value can also be greater than 1.

[0168] A smaller change in the EDA value indicates that the user is relaxed. Regarding EDA, the above conclusion can be obtained because the EDA value returns to the original value after rising when the user feels stressed, and the above-mentioned change in the EDA value does not occur when the user does not feel stressed. That is, regarding EDA, if (the change in multiple EDAs when the user is in a quiet state) × (the fifth specified value) ≥ (the change in multiple EDAs when the user is in a task execution state), it can also be judged that the user is relaxed. The fifth specified value can also be determined based on the EDA of an appropriate number of subjects. The fifth specified value can also be smaller than 1.

[0169] A lower pulse rate indicates that the user is relaxed. Regarding the pulse rate, if (the pulse rate of the user in a resting state)×(the sixth prescribed value)≥(the pulse rate of the user in a task execution state), it can also be determined that the user is relaxed. The sixth prescribed value can also be determined by using the pulse rates of an appropriate number of subjects. The sixth prescribed value can also be smaller than 1.

[0170] The judgment in S204 may be based on "at least two of the following biological information: heart rate, pulse rate, LF / HF, HF, skin temperature and EDA" instead of "at least two of the following biological information: heart rate, pulse rate, LF / HF, HF, skin temperature, EDA, brain wave, cerebral blood flow, facial expression, respiratory rate, electromyography and blood pressure".

[0171] If the determination unit 130 determines with respect to the above-mentioned biological information that the value in the task execution state is compared with the value in the resting state and the user is more relaxed, or that the value in the resting state and the value in the task execution state are of the same degree (step S204: yes), the determination unit 130 proceeds to step S205; otherwise (step S204: no), the determination unit 130 proceeds to step S211.

[0172] If S204 is Yes, the process shown in step S206 is executed, and if S204 is No, the process shown in step S206 is not executed. In this way, the processor can reduce the amount of processing and determine the state of the user.

[0173] In step S205 , the determination unit 130 determines whether the user is in a convergent thinking state, a divergent thinking state, or a relaxed state. The determination unit 130 may not store the determination result in the determination unit 130 .

[0174] In step S206, the determination unit 130 determines whether the user is in the convergent thinking state, the divergent thinking state, or the relaxed state. The detailed processing included in step S206 will be described later.

[0175] In step S211 , the determination unit 130 determines that the user is not in any of the convergent thinking state, the divergent thinking state, and the relaxed state. The determination unit 130 may not store the above determination result in the determination unit 130 .

[0176] In step S212, the determination unit 130 determines whether to end Figure 3 For example, the determination unit 130 may determine whether the biometric information is provided from the calculation unit 120, and when it is determined that the biometric information is no longer provided, it is determined to be ended. Figure 3 In addition, the determination unit 130 may also determine whether a preset time has passed, and when it is determined that the above time has passed, it is determined that the process is finished. Figure 3 The series of determination processes shown in the figure. By ending the determination process, the amount of processing by the processor can be reduced.

[0177] In step S212, it is determined to be completed. Figure 3 In the case of a series of determination processes shown (step S212: Yes), the process ends. Figure 3 Otherwise, the process proceeds to step S201. In this way, the information processing device 100 repeatedly executes the above-mentioned determination process until it is determined that the process is finished. Figure 3 The series of determination processes shown above are completed.

[0178] Figure 4 This is a flowchart showing a third example of the information processing system 10 according to the present embodiment. Figure 4 The processing shown is the processing performed by the determination unit 130, and the details are shown in Figure 3 The processing included in step S206.

[0179] In step S301 , the determination unit 130 acquires the CVRR from the calculation unit 120 . The CVRR acquired by the determination unit 130 is the CVRR calculated by the calculation unit 120 based on the electrocardiographic waveform acquired by the acquisition unit 110 .

[0180] In step S302, it is determined whether the CVRR obtained in step S201 is greater than or equal to a threshold value. If it is determined that the CVRR is greater than or equal to the threshold value (step S302: Yes), the process proceeds to step S304, otherwise (step S302: No), the process proceeds to step S303. The determination process of step S302 may also be referred to as the first determination process.

[0181] The threshold of CVRR used in step S302 is, for example, within the range of 3.5% to 4.2%. In a previous experiment, the following results were obtained: the average CVRR of users who performed a task to induce the user to enter a convergent thinking state was 3.43%, and the average CVRR of users who performed a task to induce the user to enter a divergent thinking state was 4.29%. Therefore, by using a threshold included in the above range as a threshold between 3.43% and 4.29%, it is possible to appropriately determine whether the user is in a convergent thinking state or a divergent thinking state.

[0182] In step S303 , the determination unit 130 determines that the user's state is a convergent thinking state.

[0183] In step S304 , the determination unit 130 determines that the user's state is either a divergent thinking state or a relaxed state.

[0184] In step S305 , the determination unit 130 acquires LF / HF from the calculation unit 120 . The LF / HF acquired by the determination unit 130 is the LF / HF calculated by the calculation unit 120 based on the electrocardiographic waveform acquired by the acquisition unit 110 .

[0185] In step S306, it is determined whether the LF / HF acquired in step S305 is greater than or equal to the threshold. If it is determined that the LF / HF is greater than or equal to the threshold (step S306: Yes), the process proceeds to step S308, otherwise (step S306: No), the process proceeds to step S307. The determination process in step S306 is also referred to as the second determination process.

[0186] The threshold value of LF / HF used in step S306 is, for example, within the range of 3.0% to 4.5%. In a previous experiment, the following results were obtained: the average LF / HF value of users who performed a task to induce the user to enter a convergent thinking state was 2.57%, and the average CVRR value of users who performed a task to induce the user to enter a divergent thinking state was 4.91%. Therefore, by using a threshold value included in the above range as a threshold value between 2.57% and 4.91%, it is possible to appropriately determine whether the user is in a convergent thinking state or a divergent thinking state.

[0187] In step S307 , the determination unit 130 determines that the user is in a relaxed state.

[0188] In step S308 , the determination unit 130 determines that the user is in a divergent thinking state.

[0189] In step S309, the determination unit 130 stores the determination result regarding the user's state. Specifically, the determination unit 130 stores the determination result of step S303, step S307, or step S308. The determination processing of step S303, step S307, and step S308 is also referred to as a third determination processing.

[0190] In step S310, the determination unit 130 determines whether to end Figure 4 For example, the determination unit 130 may determine whether CVRR or LF / HF is provided from the calculation unit 120, and when it is determined that one or both of CVRR and LF / HF are no longer provided, it is determined to end. Figure 4 In addition, the determination unit 130 may also determine whether a preset time has passed, and when it is determined that the above time has passed, it is determined that the process is finished. Figure 4 A series of determination processes are shown.

[0191] In step S310, it is determined to be completed. Figure 4 In the case of a series of determination processes shown (step S310: Yes), the process ends. Figure 4 Otherwise, the process proceeds to step S301. In this way, the information processing device 100 repeatedly performs the above-mentioned determination process until it is determined that the process is finished. Figure 4 A series of determination processes are performed.

[0192] Figure 5 It is an explanatory diagram showing an example of a state determined by the information processing system 10 according to the present embodiment.

[0193] Figure 5The user's state determination result determined by the determination unit 130 (step S102 ), that is, whether the user is in a convergent thinking state, a divergent thinking state, or a relaxed state, is indicated on the time axis.

[0194] Figure 5 (1) represents the average value of the user's CVRR in each time interval and the threshold value of CVRR.

[0195] Figure 5 (2) represents the average value of the user's LF / HF in each time interval and the threshold value of LF / HF.

[0196] exist Figure 5 In the time interval T1 shown, since the CVRR is smaller than the threshold, the determination unit 130 determines that the user is in a convergent thinking state (step S303 ).

[0197] exist Figure 5 In the time period T2 shown, since CVRR is equal to or greater than the threshold value and LF / HF is equal to or greater than the threshold value, the determination unit 130 determines that the user is in a divergent thinking state (step S308 ).

[0198] exist Figure 5 In the time period T3 shown, since CVRR is equal to or greater than the threshold and LF / HF is less than the threshold, the determination unit 130 determines that the user is in a relaxed state (step S307 ).

[0199] When a user performs a complex task, it takes some time from when the task is presented to when the user understands the content of the task and starts to perform the task. Therefore, when the determination unit 130 determines the user's state, the user's state at a certain time after the user starts the task may be used.

[0200] Furthermore, considering that the change in the user's state after the task occurs after a certain period of time, in order to establish a correspondence between these states and the tasks and determine the state, for each identical task, the time period from the end of the task to a certain period of time can be aggregated as one determination object.

[0201] exist Figure 4 In the determination processing shown in the examples, threshold information for determining the value to which the threshold is set may be stored in a storage device, and the threshold set by using the threshold information acquired from the storage device may be used.

[0202] The threshold information may also be stored in association with an identification ID for identifying an individual. In this case, a threshold suitable for an individual can be used to determine a state related to thinking, and determination accuracy can be improved.

[0203] The threshold information corresponding to the identification ID may also be a value obtained by also considering the CVRR and LF / HF of the individual in a quiet state. Alternatively, the CVRR and LF / HF of each user in a quiet state may be stored in a storage device in correspondence with the identification ID, and threshold information for each user may be generated. The quiet state may also be a neutral state (in other words, a neutral state from the perspective of thinking) induced by letting the user listen to white noise or say meaningless words, or a state in which a task is not performed. The threshold information may also be updated based on the result of the state determination, etc.

[0204] Figure 6 This is a flowchart showing an example of processing related to updating of threshold information according to the present embodiment. Figure 6 This indicates a process of performing determination using threshold information associated with user identification information.

[0205] In step S401, the determination unit 130 obtains identification information of the user. Identification information is information that can uniquely identify the user. The identification information may be characters or symbols input by the user using an input device such as a keyboard, or may be a facial image of the user captured by a camera.

[0206] In step S402 , the determination unit 130 acquires threshold information corresponding to the identification information acquired in step S401 from the storage device.

[0207] In step S403, the determination unit 130 determines a threshold based on the threshold information acquired in step S402. The determined threshold is the CVRR threshold (corresponding to the first threshold), or both the CVRR threshold (corresponding to the first threshold) and the LF / HF threshold (corresponding to the second threshold).

[0208] In step S404, the determination unit 130 performs determination processing based on the user's biological information. The determination processing performed in step S404 is Figure 3 and Figure 4 Processing shown.

[0209] In step S405, the determination unit 130 obtains subjective evaluation information related to the user's state. The subjective evaluation information is the user's state evaluated by the user himself. The determination unit 130, for example, prompts a GUI (Graphical User Interface) for accepting the user's answer, and the GUI includes a message asking about the user's state in the task, such as "Please self-evaluate the state in the task", and options for the user's state when performing the task (specifically "divergent thinking state", "relaxed state" and "convergent thinking state"). In the case where the user answers "divergent thinking state" using the GUI, the information that the user is in a divergent thinking state when performing the task is obtained as subjective evaluation information. In addition, the information obtained in step S405 is not limited to the subjective evaluation information evaluated by the user himself, and can also be evaluation information indicating the determination result determined by using a method different from the state determined based on the heartbeat. Here, the case where the evaluation information is subjective evaluation information is used as an example for explanation.

[0210] In step S406, the determination unit 130 determines whether the state of the user determined in step S404 is consistent with the state of the user indicated by the subjective evaluation information obtained in step S405. For example, when the state of the user determined based on the biometric information is a convergent thinking state, and the state of the user indicated by the subjective evaluation information is a convergent thinking state, it is determined that the two states are consistent. On the other hand, for example, when the state of the user determined based on the biometric information is a convergent thinking state, and the state of the user indicated by the subjective evaluation information is a divergent thinking state, it is determined that the two states are inconsistent.

[0211] If the two states are consistent (step S406: yes), end Figure 6 The series of processing shown is performed, otherwise (step S406: No) proceeds to step S407.

[0212] In step S407, the determination unit 130 updates the threshold information corresponding to the user (i.e., the identification information) based on the determined state of the user and the state of the user represented by the subjective evaluation information. For example, when the state of the user determined based on the biological information is a convergent thinking state, and the state of the user represented by the subjective evaluation information is a divergent thinking state, the threshold information is updated to lower the threshold of the CVRR represented by the threshold information. This is because by lowering the threshold of the CVRR, the range of the CVRR determined to be above the threshold (step S302) can be expanded, which helps to determine the user's state as a divergent thinking state.

[0213] The updating of the threshold values ​​of LF / HF is also similar, and the detailed description is omitted.

[0214] As described above, by updating the threshold information using the result of subjective evaluation, the accuracy of state determination can be improved.

[0215] The following describes the prompting of information related to the user's status. The prompted information includes Figure 4 The determination result stored in step S209 is presented to the user using the presentation unit 140.

[0216] The diagram (e.g., graph) indicating the determination result indicated by the indicating unit 140 may indicate the state of the user (i.e., convergent thinking state, divergent thinking state, or relaxed state) in time series ( Fig.7D ), or it can also represent the proportion or ratio of the user's status ( Figure 7C or Fig. 7E ). Alternatively, you can just indicate the user's status ( Fig. 7A , Figure 7C , Fig.7D or Figure 7F ), and the evaluation value of the judgment may also be displayed together with the user's status ( Figure 7B or Fig. 7E ). The evaluation value can be a value indicating the degree of appropriateness of the user's state, a value indicating the degree of stability of thinking based on the time a certain state is maintained, or a value indicating the proportion of time in a certain state in the task time. When displaying the evaluation value, it can also be displayed as a score, such as x points for convergent thinking state, y points for divergent thinking state, or z points for relaxed state ( Figure 7B ). In addition, a more general expression may be used, where the convergent thinking state is expressed as "concentration" and the divergent thinking state is expressed as "creativity". The judgment result may be the result of evaluating and judging the business time as a whole, or the result of judging the state of a specific time period.

[0217] After the determination unit 130 determines the state of the user, when scoring the determined state, the score may be determined based on the amount of change from the previously acquired biological information of the user in a resting state to the biological information in a task execution state. Alternatively, the score may be calculated by comparing the average value of the biological information measured in the task execution state of the user with the value of the average feature quantity of data of multiple people acquired in advance in an experiment. Furthermore, the score may be calculated by comparing the value obtained by calculating the amount of change from the previously acquired biological information of the user in a resting state to the biological information in a task execution state with the value of the average change amount of feature quantity data of multiple people acquired in advance in an experiment.

[0218] Figure 7A to Figure 7G An example of presentation when presenting the determination result according to the present embodiment is shown.

[0219] Fig. 7A It is an explanatory diagram of a first example of presentation of determination results according to the present embodiment. Fig. 7A This is an example of using words to indicate the tendency of the status of the user in the work. Fig. 7A The "divergent thinking" in is the abbreviation of "divergent thinking state". In addition, the abbreviation of "convergent thinking state" can be "convergent thinking", and the abbreviation of "relaxed state" can be "relaxed". The same is true for the following. In addition, Fig. 7A The prompts are not limited to being displayed on the screen, but can also be used as sound prompts.

[0220] Figure 7B It is an explanatory diagram of a second example of presentation of determination results according to the present embodiment. Figure 7B This is an example of using a score to present the result of the status determination of the user in the business. The score presented can be only the score for a specific status or the scores for multiple statuses. The upper limit of the score can be 100 points or 5 points.

[0221] Figure 7C It is an explanatory diagram of a third example of presentation of determination results according to the present embodiment. Figure 7C This is an example of expressing the proportion of the state of the user in the business (ie, the convergent thinking state, the divergent thinking state, or the relaxed state) using a pie chart.

[0222] Fig.7D It is an explanatory diagram of a fourth example of presentation of determination results according to the present embodiment. Fig.7D This is an example of representing the state of a user in a business in time series. The horizontal axis represents time, and the vertical axis represents the state of the user (i.e., convergent thinking state, divergent thinking state, or relaxed state). In addition, the time shown on the horizontal axis can represent a moment or a few minutes.

[0223] Fig. 7E It is an explanatory diagram of a fifth example of presentation of determination results according to the present embodiment. Fig. 7E This is an example of representing the score of the convergent thinking state (also called the convergent thinking degree) of the user in the business in a time series. The horizontal axis represents time, and the vertical axis represents the score of the convergent thinking state of the user. In addition, the vertical axis can also be set to the score of the divergent thinking state, and can also be set to the score of the relaxed state. In addition, the results of multiple thinking states can also be displayed comprehensively.

[0224] Figure 7F It is an explanatory diagram of a sixth example of presentation of determination results according to the present embodiment. Figure 7F This is an example of representing the status of a user in service with circular marks on a coordinate plane consisting of a horizontal axis representing CVRR and a vertical axis representing LF / HF. Figure 7FIn the diagram, the first quadrant represents the divergent thinking state, the second and third quadrants represent the convergent thinking state, and the fourth quadrant represents the relaxed state.

[0225] For example, Figure 7F The mark 31 shown indicates the user's state 5 minutes after the service starts, specifically indicating that the user's state 5 minutes after the service starts is a divergent thinking state. Figure 7F The symbol 32 shown indicates the state of the user 10 minutes after the start of the service, and specifically indicates that the state of the user 10 minutes after the start of the service is a divergent thinking state. Figure 7F The symbol 33 shown indicates the state of the user 15 minutes after the start of the service, and specifically indicates that the state of the user 15 minutes after the start of the service is a convergent thinking state.

[0226] In addition, the labels of the horizontal axis and the vertical axis can be set to CVRR and LF / HF, respectively, or other words. Figure 7F The marks shown may represent a plurality of points indicating the states of a plurality of time intervals in the business, or may represent the average state of the entire business with a single point.

[0227] Figure 7G It is an explanatory diagram of a seventh example of presentation of determination results according to the present embodiment. Figure 7G 1 is a diagram showing an example of presentation including information other than the determination result. 1 is a diagram showing an example of a display image G1 displayed by the presentation unit 140 as presentation information. The display image G1 includes a graph G11, an input field G12, and message display fields G13 and G14.

[0228] Figure G11 and Figure 7C The same is true for the diagram shown.

[0229] The input bar G12 is a bar for the user to select whether to save the determination result and input it. In the input bar G12, a message written as "Do you want to save the result?", a "YES" button, and a "NO" button are displayed. The "Yes" button is a button for the user to choose to save the determination result. The "No" button is a button for the user to choose not to save the determination result. If the user selects the "Yes" button, the prompt unit 140 accepts the operation and changes the color of the "Yes" button. If the user selects the "No" button, the prompt unit 140 accepts the operation and changes the color of the "No" button. In this way, the user can easily confirm which button is selected.

[0230] If the user selects the "Yes" button, the prompt unit 140 accepts the operation, and the result of the determination on whether to save becomes "permitted", and the determination result on the user's status is saved. If the user selects the "No" button, the prompt unit 140 accepts the operation, and the result of the determination on whether to save becomes "not permitted", and the determination result on the user's status is not saved. The determination result of not permitted is not saved in the storage unit, so it is possible to reduce unnecessary consumption of memory.

[0231] The message display field G13 includes a QR code. In addition, the message display field G13 includes a message for notifying the user that the user can confirm the result of this time with his / her own portable terminal by scanning the QR code separately. Figure 7G In the message display field G13, a message such as "If you want to confirm the result of this time with your own smartphone, please scan the QR code here" and a QR code are included. In addition, although the QR code is shown in the example, it can also be set to input the user's email address. In addition, if a card reader is installed in the prompt unit 140, when the card reader reads a card such as an employee ID card, the determination result can also be sent to the user and his / her supervisor.

[0232] The message display field G14 includes messages that take into account the user's biological information in the business, the weather of the day, the time period, etc. Figure 7G In the example, a user who imagines a specific state of mind that persists for a long time during the early morning hours is shown a positive message such as "Your state of mind is very stable. You are able to think deeply about things and should be able to come up with better results. I wish you a good day."

[0233] Next, a description will be given of a process in which the information processing device 100 controls the lighting according to the determination result.

[0234] The information processing device 100 compares the target state, which is the state set as the target by the user, with the state related to the user's thinking determined by the information processing device 100, and when the result of the comparison is that the target state is different from the determined state related to the user's thinking, the information processing device 100 controls the characteristics of the illumination light irradiated by the illumination device that illuminates the vicinity of the user to change. The control of the illumination device will be described in more detail later.

[0235] Figure 8 This is a flowchart showing an example of a process of controlling lighting according to a determination result according to the present embodiment.

[0236] In step S501 , the acquisition unit 110 acquires information on a state targeted by the user.

[0237] The processing from step S502 to step S503 is the same as Figure 2BThe same applies to steps S101 to S102 in FIG.

[0238] In step S504, the determination unit 130 determines whether the target state acquired by the acquisition unit 110 in step S501 is consistent with the state determined in step S503. If it is determined that the two states are consistent (step S504: Yes), the process proceeds to step S506, and if it is determined that they are inconsistent (step S504: No), the process proceeds to step S505.

[0239] In step S505, the presentation unit 140 controls at least one of the illuminance and the color temperature of the lighting. The details of the control will be described later.

[0240] In step S506, the determination unit 130 determines whether to end Figure 8 For example, the determination unit 130 may determine whether the new biological information is successfully acquired (step S502), and if it is determined to be unsuccessful, the process is terminated. Figure 8 In addition, the determination unit 130 may also determine whether a preset time has passed, and when it is determined that the above time has passed, it is determined that the process is finished. Figure 8 The series of determination processes shown in the figure. By ending the determination process, the amount of processing by the processor can be reduced.

[0241] Fig. 9 This is a diagram showing the relationship between the illuminance and color temperature of lighting suitable for guiding the user to a certain state (i.e., a convergent thinking state, a divergent thinking state, or a relaxed state). Such a relationship between the illuminance and color temperature of lighting is described in Non-Patent Document 3.

[0242] Therefore, the information processing device 100 can guide the user to a divergent thinking state, a convergent thinking state, or a relaxed state by controlling the lighting device as an example.

[0243] (1) Control that induces users to divergent thinking

[0244] For example, Non-Patent Document 3 describes the use of lighting with high illuminance and low color temperature as a condition suitable for work such as brainstorming, that is, a condition suitable for a divergent thinking state.

[0245] On the other hand, when it is desired to induce the user to a divergent thinking state, the user's state is different from the divergent thinking state, and is estimated to be a convergent thinking state or a relaxed state, for example.

[0246] At this time, if the information processing device 100 controls the lighting device to lower the color temperature of the lighting light and increase the illuminance, there is a possibility that the user can be guided to a divergent thinking state (see Fig. 9 ).

[0247] Therefore, when the information processing device 100 determines that the user's CVRR is less than a threshold value (that is, when it is determined that the user is in a convergent thinking state), or when it determines that the user's CVRR is above the threshold and LF / HF is less than the threshold value (that is, when it is determined that the user is in a relaxed state), if the lighting device is controlled to lower the color temperature of the lighting light and increase the illuminance, there is a possibility that the user can be induced into a divergent thinking state.

[0248] (2) Control that induces users to converge their thinking state

[0249] For example, Non-Patent Document 3 describes that lighting with a high color temperature and a high illuminance is used as a condition suitable for a focused thinking state.

[0250] On the other hand, when it is desired to induce the user to a convergent thinking state, the user's state is different from the convergent thinking state, and is estimated to be, for example, a divergent thinking state or a relaxed state.

[0251] At this time, if the information processing device 100 controls the lighting device to increase the color temperature of the lighting light and the illuminance, there is a possibility that the user can be guided to a state of convergent thinking (see Fig. 9 ).

[0252] Therefore, when the information processing device 100 determines that the user's CVRR is above the threshold and the LF / HF is above the threshold (that is, when it is determined that the user is in a divergent thinking state), or when it determines that the user's CVRR is above the threshold and the LF / HF is less than the threshold (that is, when it is determined that the user is in a relaxed state), if the lighting device is controlled to increase the color temperature of the lighting light and increase the illuminance, there is a possibility that the user can be induced into a convergent thinking state.

[0253] (3) Control that induces the user to relax

[0254] For example, Non-Patent Document 3 describes the use of lighting with a low color temperature and low illuminance as a condition suitable for a relaxed state.

[0255] On the other hand, when it is desired to induce the user to a relaxed state, the user's state is different from the relaxed state, and is estimated to be, for example, a divergent thinking state or a convergent thinking state.

[0256] At this time, if the information processing device 100 controls the lighting device to reduce the color temperature of the lighting light and reduce the illuminance, there is a possibility that the user can be induced to a relaxed state (see Fig. 9 ).

[0257] Therefore, when the information processing device 100 determines that the user's CVRR is less than a threshold value (that is, when it is determined that the user is in a convergent thinking state), or when it determines that the user's CVRR is above the threshold value and the LF / HF is above the threshold value (that is, when it is determined that the user is in a divergent thinking state), if the lighting device is controlled to lower the color temperature of the lighting light and lower the illuminance, there is a possibility that the user can be induced into a relaxed state.

[0258] As described above, according to the information processing device 100 of the present embodiment, it is possible to determine the state related to the user's thoughts with higher accuracy.

[0259] In addition, in the above-mentioned embodiments, each component can be composed of dedicated hardware or can be implemented by executing a software program suitable for each component. Each component can also be implemented by a program execution unit such as a CPU or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory. Here, the software for implementing the information processing device and the like in the above-mentioned embodiments is the following program.

[0260] That is, the program causes a computer to execute an information processing method, which includes: obtaining the user's CVRR (Coefficient of Variation of R-R interval) and LF / HF (Low Frequency / High Frequency) by a sensor; and determining by a processor based on the obtained CVRR and LF / HF whether the state related to the user's thinking is a convergent thinking state, a divergent thinking state, and a relaxed state.

[0261] Alternatively, a configuration may be adopted in which any one of a CPU or a processor and a storage device that performs a process of determining a thought state is disposed in a server that communicates with a sensor that detects biological information of a user via a network.

[0262] The above describes information processing methods and the like involved in one or more embodiments based on the embodiments, but the present disclosure is not limited to the embodiments. As long as it does not deviate from the main purpose of the present disclosure, the embodiments obtained by applying various modifications thought of by those skilled in the art to the embodiments, and the embodiments constructed by combining constituent elements in different embodiments may also be included in the scope of one or more embodiments.

[0263] (Other 1)

[0264] Modifications of the embodiments of the present disclosure may be as follows.

[0265] The method according to item 1 is a method performed by a processor,

[0266] The method comprises:

[0267] The processor performs a first process that does not include a frequency analysis process; and

[0268] When the result of the first processing satisfies a predetermined condition, the processor performs a second processing.

[0269] When the result of the first process does not satisfy the predetermined condition, the processor does not perform the second process.

[0270] the first process is (i) a first decision process; (ii) a second decision process; (iii) a third decision process; (iv) the first decision process and the second decision process; (v) the first decision process and the third decision process; (vi) the second decision process and the third decision process; or (vii) the first decision process, the second decision process and the third decision process,

[0271] The first determination process is to determine whether the user's heart rate is smaller than a first threshold value.

[0272] The second determination process is to determine whether the skin temperature of the user is lower than a second threshold value.

[0273] The third determination process is to determine whether the difference between the maximum value and the minimum value of the skin electrical activity of the user in a predetermined period is smaller than a third threshold value,

[0274] The second process includes:

[0275] Calculating the CVRR based on a first standard deviation of a plurality of heartbeat intervals of the user and a first average of the plurality of heartbeat intervals;

[0276] Performing frequency analysis on the multiple heartbeat intervals to obtain a power spectrum density function of the user's heartbeat intervals;

[0277] Calculating LF / HF based on a first integrated value of a first interval of the power spectral density function and a second integrated value of a second interval of the power spectral density function;

[0278] Based on the CVRR and the LF / HF, determining a state associated with the user; and

[0279] The status of the decision is output.

[0280] The above method shows that: when the result of the first process does not satisfy the specified condition, the processor does not perform the second process. That is, when the result of the first process does not satisfy the specified condition, the processor does not perform the frequency analysis process, does not perform the standard deviation calculation process, does not perform the average value calculation process, and does not perform the integral value calculation process. In this way, the processor can reduce the processing amount and determine the user's state.

[0281] The processing amount obtained by adding the processing amount of the first determination process, the processing amount of the second determination process, and the processing amount of the third determination process is smaller than the processing amount of the third determination process. Thus, the processor can reduce the processing amount and determine the state of the user.

[0282] The frequency analysis process may be a process of performing a Fast Fourier Transform.

[0283] The first threshold value may be (heart rate when the user is in a resting state)×a. Alternatively, a>1 may be satisfied.

[0284] The second threshold value may be (the skin temperature of the user in a resting state)×b. b>1 may also be satisfied.

[0285] The third threshold may be [(the maximum value of the skin electrical activity included in the plurality of skin electrical activities when the user is in a resting state) - (the minimum value of the skin electrical activity included in the plurality of skin electrical activities when the user is in a resting state)] × c. c>1 may also be satisfied.

[0286] The method according to item 2 is the method according to item 1,

[0287] The CVRR is (the first standard deviation) / (the first mean value),

[0288] The LF / HF is (the first integrated value) / (the second integrated value),

[0289] The beginning of the first interval is the first frequency, and the end of the first interval is the second frequency.

[0290] The beginning of the second interval is the third frequency, and the end of the second interval is the fourth frequency.

[0291] The first frequency is smaller than the second frequency, and the third frequency is smaller than the fourth frequency.

[0292] The first frequency is lower than the third frequency, and the second frequency is lower than the fourth frequency.

[0293] The method according to item 3 is, in the method according to item 2,

[0294] The user's electrocardiogram waveform is measured by using a plurality of electrodes.

[0295] The plurality of heartbeat intervals are determined based on the electrocardiogram waveform,

[0296] Each of the plurality of heartbeat intervals is a time interval between adjacent R waves in the electrocardiogram waveform.

[0297] The skin temperature is measured using a thermocouple or a camera.

[0298] The electrodermal activity is measured using a plurality of electrodes.

[0299] (Other 2)

[0300] The information processing device 100 may also be Fig.10 The information processing device 100 shown, or Fig.11 The information processing device 1000 is shown.

[0301] (Other 2-1)

[0302] Fig.10 FIG. 1 is a diagram showing an example of transmission of a plurality of biological information in the information processing device 100 according to the embodiment.

[0303] The information processing system 10 includes an information processing device 100. The information processing system 10 may include a first measuring device 150-1, a second measuring device 150-2, a third measuring device 150-3, and a fourth measuring device 150-4.

[0304] The first measuring device 150-1 includes a first sensor. The first sensor may be an image sensor or one or more electrodes.

[0305] The second measuring device 150-2 includes a second sensor. The second sensor may be an image sensor or one or more electrodes.

[0306] The third measuring device 150-3 includes a third sensor. The third sensor may be an image sensor or a thermocouple.

[0307] The fourth measuring device 150-4 includes a fourth sensor. The fourth sensor may be an EDA sensor. The EDA sensor may include one or more electrodes.

[0308] The first measurement device 150 - 1 may determine the heart rate based on the information observed by the first sensor.

[0309] The first measurement device 150-1 may generate an electrocardiogram waveform based on information observed by the first sensor. The first measurement device 150-1 may determine a plurality of heartbeat intervals based on the electrocardiogram waveform.

[0310] The second measuring device 150 - 2 may determine the pulse rate based on the information observed by the second sensor.

[0311] The second measuring device 150-2 may generate an acceleration pulse based on the information observed by the second sensor. The second measuring device 150-2 may determine a plurality of pulse intervals based on the waveform of the acceleration pulse.

[0312] The third measuring device 150 - 3 may determine the skin temperature based on the information observed by the third sensor.

[0313] The fourth measuring device 150 - 4 may determine the electrical skin activity based on the information observed by the fourth sensor.

[0314] The acquisition unit 110 may receive the heart rate or a plurality of heartbeat intervals from the first measurement device 150 - 1 .

[0315] The acquisition unit 110 may receive the pulse rate and a plurality of pulse intervals from the second measurement device 150 - 2 .

[0316] The acquisition unit 110 may receive the skin temperature from the third measuring device 150 - 3 .

[0317] The acquisition unit 110 may receive the electrical skin activity from the fourth measuring device 150 - 4 .

[0318] The acquisition unit 110 may send the heart rate, a plurality of heartbeat intervals, the pulse rate, a plurality of pulse intervals, the skin temperature, and the skin electrical activity to the calculation unit 120. The acquisition unit 110 may send the heart rate, the pulse rate, the skin temperature, and the skin electrical activity to the determination unit 130 without passing through the calculation unit 120.

[0319] The calculation unit 120 may also calculate CVRR, LF / HF, and HF based on a plurality of heartbeat intervals. Figure 1A , Figure 1B , Figure 1C , Formula 1, etc. are explained.

[0320] The calculation unit 120 may also calculate CVRR', LF' / HF', and HF' based on a plurality of pulse intervals. The pulse interval is the time interval between two consecutive a waves in the waveform of the acceleration pulse. In addition, the pulse rate is, for example, the number of beats per minute. That is, (pulse rate) = 60 / (pulse interval). When detecting the a wave, for example, a well-known method such as the Pan&Tompkins method may be used. It may also be set as CVRR' = (standard deviation of the pulse interval) / (average value of the pulse interval). HF' and LF may also be calculated based on the power spectral density, which is obtained by performing frequency analysis on the equally spaced time series data of the pulse fluctuation using Fast Fourier Transform (FFT). The power spectrum may also be used instead of the power spectral density. HF' is the integral value of the power spectral density in the high frequency domain (for example, 0.14 Hz to 0.4 Hz). LF' is the integral value of the power spectral density in the low frequency region (for example, 0.04 Hz to 0.14 Hz). The frequency conversion of FFT can be performed at 5-second intervals or at any time interval. Alternatively, LF' / HF'=(integral value of the above power spectrum density in the range of 0.04 Hz to 0.14 Hz) / (integral value of the above power spectrum density in the range of 0.14 Hz to 0.4 Hz).

[0321] Before explaining the determination unit 130, Figure 3 Variations of Figure 4 A variation of .

[0322] Figure 3 It can also be changed as follows.

[0323] In S201, "obtain at least two biological information among heart rate, pulse rate, LF / HF, HF, skin temperature and EDA" can also be changed to "obtain at least two biological information among heart rate, pulse rate, LF / HF, HF, LF' / HF', HF', skin temperature and EDA".

[0324] ·In S204, "Regarding at least two biological information among heart rate, pulse rate, LF / HF, HF, skin temperature and EDA, it is shown that the individual is more relaxed in the task execution state compared to the resting state" can also be changed to "Regarding at least two biological information among heart rate, pulse rate, LF / HF, HF, LF' / HF', HF', skin temperature and EDA, it is shown that the individual is more relaxed in the task execution state compared to the resting state".

[0325] Figure 4 It can also be changed as follows.

[0326] In S301, "obtain CVRR" may be changed to "obtain CVRR, or obtain CVRR'".

[0327] In S302, "CVRR is equal to or greater than a threshold value" may be changed to "CVRR is equal to or greater than a threshold value corresponding to CVRR, or CVRR' is equal to or greater than a threshold value corresponding to CVRR'".

[0328] In S305, "obtain LF / HF" may be changed to "obtain LF / HF, or obtain LF' / HF'".

[0329] In S306, "LF / HF is equal to or greater than a threshold value" may be changed to "LF / HF is equal to or greater than a threshold value corresponding to LF / HF, or LF' / HF' is equal to or greater than a threshold value corresponding to LF' / HF'".

[0330] Above, the end Figure 3 Variations of Figure 4 Description of a modified example.

[0331] The determination unit 130 may receive the heart rate, pulse rate, skin temperature, and skin electrical activity from the acquisition unit 110 via the calculation unit 120. The determination unit 130 may receive the heart rate, pulse rate, skin temperature, and skin electrical activity from the acquisition unit 110 without passing through the calculation unit 120. The determination unit 130 may receive CVRR, LF / HF, HF, CVRR', LF' / HF', and HF' from the calculation unit 120.

[0332] The determination unit 130 may also receive a plurality of biological information required for implementing the processes of S204, S302, and S306. That is, the determination unit 130 may not necessarily receive all of the 10 biological information, namely, heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity. The plurality of biological information required are the first biological information, the second biological information, and the third generated information.

[0333] The user may also indicate to the information processing device 100 what the first biometric information, the second biometric information, and the third generated information are, and the information processing device 100 may also execute S201, S204, S301, S302, S305, and S306 based on the indicated first biometric information, the second biometric information, and the third generated information.

[0334] The first biometric information is CVRR or CVRR'.

[0335] The second biological information is LF / HF or LF' / HF'.

[0336] The third biological information is one or more biological information included in eight biological information including heart rate, pulse rate, LF / HF, LF' / HF', HF, HF', skin temperature, and skin electrical activity.

[0337] Among them, (the second biological information, the third biological information) ≠ (LF / HF, LF / HF), (the second biological information, the third biological information) ≠ (LF' / HF', LF' / HF'), (the second biological information, the third biological information) ≠ (LF / HF, LF' / HF'), (the second biological information, the third biological information) ≠ (LF' / HF', LF / HF).

[0338] However, the third biological information does not include HF and HF'.

[0339] The information processing system 10 may not necessarily include all of the first measuring device 150-1, the second measuring device 150-2, the third measuring device 150-3, and the fourth measuring device 150-4. The information processing system 10 may include one or more measuring devices necessary to supply the first biological information, the second biological information, and the third biological information to the determination unit 130 among these four measuring devices.

[0340] The acquisition unit 110 does not necessarily need to acquire all of the heart rate, heartbeat interval, pulse rate, pulse interval, skin temperature, and skin electrical activity. The acquisition unit 110 may also acquire one or more of the six pieces of biometric information required to supply the first biometric information, the second biometric information, and the third biometric information to the determination unit 130.

[0341] The acquisition unit 110 does not necessarily need to send all of the heart rate, heartbeat interval, pulse rate, pulse interval, skin temperature, and skin electrical activity to the calculation unit. The acquisition unit 110 may send one or more of the six pieces of biometric information necessary for supplying the first biometric information, the second biometric information, and the third biometric information to the determination unit 130 to the calculation unit 120.

[0342] The calculation unit 120 does not necessarily need to receive all of the heart rate, heartbeat interval, pulse rate, pulse interval, skin temperature, and skin electrical activity. The calculation unit 120 may also receive one or more of the six biometric information required to supply the first biometric information, the second biometric information, and the third biometric information to the determination unit 130.

[0343] The calculation unit 120 does not necessarily need to calculate all of the six pieces of biometric information, namely, CVRR, LF / HF, HF, CVRR', LF' / HF', and HF'. It is also possible not to calculate one or more pieces of biometric information that are the six pieces of biometric information but are not included in the first biometric information, the second biometric information, and the third generated information.

[0344] The calculation unit 120 does not necessarily need to send all of the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity to the calculation unit. The calculation unit 120 may send a plurality of pieces of biological information required to supply the first biological information, the second biological information, and the third biological information to the determination unit 130 among the ten biological information.

[0345] The determination unit 130 does not necessarily need to receive all of the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity. The determination unit 130 may also receive the biological information identified as the first biological information, the second biological information, and the third biological information among the ten biological information.

[0346] (Other 2-2)

[0347] Fig.11 FIG. 1 is a diagram showing an information processing device 1000 which is a modified example of the information processing device 100 according to the embodiment.

[0348] Mainly mentioned include (Other 2-1) Fig.10 The information processing system 10 including the information processing device 100 shown in FIG. 1 is different from the information processing system 10000 including the information processing device 1000 . The information processing device 1000 is described below.

[0349] The information processing system 10000 includes the information processing device 1000. The information processing system 10000 may include a 1a-th measuring device 1500-1, a 2a-th measuring device 1500-2, a 3a-th measuring device 1500-3, and a 4a-th measuring device 1500-4.

[0350] The 1a-th measuring device 1500-1 includes a first sensor and a calculation unit a. The first sensor may be an image sensor or one or more electrodes.

[0351] The 2a-th measuring device 1500-2 includes a second sensor and a calculation unit b. The second sensor may be an image sensor or one or more electrodes.

[0352] The 3a-th measuring device 1500 - 3 is identical to the third measuring device 150 - 3 except for “one difference”: the first difference is that the 3a-th measuring device 1500 - 3 is connected to the acquisition unit 1100 , while the third measuring device 150 - 3 is connected to the acquisition unit 1100 .

[0353] The 4a-th measuring device 1500 - 4 is identical to the 4th measuring device 150 - 4 except for the second difference. The second difference is that the 4a-th measuring device 1500 - 4 is connected to the acquisition unit 1100 , while the 4th measuring device 150 - 4 is connected to the acquisition unit 1100 .

[0354] The first measurement device 150 - 1 may determine the heart rate based on the information observed by the first sensor.

[0355] The first measuring device 150-1 may also generate an electrocardiogram waveform based on the information observed by the first sensor. The first measuring device 150-1 may also determine a plurality of heartbeat intervals based on the electrocardiogram waveform. The calculation unit a may also calculate CVRR, LF / HF, and HF based on a plurality of heartbeat intervals. The calculation methods thereof are the same as those implemented by the calculation unit 120.

[0356] The second measuring device 150 - 2 may determine the pulse rate based on the information observed by the second sensor.

[0357] The second measuring device 150-2 may also generate an acceleration pulse based on the information observed by the second sensor. The second measuring device 150-2 may also determine multiple pulse intervals based on the waveform of the acceleration pulse. The calculation unit b may also calculate CVRR', LF' / HF', HF' based on multiple heartbeat intervals. Their calculation methods are the same as those implemented by the calculation unit 120.

[0358] The acquisition unit 1100 may receive the heart rate, CVRR, LF / HF, and HF from the 1a-th measurement device 1500-1.

[0359] The acquisition unit 1100 may receive the pulse rate, CVRR', LF' / HF', and HF' from the 2a-th measuring device 1500-2.

[0360] The acquisition unit 1100 may receive the skin temperature from the 3a-th measuring device 1500-3.

[0361] The acquisition unit 1100 may receive the skin electrode activity from the 4a-th measuring device 1500-4.

[0362] The acquisition unit 1100 may send the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR′, LF′ / HF′, HF′, skin temperature, and skin electrical activity to the determination unit 1300 .

[0363] As described in (Other 2-1) Figure 3 Variations of Figure 4 The modified examples can also be applied to the information processing device 1000.

[0364] The determination unit 1300 may receive the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR′, LF′ / HF′, HF′, skin temperature, and skin electrical activity from the acquisition unit 110 .

[0365] The determination unit 130 and the determination unit 1300 are identical except for the third difference. The third difference is that the determination unit 130 receives the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity from the calculation unit 120, while the determination unit 1300 receives the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity from the acquisition unit 1100.

[0366] The same matters as those mentioned in (Other 2-1) as shown below apply to the information processing device 1000 .

[0367] The determination unit 1300 may also receive a plurality of biological information required for implementing the processes of S204, S302, and S306. In other words, the determination unit 1300 may not necessarily receive all of the 10 biological information, namely, heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity.

[0368] The user may instruct the information processing device 1000 what the first biometric information, the second biometric information, and the third generated information are, and the information processing device 1000 may execute S201, S204, S301, S302, S305, and S306 based on the instructed first biometric information, the second biometric information, and the third generated information.

[0369] The information processing system 10000 may not necessarily include all of the 1a measuring device 1500-1, the 2a measuring device 1500-2, the 3a measuring device 1500-3, and the 4a measuring device 1500-4. The information processing system 10000 may include one or more measuring devices necessary to supply the first biological information, the second biological information, and the third biological information to the determination unit 1300 among these four measuring devices.

[0370] The acquisition unit 1100 does not necessarily need to acquire all of the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity. The acquisition unit 1100 may acquire a plurality of pieces of biometric information required to supply the first biometric information, the second biometric information, and the third biometric information to the determination unit 1300 among the ten biometric information.

[0371] The acquisition unit 1100 does not necessarily need to send all of the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity to the determination unit 1300. The acquisition unit 1100 may send a plurality of biometric information determined by the first biometric information, the second biometric information, and the third biometric information among the ten biometric information to the determination unit 1300.

[0372] The determination unit 1300 does not necessarily need to receive all of the heart rate, CVRR, LF / HF, HF, pulse rate, CVRR', LF' / HF', HF', skin temperature, and skin electrical activity. The determination unit 1300 only needs to receive a plurality of biological information determined by the first biological information, the second biological information, and the third biological information among the ten biological information.

[0373] Industrial Applicability

[0374] The present disclosure can be used in a device for sensing a person's state.

[0375] Description of reference numerals:

[0376] 10 Information Processing System

[0377] 11 Measurement Department

[0378] 31, 32, 33 marks

[0379] 100 Information processing device

[0380] 110 Acquisition Department

[0381] 120 Computing Department

[0382] 130 Judgment Department

[0383] 140 Tips Department

[0384] 150 Measuring device

[0385] G1 Display image

[0386] G11 Chart

[0387] G12 Input Field

[0388] G13, G14 message display bar

Claims

1. An information processing method, comprising: Accepting the user's CVRR, i.e., coefficient of variation of the RR interval, and the user's LF / HF, i.e., low frequency / high frequency, or calculating the CVRR and the LF / HF; as well as A determination process is executed by a processor to determine whether the state related to the thinking of the user is a convergent thinking state, a divergent thinking state, or a relaxed state based on the CVRR and the LF / HF.

2. The information processing method according to claim 1, In the determination process, When the CVRR is smaller than a first threshold, it is determined that the user is in the convergent thinking state.

3. The information processing method according to claim 1, In the determination process, When the CVRR is equal to or greater than a first threshold value and the LF / HF is equal to or greater than a second threshold value, it is determined that the user is in the divergent thinking state.

4. The information processing method according to claim 1, In the determination process, When the CVRR is equal to or greater than a first threshold and the LF / HF is less than a second threshold, it is determined that the user is in the relaxed state.

5. The information processing method according to any one of claims 1 to 4, The information processing method further includes: Prior to the determination process, the processor performs a preliminary determination process of determining whether the user's state is one of the convergent thinking state, the divergent thinking state, and the relaxed state based on at least the LF / HF. When it is determined in the preliminary determination process that the state of the user is one of the states, the determination process is executed.

6. The information processing method according to any one of claims 1 to 4, The information processing method further includes: Prior to the determination process, the processor performs a preliminary determination process for determining whether the user's state is one of the convergent thinking state, the divergent thinking state, and the relaxed state based on at least one of the user's heart rate, pulse rate, LF / HF, HF, skin temperature, and skin electrical activity, When it is determined in the preliminary determination process that the state of the user is one of the states, the determination process is executed.

7. The information processing method according to claim 1, The CVRR and the LF / HF correspond to a first period included in a plurality of periods, In the determination process, executing the determination process on the state related to the user's thoughts in the period based on the CVRR and LF / HF corresponding to each of the plurality of periods, The information processing method further includes: In the determination process, a graph is generated that shows the ratio of the period determined to be the convergent thinking state, the period determined to be the divergent thinking state, and the period determined to be the relaxed state among the plurality of periods; as well as The chart is displayed.

8. The information processing method according to claim 2, The information processing method further includes: obtaining identification information for identifying the user; and obtaining threshold information corresponding to the identification information, The first threshold is determined based on the threshold information.

9. The information processing method according to claim 8, The information processing method further includes: acquiring evaluation information obtained by evaluating the state related to the user's thinking by a method different from the determination process; as well as The threshold information is updated based on the determined state of the user and the state of the user indicated by the evaluation information.

10. The information processing method according to claim 3 or 4, further comprising: obtaining identification information for identifying the user; as well as obtaining threshold information corresponding to the identification information, The first threshold value and the second threshold value are determined based on the threshold value information.

11. The information processing method according to claim 10, The information processing method further includes: obtaining evaluation information obtained by the user evaluating a state related to the user's thinking; as well as The threshold information is updated based on the determined state of the user and the state of the user indicated by the evaluation information.

12. The information processing method according to claim 2, The information processing method further includes: After the determination process is performed, the lighting device illuminating the vicinity of the user is subjected to the following steps: (i) reducing the color temperature of the lighting and increasing the control of the illuminance; or (ii) Lowering the color temperature of the lighting and reducing the illumination intensity.

13. The information processing method according to claim 3, The information processing method further includes: ， After the determination process is performed, the lighting device illuminating the vicinity of the user is: (i) increasing the color temperature of the lighting and improving the control of the illumination intensity; or (ii) Lowering the color temperature of the lighting and reducing the illumination intensity.

14. The information processing method according to claim 4, The information processing method further includes: After the determination process is performed, the lighting device illuminating the vicinity of the user is subjected to the following steps: (i) reducing the color temperature of the lighting and increasing the control of the illuminance; or (ii) Improve the color temperature of lighting and improve the control of illumination.

15. An information processing method, comprising: Using the processor, Acquire target information indicating a target state that is a state set as a target by a user; obtaining biological information of the user; determining a state related to the user's thinking based on the biological information; comparing the target state represented by the target information with the determined state related to the user's thinking; as well as When the result of the comparison is that the target state is different from the determined state related to the user's thoughts, control is performed to change the characteristics of illumination light irradiated by an illumination device that illuminates the vicinity of the user.

16. An information processing system comprising: A light source, irradiating light to a user; a detector for detecting reflected light generated by the irradiated light; Processing circuit; storage device; and display device, the processing circuit, performing time domain analysis processing on the component of the reflected light detected by the detector per unit period, thereby calculating the CVRR corresponding to the fluctuation of the heartbeat or pulse of the user, performing frequency analysis processing on the component of the reflected light detected by the detector for each unit period, thereby calculating LF / HF corresponding to the fluctuation of the user's heartbeat or pulse, acquiring threshold information indicating a first threshold and a second threshold from the storage device, executing a first determination process of determining whether the average value of the CVRR in the unit period is equal to or greater than the first threshold value, executing a second determination process of determining whether the average value of the LF / HF in the unit period is equal to or greater than the second threshold value, executing a third determination process of determining whether the user is in a divergent thinking state, a convergent thinking state, or a relaxed state during the unit period based on the first determination process and the second determination process, An image associated with the state of the user determined in the third determination process is generated, and the generated image is displayed on the display device.

17. The information processing method according to claim 1, The CVRR is calculated based on a first standard deviation of a plurality of heartbeat intervals of the user and a first average of the plurality of heartbeat intervals, The LF / HF is calculated based on a first integrated value of a first section of a power spectrum density of the user's heartbeat intervals obtained based on the plurality of heartbeat intervals and a second integrated value of a second section of the power spectrum density.

18. The information processing method according to claim 17, The CVRR is (the first standard deviation) / (the first mean value), The LF / HF is (the first integrated value) / (the second integrated value), The sensor has a plurality of electrodes for measuring an electrocardiogram waveform of the user. The plurality of heartbeat intervals are determined based on the electrocardiogram waveform, Each of the plurality of heartbeat intervals is a time interval between adjacent R waves in the electrocardiogram waveform. The beginning of the first interval is the first frequency, and the end of the first interval is the second frequency. The beginning of the second interval is the third frequency, and the end of the second interval is the fourth frequency. The first frequency is smaller than the second frequency, and the third frequency is smaller than the fourth frequency. The first frequency is lower than the third frequency, and the second frequency is lower than the fourth frequency.

19. The information processing method according to claim 16, The CVRR is calculated based on a first standard deviation of a plurality of intervals and a first average of the plurality of intervals, The LF / HF is calculated based on a first integrated value of a first interval of the power spectrum density and a second integrated value of a second interval of the power spectrum density. The plurality of intervals are a plurality of heartbeat intervals of the user, or a plurality of pulse intervals of the user, The power spectral density is a first power spectral density of the user's heartbeat interval obtained based on the plurality of heartbeat intervals, or a second power spectral density of the user's pulse interval obtained based on the plurality of pulse intervals.

20. The information processing method according to claim 19, The CVRR is (the first standard deviation) / (the first mean value), The LF / HF is (the first integrated value) / (the second integrated value), The beginning of the first interval is the first frequency, and the end of the first interval is the second frequency. The beginning of the second interval is the third frequency, and the end of the second interval is the fourth frequency. The first frequency is smaller than the second frequency, and the third frequency is smaller than the fourth frequency. The first frequency is lower than the third frequency, and the second frequency is lower than the fourth frequency.

Images