Information processing device, information processing method, and program
The user wears bioinformatic sensors to obtain exercise and burden data, calculate the difference between user time and standard time, and provides personalized time processing, which solves the problems that cannot be reflected in the existing technology, helps individuals adjust their life rhythm and maintain health.
Patent Information
- Application Number
- CN201980067326.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-10-19
- Filing Date
- 2019-10-10
- Publication Date
- 2024-11-01
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The prior art is difficult to dynamically adjust time processing based on individuals’ feelings about time elapsed, resulting in differences in time perceptions that cannot be effectively reflected in personal life.
The user wears a bioinformatic sensor to obtain data such as exercise amount and burden amount, calculates the difference between user time and standard time, and provides personalized time processing.
It has achieved personalized time processing for individuals based on their personal perception of the passage of time, helping to maintain health and adjust the pace of life.
Smart Images

Figure CN113038876B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an information processing device, an information processing method, and a program. Background Art
[0002] Many people live using time based on atomic time (eg, standard time (standard time point)) determined by an atomic clock that keeps time by using transitions between specific energy levels such as atoms as an oscillator.
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2005-13385 Summary of the invention
[0006] Problems to be solved by the present invention
[0007] However, the passage (progress) of time varies according to each person's situation. In other words, the way people feel the passage of time varies according to each person's situation. However, in addition to personal attributes (gender, age, etc.), this difference in feeling depends on many factors such as the amount of physical exercise per day, the amount of burden, physical condition, and mental state.
[0008] Therefore, the present disclosure proposes examples of an information processing device, an information processing method, and a program that can provide time to an individual according to how the individual feels the passage of time.
[0009] Problem Solution
[0010] According to the present disclosure, there is provided an information processing device, comprising: an information acquisition unit, which acquires the time change of biological information from one or more biological information sensors worn by a user; and a calculation unit, which calculates the difference between the time change of first biological information in a first interval and the time change of second biological information in a second interval at a predetermined time interval, and calculates the time difference relative to a standard time, the second interval having the same time as the first interval.
[0011] In addition, according to the present disclosure, there is provided an information processing method, including: acquiring a time change of biological information from one or more biological information sensors worn by a user; and calculating a difference between a time change of first biological information in a first interval and a time change of second biological information in a second interval at predetermined time intervals, and calculating the time difference relative to a standard time. The second interval has the same time as the first interval.
[0012] Moreover, according to the present disclosure, there is provided a program for causing a computer to perform the following functions: a function of acquiring time changes of biological information from one or more biological information sensors worn by a user; and a function of calculating the difference between the time changes of first biological information in a first interval and the time changes of second biological information in a second interval at predetermined time intervals, and calculating the time difference relative to a standard time, the second interval having the same time as the first interval.
[0013] Effects of the Invention
[0014] According to the present disclosure described above, it is possible to provide time to an individual according to how the individual feels the passage of time.
[0015] Note that the above effects are not necessarily limitative. With or in place of the above effects, any of the effects described in this specification or other effects that can be understood from this specification can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 It is an explanatory diagram (No. 1) for explaining the concept of the embodiment of the present disclosure.
[0017] Figure 2 1 is an explanatory diagram (No. 1) for explaining an example of calculation of the user time 412 in the embodiment of the present disclosure.
[0018] Figure 3 2 is an explanatory diagram (No. 2) for explaining an example of calculation of the user time 412 in the embodiment of the present disclosure.
[0019] Figure 4 It is an explanatory diagram (No. 2) for explaining the concept of the embodiment of the present disclosure.
[0020] Figure 5 is an explanatory diagram for explaining an example of the configuration of the information processing system 1 according to an embodiment of the present disclosure.
[0021] Figure 6 is a block diagram showing an example of a configuration of the wearable device 10 according to an embodiment of the present disclosure.
[0022] Figure 7 is an explanatory diagram for explaining an example of the appearance of the wearable device 10 according to an embodiment of the present disclosure.
[0023] Figure 8 is a block diagram showing an example of the configuration of the server 30 according to an embodiment of the present disclosure.
[0024] Fig. 9 is a flowchart illustrating an example of an information processing method according to an embodiment of the present disclosure.
[0025] Fig.10 is an explanatory diagram for explaining an example of a display screen 800 a according to an embodiment of the present disclosure.
[0026] Fig.11 is an explanatory diagram for explaining an example of a display screen 800 b according to an embodiment of the present disclosure.
[0027] Fig.12 is an explanatory diagram for explaining an example of a display screen 800 c according to an embodiment of the present disclosure.
[0028] Fig.13 is an explanatory diagram for explaining an example of a display screen 800 d according to an embodiment of the present disclosure.
[0029] Fig.14 is an explanatory diagram for explaining an example of a display screen 800 e according to an embodiment of the present disclosure.
[0030] Fig.15 is an explanatory diagram for explaining an example of a display screen 800 f according to an embodiment of the present disclosure.
[0031] Fig.16 is an explanatory diagram for explaining an example of a display screen 800g according to an embodiment of the present disclosure.
[0032] Fig.17 is an explanatory diagram for explaining an example of a display screen 800h according to an embodiment of the present disclosure.
[0033] Fig.18 850 is an explanatory diagram for explaining an example of a display screen 850 a according to an embodiment of the present disclosure.
[0034] Fig.19 850 is an explanatory diagram for explaining an example of a display screen 850 b according to an embodiment of the present disclosure.
[0035] Fig. 20 850 is an explanatory diagram for explaining an example of a display screen 850 c according to an embodiment of the present disclosure.
[0036] Fig.21 is an explanatory diagram for explaining an example of display timing according to an embodiment of the present disclosure.
[0037] Fig. 22 is an explanatory diagram for explaining an example of transition of a calculation mode according to an embodiment of the present disclosure.
[0038] Fig.23 is a flowchart illustrating an example of an information processing method in an automatic mode according to an embodiment of the present disclosure.
[0039] Fig.24is a flowchart illustrating an example of a process for selecting reference data 420 according to an embodiment of the present disclosure.
[0040] Fig.25 is an explanatory diagram for explaining an example of a display screen 850 d according to an embodiment of the present disclosure.
[0041] Fig.26 is a block diagram showing an example of the hardware configuration of the information processing device 900 according to one embodiment of the present disclosure. DETAILED DESCRIPTION
[0042] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that in this specification and the drawings, configuration elements having substantially the same function and configuration are denoted by the same reference numerals, and repeated descriptions are omitted.
[0043] In addition, in this specification and the accompanying drawings, multiple configuration elements with substantially the same or similar functions and configurations can be represented by the same symbol and then distinguished by different numbers. However, in the case where it is not necessary to particularly distinguish multiple configuration elements with substantially the same or similar functions and configurations, only the same symbol is attached. In addition, similar configuration elements in different embodiments can be distinguished by specifying with different letters after the same symbol. However, in the case where it is not particularly necessary to distinguish between similar configuration elements, only the same reference numeral will be given.
[0044] Note that the description is given in the following order.
[0045] 1. Background of the embodiments of the present disclosure
[0046] 1.1. Background
[0047] 1.2 Concept
[0048] 2. Embodiments of the present disclosure
[0049] 2.1. Configuration of the information processing system 1 according to the embodiment of the present disclosure
[0050] 2.2. Configuration of the wearable device 10 according to an embodiment of the present disclosure
[0051] 2.3. Configuration of the server 30 according to the embodiment of the present disclosure
[0052] 2.4. Information processing method according to an embodiment of the present disclosure
[0053] 2.5. Setting of the start time according to the embodiment of the present disclosure
[0054] 2.6. Presentation method according to an embodiment of the present disclosure
[0055] 2.7. Timing of Presentation According to Embodiments of the Present Disclosure
[0056] 2.8. Timing of Calculations According to Embodiments of the Present Disclosure
[0057] 2.9. Selection of Reference Data 420 According to Embodiments of the Present Disclosure
[0058] 2.10. Feedback Processing of User Evaluation According to Embodiments of the Present Disclosure
[0059] 2.11. Examples of using the user interface according to embodiments of the present disclosure
[0060] 3. Examples of embodiments according to the present disclosure
[0061] Example 1
[0062] Example 2
[0063] 4. Conclusion
[0064] 5. About hardware configuration
[0065] 6. Supplement
[0066] Note that in the following description, a wearable device 10 (see Figure 1 ) is called a user.
[0067] <<1. Background of Creating the Embodiments of the Present Disclosure>>
[0068] <1.1. Background>
[0069] First, before describing the details of the embodiments of the present disclosure, the background that led the inventors to create the embodiments of the present disclosure will be described.
[0070] Generally, a "time interval" is defined as the length between two points in the time stream, and a "time point" is defined as a moment (a point) in the time stream. As mentioned earlier, many people use time (e.g., standard time (standard time point) 410 (see Figure 1 In other words, many people's daily lives are governed by standard time 410.
[0071] However, daily life does not seem to be a process that progresses steadily according to the time progress of standard time 410, but seems to speed up or slow down in some cases according to the time progress that changes according to personal circumstances. For example, on days when a person spends a lot of time relaxing, the person often feels that "today is such a long day." On the other hand, on days when a person is busy, the person often feels that "it's already this time. Today is going by quickly." In other words, an individual's feeling about the progress of time changes from day to day, depending on the individual's circumstances.
[0072] Therefore, the present inventors have implemented a thought experiment based on the actual feelings in daily life described above to understand the personal time (in the following description, "user time 412 (see Figure 1 )”) instead of the standard time 410, what kind of impact can it have on personal life.
[0073] For example, consider a situation where even though it is 9:00pm in the standard time 410, the user time 412 is 11:00pm (i.e., the time process of the user time 412 is faster than the time process of the standard time 410). As described above, the individual with the user time 412 realizes that the time process becomes very fast because today is a busy workday. Then, the individual realizes that even though he or she usually goes to bed at 11:pm of the standard time 410, he or she feels tired because of being busy at work, and chooses to take the action of going to bed before 11:00pm of the standard time 410. That is, the inventor has considered that by providing the user time 412 as described above, the user is released from the control of the standard time 410, which in turn causes the individual's action change. In addition, the inventor considers that if the individual can take appropriate action according to the user time 412, this can maintain the individual's health.
[0074] Therefore, the present inventors have carefully studied methods for calculating user time 412 so as to provide many people with time released from standard time 410 (ie, personal time "user time 412") based on their personal perception of the passage of time.
[0075] There are various factors that affect how an individual feels the course of time. Examples of the above-mentioned factors include personal attributes (gender, age, etc.), the amount of physical exercise in a day, the amount of burden, and mental state (relaxed state). Therefore, the inventors believe that the user time 412 can be calculated by paying attention to the amount of physical exercise in a day and the amount of personal burden among the above-mentioned factors to estimate the change in how an individual feels the course of time. In detail, the inventors have considered that among the above-mentioned factors, personal attributes are not factors that change significantly every day, and therefore, the influence on the change in how an individual feels the course of time every day is small. On the other hand, the inventors consider that the amount of physical exercise and the amount of burden are factors that change significantly every day, and therefore, the influence on the change in how an individual feels the course of time every day is large.
[0076] More specifically, based on the inventor's own actual experience, the inventor estimated that in the case where the amount of physical exercise (burden) of one day is large, the time course of the user time 412 is faster than the time course of the standard time 410. Furthermore, based on this estimation, the inventor initially thought of regarding the difference between the amount of physical exercise of one day and a reference value (the details of the reference value will be described later) as a predetermined value as a difference index (i.e., time difference) of the time course of the user time 412 relative to the standard time 410. Then, based on this original idea of the inventor, by using the difference between the amount of physical exercise of one day and the above-mentioned reference value (the difference is a difference index of the time course of the user time 412 relative to the standard time 410), the user time 412 can be calculated from the standard time 410. Furthermore, the inventor estimated the above-mentioned amount of physical exercise and the like based on personal biometric information (e.g., pulse rate, etc.).
[0077] Based on this original idea of the inventors, the embodiments of the present disclosure described below have been created. That is, according to the embodiments of the present disclosure, based on factors of the individual's actions (e.g., the amount of exercise and the amount of burden), user time 412 can be provided, which is created by the individual himself for the individual and is the personal time to be used for the individual. The concept of the embodiments of the present disclosure created by the inventors will be described below.
[0078] <1.2. Concept>
[0079] Will refer to Figures 1 to 4 The concepts of the embodiments of the present disclosure are described. Figure 1 and Figure 4 It is an explanatory diagram for explaining the concept of the embodiment of the present disclosure. Figure 2 1 is an explanatory diagram for explaining a calculation example of user time according to an embodiment of the present disclosure, and in detail, explains an example of calculating user time based on sensing data (temporal change) of the number of steps of an individual (user). Figure 3is an explanatory diagram for explaining a calculation example of a user time according to an embodiment of the present disclosure, and in detail, explains an example of calculating the user time based on sensing data of a pulse rate of a user.
[0080] like Figure 1 As shown, in the present embodiment, for example, as various biological information corresponding to the amount of exercise or the amount of burden of an individual (user), sensing data (time changes of first biological information) 400a, 400b, 400c and 400d are acquired from the body surface temperature sensor 120a, the pulse wave sensor 120b, the acceleration sensor 120c and the step number sensor 120d. In the present embodiment, it is assumed that the sensing data 400a to 400d (for example, time changes of body temperature, pulse wave, acceleration, number of steps, etc.) acquired from each of these biological information sensors 120a to 120d are related to the amount of exercise and the amount of burden of the user. That is, in the present embodiment, it is assumed that the above-mentioned sensing data 400a to 400d are data reflecting the amount of exercise or the amount of burden, which is a factor affecting the change in the user's feeling of the time course every day.
[0081] Specifically, in this embodiment, according to the original estimation, when the amount of exercise (burden) is large, the time process of the user time 412 is faster than the time process of the standard time 410, and according to the type of the sensing data 400, the difference (amplitude relationship) with the reference value is explained as follows.
[0082] For example, in the case where the sensing data 400a such as the body temperature of the user obtained by the body surface temperature sensor 120a is greater than the reference value, it is assumed that the amount of exercise (burden) of the user is large, and the time course of the user time 412 is interpreted as being faster than the time course of the standard time 410. For example, in the case where the sensing data 400b such as the pulse rate or the heart rate obtained by the pulse wave sensor 120b is greater than the reference value, it is assumed that the amount of physical burden of the user is large, and the time course of the user time 412 is interpreted as being faster than the time course of the standard time 410. In addition, for example, in the case where the sensing data 400c such as the acceleration obtained by the acceleration sensor 120c is greater than the reference value, it is assumed that the amount of exercise (burden) is large, and the time course of the user time 412 is interpreted as being faster than the time course of the standard time 410. In addition, for example, in the case where the sensing data 400d such as the number of steps obtained by the step number sensor 120d is greater than the reference value, it is assumed that the amount of exercise (burden) is large, and the time course of the user time 412 is interpreted as being faster than the time course of the standard time 410.
[0083] Furthermore, in the present embodiment, in the case where the sensing data 400 obtained by the pulse wave sensor 120 b or the brain wave sensor (not shown) indicates that the user is more relaxed relative to the reference value, it can be assumed that the amount of burden is small, and the time course of the user time 412 can be interpreted as slower than the time course of the standard time 410. Furthermore, in the present embodiment, in the case where the sensing data 400 obtained by the pulse wave sensor 120 b or the like indicates that the user is tense relative to the reference value, it can be assumed that the amount of burden is large, and the time course of the user time 412 can be interpreted as faster than the time course of the standard time 410. Furthermore, in the present embodiment, in the case where the sensing data 400 obtained by the pulse wave sensor 120 b or the like indicates that the user is sleeping for a long time or the sleep depth is deeper relative to the reference value, it can be assumed that the amount of burden has decreased, and the time course of the user time 412 can be interpreted as slower than the time course of the standard time 410.
[0084] Table 1 below shows an example of interpretation (hypothesis) of the time course of the user time 412 in the various sensing data 400 in the present embodiment. Note that in the present embodiment, the interpretation is not limited to that shown in Table 1 below.
[0085] [Form 1]
[0086] (Form 1)
[0087]
[0088] In addition, in this embodiment, if Figure 1 As shown, by applying the synthesis algorithm 600 to these sensing data 400a to 400d (in detail, the difference between the sensing data 400 and the reference value), the index 408 related to the user is calculated (see Figure 4 ). The index 408 related to the user is an index showing how the user feels the progress of time, and in detail, is an index related to a time difference indicating how much the user time 412 is before or after the standard time 410. Then, in this embodiment, as Figure 1 As shown, user time 412 may be calculated by adding calculated user-related metric 408 to standard time 410 .
[0089] Next, calculation of the index 408 related to the above-mentioned user (ie, details of the synthesis algorithm 600 of the present embodiment) will be described in sequence.
[0090] First, in the present embodiment, for each sensing data 400, a difference 402 (or a difference rate (%)) between the sensing data 400 in a first interval and reference data (temporal change in the second biological information) 420, which is sensing data of the same type as the sensing data 400 in a second interval of the same time as the first interval, is calculated at predetermined time intervals. Then, in the present embodiment, the calculated difference 402 is multiplied by a predetermined coefficient to convert the difference 402 into a difference time (time conversion), and a plurality of difference times are integrated to calculate an integrated time 406 of the difference for each sensing data 400 (see Figure 4 ). In addition, in the present embodiment, the integration time 406 of the plurality of sensing data 400 is synthesized by processing based on a predetermined formula to calculate the time difference as the index 408 related to the user.
[0091] In this embodiment, for example, Figure 2 As shown in FIG. 4 , as the user's sensing data 400, the first interval (in Figure 2 In the example of FIG. 4 , the standard time 410 is displayed as a predetermined time interval (in the interval of 8:00 to 19:00) Figure 2 In the example, 50 minutes is the time variation of the number of steps counted by the user. In other words, Figure 2 , as an example, the sensing data 400 is shown, in which the time change of the number of steps of the user is obtained by a set of discretely obtained values as an example of time change. In addition, in this embodiment, as reference data 420 (reference value), a day earlier than the date on which the sensing data 400 is obtained and having the same time as the first interval (in Figure 2 In the example of the standard time 410, the interval from 8:00 to 19:00 is shown) and the same length of time (in Figure 2 In the example of FIG. 4, the time variation of the number of steps of the user is changed to 11 hours in the standard time 410. In addition, the time variation of the number of steps of the user acquired as the reference data 420 is similar to the sensing data 400, which is a time variation of the number of steps of the user at a predetermined time interval (in the second interval). Figure 2 The temporal variation of the number of steps counted by the user (50 minutes in the example).
[0092] Note that Figure 2In the example shown, the reference data 420 may be a time variation of a set of smoothed values (average values) of the number of steps of the user counted at predetermined time intervals of a plurality of second intervals, the plurality of second intervals having the same time and the same time length as the first interval in a time period of a predetermined number of days (e.g., about 1 to 3 months) closest to the date of acquiring the sensing data 400. Alternatively, the reference data 420 may be reference data set by the user, or may be a time variation of the number of steps of another user, and is not particularly limited in the present embodiment.
[0093] In more detail, in the present embodiment, the reference data 420 may be appropriately selected according to the type of the sensed data 400 and what kind of information is desired (e.g., the user time 412 of the current time or whether the transition of the user time 412 to date is to be presented to the user, etc.). In addition, in the present embodiment, the sensed data 400 and the reference data 420 may be processed, etc., to remove measurement noise, etc. included in the sensed data 400 and the reference data 420, depending on the type of the sensed data 400, what kind of information is desired, etc.
[0094] Then, in this embodiment, the difference step number is obtained as the difference 402 by subtracting the reference data 420 from the sensed data 400 at predetermined time intervals. Figure 2 In the example of FIG. 4 , at 8:00 of the standard time 410, by subtracting “100 steps” of the reference data 420 from “0 steps” of the sensed data 400, the difference step number is “minus 100 steps.” Note that in the present embodiment, the difference 402 may be, for example, a numerical value of the difference itself, or may be converted into a difference rate by performing a predetermined statistical process.
[0095] Next, in this embodiment, the calculated difference 402 is multiplied by a predetermined coefficient to convert it into a difference time. Figure 2 In the example shown, the difference time is calculated so that every 100 steps in the difference 402 corresponds to 10 minutes. Note that here, since the sensing data 400 is the time change of the number of steps, the positive difference 402 is interpreted as making the time process of the user time 412 faster than the time process of the standard time 410. Therefore, the positive difference 402 is converted to a positive difference time. On the other hand, since the sensing data 400 is the time change of the number of steps, the negative difference 402 is interpreted as making the time process of the user time 412 slower than the time process of the standard time 410. Therefore, the negative difference 402 is converted to a negative difference time (see Table 1). More specifically, in Figure 2 In the example of FIG. 4 , when the difference 402 is negative 100 steps, the difference time is converted to negative 10 minutes.
[0096] Furthermore, in the present embodiment, the predetermined start time set by the user or the like (for example, the time indicated by the standard time 410) is set. Figure 2 In the example of , the time period from "8:00" of the standard time 410) to the predetermined end time set by the user or the like (eg, set by the time indicated in the standard time 410. Figure 2 In the example of , multiple integral times obtained from the standard time 410 ("19:00") are integrated to obtain the differential integral time 406. Figure 2 In the example of , the integration time 406 is “10 minutes” at 19:00 of the standard time.
[0097] Then, in this embodiment, the integration time 406 of the plurality of different types of sensing data 400 is synthesized by processing based on a predetermined formula, so that the synthesized integration time 406 is calculated as an index 408 (time difference) related to the user. Then, in this embodiment, the user time 412 can be calculated by adding the synthesized integration time 406 as the index 408 related to the user to the standard time 410.
[0098] Note that Figure 2 In the example shown, the following case is shown: the synthesis of the integration time 406 related to other types of sensing data 400 is omitted, and the user time 412 is directly calculated based on only the integration time 406 related to the sensing data 400 (which is the time change of the number of steps of the user). Figure 2 In the example shown, the integration time 406 associated with the sensor data 400 (which is the time variation of the number of steps of the user) is regarded as the indicator 408 associated with the user. Figure 2 In the example of , since the integrated time 406 is "plus 10 minutes" at 19:00 of the standard time, it is directly added to calculate "19:10" as the user time 412. Note that the details of the above synthesis will be described later.
[0099] In the present embodiment, as described above, the user time 412 can be calculated based on one sensing data 400, but preferably, synthesis is performed based on a plurality of different types of sensing data 400 to calculate the user time 412. This is because, in the present embodiment, the use of a plurality of different types of sensing data 400 is considered to increase the possibility of obtaining a highly accurate user time 412 that is closer to the actual feeling of the user. In addition, by doing so, even in the case where the reliability of one or more sensing data 400 is low (measurement accuracy, measurement state, etc. deteriorates), the user time 412 can be calculated based on the remaining other highly reliable sensing data 400, and the user time 412 can be continuously provided. Note that in the following description, the highly accurate user time 412 refers to the user time 412 that is close to the actual feeling of the user or the user time 412 is calculated by faithfully reflecting the user's physical condition (exercise amount, load amount), etc.
[0100] Furthermore, as another specific example, Figure 3 As shown in FIG. 4 , as the user's sensing data 400, the first interval (in Figure 3 In the example of FIG. 4 , the standard time 410 is displayed as a time change of the user's pulse rate obtained at predetermined time intervals in the interval from 8:00 to 19:00. In other words, Figure 3 , as an example, sensing data 400 is shown in which a time change of a user's pulse rate is obtained as an example of a time change of a continuous sensing value. In addition, in the present embodiment, for example, as reference data 420, a time change of a user's pulse rate obtained at predetermined time intervals in a second interval is obtained, the second interval being one day earlier than the date on which the sensing data 400 is obtained and having the same time as the first interval (at Figure 3 In the example of FIG. 4 , the standard time 410 is displayed as an interval from 8:00 to 19:00) and the time length (in Figure 3 In the example of , it becomes 11 hours in standard time 410). Note that also in Figure 3 In the example shown, the reference data 420 may be a time variation of a smoothed value (average value) of a user's pulse rate obtained at predetermined time intervals for a plurality of second intervals, the plurality of second intervals having the same time and the same time length as the first interval in a time period of a predetermined number of days (e.g., approximately 3 to 5 days) closest to the date on which the sensing data 400 is acquired, and is not particularly limited.
[0101] Then, in the present embodiment, the difference pulse rate (%) may be obtained as the difference 402 by subtracting the reference data 420 from the sensing data 400 and performing normalization with the reference data of the corresponding time or the like at predetermined time intervals.
[0102] Next, in this embodiment, the calculated difference 402 is multiplied by a predetermined coefficient to convert it into a difference time (time conversion). Figure 3 In the example shown, the difference time is calculated so that every 10% of the difference 402 corresponds to 10 minutes. Note that here, since the sensed data 400 is the time variation of the pulse rate, the positive difference 402 is interpreted as making the time progression of the user time 412 faster than the time progression of the standard time 410. Therefore, the positive difference 402 is converted to a positive difference time. On the other hand, since the sensed data 400 is the time variation of the pulse rate, the negative difference 402 is interpreted as making the time progression of the user time 412 slower than the time progression of the standard time 410. Therefore, the negative difference 402 is converted to a negative difference time (see Table 1). Specifically, in Figure 3 In the example of FIG. 4 , when the difference 402 is negative 10%, the difference time is converted to negative 10 minutes.
[0103] In addition, in the present embodiment, by setting the scheduled start time (in Figure 3 In the example of the standard time 410, "8:00") to the scheduled end time set by the user or the like (in Figure 3 In the example of , multiple difference times obtained from the standard time 410 ("19:00") are integrated to obtain the difference integration time 406. Specifically, Figure 3 In the example of , the integration time 406 is "minus 36 minutes" at 19:00 of the standard time.
[0104] Then, in Figure 3 In the example shown, the following case is shown: the synthesis of the integration time 406 related to other types of sensing data 400 is omitted, and the user time 412 is directly calculated based on the integration time 406 related to the sensing data 400 (which is the time change of the user's pulse rate). Figure 3 In the example shown, the integration time 406 associated with the sensed data 400 (which is the temporal variation of the user's pulse rate) is considered as an indicator 408 associated with the user. Figure 3 In the example of , since the integral time 406 is “minus 36 minutes” at 19:00 of the standard time, it is directly added to calculate “18:24” as the user time 412 .
[0105] In addition, as described above, in this embodiment, it is preferred that the integration time 406 of a plurality of different types of sensing data 400 obtained by processing based on a predetermined formula is synthesized to calculate the user-related index 408. For example, in this embodiment, Figure 4 As shown, the integration time 406a to 406d (in Figure 4In the example of FIG. 1 , each integration time 406 a to 406 d related to each sensing data is expressed as ΔTt, ΔTp, ΔTa, ΔTf) multiplied by a predetermined coefficient (weight) a to d based on the characteristics of each sensing data 400. In addition, in the present embodiment, by adding the multiplied integration times 406 a to 406 d, the added integration times 406 a to 406 d are used as the index (time difference) 408 related to the user (in Figure 4 In the example of , the user-related index 408 is expressed as ΔTH) calculated. That is, the user-related index 408 can be calculated by using the following formula (1).
[0106] [Mathematics 1]
[0107] ΔT H =a×ΔT t +b×ΔT p +c×ΔT a +d×ΔT f Formula (1)
[0108] Furthermore, in the present embodiment, the user-related index 408 calculated as described above is multiplied by a predetermined coefficient e (for example, a coefficient e determined according to the attributes of the user), and the result is added to the standard time 410 (at Figure 4 In the example of FIG. 4 , the standard time is represented by T), so that the user time 412 (in Figure 4 In the example of , the user time 412 is indicated by Tu). That is, the user time 412 can be calculated using the following formula (2).
[0109] [Mathematics 2]
[0110] T u =e×ΔT H +T Formula (2)
[0111] Note that in the present embodiment, for example, the above-mentioned coefficients a to e can be set as described below. For example, the coefficients a to e can be set by using the difference (variation) of the sensed data of the user obtained recently (for example, the previous day) or by statistically processing a plurality of sensed data obtained recently (for example, the previous 3 to 5 days) and obtaining a statistical index (such as variance). In addition, in the present embodiment, the coefficients a to e can be values calculated based on the sensed data of a plurality of users including other users. In addition, in the present embodiment, they can be set according to the attribute information (age, gender, etc.) of the user and the environmental information (temperature, season, etc.) around the user. Then, as described above, the coefficients a to e preferably set for calculating the user time 412 of each user can be associated with each user or the attribute information of each user, and can be stored and used in the storage unit 308 of the server 30.
[0112] In the embodiment of the present disclosure, the user time 412 can be calculated based on the above concept. Note that Figures 1 to 4 The illustrated example is shown as an example of the present embodiment, and the embodiments of the present disclosure are not limited to Figures 1 to 4 Next, an information processing system according to an embodiment of the present disclosure that calculates the user time 412 using the above-mentioned concept will be described.
[0113] <<2. Embodiments of the present disclosure>>
[0114] <2.1. Configuration of Information Processing System 1 According to Embodiment of the Present Disclosure>
[0115] Reference Figure 5 The configuration of the information processing system 1 according to the embodiment of the present disclosure is described. Figure 5 1 is an explanatory diagram for explaining a configuration example of the information processing system 1 according to the present embodiment.
[0116] like Figure 5 As shown, the information processing system 1 according to the present embodiment includes a wearable device (wearable terminal) 10, a server 30, and a user terminal 70, which are communicably connected to each other via a network 90. In detail, the wearable device 10, the server 30, and the user terminal 70 are connected to the network 90 via a base station (e.g., a mobile phone base station, a wireless local area network (LAN) access point, etc.) not shown. Note that any scheme can be adopted as a communication scheme used in the network 90, regardless of whether the communication scheme is wired or wireless (e.g., WiFi (registered trademark), Bluetooth (registered trademark)), etc.), but it is desirable to use a communication scheme that can maintain stable operation.
[0117] (Wearable Devices 10)
[0118] The wearable device 10 may be a device that can be connected to a part of the user's body (ear lobe, neck, arm, wrist, ankle, etc.), or an implanted device (implanted terminal) inserted into the user's body. More specifically, the wearable device 10 may be various types of wearable devices, such as a head mounted display (HMD) type, glasses type, ear device type, anklet type, bracelet (wristband) type, collar type, eye ornament type, pad type, batch type, and clothing type.
[0119] Furthermore, the wearable device 10 has, for example, a sensor unit (biological information sensor) 120 including a sensor such as a pulse wave sensor unit 122 that detects the pulse of the user (see Figure 6). In the present embodiment, the above-mentioned user time 412 can be calculated based on the sensing data 400 acquired by such a sensor unit 120. In addition, in the present embodiment, the number of steps, sleep state (sleep depth, sleep time), etc. of the user can be estimated based on the sensing data acquired by the sensor unit 120 of the wearable device 10, and the estimation result can be used as the sensing data 400. Note that in the present embodiment, the sensor unit 120 can be set as a main body separated from the wearable device 10. In addition, in the following description, the wearable device 10 will be described as a bracelet (wristband) type wearable device. In addition, the detailed configuration of the wearable device 10 will be described later.
[0120] (Server 30)
[0121] The server 30 includes, for example, a computer, etc. The server 30 is owned by, for example, a service provider that provides services according to the present embodiment, and can provide (present) services to each user (for example, provide user time 412). Specifically, the server 30 calculates the user time 412 based on the sensing data 400 from each wearable device 10, and provides the calculated user time 412 to the user via the wearable device 10 or the user terminal 70. Note that the detailed configuration of the server 30 will be described later.
[0122] (User Terminal 70)
[0123] The user terminal 70 is a terminal used by the user or installed near the user to output information (e.g., user time 412) obtained by the server 30 to the user. In addition, the user terminal 70 can receive information input from the user and send the received information to the server 30. For example, the user terminal 70 can be a mobile terminal such as a tablet personal computer (PC), a smart phone, a mobile phone, a laptop PC, a notebook PC, or a wearable device such as an HMD. In addition, in detail, the user terminal 70 may include a display unit (not shown) that performs display to the user, an operation unit (not shown) that accepts an operation from the user, a speaker (not shown) that performs sound output to the user, and the like.
[0124] Note that Figure 5, the information processing system 1 according to the present embodiment is shown as including one wearable device 10 and one user terminal 70, but the present embodiment is not limited thereto. For example, the information processing system 1 according to the present embodiment may include a plurality of wearable devices 10 and a plurality of user terminals 70. In addition, the information processing system 1 according to the present embodiment may include, for example, another communication device (such as a relay device for sending information from the wearable device 10 to the server 30). In addition, the information processing system 1 according to the present embodiment may not include the wearable device 10. In this case, for example, the function of the user terminal 70 is similar to that of the wearable device 10, and the sensing data acquired by the user terminal 70 is output to the server 30. In addition, the information processing system 1 according to the present embodiment may not include the user terminal 70. In this case, for example, the function of the wearable device 10 is similar to that of the user terminal 70, and the information acquired from the server 30 is output to the wearable device 10.
[0125] <2.2. Configuration of Wearable Device 10 According to Embodiment of the Present Disclosure>
[0126] The configuration of the information processing system 1 according to the embodiment of the present disclosure has been described above. Figure 6 and Figure 7 The configuration of the wearable device 10 according to the embodiment of the present disclosure is described. Figure 6 is a block diagram showing an example of the configuration of the wearable device 10 according to the present embodiment, and Figure 7 is an explanatory diagram for explaining an example of the appearance of the wearable device 10 according to the present embodiment.
[0127] like Figure 6 As shown, the wearable device 10 mainly includes an input unit 102, an output unit (presentation unit) 104, a communication unit 106, a storage unit 108, a main control unit 110, and a sensor unit 120. The details of each functional unit of the wearable device 10 will be described below.
[0128] (Input unit 102)
[0129] The input unit 102 receives input of data and commands from the user to the wearable device 10. More specifically, the input unit 102 is implemented by a touch panel, a button, a switch, a dial, a microphone, etc. In addition, in the present embodiment, the wearable device 10 may not directly obtain input from the user, but may detect the user's motion using the motion sensor unit 124 described later, and obtain input information based on the sensed data 400 related to the detected user's motion.
[0130] (Output unit 104)
[0131] The output unit 104 is a functional unit for presenting information to the user, and outputs various information to the user, for example, through images, sounds, colors, lights, vibrations, etc. More specifically, the output unit 104 can present the user time 412, the index 408 related to the user, etc. to the user by displaying the user time 412 provided from the server 30 described later on the screen. The output unit 104 is implemented by a display, a speaker, an earphone, a light emitting element (e.g., a light emitting diode (LED)), a vibration module, etc. Note that a part of the function of the output unit 104 can be provided by the user terminal 70.
[0132] (Communication unit 106)
[0133] The communication unit 106 is provided in the wearable device 10, and can transmit information to / receive information from an external device such as the server 30. In other words, the communication unit 106 can be said to be a communication interface having a function of transmitting and receiving data. The communication unit 106 is implemented by, for example, a communication device such as a communication antenna, a transmission / reception circuit, and a port.
[0134] (Storage unit 108)
[0135] The storage unit 108 is provided in the wearable device 10, and stores programs, information, etc. (described later) for the main control unit 110 to perform various processes, and information obtained by the processes. The storage unit 108 is realized by, for example, a nonvolatile memory such as a flash memory.
[0136] (Main control unit 110)
[0137] The main control unit 110 is provided in the wearable device 10, and can control each functional unit of the wearable device 10. For example, the main control unit 110 acquires the sensing data 400 from the sensor unit 120 described later, converts the sensing data 400 into a predetermined format that can be transmitted, and transmits the sensing data 400 in the predetermined format to the server 30 described later via the communication unit 106. In addition, the main control unit 110 may be combined with a clock mechanism (not shown) for grasping accurate time, and presents the standard time 410 obtained from the clock mechanism to the user via the above-mentioned output unit 104. The main control unit 110 is implemented, for example, by hardware such as a central processing unit (CPU), a read-only memory (ROM), a random access memory (RAM), etc. Note that a part of the functions of the main control unit 110 may be provided by the server 30 described later.
[0138] (Sensor unit 120)
[0139] The sensor unit 120 is provided in the wearable device 10 mounted on the user, and includes a pulse wave sensor unit (pulsation sensor) 122 for detecting the pulse of the target user, a motion sensor unit 124 for detecting the movement of the user's body, etc. Details of various sensors included in the sensor unit 120 will be described below.
[0140] ~Pulse wave sensor unit 122~
[0141] The pulse wave sensor unit 122 is a biosensor that is attached to a part of the body such as the user's skin (e.g., an arm, a wrist, an ankle, etc.) in order to detect the user's pulse and detect the user's pulse wave. Here, the pulse wave refers to a waveform caused by the pulsation of the arteries that appears on the surface of the body, etc. when the muscles of the heart contract (beat; note that the number of heart beats per unit time is called the heart rate), blood is transported to the whole body through the arteries, and the pressure on the inner wall of the artery changes. For example, in order to obtain the pulse wave, the pulse wave sensor unit 122 irradiates the blood vessels in the measurement site such as the hand, arm, or leg of the user with light, and detects the light scattered in the moving substance or the stationary biological tissue in the user's blood vessels. Since the irradiated light is absorbed by the red blood cells in the blood vessels, the amount of light absorbed is proportional to the amount of blood flowing in the blood vessels of the measurement site. Therefore, the pulse wave sensor unit 122 can know the change in the amount of blood flow by detecting the intensity of the scattered light. In addition, the pulsation waveform (pulse wave) can be detected from the change in the blood flow rate, and the pulse can be detected based on the change in the waveform every predetermined time. Note that this method is called the photoplethysmography (PPG) method.
[0142] In detail, the pulse wave sensor unit 122 includes, for example, a small laser or LED (not shown) capable of emitting coherent light, and emits light having a predetermined wavelength such as around 850 nm. Note that in the present embodiment, the wavelength of the light emitted by the pulse wave sensor unit 122 can be appropriately selected. In addition, the pulse wave sensor unit 122 includes, for example, a photodiode (photodetector (PD)), and acquires a pulse wave by converting the detected light intensity into an electrical signal. Note that, instead of the PD, the pulse wave sensor unit 122 may incorporate a charge coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor, or the like. In addition, the pulse wave sensor unit 122 may include an optical system mechanism such as a lens or a filter so as to detect light from a measurement site of the user. Then, the pulse wave sensor unit 122 may detect the pulse wave as a time variation with a plurality of peaks (sensing data 400), and by counting a plurality of peaks appearing in the pulse wave per a predetermined time, the pulse rate of the user may be detected.
[0143] In addition, in this embodiment, by performing various statistical processing on the pulse wave obtained in this way (for example, obtaining the time change of the peak interval time of the pulse wave and analyzing the acquisition results), the user's sleep time, sleep depth, degree of relaxation, degree of tension, etc. can be calculated.
[0144] In addition, the present embodiment is not limited to obtaining the pulse wave by using the above-mentioned PPG method, but the pulse wave can be obtained by another method. For example, in the present embodiment, the pulse wave sensor unit 122 can detect the pulse wave by using the laser Doppler blood flow measurement method. The laser Doppler blood flow measurement method is a method for measuring blood flow using the following phenomenon. In detail, when a laser beam is emitted to the user's measurement site, scattered light accompanied by a Doppler frequency shift is generated due to the movement of scattering substances (mainly red blood cells) present in the user's blood vessels. Then, the scattered light accompanied by the Doppler frequency shift is disturbed by the immovable tissue present in the user's measurement site, so that a pulsating intensity change is observed. Therefore, the laser Doppler blood flow measurement method can detect the pulse wave by analyzing the intensity and frequency of the pulsating signal.
[0145] Note that in the present embodiment, an electrocardiogram (ECG) sensor unit (not shown) that detects the user's electrocardiogram via electrodes (not shown) attached to the user's body may be provided instead of the pulse wave sensor unit 122. In this case, the user's heart rate may be detected from the detected electrocardiogram.
[0146] Furthermore, in the present embodiment, the sensor unit 120 may include various other bio-information sensors (not shown) instead of the pulse wave sensor unit 122 or various other bio-information sensors (not shown) together with the pulse wave sensor unit 122. For example, the various bio-information sensors may include one or more sensors directly or indirectly attached to a part of the target user's body to measure the target user's brain waves, respiration, myoelectric potential, skin temperature, sweating, blood pressure, blood oxygen concentration, etc.
[0147] ~Motion sensor unit 124~
[0148] In addition, the sensor unit 120 may include a motion sensor unit 124 for detecting the movement of the user's body. For example, the motion sensor unit 124 detects the number of steps of the user based on the amount of movement of the user or the movement distance of the user by acquiring sensing data 400 indicating the change of acceleration generated by the movement of the user. Specifically, the motion sensor unit 124 includes an acceleration sensor, a gyro sensor, a geomagnetic sensor, etc. (not shown).
[0149] In addition, the sensor unit 120 may include a positioning sensor (position sensor) (not shown) instead of the motion sensor unit 124 or a positioning sensor (position sensor) (not shown) together with the motion sensor unit 124. The positioning sensor is a sensor that detects the position of the user wearing the wearable device 10, and specifically may be a global navigation satellite system (GNSS) receiver or the like. In this case, the positioning sensor may generate sensing data 400 indicating the latitude and longitude of the current position of the target user based on a signal from a GNSS satellite. In addition, in the present embodiment, for example, the relative position relationship of the user may be detected from radio frequency identification (RFID), Wi-Fi access points, radio base station information, and the like, and such a communication device may also be used as a positioning sensor.
[0150] As described above, in the present embodiment, the sensor unit 120 may include various bio-information sensors, etc. In addition, the sensor unit 120 may cooperate with a clock mechanism (not shown) included in the above-mentioned main control unit 110, and may associate the acquired sensing data 400 with the standard time 410 at which the sensing data 400 has been acquired. In addition, the various sensors may not be provided in the sensor unit 120 of the wearable device 10, and may be provided as a body separate from the wearable device 10, for example.
[0151] In addition, as described above, the wearable device 10 may adopt various types of wearable devices, such as an HMD type, an ear device type, an anklet type, a bracelet type, a necklace type, an eyewear type, a pad type, a batch type, and a clothing type. For example, Figure 7 The wearable device 10a shown is a bracelet (wristband) type wearable device. The wearable device 10a includes a main body 100, a button 102a provided on the side of the main body 100 for the user to operate the wearable device 10a (for example, the number of buttons 102a is not limited to one, but can be multiple), and a display unit 104a provided on the surface of the main body 100 and including, for example, an organic electroluminescent (EL) display, etc. In addition, the wearable device 10a has a wristband 150 for attaching and fixing the main body 100 to the user's arm. In addition, the main body 100 can be combined with a universal serial bus (USB) port (not shown) as an interface for connecting an external device (such as a battery (not shown) of a lithium ion battery, etc.).
[0152] Notice, Figure 6 and Figure 7 The wearable device 10 shown is an example of this embodiment. That is, in this embodiment, the wearable device 10 is not limited to Figure 6 and Figure 7 Example shown.
[0153] <2.3. Configuration of the server 30 according to the embodiment of the present disclosure>
[0154] The configuration of the wearable device 10 according to the embodiment of the present disclosure has been described above. Figure 8 The configuration of the server 30 according to the embodiment of the present disclosure is described. Figure 8 : is a block diagram showing a configuration example of the server 30 according to the present embodiment.
[0155] As described above, the server 30 includes, for example, a computer, etc. Figure 8 As shown, the server 30 mainly includes an input unit 302, an output unit 304, a communication unit 306, a storage unit 308, and a main control unit 310. The details of each functional unit of the server 30 will be described below.
[0156] (Input unit 302)
[0157] The input unit 302 receives input of data and commands to the server 30. More specifically, the input unit 302 is implemented by, for example, a touch panel, a keyboard, or the like.
[0158] (Output unit 304)
[0159] The output unit 304 includes, for example, a display, a speaker, a video output terminal, a sound output terminal, and the like, and outputs various information by way of images, sounds, and the like.
[0160] (Communication unit 306)
[0161] The communication unit 306 is provided in the server 30, and can transmit and receive information to and from external devices such as the wearable device 10 and the user terminal 70. The communication unit 306 is implemented by, for example, a communication device such as a communication antenna, a transmission / reception circuit, and a port.
[0162] (Storage unit 308)
[0163] The storage unit 308 is provided in the server 30, and stores programs, information, etc. (to be described later) for the main control unit 310 to perform various processes, and information obtained by the processes. The storage unit 308 is implemented by, for example, a magnetic recording medium such as a hard disk (HD), a nonvolatile memory such as a flash memory, etc.
[0164] (Main control unit 310)
[0165] The main control unit 310 is set in the server 30, and can control each block of the server 30 and calculate the user time 412 based on the acquired sensing data 400. The main control unit 310 is implemented by hardware such as a CPU, a ROM, and a RAM, for example. In addition, the main control unit 310 can also be used as a sensing data acquisition unit (information acquisition unit) 320, an evaluation acquisition unit 322, a processing unit 330, and an output control unit 340. The details of these functions of the main control unit 310 according to the present embodiment will be described below. Note that the main control unit 310 can perform a part of the functions of the main control unit 110 of the wearable device 10, or a part of the functions of the main control unit 310 can be performed by the main control unit 110 of the wearable device 10.
[0166] ~Sensing Data Acquisition Unit 320~
[0167] The sensing data acquisition unit 320 acquires a plurality of sensing data (time changes) 400 of one or different types output from one or more wearable devices 10, and outputs the acquired sensing data 400 to the processing unit 330 described later. In addition, the sensing data acquisition unit 320 may cooperate with the sensor unit 120 of the wearable device 10 to suppress an increase in power consumption of the sensor unit 120 or improve the accuracy of the sensing data 400, so as to appropriately change the timing acquisition (time interval) of the sensing data 400.
[0168] ~Evaluation Acquisition Unit 322~
[0169] The evaluation acquisition unit 322 acquires the user's evaluation of the user time 412 and the index 408 related to the user, etc., and outputs the acquired evaluation, etc. to the processing unit 330. For example, the processing unit 330 may change the synthesis algorithm 600 of the user time 412 by referring to the evaluation, etc., and correct the calculated user time 412 to a time closer to the actual feeling of the user.
[0170] ~Processing Unit 330~
[0171] The processing unit 330 processes the sensing data 400 output from the sensing data acquisition unit 320, and calculates the index 408 related to the user and the user time 412. In detail, the processing unit 330 functions as an index calculation unit (calculation unit) 332 and a time calculation unit 334 to implement the above-mentioned functions. The details of these functions of the processing unit 330 according to the present embodiment will be described below.
[0172] The index calculation unit 332 calculates the difference 402 between the sensed data 400 in the first interval and the reference data 420 in the second interval (the same time as the first interval) at a predetermined time interval. In addition, the index calculation unit 332 converts the calculated multiple differences 402 into time and integrates them to calculate the integration time 406. In addition, the index calculation unit 332 calculates the index 408 related to the user regarding the time difference from the standard time 410 based on the above-mentioned integration time 406. In detail, the index calculation unit 332 weights each integration time 406 according to the type of the sensed data 400 (for example, multiplies by a predetermined coefficient), then adds each integration time 406 of different types, and calculates the added integration time as the index (time difference) 408 related to the user. At this time, the index calculation unit 332 can select the sensed data 400 to be used when calculating the index 408 related to the user based on the reliability of each sensed data 400. In addition, the index calculation unit 332 can appropriately change the reference data 420 used for calculation based on the evaluation acquired by the above-mentioned evaluation acquisition unit 322, the attribute information of the user, the schedule of the user, etc., and can appropriately change the weight (multiplication coefficient) used for calculation. In addition, the index calculation unit 332 can appropriately change the calculation timing (time interval) in order to suppress the increase in power consumption of the sensor unit 120 or improve the accuracy of the sensing data 400.
[0173] The time calculation unit 334 calculates the user time 412 by adding the index (time difference) 408 related to the user calculated by the index calculation unit 332 to the standard time 410 .
[0174] ~Output control unit 340~
[0175] The output control unit 340 enables the communication unit 306 to transmit the result obtained by the processing unit 330 (eg, the user-related index 408 and the user time 412 ) to the wearable device 10 or the user terminal 70 .
[0176] Notice, Figure 8 The server 30 shown is an example of this embodiment. That is, in this embodiment, the server 30 is not limited to Figure 8 Example shown.
[0177] <2.4. Information processing method according to an embodiment of the present disclosure>
[0178] The information processing system 1 according to the embodiment of the present disclosure and the details of each device included in the information processing system 1 have been described above. Fig. 9 An information processing method according to the present embodiment is described. Fig. 9 is a flowchart showing an example of the information processing method according to the present embodiment.
[0179] like Fig. 9 As shown, the information processing method according to the present embodiment includes a plurality of steps from step S101 to step S113. The details of each step included in the information processing method according to the present embodiment will be described below.
[0180] First, before starting the information processing according to the present embodiment, the wearable device 10, the server 30, or the user terminal 70 receives the user's age, gender, height, weight, and vacation (information about the user's lifestyle in a week), commuting, class time (information about the user's weekday lifestyle), and other information about the user's specific regular activities as attribute information from the user. For example, the user can input the user's own attribute information by answering a question window (for example, "What is your gender? 1: Male, 2: Female") displayed on a display unit (not shown) of the user terminal 70 such as a smart phone. Note that in the present embodiment, the input of attribute information is not limited to being performed before the initial information processing, but can be performed in the middle of continuous information processing and is subject to special restrictions. In addition, the wearable device 10, the server 30, or the user terminal 70 can obtain information such as the user's ambient temperature on the day by using the input from the user, the user's location information, etc. Then, when performing weighting when calculating the user time 412, selecting the reference data 420, etc., the attribute information accepted in this way will be referred to. In addition, in the present embodiment, input such as the user's schedule on the day can be accepted together with the attribute information. In the present embodiment, for example, actions such as exercise and drinking may affect how the user feels the course of time. Therefore, it is preferred to accept the input of a schedule for running, hiking, attending a cocktail party, etc. Then, in the present embodiment, similar to the above-mentioned attribute information, when performing weighting when calculating the user time 412, selecting reference data 420, etc., the accepted schedule information can be referred to. In addition, in the present embodiment, the server 30 can store the scheduling information in association with the corresponding sensed data 400, the index 408 related to the user, and the information related to the trend of the user time 412. By doing so, the impact of the content of the user's action on the user's body, etc. can be analyzed, which is reflected in the user time 412, etc. at a later time.
[0181] (Step S101)
[0182] The server 30 obtains one or more different types of sensing data 400 from the wearable device 10 .
[0183] Note that in this embodiment, in order to ensure the quality of the sensed data 400, the following processing is preferably performed. In detail, regarding the derivation of the sensed data 400 from the pulse wave and the like, the measurement state changes according to the wearing state of the wearable device 10 including the sensor unit 120 and the influence of the user's body movement. Therefore, since the sensed data 400 such as the pulse rate is not always acquired in a good measurement state, it is preferred that the acquired sensed data 400 is selected as the sensed data 400 for calculating the user time 412 after the following processing is performed on the acquired sensed data 400.
[0184] Specifically, in the present embodiment, for example, after performing a process of presetting a threshold value for the amplitude of the pulse wave waveform and removing a waveform portion having an amplitude smaller than the threshold value or a waveform portion having a large amplitude, the sensed data is used as the sensed data 400 for calculating the user time 412. Furthermore, for example, it is determined whether the pulse wave waveform has a waveform that is temporally distant from a noise waveform existing nearby, and after performing a process of removing a waveform portion similar to the noise waveform, the sensed data is used as the sensed data 400 for calculating the user time 412.
[0185] In addition, since the pulse wave has a property of periodically detecting a similar waveform, it is determined whether the detected pulse wave waveform is located in a time frame that can be estimated from the pulse wave waveform detected immediately before. In addition, in the case of not being in the time frame, a pseudo pulse wave waveform is configured in the time frame, and a time frame in which the waveform to be detected next will exist is estimated. In the present embodiment, by repeating such estimation and determination, the reliability of the acquired pulse wave is determined, and based on the determination, it is determined whether to select the pulse wave as the sensing data 400 for calculating the user time 412. In addition, in the present embodiment, for example, the reliability of the pulse wave can be determined by the motion sensor unit 124 using the sensing data 400.
[0186] Note that in the present embodiment, in the case where the sensing data 400 such as the pulse rate is not selected as the sensing data 400 for calculating the user time 412 according to the reliability determination result or the like, only another type of sensing data 400 may be used to calculate the user time 412. Alternatively, in the present embodiment, in the case where another type of sensing data 400 is not acquired or selected, the standard time 410 may be temporarily used as the user time 412. Furthermore, in the present embodiment, when the user time 412 is presented to the user, it is preferred to present to the user which type of sensing data 400 is used to calculate the user time 412.
[0187] Furthermore, in the present embodiment, with respect to the sensing data 400 derived from acceleration (from such as acceleration and the number of steps), it is assumed that these sensing data 400 have high reliability, and the above-mentioned processing may not be performed.
[0188] (Step S103)
[0189] The server 30 selects the reference data 420 to be compared with the sensed data 400. In the present embodiment, the reference data 420 may be sensed data of the same type as the sensed data obtained from the wearable device 10 worn by the user. In addition, the reference data 420 may be sensed data obtained at predetermined time intervals in a second interval (on a date one day earlier than the date on which the sensed data 400 is obtained, and having the same time and the same time length as the first interval).
[0190] More specifically, the reference data 420 may be a time variation of a smoothed value (average value) acquired at a predetermined time interval of a plurality of second intervals, the plurality of second intervals being in a time period that satisfies a predetermined condition and is closest to a predetermined number of days for acquiring the sensing data 400 (e.g., the last 3 to 5 days, the last 3 to 5 days of the last weekday, the last 7 days of the last week, the last 4 days of the same day of the week of the last month, the last 4 days of the last month with the same schedule of the user, etc.), and having the same time and the same time length as the above-mentioned first interval. For example, when the sensing data 400 is acquired on a weekday, as the reference data 420, data obtained by smoothing a plurality of sensing data of three days of the last weekday may be used. For example, when the sensing data 400 is acquired on Wednesday, as the reference data 420, data obtained by smoothing a plurality of sensing data of three days of the last Wednesday may be used. In addition, for example, when the sensing data 400 is sensing data acquired on a day when the user's schedule includes running, as the reference data 420, data obtained by smoothing a plurality of sensing data of three days when the user's schedule includes running may be used.
[0191] Alternatively, in the present embodiment, the reference data 420 may be sensing data acquired at predetermined time intervals in a second interval that is in the past day set by the user (e.g., the previous day, the most recent past working day, the same day of the most recent past week, the same month and date of the previous year, etc.) and has the same time and the same time length as the above-mentioned first interval. In addition, in the present embodiment, the reference data 420 may be sensing data acquired from the wearable device 10 worn by another user, or may be a model (default data) of sensing data previously stored in the storage unit 308 of the server 30.
[0192] Furthermore, in the present embodiment, the reference data 420 can be appropriately changed according to the attribute information of the user, what kind of information is desired, etc. For example, when the user is a male, the sensing data of a male can be used as the reference data 420. Furthermore, for example, in the case where it is desired to compare the status of last year with that of this year, the sensing data of last year of the same month and date as that of acquiring the sensing data 400 can be used as the reference data 420.
[0193] (Step S105)
[0194] The server 30 calculates the difference 402 by subtracting the reference data 420 selected in the above step S103 from the sensing data 400. At this time, the server 30 may perform normalization on the difference 402 or may perform another statistical process.
[0195] (Step S107)
[0196] The server 30 converts the difference 402 calculated in the above step S105 into a difference time by multiplying the difference 402 by a predetermined coefficient (time conversion). Note that, for example, the explanation of the time course of the user time 412 regarding the difference 402 (amplitude relationship) of each sensing data 400 has been described with reference to Table 1.
[0197] (Step S109)
[0198] The server 30 integrates the multiple difference times after the time conversion in the above step S107. Specifically, starting from the scheduled start time set by the user, etc., the multiple difference times obtained from the scheduled end time set by the user, etc. (eg, the current time) are integrated to obtain the integrated time 406.
[0199] (Step S111)
[0200] The server 30 calculates the user time 412 based on the integrated time 406 integrated in the above step S109. In detail, the server 30 synthesizes the integrated time 406 of the plurality of different types of sensing data 400 by processing based on a predetermined formula to calculate the user-related index (time difference) 408. In addition, the server 30 calculates the user time 412 by adding the calculated user-related index 408 to the standard time 410.
[0201] (Step S113)
[0202] The server 30 presents the integrated time 406 obtained in the above step S109 as the index (time difference) 408 related to the user, or the index 408 related to the user obtained in the above step S111, the user time 412, etc. to the user. Note that the details of the presentation method in this embodiment will be described later.
[0203] As described above, according to the present embodiment, the user time 412 can be provided to the user based on the amount of exercise and the amount of load due to the user's action according to the user's feeling of the time flow. In addition, according to the present embodiment, since the amount of exercise and the amount of load of the user to be presented are replaced by the time points or time intervals familiar to the user every day, the user can easily understand his or her own state, etc., compared with the case where the amount of exercise, etc. is directly presented. As a result, according to the present embodiment, based on the above understanding, the user's action change can be caused.
[0204] <2.5. Setting of start time according to an embodiment of the present disclosure>
[0205] Next, an example of setting the integration range of the difference time will be described, and an example of setting the start time for starting integration will be described in detail. In the present embodiment, various times can be set for the start time.
[0206] (Example 1)
[0207] For example, in this embodiment, it can be assumed that when the user goes to bed, the standard time 410 is different from the user time 412, and when the user wakes up and performs activities, a difference occurs between the standard time 410 and the user time 412. With such an assumption, in this embodiment, the time when the user wakes up is set as the start time. Note that the time when the user wakes up can be detected by the motion sensor unit 124 of the wearable device 10.
[0208] (Example 2)
[0209] Furthermore, for example, in the present embodiment, even if the user goes to bed or performs activities, it can be assumed that there is always a difference between the standard time 410 and the user time 412. With such an assumption, in the present embodiment, the start of the wearable device 10 itself can be set as the start time, and integration of the difference time can be continued while the wearable device 10 is running.
[0210] (Example 3)
[0211] Furthermore, in this embodiment, a time specified by the user (eg, 12:00 of the standard time 410 ) may be set as the start time.
[0212] Furthermore, in the present embodiment, the user can appropriately change the start time, the end time, the reset timing of the integration time 406, etc. Note that the above examples are shown as examples of settings of the present embodiment, that is, the present embodiment is not limited to these examples.
[0213] <2.6. Presentation method according to an embodiment of the present disclosure>
[0214] Next, we will refer to Figures 10 to 20 Details of a presentation method according to an embodiment of the present disclosure are described. Figures 10 to 17 is an explanatory diagram for explaining an example of display screens 800a to 800h according to an embodiment of the present disclosure, and Figures 18 to 20 850a to 850c are explanatory diagrams for explaining examples of display screens 850a to 850c according to an embodiment of the present disclosure.
[0215] (First presentation method)
[0216] The first presentation method is a mode of presenting the user time 412 of the current time according to the user's situation on the day. Note that in the first presentation method, only the user time 412, etc. are presented to the user, and the actions that the user should take on the day, etc. are not suggested to the user. That is, in the first presentation method, the user himself is expected to voluntarily take appropriate actions by referring to the user time 412, etc.
[0217] In this embodiment, for example, Fig.10 As shown, the user time 412 is presented to the user through a display screen 800a displayed on the display unit 104a of the wristband type wearable device 10a. In detail, the display screen 800a may include, for example, a user time display 802 indicating the user time 412, an integral time graphic display 804 indicating the integral time 406 calculated as the index (time difference) 408 related to the user with the length of a bar graph, and an integral time display 806 indicating the above integral time 406. Note that in the present embodiment, the integral time graphic display 804 and the integral time display 806 may indicate the integral time including the synthesized integral time 406 as the index 408 related to the user, or may indicate the unsynthesized integral time 406 obtained from one type of sensing data 400. For example, the integral time graphic display 804 indicates that the user time 412 is later than the standard time 410 as the integral time graphic display 804 extends to the left side of the graphic, and indicates that the user time 412 is earlier than the standard time 410 as the integral time graphic display 804 extends to the right side of the graphic. For example, by viewing such a display screen 800a, since the user time 412 is 25 minutes later than the standard time 410, the user will think "Today, I can spend relaxing time starting from the morning. I hope I can work harder until noon", and the business processing speed will be improved.
[0218] Furthermore, in this embodiment, for example, Fig.11As shown, the user time 412 may be presented to the user through a display screen 800b displayed on the display unit 104a. In detail, the display screen 800b may include, for example, a user time display 802, a standard time display 808 indicating the standard time 410, and an integrated time graphic display 804. For example, by viewing such a display screen 800b, since the user time 412 is 15 minutes faster than the standard time 410, the user may think, "Today, I have been busy since the morning. I want to have lunch early today," and will have lunch early.
[0219] Note that Fig.11 As shown, the display screen 800b may include a trend display 812 having an arrow shape. The trend display 812 indicates the progress of the user time 412 relative to the standard time 410 in the most recent scheduled time (e.g., the most recent 10 minutes). Specifically, for example, in the case where the trend display 812 is inclined to the left in the figure, it indicates that the user time 412 is later than the standard time 410 in the most recent scheduled time, and in the case where the trend display 812 is inclined to the right in the figure, it indicates that the user time 412 is faster than the standard time 410 in the most recent scheduled time.
[0220] In this embodiment, if Figure 12 to Figure 14 As shown, by displaying the user time display 802, the integral time graphic display 804, the integral time display 806 and the standard time display 808 in various combinations, information can be presented to the user, and the form of the display screen 800 is not particularly limited. In addition, the user can operate the button 102a (see Figure 7 ) to, for example, switch the display between user time 412 and standard time 410, or to switch the display between integration time 406 and standard time 410.
[0221] In addition, in this embodiment, if Fig.15 and Fig.16 As shown, the type of sensory data used in calculating user time 412, etc. can be presented to the user. Fig.15 As shown, the type of sensing data used to calculate the user time 412, etc., etc. can be presented by a type display 810 included in a display screen 800f displayed on the display unit 104a. In detail, the display screen 800f may include, for example, a user time display 802, a standard time display 808 indicating the standard time 410, and a type display 810. The type display 810 displays to the user the type of sensing data used when calculating the user time 412, etc. by displaying various letters (e.g., corresponding to T: body temperature, P: pulse rate, A: acceleration, F: number of steps). Fig.15 In the example of , “T, P, A, F” is displayed, indicating that the user time 412 is calculated using the sensing data 400 of body temperature, pulse rate, acceleration, and number of steps.
[0222] In addition, Fig.16 In the example of , displaying “T, _, A, F” (ie, not displaying “P”) indicates that sensing data 400 of body temperature, acceleration, and number of steps (excluding pulse rate) is used to calculate user time 412.
[0223] In addition, in this embodiment, if Fig.17 As shown, by switching the color, brightness or pattern of the display unit 104a, an indicator 408 related to the user (which is the progress of the user time 412 relative to the standard time 410) can be presented. For example, in the case where the display unit 104a has a bright color, the display unit 104a indicates that the user time 412 is later than the standard time 410, and in the case where the display unit 104a has a dark color, the display unit 104a indicates that the user time 412 is faster than the standard time 410. In addition, in the present embodiment, the progress of the user time 412 relative to the standard time 410 can be presented through sound, vibration pattern (e.g., difference in vibration pattern), etc.
[0224] (Second presentation method)
[0225] The second presentation method is a mode of presenting the progress (transition) of the user time 412 in a predetermined time period (e.g., one day, several days, week, month, year) in the past. In the second presentation method, instead of presenting the user time 412 at the current moment as in the first presentation method, information that considers the user's activities, etc. from more perspectives is presented by presenting the progress of the user time 412 over a wide period of time. Then, in the second presentation method, it is expected that the actions that the user will perform in the future and the quality of the actions themselves will be changed by providing such multifaceted information. Note that in the second presentation method, the server 30 performs a preferred comparison by expanding the time period for which the progress of the user time 412 is calculated, and preferably, the reference data 420 used for calculation, etc. is changed to data different from that of the first presentation method.
[0226] For example, in this embodiment, Fig.18As shown, the progress of the user time 412 in one day can be presented to the user by a display screen 850a displayed on the display unit 700 of the user terminal 70 including a smart phone. In detail, the display screen 850a includes, for example, a standard time display 808 indicating the current standard time 410 and a progress display 852 indicating the progress of the user time 412. The progress display 852 includes, for example, nine bands 860, which are obtained by dividing the time from 7:00 to 11:00 into nine hours and correspond to each divided hour. In addition, the progress display 852 displays the progress of the user time 412 at each moment with the color, pattern, etc. of the corresponding band 860. For example, in the case where the band 860 is displayed in a bright color, the progress of the user time 412 indicated by the band 860 is slower than the current standard time 410, and in the case where the band 860 is dark, the progress of the user time 412 indicated by the band 860 is faster than the standard time 410.
[0227] Furthermore, in this embodiment, for example, Fig.19 As shown, the progress of the user time 412 for one month can be presented to the user through the display screen 850b displayed on the display unit 700. In detail, the display screen 850b includes, for example, the standard time display 808 indicating the current standard time 410, the progress display 852a indicating the progress of the user time 412, and the indicator display 854 indicating the indicator of the progress trend of the user time 412 for one month. The progress display 852a includes, for example, four bands 860, which are obtained by dividing the most recent month into four hours (weeks) and correspond to each week. In addition, the progress display 852a displays the progress of the user time 412 for each week with the color, pattern, etc. of the corresponding band 860. In addition, the indicator display 854 displays the indicator obtained by subtracting the fast progress week number from the slow progress week number of the user time 412 as an indicator indicating the progress trend of the user time 412 for the most recent month.
[0228] Furthermore, in this embodiment, for example, Fig. 20As shown, the progress of the user time 412 for one year can be presented to the user through the display screen 850c displayed on the display unit 700. In detail, the display screen 850c includes, for example, the standard time display 808 indicating the current standard time 410, the progress display 852a indicating the progress of the user time 412, and the indicator display 854a indicating the indicator of the progress trend of the user time 412 for one year. The progress display 852b includes, for example, twelve bands 860, which are obtained by dividing the most recent year into twelve hours (months) and correspond to each month. In addition, the progress display 852b displays the progress of the user time 412 for each month with the color, pattern, etc. of the corresponding band 860. In addition, the indicator display 854a displays the indicator obtained by subtracting the number of fast progress months from the number of slow progress months of the user time 412 as an indicator indicating the progress trend of the user time 412 for the most recent year.
[0229] As described above, in this embodiment, by presenting the user time 412 and the like in a form that the user can intuitively understand, the user can easily understand the user time 412 and the like. Moreover, according to this embodiment, based on the above understanding, the user's action change can be caused. Note that, Figures 10 to 20 The illustrated example is shown as an example of the display screen 800 and the display screen 850 of the present embodiment (that is, the display screen 800 and the display screen 850 according to the present embodiment are not limited to Figures 10 to 20 example shown).
[0230] <2.7. Timing of Presentation According to Embodiments of the Present Disclosure>
[0231] Next, we will refer to Fig.21 The timing of presenting the user time 412 according to the present embodiment is described. Fig.21 1 is an explanatory diagram for explaining an example of display timing according to the present embodiment. Fig.21 As shown, in this embodiment, various forms can be selected for the timing of presentation (display) of the user time 412 and the like.
[0232] In this embodiment, for example, Fig.21 As shown in (a) of FIG. 1 , the display of the user time 412 and the like continues, and the above display can be updated at the timing when the calculation process of the user time 412 is executed.
[0233] Furthermore, in this embodiment, for example, Fig.21 As shown in (b), after the user time 412 is calculated, the user time 412 and the like may be displayed within a predetermined time (eg, one minute).
[0234] Furthermore, in this embodiment, for example, Fig.21As shown in (c), the user time 412 etc. may be automatically calculated at each time (eg, 15 minutes) set by the user, and then the user time 412 etc. may be displayed within a predetermined time (eg, one minute).
[0235] For example, Fig.21 As shown in (d), when it is detected that the user is viewing the display unit 104a (see Figure 4 ), the user time 412 etc. can be automatically calculated. Note that in the present embodiment, for example, the user's viewing action can be detected by detecting a click operation of the user on the display unit 104a or by performing detection based on the acceleration of the user's arm. Then, after calculation, the display unit 104a can display the user time 412 etc. for a predetermined time (for example, one minute).
[0236] In addition, the user time 412 can be displayed only when the user time 412 is calculated for each predetermined time and the progress of the acquired user time 412 has changed significantly (for example, when a change equal to or greater than a predetermined threshold is detected compared to the progress of the previously calculated user time 412).
[0237] As described above, in this embodiment, the time for presenting the user time 412 or the like can be set to various forms. Therefore, information such as the user time 412 or the like can be presented according to the user's request, and an increase in power consumption can be suppressed by presenting the information. Note that Fig.21 The example shown is shown as an example of the timing of presentation of the present embodiment (ie, the timing of presentation according to the present embodiment is not limited to Fig.21 example shown).
[0238] <2.8. Timing of Calculation According to Embodiments of the Present Disclosure>
[0239] Next, we will refer to Fig. 22 and Fig.23 The calculation timing of the index 408 related to the user, the user time 412 and the like according to the present embodiment will be described. Fig. 22 is an explanatory diagram for explaining an example of transition of the calculation mode according to the present embodiment, and Fig.23 is a flowchart illustrating an example of an information processing method of an automatic mode according to an embodiment of the present disclosure.
[0240] In this embodiment, the acquisition timing of the sensing data 400, the calculation timing of the user-related index 408 or the user time 412, etc. can be appropriately selected and changed according to the power consumption of the wearable device 10 or the type of sensing data 400 to be acquired.
[0241] For example, in the present embodiment, the calculation mode can be appropriately changed according to the user's setting, the power consumption of the wearable device 10, etc. In the present embodiment, for example, as shown in Table 2 below, five calculation modes can be set.
[0242] [Table 2]
[0243] (Table 2)
[0244]
[0245] Note that the example shown in Table 2 is shown as an example of the calculation mode of the present embodiment. That is, the calculation mode according to the present embodiment and the setting conditions in each calculation mode are not limited to the example shown in Table 2.
[0246] In addition, in this embodiment, when the predetermined conditions are met, Fig.21 The above calculation mode is converted as shown. For example, by converting to the low consumption mode, the increase in power consumed when acquiring the sensing data about the pulse wave can be suppressed, and thus, the wearable device 10 can be activated for a long time. In addition, for example, in the case where the same type of sensing data 400 changes significantly, the accuracy of the calculated user time 412 can be improved by converting the calculation mode to the high frequency mode according to the change.
[0247] Notice, Fig.21 Conditions A to D in are as follows, for example.
[0248] A: In the case where the difference (difference rate) between the previously acquired sensing data 400 and the currently acquired sensing data 400 is within a predetermined range (for example, within 10%).
[0249] B: When the difference (difference rate) between the previously acquired sensing data 400 and the currently acquired sensing data 400 exceeds a predetermined range (eg, 10% or more).
[0250] C: When an instruction to acquire the sensing data 400 is received from the user
[0251] D: When acquiring sensing data 400
[0252] Notice, Fig.21 The example shown is an example of the transition of the computing mode of the present embodiment. That is, the transition of the computing mode according to the present embodiment and the conditions of the transition are not limited to Fig.21 and the aforementioned conditions.
[0253] Furthermore, in the present embodiment, in the above-described automatic mode, only when the difference (difference rate) between the previously acquired sensing data 400 and the currently acquired sensing data 400 is outside a predetermined range, the timing of acquiring a single sensing data 400 can be changed. In detail, for example, the acquisition interval is reduced only for the sensing data 400 having a large change width, and the acquisition interval is maintained so far for the sensing data 400 having a small change width. In this way, in the automatic mode, the accuracy of the calculated user time 412 can be improved while suppressing an increase in power consumption.
[0254] More specifically, for example, Fig.23 As shown, the automatic mode according to the present embodiment includes a plurality of steps from step S201 to step S207. The details of each step included in the automatic mode according to the present embodiment will be described below.
[0255] (Step S201)
[0256] The server 30 sets an acquisition timing (time interval) for each sensing data 400 .
[0257] (Step S203)
[0258] The server 30 acquires the sensing data 400 based on the setting in step S201 (n-th acquisition).
[0259] (Step S205)
[0260] The server 30 compares the sensing data 400 acquired in the n-1th time with the sensing data 400 acquired in the above step S203, and determines whether the difference is within a predetermined range. When within the predetermined range, the server 30 proceeds to step S207, and when not within the predetermined range, the server 30 returns to step S201. Then, in the returned step S201, the server 30 sets the time interval related to the timing of acquiring the corresponding sensing data 400 to be short based on a predetermined rule, for example.
[0261] (Step S207)
[0262] The server 30 acquires each sensing data 400 based on the acquisition timing first set in step S201 (n+1th acquisition).
[0263] As described above, in the automatic mode, through the above processing, the accuracy of the calculated user time 412 can be improved while suppressing an increase in power consumption.
[0264] <2.9. Selection of Reference Data 420 According to an Embodiment of the Present Disclosure>
[0265] Next, the details of the selection of the reference data 420 according to the present embodiment will be described. In the present embodiment, preferably, the reference data 420 is selected based on the process described below so as to calculate the user time 412 with higher accuracy. In detail, in the following process, in the case where the calculated user time 412 is significantly different from the previously calculated user time 412, the reference data 420 is changed. By doing so, more appropriate reference data 420 can be selected for calculating the user time 412 with high accuracy, etc.
[0266] Reference Fig.24 An example of a process for selecting the reference data 420 in the present embodiment is described. Fig.24 4 is a flowchart showing an example of a process for selecting reference data 420 according to the present embodiment. Fig.24 As shown, the process for selecting according to the present embodiment includes a plurality of steps from step S301 to step S307. The details of each step will be described below.
[0267] (Step S301)
[0268] The server 30 selects reference data 420 according to the attributes of the user or the settings of the user.
[0269] (Step S303)
[0270] The server 30 calculates the user time 412 based on the selection in the above step S301 .
[0271] (Step S305)
[0272] The server 30 compares the previously calculated user time 412 with the user time 412 calculated in the above step S303, and determines whether the difference is within a predetermined range. When within the predetermined range, the server 30 proceeds to step S307, and when outside the predetermined range, the server 30 returns to step S301. Then, in step S301 to which the process has returned, the server 30 selects the reference data 420 to be used for comparison with the sensing data 400 based on a predetermined rule.
[0273] For example, in a case where the previously selected reference data 420 is sensing data obtained by smoothing a plurality of sensing data of the latest three days from the day the sensing data 400 is acquired, the server 30 newly selects sensing data acquired by smoothing a plurality of sensing data of the latest 5 days from the day the sensing data 400 is acquired.
[0274] (Step S307)
[0275] The server 30 presents the user time 412 calculated in step S303 to the user.
[0276] According to the present embodiment, by performing the above-described process, more appropriate reference data 420 may be selected for calculating user time 412 and the like with high accuracy.
[0277] <2.10. Feedback Processing of User Evaluation According to Embodiments of the Present Disclosure>
[0278] Incidentally, in the present embodiment, in order to calculate the user time 412 closer to the user's actual feeling, the user can perform an evaluation, and the evaluation can be fed back to the calculation of the user time 412. Fig.25 The feedback process of user evaluation according to the present embodiment is described. Fig.25 850d is an explanatory diagram for explaining an example of a display screen 850d according to the present embodiment.
[0279] In detail, when the user time 412 is presented to the user, in order to obtain the user evaluation about the user time 412, the user may be displayed Fig.25 The display screen 850d shown. For example, the display screen 850d displayed on the display unit 700 of the user terminal 70 including the smart phone includes a user time display 802 indicating the user time 412 and a standard time display 808 indicating the current standard time 410. In addition, the display screen 850d includes a window 870 for asking the user to make an evaluation and a window 872 for the user to answer. Specifically, the window 870 is a window for asking the user to evaluate the user time 412 displayed to the user, for example, "What time do you feel?". In addition, the window 872 is a window in which the user can perform an operation of selecting each window to input the evaluation. For example, the user can perform an operation on any one of "12:00~(after 12:00)", "about 11:40" and "~11:20 (before 11:20)" displayed in each window 872 as an option for inputting an evaluation relative to the user time 412. Note that in the present embodiment, the evaluation input of the user may be a voice input, and further, the evaluation of the index 408 related to the user or the like may be acquired instead of the user time 412 .
[0280] Then, based on such evaluation results, the server 30 can set the user time 412 to a time closer to the actual feeling of the user by changing the above-mentioned coefficient a to coefficient e (weighting), for example.
[0281] In addition, the server 30 can learn the evaluation trend according to each attribute machine by associating the evaluation trend of each user obtained in this way with the attribute information of each user. Then, the server 30 can use the trend obtained by machine learning when calculating the user time 412 of another user (for example, setting the values of coefficients a to e).
[0282] <2.11. Example of using the user interface according to an embodiment of the present disclosure>
[0283] An example of using the user interface in the case where the wearable device 10 is a wristband type wearable device 10a will be described below. As an example of using the user interface according to the present embodiment, an operation on the button 102a of the wristband type wearable device 10a, a tap operation on the surface of the wristband type wearable device 10a, and a corresponding operation of the wristband wearable device 10a are shown in Table 3 below.
[0284] [Table 3]
[0285] (Table 3)
[0286]
[0287]
[0288] Note that in this embodiment, the click operation may be detected by the acceleration sensor 120c of the motion sensor unit 124. Also, in this embodiment, by storing the user time 412 using the user's operation, the stored user time 412 may be used for future calculation of the user time 412 or verification of the calculation result.
[0289] Note that the example shown in Table 3 is an example of using the user interface of the present embodiment, and the example of using the user interface according to the present embodiment is not limited to Table 3.
[0290] <<3. Examples according to embodiments of the present disclosure>>
[0291] The details of the information processing method in the embodiment of the present disclosure have been described above. Next, an example of information processing according to an embodiment of the present disclosure will be described in more detail while showing a specific example. Note that the example shown below is merely an example of information processing according to an embodiment of the present disclosure, and the information processing method according to an embodiment of the present disclosure is not limited to the following example.
[0292] <3.1. Example 1>
[0293] For example, an example will be described in which the user time 412 is 11:00 pm even though the standard time 410 is 9:00 pm. The user provided with such user time 412 will realize that even though the user usually goes to bed at 11:00 pm at the standard time 410, the user may feel tired due to being busy at work and take an action to go to bed before 11:00 pm at the standard time 410.
[0294] That is, according to the present example, the provided user time 412 allows the user to confirm the advance / delay of the user's own user time 412 before going to bed, and can cause the user to go to bed at an appropriate time.
[0295] <3.2. Example 2>
[0296] In addition, the embodiments of the present disclosure can also be used to cause an action to maintain a suitable sleep time for the user. In Example 2, when the sensing data 400 obtained by the pulse wave sensor 120b or the like indicates that the user is sleeping for a longer time or the sleep depth is deeper than the reference value, it is assumed that the time course of the user time 412 is slower than the time course of the standard time 410.
[0297] For example, an example will be described in which the user time 412 is 6:00am even though the standard time 410 is 8:00am. The user provided with such user time 412 will realize that even though the user usually gets up at 8:00am of the standard time 410, the user may not get enough sleep and continue to sleep until a time after 8:00am of the standard time 410.
[0298] That is, according to the present example, the provided user time 412 allows the user to confirm the advance / retardation of the user's own user time 412 before waking up, and may cause an action to maintain an appropriate sleep time for the user.
[0299] As described above, according to the user time 412 provided by the present embodiment, the user can easily understand the rhythm (process) of his / her own time due to his / her past activities. As a result, according to the present embodiment, when the user's action change can be caused, and finally when the action according to the user time 412 can be appropriately taken, it can maintain the user's health.
[0300] <<4. Conclusion>>
[0301] As described above, according to the above-described embodiments of the present disclosure, the user time 412 may be provided to the user according to how the user feels the flow of time.
[0302] In addition, according to the present embodiment, by providing the user time 412, the difference between the current state and the appropriate state can be easily understood, and thus the user's action change can be caused. In addition, in the present embodiment, since the user time 412 is presented at the time point and time interval of a generally recognizable indicator, the user or another user can easily understand the user's physical condition, etc. In addition, by using the user time 412, it becomes easy to understand the trend of the status of multiple users (people).
[0303] Furthermore, it is difficult to understand what kind of state the user is showing from a numerical value such as a heart rate, but it is easy to understand what kind of state the user is showing according to the user time 412 replaced with a time point or time interval familiar to the user every day. Furthermore, even when various biometric information is synthesized, the state the user is in can be easily understood by converting it into the user time 412.
[0304] Furthermore, in the above-described embodiment, by causing the wearable device 10 according to the present embodiment to have the function of the server 30, the wearable device 10 can be an independent apparatus.
[0305] <<5. About hardware configuration>>
[0306] Fig.26 is an explanatory diagram showing an example of the hardware configuration of the information processing apparatus 900 according to the present embodiment. Note that Fig.26 An example of the hardware configuration of the above-described server 30 in the information processing device 900 is shown.
[0307] The information processing apparatus 900 includes, for example, a CPU 950, a ROM 952, a RAM 954, a recording medium 956, an input / output interface 958, and an operation input device 960. In addition, the information processing apparatus 900 includes a display device 962, a communication interface 968, and a sensor 980. In addition, the information processing apparatus 900 connects the components with a bus 970 as a data transmission path, for example.
[0308] (CPU 950)
[0309] The CPU 950 can function as, for example, the above-described main control unit 310 which includes one or two or more processors (including an arithmetic circuit such as a central processing unit (CPU), various processing circuits, etc.) and controls the entire information processing apparatus 900 .
[0310] (ROM 952 and RAM 954)
[0311] The ROM 952 stores control data and the like (such as programs, arithmetic parameters, and the like) used by the CPU 950. The RAM 954 functions as the above-mentioned storage unit 308, and temporarily stores a program executed by the CPU 950, for example.
[0312] (Recording medium 956)
[0313] The recording medium 956 functions as the above-mentioned storage unit 350, and stores, for example, various data (such as data related to the information processing method according to the present embodiment, various applications, etc.). Here, examples of the recording medium 956 include a magnetic recording medium such as a hard disk and a nonvolatile memory such as a flash memory. In addition, the recording medium 956 may be separated from the information processing device 900.
[0314] (Input / output interface 958, operation input device 960, and display device 962)
[0315] The input / output interface 958 connects, for example, the operation input device 960, the display device 962, etc. Examples of the input / output interface 958 include a universal serial bus (USB) terminal, a digital visual interface (DVI) terminal, a high-definition multimedia interface (HDMI) (registered trademark) terminal, and various processing circuits.
[0316] An operation input device such as 960 is provided in the information processing apparatus 900, and is connected to the input / output interface 958 inside the information processing apparatus 900. Examples of the operation input device 960 include buttons, direction keys, a rotary selector such as a dial, a touch panel, and a combination thereof.
[0317] The display device 962 is provided on the information processing apparatus 900, for example, and is connected to the input / output interface 958 inside the information processing apparatus 900. Examples of the display device 962 include a liquid crystal display and an organic electroluminescence (EL) display.
[0318] Note that it goes without saying that the input / output interface 958 can also be connected to an external device such as an operation input device (for example, a keyboard or a mouse) or a display device outside the information processing device 900 .
[0319] (Communication interface 968)
[0320] The communication interface 968 is a communication device included in the information processing device 900 and serves as a communication unit 306, which communicates wirelessly or wired with an external device such as the wearable device 10 or the user terminal 70 via the network 90 (or directly). Here, examples of the communication interface 968 include a communication antenna and a radio frequency (RF) circuit (wireless communication), an IEEE802.15.1 port and a transmission / reception circuit (wireless communication), an IEEE802.11 port and a transmission / reception circuit (wireless communication), or a local area network (LAN) terminal and a transmission / reception circuit (wired communication).
[0321] So far, an example of the hardware configuration of the information processing device 900 has been shown. Note that the hardware configuration of the information processing device 900 is not limited to Fig.26The configuration shown. In detail, the above components can be configured using general components, or can be configured by hardware dedicated to the functions of the components. Such a configuration can be appropriately changed according to the technical level when implemented.
[0322] For example, in the case of performing communication with an external device or the like via a connected external communication device or in the case of a configuration in which processing is performed in an independent manner, the information processing apparatus 900 may not include the communication interface 968. In addition, the communication interface 968 may have a configuration capable of communicating with one or two or more external devices through a variety of communication schemes. In addition, the information processing apparatus 900 may be configured not to include, for example, the recording medium 956, the operation input device 960, the display device 962, and the like.
[0323] In addition, the information processing device according to the present embodiment can be applied to a system including multiple devices, which is connected to a network such as cloud computing (or communication between devices) as a prerequisite. That is, the above-mentioned information processing device according to the present embodiment can be implemented as an information processing system in which, for example, multiple devices perform processing related to the information processing method according to the present embodiment.
[0324] <<6.Supplement>>
[0325] Note that the above-described embodiment of the present disclosure may include, for example, a program for causing a computer to function as an information processing apparatus according to the present embodiment and a non-transitory tangible medium having the program recorded therein. In addition, the program may be distributed via a communication line (including wireless communication) such as the Internet.
[0326] In addition, each step in the processing of the above-described embodiment of the present disclosure does not necessarily have to be processed in the order described. For example, the order of the steps can be appropriately changed and processed. In addition, each step can be partially processed in parallel or individually, rather than processed in a time series. Moreover, the processing method of each step does not necessarily have to be processed according to the described method, and can be processed by another functional unit by another method, for example.
[0327] The preferred embodiments of the present disclosure have been described above with reference to the accompanying drawings, and the technical scope of the present disclosure is not limited to the above examples. It is obvious that a person with ordinary knowledge in the technical field of the present disclosure can find various changes and modifications within the scope of the technical ideas stated in the claims, and it should be understood that they will naturally fall within the technical scope of the present disclosure.
[0328] In addition, the effects described in this specification are merely exemplary or exemplary effects, and are not restrictive. That is, with or in place of the above effects, the technology according to the present disclosure can achieve other effects that are obvious to those skilled in the art from the description of this specification.
[0329] Note that the following configurations also fall within the technical scope of the present disclosure.
[0330] (1) An information processing device comprising:
[0331] an information acquisition unit that acquires temporal changes in biological information from one or more biological information sensors worn by the user; and
[0332] A calculation unit calculates a difference between a time change of the first biological information in a first interval and a time change of the second biological information in a second interval having the same time as the first interval at predetermined time intervals, and calculates a time difference with respect to a standard time.
[0333] (2) The information processing device according to (1), further including: a time calculation unit that calculates a time related to the user by adding the calculated time difference to a standard time.
[0334] (3) The information processing device according to (1) or (2), wherein the calculation unit calculates the time difference by converting the difference into time and integrating a plurality of time-converted differences.
[0335] (4) The information processing device according to any one of (1) to (3), wherein:
[0336] The information acquisition unit acquires time changes of a plurality of different types of biological information from a plurality of different biological information sensors, and
[0337] The calculation unit calculates the time difference based on time changes among the plurality of pieces of biological information of different types, the time changes being weighted based on the type of the biological information.
[0338] (5) The information processing device according to (4), further comprising:
[0339] An evaluation acquisition unit acquires an evaluation of a time difference from a user, wherein:
[0340] The calculation unit performs a weighting based on the acquired evaluations.
[0341] (6) The information processing device according to any one of (1) to (5), wherein the calculation unit selects a time change in the biological information used in calculating the time difference based on the reliability of each biological information.
[0342] (7) The information processing device according to any one of (1) to (6), wherein the calculation unit selects the temporal change in the second biological information according to an attribute of the user.
[0343] (8) The information processing device according to (7), wherein:
[0344] The time variation of the second bio-information includes time variations of a plurality of pieces of bio-information acquired from a bio-information sensor worn by a user and acquired in a plurality of second intervals having the same time length as the first interval in the past of the first interval.
[0345] (9) The information processing device according to (8), wherein:
[0346] The time variation of the second biometric information includes the time variation obtained by smoothing the time variation of multiple pieces of biometric information obtained from a biometric information sensor worn by a user and obtained in multiple second intervals, wherein the second interval has the same time length as the first interval in a period of a predetermined number of days that have passed recently in the first interval, and the predetermined number of days satisfies a predetermined condition.
[0347] (10) The information processing device according to (9), wherein the calculation unit selects, as the predetermined condition, a temporal change in the second biological information having a second interval having the same day of the week as the day of the week associated with the first interval.
[0348] (11) The information processing device according to (7), wherein:
[0349] The time variation of the second bio-information includes time variations of a plurality of pieces of bio-information acquired from bio-information sensors worn by users other than the user and acquired in a plurality of second intervals having the same time length as the first interval in the past of the first interval.
[0350] (12) The information processing device according to any one of (1) to (11), wherein:
[0351] The temporal changes of biological information are obtained by at least one of the following:
[0352] a pulsation sensor for detecting a heartbeat or a pulse, a temperature sensor for detecting a skin temperature, a sweat sensor for detecting sweating, a blood pressure sensor for detecting blood pressure, a brain wave sensor for detecting a brain wave, a breathing sensor for detecting breathing, a myoelectric potential sensor for detecting an electromyographic potential, and a blood oxygen concentration sensor for detecting a blood oxygen concentration, which are worn directly on a part of a user's body, and
[0353] Motion sensors to detect user movement and position sensors.
[0354] (13) The information processing device according to (12), wherein the motion sensor includes at least one of an acceleration sensor, a gyro sensor, or a geomagnetic sensor worn by a user.
[0355] (14) The information processing device according to (2), further including: a presentation unit that presents the calculated time difference to a user.
[0356] (15) The information processing device according to (14), wherein the presentation unit displays the calculated time related to the user to the user.
[0357] (16) The information processing device according to (14), wherein the presentation unit changes a color or a pattern to display the time difference.
[0358] (17) An information processing device according to any one of (1) to (16), wherein the information acquisition unit or the calculation unit changes the time for acquiring the time change in the first biological information or the time for calculating the time difference according to the power consumption of the biological information sensor and the state of the time change of the first biological information.
[0359] (18) An information processing method comprising:
[0360] acquiring temporal changes in biometric information from one or more biometric information sensors worn by the user; and
[0361] A difference between a time change of the first biological information in a first interval and a time change of the second biological information in a second interval having the same time as the first interval is calculated at predetermined time intervals, and a time difference relative to a standard time is calculated.
[0362] (19) A program that causes a computer to execute the following functions:
[0363] A function of acquiring temporal changes in biometric information from one or more biometric information sensors worn by a user; and
[0364] A function of calculating a difference between a time change of first biological information in a first section and a time change of second biological information in a second section having the same time as the first section at predetermined time intervals, and calculating a time difference with respect to a standard time.
[0365] Reference Mark List
[0366] 1 Information Processing System
[0367] 10.10a Wearable devices
[0368] 30 Servers
[0369] 70 User Terminals
[0370] 90 Network
[0371] 100 Main Body
[0372] 102, 302 Input unit
[0373] 102a Button
[0374] 104, 304 output unit
[0375] 104a, 700 display unit
[0376] 106, 306 communication unit
[0377] 108, 308 storage unit
[0378] 110, 310 Main control unit
[0379] 120 sensor units
[0380] 120a Body surface temperature sensor
[0381] 120b, 122 pulse wave sensor (pulse wave sensor unit)
[0382] 120c Accelerometer
[0383] 120d step sensor
[0384] 124 Motion sensor unit
[0385] 150 Wristband
[0386] 320 sensing data acquisition unit
[0387] 322 Assessment Acquisition Unit
[0388] 330 processing units
[0389] 332 Index calculation unit
[0390] 334 Time calculation unit
[0391] 340 Output Control Unit
[0392] 400, 400a, 400b, 400c, 400d sensing data
[0393] 402 Bad
[0394] 406, 406a, 406b, 406c, 406d Integration time
[0395] 408 indicator
[0396] 410 Standard Time
[0397] 412 User Time
[0398] 420 Reference Data
[0399] 600 Synthesis Algorithm
[0400] 800, 800a, 800b, 800c, 800d, 800e, 800f, 800g, 800h, 850, 850a, 850b, 850c, 850d display
[0401] 802 User time display
[0402] 804 Integration time graphic display
[0403] 806 Integration time display
[0404] 808 Standard time display
[0405] 810 Type Display
[0406] 812 Trend Display
[0407] 852, 852a, 852b process display
[0408] 854, 854a indicator display
[0409] 860 belt
[0410] 870, 872 Windows
[0411] 900 Information Processing Device
[0412] 950 CPU
[0413] 952 ROM
[0414] 954 RAM
[0415] 956 Recording Media
[0416] 958 Input / Output Interface
[0417] 960 Operation Input Device
[0418] 962 Display devices
[0419] 968 Communication Interface
[0420] 970 Bus
[0421] 980 sensors.
Claims
1. An information processing device, comprising: an information acquisition unit, which acquires temporal changes of biological information from one or more biological information sensors worn by the user; as well as A calculation unit calculates the difference between the time change of the first biometric information in the first interval and the time change of the second biometric information in the second interval at a predetermined time interval, and multiplies the difference by a predetermined coefficient to convert it into time, and integrates a plurality of time-converted differences to calculate the time difference relative to the standard time, thereby obtaining the time actually felt by the user, and the second interval has the same time as the first interval.
2. The information processing device according to claim 1, further comprising: A time calculation unit calculates the time related to the user by adding the calculated time difference to the standard time.
3. The information processing device according to claim 1, wherein: The information acquisition unit acquires time changes of a plurality of pieces of biological information of different types from a plurality of different biological information sensors, and The calculation unit calculates the time difference based on the time changes of the plurality of pieces of the biological information of different types, the time changes being weighted based on the type of the biological information.
4. The information processing device according to claim 3, further comprising: An evaluation acquisition unit is configured to acquire an evaluation of the time difference from the user, wherein: The calculation unit performs a weighting based on the acquired evaluations.
5. The information processing device according to claim 1, wherein: The calculation unit selects the time change of the biological information used in calculating the time difference based on the reliability of each of the biological information.
6. The information processing device according to claim 1, wherein: The calculation unit selects the temporal change of the second biometric information according to an attribute of the user.
7. The information processing device according to claim 6, wherein: The time variation of the second bio-information includes the time variation of a plurality of pieces of the bio-information acquired from the bio-information sensor worn by the user and acquired in a plurality of the second intervals, the second intervals being past the first interval and having the same time length as the first interval.
8. The information processing device according to claim 7, wherein: The time variation of the second biometric information includes the time variation obtained by smoothing the time variation of multiple pieces of biometric information obtained from the biometric information sensor worn by the user and obtained in multiple second intervals, wherein the second interval has the same time length as the first interval in a period of a predetermined number of days in the most recent past of the first interval, and the predetermined number of days satisfies a predetermined condition.
9. The information processing device according to claim 8, wherein: The calculation unit selects, as the predetermined condition, the temporal change of the second biological information having the second interval having the same day of the week as the day of the week related to the first interval.
10. The information processing device according to claim 6, wherein: The time variation of the second biometric information includes the time variation of multiple pieces of the biometric information acquired from the biometric information sensors worn by users other than the user and acquired in multiple second intervals, where the second interval is in the past of the first interval and has the same time length as the first interval.
11. The information processing device according to claim 1, wherein: The temporal change of the biological information is obtained by at least one of the following: a pulsation sensor for detecting a heartbeat or a pulse, a temperature sensor for detecting a skin temperature, a sweat sensor for detecting sweating, a blood pressure sensor for detecting blood pressure, a brain wave sensor for detecting a brain wave, a breathing sensor for detecting breathing, a myoelectric potential sensor for detecting myoelectric potential, and a blood oxygen concentration sensor for detecting blood oxygen concentration, and A motion sensor or a position sensor that detects the motion of the user.
12. The information processing device according to claim 11, wherein: The motion sensor includes at least one of an acceleration sensor, a gyroscope sensor, and a geomagnetic sensor worn by the user.
13. The information processing device according to claim 2, further comprising: A presenting unit is configured to present the calculated time difference to the user.
14. The information processing device according to claim 13, wherein: The presentation unit displays the calculated time related to the user to the user.
15. The information processing device according to claim 13, wherein: The presentation unit changes color or pattern to display the time difference.
16. The information processing device according to claim 1, wherein: The information acquisition unit or the calculation unit changes the timing of acquiring the time change of the first biological information or the timing of calculating the time difference according to the power consumption of the biological information sensor and the state of the time change of the first biological information.
17. An information processing method, comprising: acquiring temporal changes in biometric information from one or more biometric information sensors worn by a user; and The difference between the time change of the first biometric information in the first interval and the time change of the second biometric information in the second interval is calculated at a predetermined time interval, and the difference is multiplied by a predetermined coefficient to convert into time, and a plurality of time-converted differences are integrated to calculate the time difference relative to the standard time, thereby obtaining the time actually felt by the user, and the second interval has the same time as the first interval.
18. A computer-readable storage medium having a program stored thereon, wherein when the program is executed, the computer is caused to perform the following functions: A function of acquiring temporal changes in biometric information from one or more biometric information sensors worn by a user; and A function of calculating the difference between the time change of the first biometric information in the first interval and the time change of the second biometric information in the second interval at a predetermined time interval, multiplying the difference by a predetermined coefficient to convert into time, and integrating multiple time-converted differences to calculate the time difference relative to the standard time, thereby obtaining the time actually felt by the user, and the second interval has the same time as the first interval.
