Wearable device, information processing system, information processing method and program

Abstract

To provide a wearable device promoting input of information about a subjective emotion.SOLUTION: A wearable device prompts a user wearing the wearable device to input information about a subjective emotion on the basis of a prescribed condition. The information about the subjective emotion is used for labelling related to machine learning of biological data of the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a wearable device, an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses the following techniques 1 and 2. 1. Learning data representing the relationship between the acquired information representing the subject's emotions and the information representing the subject's activity state is generated and stored in memory. 2. In this state, the subject's current emotion is estimated based on the acquired information representing the subject's current activity state and the learning data stored in memory. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-208576 Summary of the Invention [Problem to be solved by the invention]

[0004] When generating training data that indicates the association between subjective emotions and biometric data, a labeling process is required to assign correct subjective emotions to the biometric data. Patent Document 1 does not disclose how to input subjective emotions for labeling. [Means for solving the problem]

[0005] According to one aspect of the present invention, there is provided a wearable device that prompts a user wearing the wearable device to input information about a subjective emotion based on a predetermined condition, and the information about the subjective emotion is used for labeling the user's biometric data for machine learning. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a diagram illustrating an example of a wearable device. [Figure 2] FIG. 2 is a diagram illustrating an example of the hardware configuration of the smartwatch 100. [Figure 3] FIG. 3 is a flowchart showing an example of information processing in the smartwatch 100. [Figure 4] FIG. 4 shows an example of screen transitions related to input of subjective emotion information displayed on input / output section 250. In FIG. [Figure 5] FIG. 5 is a diagram showing an example of the timing of recording subjective emotion information superimposed on a time series graph of acceleration data from the smartwatch 100. DETAILED DESCRIPTION OF THE INVENTION

[0007] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0008] In this specification, the term "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In addition, various types of information are handled in this embodiment, and communication and calculation can be performed on a circuit in the broad sense, regardless of whether this information is represented by a high or low signal value as a binary bit collection consisting of 0 or 1, a physical numerical value of a signal value, or a quantum superposition.

[0009] In addition, a circuit in the broad sense is a circuit realized by at least appropriately combining a circuit, circuitry, a processor, a memory, etc. That is, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0010] In addition, the program for realizing the software appearing in the embodiments may be implemented in a manner that allows it to be downloaded from a server, the program may be executed on a cloud computer, or it may be stored on a non-volatile or volatile non-transitory storage medium and distributed.

[0011] <Embodiment 1> 1. System Configuration FIG. 1 is a diagram showing an example of a wearable device. As shown in FIG. 1, this specification will describe a smart watch 100 as an example of a wearable device. However, a smart watch is just one example of a wearable device, and other examples of wearable devices may include, for example, a fitness tracker, smart glasses, a vital sign monitor, a smart ring, and a badge-type wearable device. As will be described later, any wearable device may be used as long as it can prompt a user to input information related to subjective emotions (hereinafter referred to as subjective emotion information).

[0012] Here, the claimed information processing system may be composed of multiple devices or may be composed of a single device. When the claimed information processing system is composed of a single device, an example of that device is the smartwatch 100. When the claimed information processing system is composed of a plurality of devices, an example of the plurality of devices is the smartwatch 100 and a server device capable of communicating with the smartwatch 100, or the smartwatch 100 and a cloud system capable of communicating with the smartwatch 100.

[0013] 2. Hardware Configuration 2 is a diagram showing an example of the hardware configuration of the smartwatch 100. The hardware configuration of the smartwatch 100 includes a control unit 210, a storage unit 220, a biological data measurement unit 230, an acceleration measurement unit 240, an input / output unit 250, and a communication unit 260.

[0014] The control unit 210 is a CPU (Central Processing Unit) or the like, and controls the smartwatch 100 as a whole.

[0015] The storage unit 220 is any one of a ROM (Read Only Memory), a RAM (Random Access Memory), an SSD (Solid State Drive), or any combination thereof, and stores programs and data used when the control unit 210 executes processing based on the programs. The control unit 210 executes processing based on the programs stored in the storage unit 220, thereby realizing the functions of the smartwatch 100 and the processing of the flowchart shown in FIG. 3 (described later). The storage unit 220 is an example of a storage medium. Note that, in this embodiment, the data used when the control unit 210 executes processing based on the programs is described as being stored in the storage unit 220, but the data may also be stored in a storage unit of another device that can communicate with the smartwatch 100. In other words, the data may be stored in a storage unit of any device as long as it can be referenced by the control unit 210.

[0016] The biological data measurement unit 230 measures biological data of the user of the smart watch 100. Examples of biological data measured by the biological data measurement unit 230 include heart rate, pulse, blood pressure, oxygen concentration, skin temperature, and skin potential. The acceleration measurement unit 240 measures the acceleration of the smartwatch 100.

[0017] The input / output unit 250 is a touch panel display or the like, which displays information, accepts user operations, and selects or inputs information in response to the user operations. The communication unit 260 connects the smartwatch 100 to a network or the like and controls communication with other devices or the like.

[0018] 3. Information Processing The information processing according to this embodiment will be described below.

[0019] FIG. 3 is a flowchart showing an example of information processing in the smartwatch 100. In step S301, the control unit 210 acquires biometric data of the user wearing the smartwatch 100. The processing of step S301 is assumed to be constantly executed while the smartwatch 100 is running.

[0020] In step S302, the control unit 210 determines whether or not a predetermined condition is satisfied. For example, the control unit 210 determines whether or not the biological data satisfies the predetermined condition. For example, the control unit 210 determines whether or not the heart rate is 60 to 100 beats per minute. If the heart rate is 60 to 100 beats per minute, the control unit 210 determines that the biological data satisfies the predetermined condition. If the heart rate is not 60 to 100 beats per minute, the control unit 210 determines that the biological data does not satisfy the predetermined condition. If the control unit 210 determines that the biological data satisfies the predetermined condition, the control unit 210 proceeds to step S303. If the control unit 210 determines that the biological data does not satisfy the predetermined condition, the control unit 210 returns to step S301. The heart rate is one example, and whether or not the predetermined condition is satisfied may also be determined based on the pulse, blood pressure, oxygen concentration, skin temperature, skin potential, etc.

[0021] In step S303, the control unit 210 controls the input / output unit 250 to display a screen prompting the input of subjective emotion information. The control unit 210 also controls the transition of the screen displayed on the input / output unit 250. That is, the control unit 210 prompts the user wearing the smart watch 100 to input information related to subjective emotions based on predetermined conditions. As will be described later, information related to subjective emotions is used for labeling related to machine learning of the user's biometric data. The subjective emotion information described later is an example of information related to subjective emotions. More specifically, the control unit 210 prompts the user to input information related to subjective emotions based on the biometric data satisfying predetermined conditions. The control unit 210 prompts the user to input information related to subjective emotions by displaying a screen related to input of subjective emotion information (e.g., Figures 4(b), 4(c), and 4(d)) on the wearable device. Fig. 4 is a diagram showing an example of a screen transition related to the input of subjective emotion information displayed on the input / output unit 250. Fig. 4(a) is a diagram showing an example of a screen displayed on the input / output unit 250 when the smart watch 100 is operating in watch mode. The screen shown in Fig. 4(a) is displayed on the input / output unit 250 as the main screen. For most of the time when the smart watch 100 is running, the main screen is displayed on the input / output unit 250. In steps S301 and S302, the screen shown in Fig. 4(a) is displayed on the input / output unit 250.

[0022] FIG. 4(b) is a diagram showing an example of a joy, anger, sadness, or happiness selection screen. The screen of FIG. 4(b) is a screen displayed on the input / output unit 250 in step S303. On the joy, anger, sadness, or happiness selection screen, the user can select one of the four categories of joy, anger, sadness, or happiness as a category of subjective emotions. Note that the types of categories are merely an example and are not limited to four. Furthermore, the way of dividing the categories is not limited to joy, anger, sadness, or happiness.

[0023] When the user selects one of the four categories on the screen of Fig. 4(b), the control unit 210 transitions the screen displayed on the input / output unit 250 from Fig. 4(b) to Fig. 4(c). Fig. 4(c) is a diagram showing an example of an emotion type selection screen. On the emotion type selection screen, the user can select one emotion type from multiple emotion types included in the category selected on the joy, anger, sadness, or pleasure selection screen.

[0024] When joy is selected as the category on the screen of FIG. 4(b), the control unit 210 displays selection items on the screen of FIG. 4(c) so that one emotion can be selected from four emotion types: happiness, energy, excitement, and alert. When anger is selected as the category on the screen of FIG. 4(b), the control unit 210 displays selection items on the screen of FIG. 4(c) so that one emotion can be selected from four emotion types: tension, nervousness, pressure, and worry. When sadness is selected as the category on the screen of FIG. 4(b), the control unit 210 displays selection items on the screen of FIG. 4(c) so that one emotion can be selected from four emotion types: sadness, depression, lethargy, and fatigue. When comfort is selected as the category on the screen of FIG. 4(b), the control unit 210 displays selection items on the screen of FIG. 4(c) so that one emotion can be selected from four emotion types: calm, relaxation, tranquility, and satisfaction. The emotion types included in each category are merely examples.

[0025] When the user selects an emotion type on the screen of FIG. 4(c), the control unit 210 transitions the screen displayed on the input / output unit 250 from FIG. 4(c) to FIG. 4(d). FIG. 4(d) is a diagram showing an example of an emotion level selection screen. On the emotion level selection screen, the user can select the level of the emotion selected on the emotion type selection screen. For example, the user can select emotion levels 1 to 4 via the screen shown in FIG. 4(d). Emotion level 1 is the lowest emotion level, and emotion level 4 is the highest emotion level.

[0026] When the registration button is selected on the screen shown in Fig. 4(d) and an emotion level is registered, the control unit 210 controls the screen transition to return the screen to Fig. 4(b). Then, if no input is made for M seconds (e.g., 30 seconds) after returning to the screen of Fig. 4(b), the control unit 210 controls the screen transition to return the screen to the clock mode display of Fig. 4(a). The control unit 210 may prevent the screen of Fig. 4(a) from transitioning to the screen of Fig. 4(b) for a certain period of time (e.g., 600 seconds) after the screen returns to the display of Fig. 4(a). By performing such processing, the burden of inputting information related to subjective emotions can be reduced.

[0027] The control unit 210 may allow the user to select no emotion in addition to joy, anger, sadness, and happiness on the screen shown in Fig. 4(b). When no emotion is selected, the control unit 210 automatically selects and sets emotion level 1 without transitioning the screen from Fig. 4(b) to Fig. 4(c), Fig. 4(d), etc. However, for the sake of simplicity, the following description will be given assuming that the screen transitions from Fig. 4(b) → Fig. 4(c) → Fig. 4(d) and that the category, emotion type, and emotion level are selected.

[0028] In step S304 of Fig. 3, the control unit 210 determines whether a category, emotion type, and emotion level have been selected (or input) on a screen such as that shown in Fig. 4. If the control unit 210 determines that a category, emotion type, and emotion level have been selected, it proceeds to step S305. If the control unit 210 determines that a category, emotion type, and emotion level have not been selected, it returns the process to step S303.

[0029] In step S305, control unit 210 sets the category, emotion type, and emotion level selected via the screen shown in FIG. 4 as subjective emotion information. In step S306, control unit 210 generates learning data by associating the input subjective emotion information with biometric data of the user wearing the wearable device. The biometric data associated with the subjective emotion information is data relating to the timing at which the subjective emotion information was input (for example, the timing at which a category was selected in FIG. 4(b) or the timing at which an emotion level was selected in FIG. 4(d)). In step S307, the control unit 210 stores the generated learning data in the storage unit 220 or the like.

[0030] In step S308, control unit 210 determines whether or not to end the processing of the flowchart shown in Fig. 3. When control unit 210 determines to end the processing of the flowchart shown in Fig. 3, it ends the processing of the flowchart shown in Fig. 3. When control unit 210 determines not to end the processing of the flowchart shown in Fig. 3, it returns the processing to step S301.

[0031] According to the processing of this embodiment, the smartwatch 100 prompts the user to input information related to subjective emotions, allowing the user to input information related to subjective emotions into the smartwatch 100 at an appropriate time. The input information related to subjective emotions is then labeled as a correct label related to the user's biometric data measured by the smartwatch 100. The subjective emotion information to which the correct label has been assigned is used in supervised machine learning of the biometric data.

[0032] (Variation 1) A first modification of the first embodiment will now be described. In the first embodiment, an example of the predetermined condition in step S302 is whether the biometric data of the user satisfies the predetermined condition. In the first modification, as another example of the predetermined condition, whether or not biometric data arranged in chronological order satisfies the predetermined condition will be described.

[0033] The control unit 210 of Modification 1 (hereinafter simply referred to as the control unit 210) prompts the user to input information related to subjective emotions based on whether first and second biometric data of the user acquired at different times satisfy a predetermined condition. For example, if the blood pressure measured at the first time is 115 / 75 mmHg or less and the blood pressure measured at the second time a predetermined number of seconds (e.g., 15 seconds) after the first time is also 115 / 75 mmHg or less, the control unit 210 determines that the biometric data satisfies the predetermined condition. If the blood pressure measured at the first time is not 115 / 75 mmHg or less or the blood pressure measured at the second time is not 115 / 75 mmHg or less, the control unit 210 determines that the biometric data does not satisfy the predetermined condition.

[0034] That is, in the first modification, the control unit 210 may prompt the user to input information related to subjective emotions when the biological data arranged in chronological order satisfies a predetermined condition.

[0035] According to the first modification, if the biometric data satisfies a predetermined condition for a certain period of time, the user can be prompted to input information related to subjective emotions.

[0036] (Variation 2) A second modification of the first embodiment will now be described. In the first embodiment, an example of the predetermined condition in step S302 is whether the biometric data of the user satisfies the predetermined condition. In the second modification, whether the acceleration of the smartwatch 100 measured by the acceleration measuring unit 240 satisfies a predetermined condition will be described as another example of the predetermined condition.

[0037] The control unit 210 of Modification 2 (hereinafter simply referred to as the control unit 210) acquires the acceleration of the smartwatch 100 measured by the acceleration measurement unit 240. The control unit 210 then determines whether the acceleration satisfies a predetermined condition. If the acceleration satisfies the predetermined condition (for example, if the acceleration value is within a set range), the control unit 210 prompts the user to input information related to subjective emotions.

[0038] According to the second modification, when the acceleration satisfies a predetermined condition, the user can be prompted to input information related to subjective feelings.

[0039] (Variation 3) A third modification of the first embodiment will now be described. In the first embodiment, an example of the predetermined condition in step S302 is whether the biometric data of the user satisfies the predetermined condition. In the third modification, as another example of the predetermined condition, an explanation will be given using as an example whether the accelerations of the smart watch 100 measured by the acceleration measuring unit 240 and arranged in order of time satisfy the predetermined condition.

[0040] The control unit 210 of Modification 3 (hereinafter simply referred to as the control unit 210) prompts the user to input information related to subjective emotions based on the fact that first acceleration data and second acceleration data related to the smart watch 100 acquired at different times satisfy a predetermined condition. For example, if the acceleration value measured at the first time is within a set range, and the acceleration value measured at a second time after a predetermined number of seconds (e.g., 10 seconds) has elapsed since the first time, is also within the set range, the control unit 210 determines that the acceleration satisfies the predetermined condition.

[0041] Fig. 5 is a diagram showing an example of the timing of recording subjective emotion information superimposed on a time-series graph of acceleration data of the smartwatch 100. In the example of Fig. 5, when it is determined based on the acceleration data of the smartwatch 100 that the smartwatch 100 has been in a stationary state for a certain period of time (for example, 50 seconds), the user is prompted to input information related to the subjective emotion, and the information related to the subjective emotion is recorded.

[0042] According to the third modification, if the acceleration satisfies a predetermined condition for a certain period of time, the user can be prompted to input information related to subjective feelings.

[0043] (Variation 4) A fourth modification of the first embodiment will now be described. In the first embodiment, the smart watch 100 is described as performing the processing. However, an information processing system acquires biometric data of the user wearing the smart watch 100. Then, the information processing system prompts the user wearing the smart watch 100 to input information related to subjective emotions based on predetermined conditions. The information processing system may then associate the input information related to subjective emotions with the biometric data of the user wearing the smart watch 100 and store them as learning data in a predetermined storage unit or the like. The biometric data associated with the information related to subjective emotions and stored as learning data is data related to the timing at which the information related to subjective emotions was input. As described above, the information processing system may be composed of multiple devices, or may be composed of a single device. When the information processing system is composed of a single device, an example of that device is the smartwatch 100. In such a configuration, Modification 4 is the same as Embodiment 1. When the information processing system is composed of multiple devices, an example of the multiple devices is the smartwatch 100 and a server device capable of communicating with the smartwatch 100, or the smartwatch 100 and a cloud system capable of communicating with the smartwatch 100.

[0044] The fourth modification can achieve the same effects as the first embodiment described above.

[0045] Furthermore, it may be provided in the following aspects.

[0046] (1) A wearable device that prompts a user wearing the wearable device to input information regarding subjective emotions based on predetermined conditions, and the information regarding subjective emotions is used for labeling the user's biometric data for machine learning.

[0047] (2) A wearable device as described in (1) above, which acquires biometric data of a user wearing the wearable device and prompts the user to input information regarding subjective emotions based on whether the biometric data satisfies the specified conditions.

[0048] (3) A wearable device as described in (2) above, which prompts the user to input information regarding subjective emotions based on the first biometric data and second biometric data of the user acquired at different times satisfying the specified condition.

[0049] (4) A wearable device according to (1) above, which acquires acceleration data relating to the wearable device and prompts the user to input information relating to subjective emotions based on the acceleration data satisfying the predetermined condition.

[0050] (5) A wearable device as described in (4) above, which prompts the user to input information regarding subjective emotions based on first acceleration data and second acceleration data regarding the wearable device acquired at different times satisfying the specified condition.

[0051] (6) A wearable device according to any one of (1) to (5) above, which prompts the user to input information about the subjective emotion by displaying a screen for inputting information about the subjective emotion on the wearable device.

[0052] (7) A wearable device according to any one of (1) to (6) above, wherein biometric data of a user wearing the wearable device is acquired, and information relating to the input subjective emotion is associated with the biometric data of the user wearing the wearable device and stored as learning data, and the biometric data associated with the information relating to the subjective emotion and stored as learning data is data relating to the timing at which the information relating to the subjective emotion was input.

[0053] (8) An information processing system that acquires biometric data of a user wearing a wearable device, prompts the user wearing the wearable device to input information related to subjective emotions based on predetermined conditions, associates the input information related to subjective emotions with the biometric data of the user wearing the wearable device and stores it as learning data, and the biometric data associated with the information related to subjective emotions and stored as learning data is data related to the timing when the information related to the subjective emotions was input.

[0054] (9) An information processing method executed by a wearable device, which prompts a user wearing the wearable device to input information regarding subjective emotions based on predetermined conditions, and the information regarding subjective emotions is used for labeling the user's biometric data for machine learning.

[0055] (10) A program for causing a computer to function as a wearable device according to any one of (1) to (7) above. Of course, this is not the case.

[0056] For example, the above-described embodiments and modifications may be combined in any manner. In the first embodiment and the modifications described above, the device for acquiring biometric data and the device for prompting the input of information related to subjective feelings may be separate devices.

[0057] Finally, while various embodiments of the present invention have been described, these are presented by way of example only and are not intended to limit the scope of the invention. The novel embodiments may be embodied in various other forms, and various omissions, substitutions, and modifications may be made without departing from the spirit of the invention. The embodiments and their modifications are intended to be included within the scope and spirit of the invention, as well as within the scope of the inventions and their equivalents as defined in the appended claims. [Explanation of symbols]

[0058] 100: Smartwatch 210: Control unit 220: Storage section 230: Biological data measurement unit 240: Acceleration measurement unit 250: Input / output section 260: Communications Department

Claims

1. A wearable device, Continuously acquiring biometric data of a user wearing the wearable device; prompting the user to input information about subjective feelings by displaying a screen for inputting information about subjective feelings on the wearable device based on the data obtainable by the wearable device satisfying a predetermined condition; The information relating to the subjective emotion and the biometric data are associated with each other and stored as learning data, the biometric data associated with the information on the subjective emotion and stored as the learning data is data related to a timing at which the information on the subjective emotion was input; Wearable device.

2. The wearable device according to claim 1 , the data obtainable at the wearable device includes acceleration data relating to the wearable device; prompting the user to input the acceleration data when the acceleration data is within a preset range; Wearable device.

3. The wearable device according to claim 2, prompting the user to input the data when it is determined that the wearable device has been in a stationary state for a predetermined period of time based on the acceleration data; Wearable device.

4. The wearable device according to claim 1 , the data obtainable by the wearable device includes biometric data of a user wearing the wearable device; prompting the input when the biometric data satisfies the predetermined condition; Wearable device.

5. The wearable device according to claim 4, prompting the user to input the first biometric data and the second biometric data of the user acquired at different times when the first biometric data and the second biometric data of the user satisfy the predetermined condition; Wearable device.

6. The wearable device according to claim 1, the screen is a first screen including a plurality of categories of the subjective emotions, displaying a second screen including a plurality of emotion types corresponding to the category in response to receiving a selection of the category from the user via the first screen; The emotion type received from the user via the second screen is used for labeling related to machine learning of the biometric data of the user. Wearable device.

7. An information processing system, The wearable device continuously collects biometric data from the user, prompting the user to input information about subjective feelings by displaying a screen for inputting information about subjective feelings on the wearable device based on the data obtainable by the wearable device satisfying a predetermined condition; The information relating to the subjective emotion and the biometric data are associated with each other and stored as learning data, the biometric data associated with the information on the subjective emotion and stored as the learning data is data related to a timing at which the information on the subjective emotion was input; Information processing system.

8. An information processing method executed by a wearable device, comprising: Continuously acquiring biometric data of a user wearing the wearable device; prompting the user to input information about subjective feelings by displaying a screen for inputting information about subjective feelings on the wearable device based on the data obtainable by the wearable device satisfying a predetermined condition; The information relating to the subjective emotion and the biometric data are associated with each other and stored as learning data, the biometric data associated with the information on the subjective emotion and stored as the learning data is data related to a timing at which the information on the subjective emotion was input; Information processing methods.

9. A program, Computer, A program for causing a wearable device to function as the wearable device according to any one of claims 1 to 6.

Images