Subjective state data collection device, subjective state data collection method, and program

Abstract

A subjective state data collection device according to an embodiment comprises: a question presentation unit for presenting a question; a notification timing generation unit for generating a notification time for notifying a user to answer the question after the question is presented; a notification unit for notifying the user in a non-visual manner when the notification time is generated; and a gesture determination unit for acquiring an answer of the user to the question on the basis of a gesture of the user when the notification is issued.

Description

Subjective state data collection device, subjective state data collection method, and program

[0001] The embodiments relate to a subjective state data collection device, a subjective state data collection method, and a program.

[0002] As described in Non-Patent Document 1, a technique called experience sampling is known in daily life, including professional life, in which questions such as "Are you concentrating right now?" are displayed on the screen of a computer, smartphone, or the like at random times in real time, and responses are obtained. This technique makes it possible to collect subjective state data that can be used for various purposes without bias due to forgetting or recall. In the following description, the subjective state refers to, for example, a subjective state of concentration.

[0003] By combining the above-described experience sampling and objective indicator measurement, it is expected that an attention state estimation device that estimates a subjective state from objective indicators can be realized. Here, objective indicator measurement is a method of measuring or acquiring objective indicator data related to, for example, physiological signals, behavioral characteristics, physical movements, and terminal operation logs. By using the attention state estimation device, a subjective state in daily life can be estimated from, for example, feature quantities based on the measured objective indicator data. More specifically, in a technology using the attention state estimation device, a relationship between objective indicator data acquired in real time when a subject of estimation is in a target situation and subjective state data acquired by experience sampling is modeled. This makes it possible to accurately estimate a subjective state from objective indicator data without being affected by individual and situational differences.

[0004] Yuka Ozaki, Takashi Goto, Mai Kobayashi, "Experience Sampling Method Using Smartphones: Introduction to the Method and a Practical Report," 21st Century Human Interaction Research Center Annual Research Report, Vol. 12, pp. 21-29, 2015

[0005] However, in experience sampling, there is a problem that obtaining subjective state data responses from a subject interferes with the subject's daily activities. To further explain, when obtaining subjective state data responses, for example, visual processing associated with reading questions displayed on a screen and pressing answer buttons can interfere with visual information processing, which is involved in most daily activities. As a result, as described in Non-Patent Document 1, problems such as impeding the subject's activities and reducing the subject's response rate may arise.

[0006] The present invention has been made in light of the above circumstances, and its purpose is to provide a means for reducing visual processing in experience sampling, thereby alleviating interference with daily activities and a decrease in the rate at which responses are made.

[0007] In one embodiment, the subjective state data collection device includes a question presentation unit that presents a question; a notification timing generation unit that generates a notification time to notify a user to answer the question after the question is presented; a notification unit that provides a non-visual notification to the user when the notification time is generated; and a gesture determination unit that obtains the user's answer to the question based on a gesture of the user when the notification is made.

[0008] According to the embodiment, it is possible to provide a means for reducing visual processing in experience sampling, thereby reducing interference with daily activities and a decrease in the rate at which responses are completed.

[0009] Fig. 1 is a diagram showing an overview of an example of a subjective state data collection device according to an embodiment. Fig. 2 is a block diagram showing an example of a hardware configuration of a subjective state data collection device according to an embodiment. Fig. 3 is a block diagram showing an example of a functional configuration of a subjective state data collection device according to an embodiment. Fig. 4 is a diagram showing an example of gesture information. Fig. 5 is a flowchart showing an example of subjective state data collection processing in a subjective state data collection device according to an embodiment.

[0010] Hereinafter, embodiments will be described with reference to the drawings. In the following description, components having the same functions and configurations will be given the same reference numerals.

[0011] 1. Embodiment 1.1 Subjective State Data Collection Device FIG. 1 is a diagram showing an overview of an example of a subjective state data collection device according to an embodiment.

[0012] The subjective state data collection device 10 according to the embodiment is, for example, a device configured to be able to perform experience sampling. The subjective state data collection device 10 is, for example, a wearable device such as a smartwatch that can be worn on the wrist of a user (subject). The subjective state data collection device may also be, for example, a dedicated terminal for collecting subjective state data, or may be a smartphone or the like.

[0013] The subjective state data collection device 10 visually presents a question for collecting the user's subjective state data to the user, for example, using a display or the like. Note that in the following description, presenting a question to the user by visual means, for example, using a display or the like, is also simply referred to as "presentation." Also, in the following description, a question for collecting the user's subjective state data is also simply referred to as "question." Also, the subjective state data collection device 10 non-visually notifies the user to answer the question, for example, using vibration or the like, at random timing. Then, the subjective state data collection device 10 acquires the user's answer at each notification timing based on the user's gesture. In the following description, a gesture used to answer a question is simply referred to as a gesture.

[0014] 1.1.1 Hardware Configuration FIG. 2 is a block diagram showing an example of the hardware configuration of a subjective state data collection device according to an embodiment.

[0015] The subjective state data collection device 10 includes a control circuit 11 , a storage 12 , a user interface 13 , a sensor 14 , and a vibrator 15 .

[0016] The control circuit 11 is a circuit that controls the overall components of the subjective state data collection device 10. The control circuit 11 includes a CPU (Central Processing Unit), RAM (Random Access Memory), and ROM (Read Only Memory). The ROM of the control circuit 11 stores programs and the like used in various processes in the subjective state data collection device 10. The CPU of the control circuit 11 controls the entire subjective state data collection device 10 in accordance with the programs stored in the ROM of the control circuit 11. The RAM of the control circuit 11 is used as a working area for the CPU of the control circuit 11.

[0017] The storage 12 stores, for example, the collected subjective state data. The storage 12 may also store, for example, information used in various processes in the subjective state data collection device 10.

[0018] The user interface 13 is an interface that manages communication between a user and the control circuit 11. The user interface 13 includes input devices and output devices. The input devices include, for example, an audio microphone, a touch panel, and operation buttons. The output devices include, for example, a display and a speaker.

[0019] The sensor 14 included in the user interface 13 includes, for example, an inertial sensor (angular velocity sensor). The sensor 14 acquires data for determining whether the user has made a gesture based on, for example, the movement of the subjective state data collection device 10.

[0020] The vibrator 15 included in the user interface 13 non-visually notifies the user that subjective state data is to be collected, for example, by vibrating.

[0021] 3 is a block diagram showing an example of the functional configuration of the subjective state data collection device according to the embodiment. The CPU of the control circuit 11 loads a program stored in the ROM of the control circuit 11 or the storage 12 into the RAM of the control circuit 11. The CPU of the control circuit 11 then interprets and executes the program loaded into the RAM of the control circuit 11. As a result, the subjective state data collection device 10 realizes the functions of a question presentation unit 21, a notification timing generation unit 22, a notification unit 23, a sense unit 24, a gesture assignment unit 25, a gesture determination unit 26, and a memory unit 27.

[0022] The question presenting unit 21 presents content related to the question to the user, for example, using a display. More specifically, at the start of a period (acquisition period) for acquiring subjective state data, the question presenting unit 21 prompts the user to respond to the question with a gesture within a notification period if a non-visual notification is received. The acquisition period may be set by the user, for example. The notification period is a period included in the acquisition period for acquiring the user's answer. The notification period is, for example, 30 seconds, but is not limited to this and may be any predetermined period. The question presenting unit 21 also prompts the user to memorize content related to the question. The question presenting unit 21 also prompts the user to input a gesture to be used for the answer, for example.

[0023] The notification timing generation unit 22 generates, for example, a plurality of notification times for acquiring the user's answer within the acquisition period. The generated plurality of notification times may be random times.

[0024] Furthermore, the notification timing generation unit 22 determines whether an acquisition period set by the user has ended, for example. Furthermore, the notification timing generation unit 22 may determine that the acquisition period has ended, for example, when an invalid period different from the acquisition period occurs. The invalid period may be set by the user, or may be set by the subjective state data collection device 10 based on the user's state. The user's state may be, for example, a state in which the user has removed the subjective state data collection device 10, a state in which the user is sleeping, or the like. The notification timing generation unit 22 may be configured to estimate the user's state, for example, based on measurement data from the sense unit 24, which will be described later. These configurations prevent unintended responses from being acquired during invalid periods in which the user is not responding.

[0025] The notification unit 23 notifies the user, for example, over a notification period from each of the generated notification times. The notification to the user during the notification period is a non-visual notification such as vibration by the vibrator 15.

[0026] The sensing unit 24 acquires measurement data relating to, for example, the movement of the subjective state data collection device 10 and the gestures of the user. The sensing unit 24 is, for example, the sensor 14.

[0027] The gesture assignment unit 25, for example, acquires measurement data from the sense unit 24 when the user makes a gesture. Furthermore, the gesture assignment unit 25 assigns, for example, the gesture and the measurement data to an answer. With the above configuration, the subjective state data collection device 10 can determine the answer by the user's gesture based on the measurement data from the sense unit 24. The answers in the embodiment will be described later, but there are, for example, two answer options for a question. In this case, the gesture assignment unit 25 assigns, for example, that the acquired gesture was made to one of the two answers. Furthermore, the gesture assignment unit 25 assigns, for example, that no gesture was made to the other of the two answers.

[0028] The gesture determination unit 26 determines the user's response based on, for example, the measurement data of the sense unit 24 during each notification period and gesture information (described later). More specifically, the gesture determination unit 26 determines whether a gesture has been made based on, for example, the measurement data of the sense unit 24 during each notification period and the gesture information. Then, the gesture determination unit 26 acquires the user's response during each notification period based on the result of the determination and the gesture information.

[0029] The storage unit 27 is a memory area of ​​the storage 12. The storage unit 27 stores, for example, question information 271, gesture information 272, and answer information 273.

[0030] The question information 271 stores data related to a question presented to the user by the question presenting unit 21. The data includes, for example, a question (a request for an answer) such as, "If your concentration is declining when the vibration notification is given, please let us know within the notification period." The data also includes, for example, content such as, "Please remember the content of the question," and "Please enter the gesture to be used in the answer." The data also includes content such as, "Use a gesture for one of two answers," and "Do not use a gesture for the other of the two answers."

[0031] The gesture information 272 is information indicating the relationship between a user's gesture and the user's answer. The gesture information 272 will be described with reference to FIG. 4 . FIG. 4 is a diagram illustrating an example of the gesture information. In FIG. 4 , the gesture information 272 stores two answers to a question, including an “irregular state (non-concentration state)” and a “regular state (concentration state).” In the example of FIG. 4 , the gesture assignment unit 25 associates the answer “irregular state (non-concentration state)” with the fact that a gesture was made. In the example of FIG. 4 , the gesture is the user vertically shaking the subjective state data collection device 10 twice. The gesture information 272 stores, for example, measurement data of the sense unit 24 when the gesture was made, in association with the fact that the gesture was made and the answer “irregular state (non-concentration state).” In addition, in the example of FIG. 4 , the gesture assignment unit 25 associates the answer “regular state (concentration state)” with the fact that a gesture was not made.

[0032] The answer information 273 stores, for example, the answer of the user determined by the gesture determination unit 26 for each notification time.

[0033] 1.2 Operation Next, the operation of the subjective state data collection device 10 according to the embodiment will be described.

[0034] FIG. 5 is a flowchart showing an example of a subjective state data collection process in the subjective state data collection device according to the embodiment.

[0035] When the subjective state data acquisition period starts (START), the question presenting unit 21 visually presents a question to the user based on the question information 271 in the storage unit 27 (S11). More specifically, the question presenting unit 21 presents the user with a question, "If your concentration level is decreasing when you receive a vibration notification, please let us know within the notification period." The question presenting unit 21 also prompts the user to memorize the content of the question. The subjective state data collection device 10 also prompts the user to use gestures to answer "irregular state (non-concentration state)" and not to use gestures to answer "regular state (concentration state)." The subjective state data collection device 10 then prompts the user with, for example, "Please input the gesture to be used for your answer."

[0036] Next, the gesture assignment unit 25 assigns a gesture to the answer (S12). More specifically, the user performs a gesture corresponding to the answer "irregular state (non-concentration state)" based on the presentation in S11. The gesture assignment unit 25 acquires measurement data of the sense unit 24 when the user performs the gesture, in association with the gesture and the answer "irregular state (non-concentration state)." Furthermore, the measurement data is stored in the gesture information 272 in association with the gesture and the answer "irregular state (non-concentration state)." Furthermore, the fact that no gesture is performed is stored in the gesture information 272 in association with the answer "regular state (concentration state)."

[0037] The processes of S11 and S12 may be executed in advance before the subjective state data collection process starts.

[0038] The notification timing generation unit 22 then randomly generates a notification time for obtaining the user's answer. The notification unit 23 then issues a non-visual question notification, such as a vibration, at the generated notification time (S13). The notification unit 23 then issues the notification over a notification period starting from the notification time.

[0039] Then, the gesture determination unit 26 acquires the user's response during the notification period based on the gesture (S14). More specifically, if the user is in a non-concentration state (irregular state), the user makes a gesture within the notification period in response to the non-visual question notification in S13. If the user is concentrating (regular state), the user does not make a gesture within the notification period. The gesture determination unit 26 acquires the response based on the measurement data of the sense unit 24 and the gesture information 272. That is, if the gesture determination unit 26 determines that the user made a gesture within the notification period, the gesture determination unit 26 acquires, for example, an answer of "irregular state (non-concentration state)." On the other hand, if the gesture determination unit 26 determines that the user did not make a gesture within the notification period, the gesture determination unit 26 acquires, for example, an answer of "regular state (concentration state)."

[0040] Next, the notification timing generation unit 22 determines, for example, whether the acquisition period has ended (S15).

[0041] If the subjective state data acquisition period has not ended (S15; NO), the process proceeds to S13. Then, in S13, the notification timing generation unit 22 generates the next notification time. In this way, the processes of S13 to S15 are repeated during the subjective state data acquisition period. Furthermore, the user's answer is acquired for each of the multiple notification times generated by the notification timing generation unit 22. If the subjective state data acquisition period has ended (S15; YES), the subjective state data collection process ends (END).

[0042] The subjective state data collection process described above is executed in real time.

[0043] 1.3 Effects of the Embodiment According to the embodiment, the subjective state data collection device 10 includes a question presenting unit 21, a notification timing generating unit 22, a notification unit 23, and a gesture determining unit 26. The question presenting unit 21 presents a simple question to the user at the start of an acquisition period. After presenting the question, the notification timing generating unit 22 generates a notification time for notifying the user to answer the question. Furthermore, when the notification time is generated, the notification timing generating unit 22 provides a non-visual notification by vibration or the like. When the notification is provided, the gesture determining unit 26 obtains the user's answer to the question based on the gesture.

[0044] According to an embodiment, the subjective state data collection device 10 can reduce the user's visual processing when asking a question to the user. More specifically, the subjective state data collection device 10 presents a simple question to the user at the start of an acquisition period, prompting the user to memorize the question. After presenting the question, the subjective state data collection device 10 then non-visually notifies the user, for example, by vibrating, that it is time to answer. With the above configuration, once a question is presented, the user can recall the question through the non-visual notification, even without being presented with a visual question.

[0045] Furthermore, the subjective state data collection device 10 can reduce the user's visual processing when acquiring the user's answer. More specifically, the subjective state data collection device 10 stores the answer to the question in association with the gesture. This allows the subjective state data collection device 10 to acquire the user's answer based on the user's gesture, without requiring the user to perform complex input such as pressing a button.

[0046] With the above-described configuration, according to the embodiment, when collecting subjective state data, it is possible to reduce the disruption of daily activities and the decrease in the rate of response implementation.

[0047] Furthermore, according to an embodiment, when collecting subjective state data, the subjective state data collection device 10 acquires a regular state by "no response" (not making a gesture), and acquires an irregular state that deviates from the regular state by making a gesture. As a result, when the user is in a regular state, the user does not make a gesture. This configuration also makes it possible to reduce the disruption of daily activities and the decrease in the rate of response implementation.

[0048] 2. Modifications, etc. Various modifications can be applied to the above-described embodiment.

[0049] In the above-described embodiment, the case where the program for executing the subjective state data collection process is executed by the subjective state data collection device 10 has been described, but this is not limiting. For example, the program for executing the subjective state data collection process may be executed by a communication module included in the subjective state data collection device 10 in a computing resource on a cloud connected via a network.

[0050] The present invention is not limited to the above-described embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the invention. Furthermore, the embodiments may be implemented in appropriate combinations, in which case the combined effects can be obtained. Furthermore, the above-described embodiments include various inventions, and various inventions can be extracted by combining selected elements from the disclosed elements. For example, if the problem can be solved and the desired effect can be obtained even if some elements are deleted from all elements shown in the embodiments, the configuration from which these elements are deleted can be extracted as an invention.

[0051] REFERENCE SIGNS LIST 10...Subjective state data collection device 11...Control circuit 12...Storage 13...User interface 14...Sensor 15...Vibrator 21...Question presentation unit 22...Notification timing generation unit 23...Notification unit 24...Sense unit 25...Gesture assignment unit 26...Gesture determination unit 27...Storage unit 271...Question information 272...Gesture information 273...Answer information

Claims

1. A subjective state data collection device comprising: a question presentation unit that presents a question; a notification timing generation unit that generates a notification time to notify a user to answer the question after the question is presented; a notification unit that provides a non-visual notification to the user when the notification time is generated; and a gesture determination unit that obtains the user's answer to the question based on a gesture of the user when the notification is provided.

2. The subjective state data collection device according to claim 1, wherein the subjective state data collection device is a wearable device.

3. The subjective state data collection device of claim 1, wherein the answer of the user includes a first state and a second state, and the gesture determination unit is configured to obtain the first state when it determines that the gesture has been performed, and to obtain the second state when it determines that the gesture has not been performed.

4. The subjective state data collecting device according to claim 1, wherein said notification timing generating unit is configured to: set an invalid period and a valid period; and generate a notification time in said valid period.

5. The subjective state data collection device according to claim 4, wherein the invalid period is set by the user.

6. The subjective state data collection device according to claim 4, further comprising a sense unit that measures a movement of the subjective state data collection device, and the invalid period is set based on a result of the measurement.

7. A subjective state data collection method comprising: presenting a question; generating a notification time after presenting the question to notify a user to answer the question; providing a non-visual notification to the user when the notification time is generated; and acquiring the user's answer to the question based on a gesture when the notification is provided.

8. A program for causing a computer to function as each unit of the subjective state data collection device according to any one of claims 1 to 6.