Support method, support system, and program

Abstract

To provide a support method or the like capable of supporting a user's intellectual work.SOLUTION: A support method supports utilization of multiple spaces, and includes an acquisition step (step S702) of acquiring a user's user information, estimation steps (steps S703 and step S705) of estimating at least one of whether a user is performing intellectual work in a first space and whether the user is utilizing a second space and estimating a user state including at least one of a first parameter showing the user's concentration degree and a user's second parameter, control steps (step S706 and step S707 of controlling a device 40, and a learning step of constructing a model capable of outputting a control condition by learning a user state before controlling the device 40. In the control steps, the device 40 is controlled under a control condition outputted by inputting a user state to the constructed model.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present invention relates to an assistance method, an assistance system, and a program. [Background technology]

[0002] It is known that the efficiency of a user performing intellectual work such as office work or study is affected by the degree of concentration (hereinafter referred to as "concentration level"). In addition, the user's concentration level changes depending on various environmental factors. For this reason, technology has been proposed to control the environmental factors that affect the user's concentration level.

[0003] Patent document 1 describes a technology in which, when a decrease in the user's concentration level is detected, the user's environment is changed to temporarily further decrease the user's concentration level, and then, after a predetermined period of time has elapsed since the change in the user's environment, the change in the user's environment is restored, thereby restoring the user's concentration level.

[0004] Patent Document 2 describes a technique for detecting a decrease in the user's concentration level when the user turns his or her gaze from a direction intended for performing intellectual work to a recovery unit. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-89747 A [Patent Document 2] JP 2017-158811 A Summary of the Invention [Problem to be solved by the invention]

[0006] The present invention provides a support method and the like that can support a user's intellectual work. [Means for solving the problem]

[0007] An assistance method according to one aspect of the present invention is a method for assisting a user in using a plurality of spaces, including a first space for performing intellectual work and a second space used by the user for a purpose other than the first space, and includes an acquisition step of acquiring user information of the user; an estimation step of estimating, based on the user information, at least one of whether the user is performing intellectual work in the first space and whether the user is using the second space, and estimating a user state including at least one of a first parameter indicating the user's concentration level and a second parameter of the user different from the first parameter; a control step of controlling equipment provided in at least one of the first space and the second space using the user state; and a learning step that is executed before the control step, for constructing a model capable of outputting control conditions by learning using the user state before control of the equipment, and in the control step, the equipment is controlled with the control conditions output by inputting the user state into the constructed model.

[0008] An assistance system according to one embodiment of the present invention is an assistance system that assists a user in using a plurality of spaces, including a first space for performing intellectual work and a second space that the user uses for a purpose other than the first space, and includes an acquisition unit that acquires user information of the user; an estimation unit that estimates, based on the user information, at least one of whether the user is performing intellectual work in the first space and whether the user is using the second space, and estimates a user state including at least one of a first parameter indicating the user's concentration level and a second parameter of the user that is different from the first parameter; a control unit that uses the user state to control equipment provided in at least one of the first space and the second space; and a learning unit that constructs a model capable of outputting control conditions by learning using the user state before control of the equipment, and the control unit controls the equipment with the control conditions output by inputting the user state into the constructed model.

[0009] A program according to one aspect of the present invention is a program for causing a computer to execute the above-described support method. Effect of the Invention

[0010] The support method etc. of the present invention can support the user's intellectual work. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing functions of a support system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating a functional configuration of the information processing device according to the embodiment. [Diagram 3] FIG. 3 is a flowchart of an operation example of the support system according to the embodiment. [Figure 4] FIG. 4 is a flowchart of a detailed operation example 1 of the support system according to the embodiment. [Diagram 5] FIG. 5 is a flowchart of a second detailed operation example of the support system according to the embodiment. [Figure 6] FIG. 6 is a flowchart of a detailed operation example 3 of the support system according to the embodiment. [Figure 7] FIG. 7 is a flowchart of a detailed operation example 4 of the support system according to the embodiment. [Figure 8] FIG. 8 is a flowchart of a detailed operation example 5 of the support system according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating functions of a support system according to another embodiment of the present invention. [Figure 10] FIG. 10 is a block diagram illustrating a functional configuration of an information processing device according to another example of the embodiment. [Figure 11] FIG. 11 is a flowchart of an example of the operation of a support system according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments will be described in detail with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component arrangement and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present invention. In addition, among the components in the following embodiments, components that are not described in the independent claims will be described as optional components.

[0013] In addition, each drawing is a schematic diagram and is not necessarily a precise illustration. In addition, in each drawing, the same reference numerals are used for substantially the same configuration, and duplicated explanations may be omitted or simplified.

[0014] (Embodiment) [composition] First, the configuration of the support system according to the embodiment will be described. FIG. 1 is a diagram showing the configuration of the support system according to the embodiment. The support system 10 according to the embodiment is a system that can control devices that act on (in other words, provide stimuli to) a user who is performing intellectual work such as office work and learning, in order to improve the concentration of the user and relieve cognitive fatigue. Stimuli in the sense of relieving cognitive fatigue are sometimes called refreshment stimuli or micro-refreshment.

[0015] The place where the work and study is performed (the space where the user is given a stimulus) is not particularly limited. The place where the work and study is performed may be an office, a school, a house, or the like, but may also be a private booth (a closed space where the work or study can be performed) installed in a station or the like.

[0016] Concentration is an index of the degree of focus on intellectual work. If most of a certain time is spent on performing intellectual work, the concentration is said to be high. Conversely, if only a small amount of time is spent on performing intellectual work within a certain time, the concentration is said to be low. In this way, the concentration can be directly quantified based on the progress of the target intellectual work. In other words, it can be quantified as the concentration time ratio (CTR), which is the proportion of time during which concentration was spent on the intellectual work. Alternatively, the concentration can be indirectly quantified by estimating that the gaze is focused on the target intellectual work and that there is little movement of the gaze, regardless of the actual progress of the intellectual work. In this way, the user's concentration can be estimated as a numerical value by adopting existing appropriate technology from image information such as facial expressions and body movements, autonomic nervous system indicators obtained by a dedicated sensor, and information such as concentration fluctuations and concentration duration obtained by secondary processing of the concentration level per unit time in the time domain.

[0017] The alleviation of cognitive fatigue can be said to mean a reduction in accumulated cognitive fatigue, i.e., recovery from cognitive fatigue, or a change of mood. The alleviation of cognitive fatigue allows the user to maintain and improve his / her concentration. Although cognitive fatigue and concentration are different parameters, they affect each other. Therefore, in order to improve the user's concentration and support intellectual work, it is necessary to both create a situation in which the concentration is easily improved and to create a situation in which cognitive fatigue is not easily accumulated or in which accumulated cognitive fatigue is easily alleviated appropriately. By obtaining a correlation between cognitive fatigue and physiological / behavioral indices, the cognitive fatigue can be quantified from the physiological / behavioral indices. Alternatively, the cognitive fatigue can be quantified using a decrease in the progress speed of intellectual work as an index. In this way, the user's cognitive fatigue can be estimated as a numerical value by adopting existing appropriate technology from information such as image information such as facial expressions and body movements, autonomic nervous system indices obtained by a dedicated sensor, and fatigue fluctuations obtained by secondary processing of cognitive fatigue per unit time in the time domain.

[0018] The assistance system 10 controls the device 40 for a user performing intellectual work or taking a break between intellectual work, thereby providing a stimulus provided by the device 40 and encouraging an improvement in concentration or a reduction in cognitive tension.

[0019] For example, when stimulating a user with light emitted by a lighting device, which is device 40, in order to wake up the user and improve concentration, it is considered that light with strong brightness and high color temperature is appropriate. In contrast, in order to relax the user, it is sufficient to set the brightness of the light emitted by the lighting device to a level that is not too strong, and the color (color temperature) to a low color temperature.

[0020] Furthermore, when stimulating the user with the airflow generated by the airflow generating device that is the device 40, a strong wind is generally blown onto the user in order to improve the user's concentration. In contrast, when the purpose is to relax the user, this is achieved by generating a soft (weak) or fluctuating airflow over a wide area.

[0021] When stimulating the user with the scent emitted by the scent generating device, which is the device 40, a scent with an awakening effect, such as a lemon scent or a peppermint scent, is used if the purpose is to improve the user's concentration. On the other hand, if the purpose is to relax the user, a relatively weak scent, such as a cypress scent or a lavender scent, is used.

[0022] As shown in FIG. 1, the support system 10 is provided across a work space 200 for a user to perform intellectual work and a refreshment space 250 for a user to take a break, and includes a camera 20, an information processing device 30, and a device 40.

[0023] The camera 20 is a camera provided in a space (each of the working space 200 and the refreshment space 250) where a user performing intellectual work or taking a break is located, and captures a video of the user performing intellectual work or taking a break. The camera 20 transmits image data of the captured video to the information processing device 30. The camera 20 may be a high-performance camera called an AI (Artificial Intelligence) camera or the like, and may perform a process of estimating the concentration level and cognitive fatigue level described below instead of the information processing device 30. In this case, the process of estimating the concentration level and cognitive fatigue level in the information processing device 30 can be omitted. In this example, an example in which the camera 20 acquires an image as user information will be described, but instead of the camera 20, a sensor such as a wearable sensor used to estimate the concentration level and cognitive fatigue level of the user described above may be provided.

[0024] The information processing device 30 performs information processing to provide a user who is performing intellectual work or taking a break with a stimulus that improves the concentration level of the user or reduces the cognitive fatigue level of the user. The information processing device 30 is, for example, a personal computer, but may also be a server device or a dedicated controller corresponding to the device 40. In FIG. 1, the information processing device 30 is provided outside the working space 200 and the refreshment space 250, but may be provided in either of these spaces.

[0025] Fig. 2 is a block diagram showing a functional configuration of the information processing device 30. As shown in Fig. 2, the information processing device 30 includes an acquisition unit 30a that acquires user information, a storage unit 30b that stores information, an estimation unit 30c that performs estimation based on the user information, a determination unit 30d that determines whether or not at least one of the cognitive fatigue level and the concentration level is higher than a reference value, and a control unit 30e that controls the device 40 based on the determination result.

[0026] The acquisition unit 30a, the estimation unit 30c, the judgment unit 30d, and the control unit 30e are functional components, and the functions of the acquisition unit 30a, the estimation unit 30c, the judgment unit 30d, and the control unit 30e are realized, for example, by a microcomputer or processor (hardware) provided in the information processing device 30 executing a computer program (software) stored in the memory unit 30b.

[0027] The acquisition unit 30a acquires an image from the camera 20 as user information.

[0028] The estimation unit 30c estimates at least one of whether the user is performing intellectual work in the work space 200 and whether the user is taking a break in the refreshment space 250 based on the acquired user information. This estimation may be performed by performing at least one of the above to estimate the other in a complementary manner, for example, by determining that the user is not taking a break in the refreshment space 250 when the user is performing intellectual work in the work space 200, and that the user is taking a break in the refreshment space 250 when the user is not performing intellectual work in the work space 200. More preferably, since the user is not necessarily taking a break in the refreshment space 250 even if the user is not performing intellectual work in the work space 200, it is sufficient to estimate both. Here, the estimation unit 30c determines whether the user is performing intellectual work in the work space 200 and whether the user is taking a break in the refreshment space 250 depending on whether the user is included in the image. The estimation unit 30c may determine whether the user is performing intellectual work in the work space 200 and whether the user is taking a break in the refreshment space 250 based on the results of the intellectual work and the break, without relying on the above.

[0029] The estimation unit 30c estimates at least one of the user's cognitive fatigue level and the user's concentration level based on the acquired user information. The method of estimating the user's cognitive fatigue level and the user's concentration level by the estimation unit 30c has already been described, and therefore will not be described here.

[0030] The determination unit 30d compares the estimated concentration level and cognitive fatigue level with reference values ​​to determine whether the concentration level is higher than the reference value (in other words, whether the concentration level is equal to or lower than the reference value) and whether the cognitive fatigue level is higher than the reference value (in other words, whether the cognitive fatigue level is equal to or lower than the reference value). Therefore, the determination unit 30d can use the reference value for comparison with the concentration level and the reference value for comparison with the cognitive fatigue level.

[0031] Here, the reference value may be a predetermined numerical value (first reference value) of the concentration level and the cognitive fatigue level, a relative value (second reference value) having a predetermined difference value with respect to the concentration level and the cognitive fatigue level at a certain timing, or a predetermined numerical value (third reference value) of the concentration level and the cognitive fatigue level when the working space 200 and the refreshment space 250 were used in the past. Which reference value is appropriate to use depends on the device 40 to be operated and the effect on the user that is desired by the device 40, so the selection of the reference value will be described in some operation examples described later. In addition, such a reference value is set in advance and stored in the storage unit 30b, etc., and is read out from the storage unit 30b as necessary.

[0032] The control unit 30e uses the determination result of the determination unit 30d and the control conditions for controlling the device 40 according to the determination result to transmit a control signal to the device 40 so that the device 40 is controlled under those conditions. The device 40 provides a stimulus to the user so as to satisfy at least one of the above conditions, that is, the condition for improving the concentration level and the condition for reducing the cognitive fatigue level, by simply operating according to the control signal.

[0033] The control unit 30e also has a function of controlling the start timing of control. That is, by adjusting the timing of transmitting a control signal, the control unit 30e can also control the timing of applying a stimulus by the device 40. Therefore, the above conditions include the start timing of applying a stimulus and the end timing of applying a stimulus or the length of time for applying a stimulus, and the control unit 30e transmits a control signal to match such timing.

[0034] The storage unit 30b is a storage device that stores the computer program and various information necessary for providing a stimulus to the user. The storage unit 30b is realized by a semiconductor memory or a HDD (Hard Disk Drive), etc. The various information necessary for providing a stimulus stored in the storage unit 30b includes a reference value, a setting of which reference value (first reference value to third reference value) is to be used for the reference value, and a control condition for controlling the device 40. Other examples of the various information necessary for providing a stimulus will be described later.

[0035] The information processing device 30 may include an input receiving unit (not shown). The input receiving unit receives information input from a user. When starting to use the support system 10, the user inputs information as initial settings, and the input receiving unit receives this information. The input receiving unit is realized by, for example, a mouse and a keyboard.

[0036] The information input by the user includes at least one of the following: the user's attributes, the content of the intellectual work or rest the user is about to perform, the environment of the space in which the user is located (in other words, the space in which the user is performing the intellectual work or resting), and the type of device 40 (device 40 to be controlled) installed in the space in which the user is located.

[0037] Specifically, the attributes of a user include the user's age, sex, and job title. The content of the intellectual work is defined, for example, by the concentration level required for the work. The content of the intellectual work is selected from among pre-prepared options, such as work that requires high concentration in a short period of time and work that requires general concentration in a long period of time. The content of the break is selected from among pre-prepared options, such as a break spent simply not doing work and a break using a device such as a pressure device / vibration device that is highly effective in recovering from physical fatigue.

[0038] The environment of the space in which the user is located means, for example, whether it is an open space or a closed space, a private room or a shared space, in other words, the type of space. The environment of the space in which the user is located is selected, for example, from options prepared in advance. The environment of the space may include information such as the temperature in the space (whether the area to which the space belongs is a warm area or not).

[0039] The type of the device 40 means the type of device (described later) that the device 40 is. The type of the device 40 is selected, for example, from options prepared in advance.

[0040] The device 40 is a stimulus providing device (stimulus presenting device) that provides a stimulus to the user under the control of the control unit 30e. In the example of Fig. 1, the device 40 is an indirect lighting device that provides a stimulus to the user by irradiating light onto a partial area of ​​a wall located in front of the user (in other words, a partial area of ​​a wall within the field of view of the user performing intellectual work).

[0041] In addition, the device 40 is not limited to an indirect lighting device, but may be an ambient lighting device, a task lighting device, an airflow generating device, an air conditioning device, a fragrance generating device, a sound source reproducing device, an electric blind, or an image projection device.

[0042] An ambient lighting device is a lighting device that creates the basic brightness of a space by illuminating the entire space in which the user is located. A task lighting device is a lighting device that illuminates only the area around the user in a spot-like manner. Both ambient lighting devices and task lighting devices provide visual stimuli to the user by emitting light. Depending on the conditions, the provided stimuli can improve the user's concentration or enhance the effect of the user's break (refreshing effect).

[0043] The airflow generating device is a blower device that does not have a temperature adjustment function. The airflow generating device may provide a tactile stimulus to the user by directing an airflow at a spot on the user, or may provide a tactile stimulus to the user by generating an airflow in the entire space in which the user is located. The air conditioning device has a temperature adjustment function, and provides a tactile stimulus to the user by adjusting the temperature of the entire space in which the user is located by blowing temperature-adjusted air.

[0044] A sound source playback device provides an auditory stimulus to a user by playing a sound source (i.e., outputting sound). An electric blind provides a visual stimulus to a user by transitioning from a closed state to an open state. In this case, the stimulus may mean letting in outside light into the space in which the user is located, or showing the user the outside scenery. An image projection device provides a visual stimulus to a user by projecting an image. In this case, the stimulus itself includes image information to be presented to the user. In other words, by visually recognizing the image information, a visual stimulus accompanied by information can be provided to the user. A fragrance generating device sprays a fragrance component into a space to provide the user with an olfactory stimulus corresponding to the fragrance component.

[0045] The control unit 30e applies a stimulus by changing the environment around the user through control of the device 40. In other words, the device 40 is a device that changes the environment around the user (such as the light environment or the air quality environment), but may also be a device that directly acts on the user (such as by applying vibrations).

[0046] In the following embodiments, the operation of device 40 to provide a stimulus (for example, an indirect lighting device emitting monochromatic blue light) is also referred to as the form of the stimulus.

[0047] [Example] Next, a description will be given of an example of the operation of the support system 10. FIG.

[0048] First, the input receiving unit receives input of information from the user, such as the user's attributes, the content of the intellectual work or rest the user will be performing, the environment of the space in which the user is located, and the type of device 40 installed in the space in which the user is located. The input information is stored in the storage unit 30b as setting information. After inputting the information, the user starts the intellectual work or rest. The intellectual work is office work, study, etc.

[0049] Next, the acquisition unit 30a acquires an image of the user performing intellectual work or taking a break as user information (S101). Step S101 is an example of an acquisition step. The estimation unit 30c estimates whether the user is performing intellectual work and whether the user is taking a break (S102). For example, when the user is included in the image of the workspace 200, the estimation unit 30c may determine that the user is performing intellectual work, or may determine whether the user is performing intellectual work based on the track record or the like when the user is included in the image of the workspace 200. Also, when the user is included in the image of the refreshment space 250, the estimation unit 30c may determine that the user is taking a break, or may determine whether the user is taking a break based on the track record or the like when the user is included in the image of the refreshment space 250.

[0050] Next, the estimation unit 30c estimates at least one of the user's cognitive fatigue level and the concentration level based on the acquired user information (S103). Steps S102 and S103 are an example of an estimation step. The method of estimating the user's cognitive fatigue level and the concentration level based on the user information by the estimation unit 30c has already been described. The estimation by the estimation unit 30c provides numerical values ​​of the cognitive fatigue level and the concentration level.

[0051] Next, the determination unit 30d determines whether the estimated cognitive fatigue level and concentration level are higher than a reference value (S104). Step S104 is an example of a determination step. Then, the control unit 30e generates and outputs a control signal for controlling the device 40 under at least one of a condition for improving the user's concentration level and a condition for reducing the user's cognitive fatigue level based on the determination result in the determination step, and controls the device 40 (S105). Step S105 is an example of a control step.

[0052] Hereinafter, detailed operation examples of the support system 10 will be described with reference to Fig. 4 to Fig. 8. Some operation examples described below may be operated alternatively in the support system 10, or a combination of a plurality of them may be operated in parallel.

[0053] FIG. 4 is a flowchart of a detailed operation example 1 of the support system according to the embodiment. After step S101, in step S102, it is estimated whether or not the user is performing intellectual work (S201). If it is estimated that the user is not performing intellectual work in the work space 200 (No in step S201), this operation (step S203 described later) is not performed. That is, the control of the device 40 related to this operation is not executed. If it is estimated that the user is performing intellectual work in the work space 200 (Yes in step S201), it is further determined in step S104 whether or not the cognitive fatigue level is equal to or lower than a reference value (S202). If it is determined that the cognitive fatigue level is higher than the reference value (No in step S202), this operation is not performed. If it is determined that the cognitive fatigue level is equal to or lower than the reference value (Yes in step S202), in step S105, the device 40 is controlled under conditions that improve the concentration level (S203).

[0054] In the example of FIG. 4, since the user is performing intellectual work and the cognitive fatigue level is relatively low, the device 40 is controlled under conditions for improving the concentration level so that the user can continue the intellectual work with greater concentration. As the reference value, the first reference value or the second reference value may be used. In addition, when the second reference value is used, a reference value that is lower by the difference value with respect to the cognitive fatigue level when the user ends the intellectual work in the past is appropriate. In this way, while the cognitive fatigue level is lower by more than the difference value compared to when the user decided to end the intellectual work in the past, the user can work on the intellectual work with a higher concentration level. By working on the intellectual work with a higher concentration level, the cognitive fatigue level is more likely to increase than usual. However, in this case, since the cognitive fatigue level is lower by more than the difference value compared to when the intellectual work was ended in the past, even if the user's cognitive fatigue level is easily increased, it is appropriate.

[0055] FIG. 5 is a flowchart of a detailed operation example 2 of the support system according to the embodiment. After step S101, in step S102, it is estimated whether or not the user is performing intellectual work (S301). If it is estimated that the user is not performing intellectual work in the work space 200 (No in step S301), this operation (step S303 described later) is not performed. That is, the control of the device 40 related to this operation is not executed. If it is estimated that the user is performing intellectual work in the work space 200 (Yes in step S301), it is further determined in step S104 whether or not the concentration level is equal to or lower than a reference value (S302). If it is determined that the concentration level is higher than the reference value (No in step S302), this operation is not performed. If it is determined that the concentration level is equal to or lower than the reference value (Yes in step S302), in step S105, the device 40 is controlled under the condition of pausing the intellectual work (S303).

[0056] In the example of FIG. 5, the user is performing intellectual work and the concentration level is relatively low, so that the device 40 is controlled under the condition of pausing the intellectual work to encourage the user to take a break. The control of the device 40 here includes control of projecting image information indicating that the user's concentration level is decreasing (i.e., information on the user's state), control of projecting image information indicating that the user should take a break (i.e., information recommending the user to take a break), or control of indirectly encouraging the user to move to the refreshment space 250 by worsening the surrounding environment of the work space 200 (such as by lowering the temperature extremely). As the reference value, the first reference value or the second reference value may be used. In addition, when the second reference value is used, a reference value that is lower by the difference value with respect to the concentration level at the start of the current intellectual work is appropriate. In this way, since the concentration level is lower than when the current intellectual work was started by more than the difference value, even when the start time is taken into consideration, a decrease in concentration level by the difference value has occurred, so that the user is made to take a break, and the concentration level can be improved when the user returns to the subsequent intellectual work.

[0057] FIG. 6 is a flowchart of a detailed operation example 3 of the support system according to the embodiment. After step S101, in step S102, it is estimated whether or not the user is performing intellectual work (S401). If it is estimated that the user is not performing intellectual work in the work space 200 (No in step S401), this operation (step S403 described later) is not performed. That is, the control of the device 40 related to this operation is not executed. If it is estimated that the user is performing intellectual work in the work space 200 (Yes in step S401), it is further determined in step S104 whether or not the cognitive fatigue level is higher than a reference value (S402). If it is determined that the cognitive fatigue level is equal to or lower than the reference value (No in step S402), this operation is not performed. If it is determined that the cognitive fatigue level is higher than the reference value (Yes in step S402), in step S105, the device 40 is controlled under the condition of pausing the intellectual work (S403).

[0058] In the example of FIG. 6, the user is performing intellectual work and the cognitive fatigue level is relatively high, so that the device 40 is controlled under the condition of pausing the intellectual work to encourage the user to take a break. The control of the device 40 here includes control of projecting image information indicating that the user's concentration level is decreasing (i.e., information on the user's state), or image information indicating that the user should take a break (i.e., information recommending the user to take a break) on the image projection device, or control of indirectly encouraging the user to move to the refreshment space 250 by worsening the surrounding environment of the work space 200 (such as by lowering the temperature extremely). As the reference value, the first reference value or the second reference value may be used. In addition, when the second reference value is used, a reference value that is higher by the difference value with respect to the cognitive fatigue level at the start of the current intellectual work is appropriate. In this way, since the cognitive fatigue level is higher than when the current intellectual work was started by more than the difference value, even when the start time is taken into consideration, an accumulation of the cognitive fatigue level of the difference value has occurred, so that the user is made to take a break, and the cognitive fatigue level can be reduced when the user returns to the subsequent intellectual work.

[0059] FIG. 7 is a flowchart of a detailed operation example 4 of the support system according to the embodiment. After step S101, in step S102, it is estimated whether or not the user is taking a break (S501). If it is estimated that the user is not taking a break in the refreshment space 250 (No in step S501), this operation (step S503 described later) is not performed. That is, the control of the device 40 related to this operation is not executed. If it is estimated that the user is taking a break in the refreshment space 250 (Yes in step S501), it is further determined in step S104 whether or not the cognitive fatigue level is higher than a reference value (S502). If it is determined that the cognitive fatigue level is equal to or lower than the reference value (No in step S502), this operation is not performed. If it is determined that the cognitive fatigue level is higher than the reference value (Yes in step S502), in step S105, the device 40 is controlled under conditions that refresh the user (S503).

[0060] In the example of Fig. 7, the user is taking a break and the cognitive fatigue level is relatively high, so that the device 40 is controlled under conditions that refresh the user to enhance the effect of the break. As the reference value, the first reference value or the second reference value may be used. When the second reference value is used, a reference value that is higher by the difference value with respect to the cognitive fatigue level at the time of ending the previous break is appropriate. In this way, the user can take a break with a more enhanced refreshing effect while the cognitive fatigue level is higher by at least the difference value than when the user decided to end the previous break.

[0061] FIG. 8 is a flowchart of a detailed operation example 5 of the support system according to the embodiment. After step S101, in step S102, it is estimated whether or not the user is taking a break (S601). If it is estimated that the user is not taking a break in the refreshment space 250 (No in step S601), this operation (step S603 to be described later) is not performed. That is, the control of the device 40 related to this operation is not executed. If it is estimated that the user is taking a break in the refreshment space 250 (Yes in step S601), it is further determined in step S104 whether or not the cognitive fatigue level is equal to or lower than a reference value (S602). If it is determined that the cognitive fatigue level is higher than the reference value (No in step S602), this operation is not performed. If it is determined that the cognitive fatigue level is equal to or lower than the reference value (Yes in step S602), in step S105, the device 40 is controlled under the condition to start the intellectual work (S603).

[0062] In the example of FIG. 8, since the user is taking a break and the cognitive fatigue level is relatively low, the device 40 is controlled under the condition of starting the intellectual work so that the user can end the break and return to the intellectual work. The control of the device 40 here includes control of projecting image information indicating that the user's cognitive fatigue level has decreased (i.e., information on the user's state), or image information indicating that the user should return to the intellectual work (i.e., information recommending the user to resume the intellectual work) using the image projection device, or control of indirectly encouraging the user to move to the working space 200 by worsening the surrounding environment of the refreshment space 250 (such as by lowering the temperature drastically). As the reference value, the first reference value or the third reference value may be used. In addition, when the third reference value is used, a reference value that matches the cognitive fatigue level at the time of ending the past break is appropriate. In this way, the user can be made to start the intellectual work when the cognitive fatigue level has decreased to a value equivalent to that at the time the user decided to end the past break.

[0063] [Variations regarding various information required for providing stimuli] In the above embodiment, an explanation of how the various pieces of information necessary for providing stimuli are used is omitted, but by using the various pieces of information necessary for providing stimuli, it is possible to provide stimuli that are more suited to the individual.

[0064] The various information necessary for providing a stimulus includes, for example, the degree of cognitive fatigue, the attribute information of the user, and the time during which the user uses the work space or the refreshment space. The type of device 40 to be controlled may be changed for each user based on the above information. In other words, when the users are divided into a plurality of groups each consisting of one or more users based on the degree of cognitive fatigue, the attribute information of the user, and the time during which the user uses the work space or the refreshment space, the type of device 40 to be controlled may be set for each group.

[0065] In addition, the various information required to provide stimuli includes standard cognitive effort, concentration level, concentration fluctuation characteristics, and concentration duration for each user, and may be used to set reference values.

[0066] In addition, the various information required for providing stimulation includes the time spent after deviating from the standard state until returning to the standard state (time spent performing intellectual work or time spent resting), which may be used to set a reference value.

[0067] In addition, the various information required to provide stimulation may include time information, and the reference value may change depending on the progress of at least one of the cognitive fatigue level and the concentration level of an average person over time.

[0068] In addition, the various information necessary for providing stimuli includes past data on the cognitive fatigue level and concentration level for each user, and at least a part of the past data may be used to set the reference value.

[0069] [Another example of the embodiment] Hereinafter, a support method and a support system according to another embodiment of the present invention will be described. In the following, the other embodiment will be described with a focus on the differences from the above embodiment, and a description of the substantially same points will be omitted.

[0070] In the above embodiment, support methods etc. for supporting the use of two spaces, the work space 200 and the refreshment space 250, have been described. However, in the following example, support methods etc. for supporting the use of three or more spaces will be described.

[0071] In the following example, methods of supporting the use of three spaces are described: a work space 200 (an example of a first space), a refreshment space 250, and a collaboration space 300 (one is an example of a second space, and the other is an example of a third space).

[0072] While the work space 200 is a space for intellectual work intended for personal use, the collaborative space 300 is a space that can be used simultaneously by multiple users to form communication between users and perform intellectual work in a form different from that of the work space 200. Therefore, the collaborative space 300 has sufficient volume and facilities, such as a conference room, for simultaneous use by multiple users. As shown in FIG. 9, the support system 10A including the collaborative space 300 is provided across the work space 200 for users to perform intellectual work, the refreshment space 250 for taking a break, and the collaborative space 300, and includes a camera 20, a microphone 25, an information processing device 30A, and a device 40. The camera 20 and the device 40 are as described in the embodiment, so their description will be omitted here.

[0073] The microphone 25 is a camera provided in a space (collaboration space 300) where multiple users performing intellectual work together are located, and collects the voices of the multiple users performing the intellectual work. The microphone 25 transmits audio data of the collected voices to the information processing device 30A. The microphone 25 may be a high-performance microphone called an AI (Artificial Intelligence) microphone or the like, and may perform a process of estimating the communication activity level described below instead of the information processing device 30A.

[0074] The information processing device 30A is a device that supports a user by estimating a user state including the user's concentration level (an example of a first parameter), cognitive fatigue level, and communication activity level (one of which is an example of a second parameter, and the other is an example of a third parameter) from user information, and controlling the device 40 according to control conditions derived based on the user state.

[0075] Here, the communication activity level is an index for quantifying whether conversations between multiple users performing intellectual tasks in a space are lively. The communication activity level is quantified based on voice data using one or more evaluation criteria, such as the ratio of the time during which users speak to the time during which the space is used, the ratio of the time during which silence occurs to the time during which the space is used, and the frequency of speaker changes from one user to another. In addition to the above, any other existing technology may be applied to estimate the communication activity level from voice data.

[0076] Fig. 10 is a block diagram showing a functional configuration of the information processing device 30A. As shown in Fig. 10, the information processing device 30A includes an acquisition unit 30f that acquires user information, a storage unit 30b that stores information, an estimation unit 30g that estimates a user state based on the user information, a learning unit 30h that constructs a model by machine learning using the user state, and a control unit 30i that controls the device 40 under control conditions output from the constructed model.

[0077] The acquisition unit 30f, the estimation unit 30g, the learning unit 30h, and the control unit 30i are functional components, and the functions of the acquisition unit 30f, the estimation unit 30g, the learning unit 30h, and the control unit 30i are realized, for example, by a microcomputer or processor (hardware) provided in the information processing device 30A executing a computer program (software) stored in the memory unit 30b.

[0078] The acquisition unit 30f acquires an image from the camera 20 as user information, and acquires a voice from the microphone 25 as user information.

[0079] In addition to the above-mentioned functions of the estimation unit 30c, the estimation unit 30g estimates whether or not the user is performing intellectual work in the collaborative space 300 based on the acquired user information. In this estimation, for example, the estimation unit 30g estimates whether or not the user is performing intellectual work in the collaborative space 300 based on whether or not the voice includes the user's speech. The determination by the estimation unit 30g of whether or not intellectual work is being performed in the collaborative space 300 may be made based on the track record of intellectual work instead.

[0080] The learning unit 30h constructs a model that outputs control conditions for the device 40 (including which device to control and how to control it) based on a large number of user states. In other words, if the user state of the current user is input to the model constructed by the learning unit 30h, it is possible to output control conditions for the device 40 according to the learning. In learning the model, by learning to output appropriate control conditions for the user, it is possible to automatically output control conditions that are considered appropriate from the user state.

[0081] For such learning, for example, a previously estimated user state (user state before past control of device 40), control conditions for control of device 40 performed for that user state (past control conditions), and a user state after being supported by that control (user state after past control of device 40) may be learned. Alternatively, a data format that can be used for the control conditions may be provided, and unsupervised learning using only previously estimated user states may be performed to analyze the structure, characteristics, etc. of the user state itself to derive appropriate control conditions.

[0082] In this case, in addition to the first to third parameters estimated from the user information, which are the user state, at least one of the user attribute information, the user's intellectual task status, and the history of the past user state may be used for learning. The user attribute information, the user's intellectual task status, and the history of the past user state may be included in the user information. In other words, the user information itself may be used in the learning for constructing the model by the learning unit 30h, together with the user state estimated from the user information.

[0083] After the learning phase in which a model is constructed, the model is used in the inference phase, and the learning unit 30h may reconstruct the model by re-learning the model using information newly obtained in the inference phase. In other words, the term "constructing a model" is a concept that includes both forming a new model from a state in which there is no model and reconstructing (or updating) an existing model by re-learning.

[0084] In this example, the control includes a control for recommending movement among three or more spaces, and a control for enhancing a parameter (also called a characteristic value) indicating the appropriateness of use of the space among the first to third parameters in each space by controlling the device 40 to optimize the environment. Furthermore, for movement among three or more spaces, there are a great many control conditions that can be considered, such as which of two or more other spaces different from the original space the user should move to, how long the user should stay in the other space, whether or not the device 40 should be additionally controlled in the other space, and in what order the user should return to the original space by passing through two or more other spaces different from the original space. Therefore, it can be said that it is preferable to use such a learning unit 30h in order to derive a control condition appropriate for the user from such a great many control conditions. The learning unit 30h stores the constructed model in, for example, the storage unit 30b.

[0085] The control unit 30i inputs the estimated user state to the model constructed by the learning unit 30h. As a result, the control unit 30i can obtain, as an output, a control condition according to the estimated user state. Using the control condition thus obtained, the control unit 30i transmits a control signal to the device 40 so that the device 40 is controlled under that condition. The device 40 only operates according to the control signal, and a stimulus is given to the user under the above control condition.

[0086] A detailed operation example of the support system 10A will be described below with reference to Fig. 11. Fig. 11 is a flowchart of an operation example of the support system 10A.

[0087] First, the learning unit 30h constructs a model through machine learning using the user state, user information, etc. (S701) Step S701 is an example of a learning step.

[0088] Next, the input receiving unit receives input of information from the user, such as the user's attributes, the content of the intellectual work or rest the user will be performing, the environment of the space in which the user is located, and the type of device 40 installed in the space in which the user is located. The input information is stored in the storage unit 30b as setting information. After inputting the information, the user starts the intellectual work or rest. The intellectual work is office work, study, etc.

[0089] Next, the acquisition unit 30f acquires an image of a user performing intellectual work or taking a break and a voice of the user performing intellectual work in the collaborative space 300 as user information (S702). Step S702 is an example of an acquisition step. The estimation unit 30g estimates whether the user is performing intellectual work in the first space, i.e., the work space 200, and whether the user is using the second space, i.e., either the refreshment space 250 or the collaborative space 300 (S703). For example, when the user is included in the image of the work space 200, the estimation unit 30g may determine that the user is performing intellectual work, or may determine whether the user is performing intellectual work based on the track record or the like when the user is included in the image of the work space 200. Also, when the user is included in the image of the refreshment space 250, the estimation unit 30g may determine that the user is taking a break, or may determine whether the user is taking a break based on the track record or the like when the user is included in the image of the refreshment space 250. Alternatively, if the audio in the collaborative space 300 includes the user's voice, the estimation unit 30g may determine that the user is performing intellectual work in the collaborative space 300, or, when the audio in the collaborative space 300 includes the user's voice, the estimation unit 30g may determine whether the user is performing intellectual work in the collaborative space 300 based on track record, etc.

[0090] Next, the estimation unit 30g estimates whether the user is using the third space, that is, either the refresh space 250 or the collaboration space 300 (S704). Through steps S703 and S704, it is estimated which of the three spaces the user is using.

[0091] Next, the estimation unit 30g estimates the user state (the user's concentration level, cognitive fatigue level, and communication activity level of multiple users including other users) based on the acquired user information (S705). Steps S703 to S705 are an example of an estimation step. The method of estimating the user state based on the user information by the estimation unit 30g has already been described. The estimation by the estimation unit 30g provides numerical values ​​of the user's concentration level, cognitive fatigue level, and communication activity level of multiple users including other users.

[0092] Next, the control unit 30i uses the estimated user information as an input and provides it to the constructed model, thereby causing the model to output the control conditions of the device 40 (S706). Then, the control unit 30i generates a control signal for controlling the device 40 under the output control conditions and transmits it to the device 40, thereby controlling the device 40 (S707). Steps S706 and S707 are an example of a control step. The control of the device 40 performed in the control step also includes a presentation step of presenting the user state to the user by displaying the estimated user state on a display device such as a display as the device 40 and allowing the user to visually confirm the user state.

[0093] As described above, when a user uses three or more spaces, the options for controlling the devices 40 to assist the user in using the spaces become complicated. However, by using a model constructed by machine learning, appropriate control of the devices 40 can be performed, thereby making it possible to appropriately assist the user in performing intellectual work.

[0094] In the above, the model constructed by machine learning is used when the number of spaces used by the user is three or more, but the model constructed by machine learning can also be used when the number of spaces used by the user is two. That is, in the working space 200 (first space) and either one of the refreshment space 250 and the collaborative space 300 (second space), image data and voice data are acquired as user information, a user state including a concentration level (first parameter) and either one of a cognitive fatigue level and a communication activity level (second parameter) is estimated as a user state, and a model capable of outputting a control condition from an input of such a user state is constructed in advance by machine learning, and a support system can be realized in which a control condition capable of supporting appropriate use of the space is output by inputting the estimated user state to the model.

[0095] [Effects, etc.] Inventions derived from the disclosure of this specification are, for example, the following inventions. Hereinafter, the inventions derived from the disclosure of this specification will be described together with the effects and the like obtained by the inventions.

[0096] Invention 1 is a method for supporting the use of a plurality of spaces including a first space (work space 200) for a user to perform intellectual work and a second space (one of a refreshment space 250 and a collaborative space 300) that the user uses for a purpose different from the first space, the method including: acquiring user information of the user (step S702); estimating, based on the user information, at least one of whether the user is performing intellectual work in the first space and whether the user is using the second space, and acquiring a user status including at least one of a first parameter indicating the user's concentration level and a second parameter of the user different from the first parameter; The support method includes an estimation step (steps S703 and S705) of estimating a user state, a control step (steps S706 and S707) of controlling a device 40 provided in at least one of the first space and the second space using the user state, and a learning step (step S701) executed before the control step, in which a model capable of outputting control conditions is constructed by learning using the user state before the control of the device 40, and in the control step, the device 40 is controlled under the control conditions output by inputting the user state into the constructed model.

[0097] Such a support method can assist the user in performing intellectual tasks.

[0098] Invention 2 is an assistance method related to Invention 1, wherein the second space is a space for the user to rest (refreshment space 250), and the multiple spaces include a third space (collaboration space 300) used for a purpose different from the first and second spaces, and in the estimation step, it is estimated (step S705) whether the user is performing intellectual work in the first space or whether he is resting in the second space, and whether he is using the third space, and the second parameter indicates the user's degree of cognitive fatigue, and the user state includes a third parameter of the user different from the first parameter and the second parameter.

[0099] Such a support method can support a user's intellectual work in using a plurality of spaces including a first space, a second space, and a third space.

[0100] Invention 3 is a support method according to Invention 1 or 2, in which the control step controls a device 40 to recommend that the user move from a space in which the user is present to another space among a plurality of spaces.

[0101] Such a support method can support the user's intellectual work by controlling the device 40 to recommend the user to move to another space when using a plurality of spaces.

[0102] Invention 4 is a support method according to any one of Inventions 1 to 3, in which in the learning step, a model is constructed by learning using past user states before and after control of the device 40.

[0103] This type of assistance method inputs the user state into a model constructed by learning from past user states before and after control of the device 40, and can assist the user in performing intellectual work using the output control conditions.

[0104] Invention 5 is an assistance method relating to any one of Inventions 1 to 3, in which in the learning step, a model is constructed by learning using the user states before and after past control of device 40, and the control conditions in the past control of device 40.

[0105] This type of support method inputs the user state into a model constructed by learning using the user states before and after past control of the device 40, and the control conditions in the past control of the device 40, and can support the user's intellectual work with the output control conditions.

[0106] Invention 6 is a support method according to any one of Inventions 1 to 5, further including a presenting step of presenting a user state to a user.

[0107] Such a support method can further present the user status to the user.

[0108] Invention 7 is a support method relating to any one of Inventions 1 to 6, wherein the user information further includes at least one of user attribute information, the status of the user's intellectual work, and a past user state, and in the learning step, a model is constructed by learning using the user state before control of the equipment and at least one of the user attribute information, the status of the user's intellectual work, and a past user state.

[0109] This type of support method inputs the user state into a model constructed by learning using the user state before control of the device, the user's attribute information, the status of the user's intellectual work, and at least one of the past user states, and can support the user's intellectual work with the output control conditions.

[0110] Invention 8 is a support system 10A that supports the use of a plurality of spaces including a first space (work space 200) for a user to perform intellectual work and a second space (one of a refreshment space 250 and a collaborative space 300) that the user uses for a purpose other than the first space, and includes an acquisition unit 30f that acquires user information of the user, an estimation unit 30g that estimates, based on the user information, at least one of whether the user is performing intellectual work in the first space and whether the user is using the second space, and estimates a user state including at least one of a first parameter indicating the user's concentration level and a second parameter of the user different from the first parameter, a control unit 30i that uses the user state to control a device 40 provided in at least one of the first space and the second space, and a learning unit 30h that constructs a model capable of outputting control conditions by learning using the user state before the control of the device 40, and the control unit 30i controls the device 40 with the control conditions output by inputting the user state into the constructed model.

[0111] Such a support system 10A can support the user in performing intellectual tasks.

[0112] A ninth aspect of the present invention is a program for causing a computer to execute the support method according to any one of the first to seventh aspects of the present invention.

[0113] Such a program can assist a user in performing intellectual tasks using a computer.

[0114] (Other embodiments) Although the embodiment has been described above, the present invention is not limited to the above embodiment.

[0115] For example, in the above embodiment, the assistance system is realized by a plurality of devices. When the assistance system is realized by a plurality of devices, the components (particularly, functional components) of the assistance system described in the above embodiment may be distributed in any manner among the plurality of devices of the assistance system. For example, the acquisition unit, the estimation unit, the determination unit, the learning unit, and the control unit may be distributed among the plurality of devices.

[0116] The assistance system may also be realized as a single device. For example, the assistance system may be realized as a single device corresponding to an information processing device.

[0117] The support system may be realized as a client-server system. For example, the support system may further include a cloud server (server device), and a part or all of the processes executed by the information processing device may be executed by the cloud server.

[0118] Furthermore, the method of communication between the devices in the above-described embodiment is not particularly limited. In addition, a relay device (not shown) may be involved in the communication between the devices.

[0119] In the above embodiment, the process performed by a specific processing unit may be executed by another processing unit. For example, the process performed by the selection unit may be executed by the control unit. The order of multiple processes may be changed, or multiple processes may be executed in parallel.

[0120] In the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0121] Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit, or a dedicated circuit.

[0122] Furthermore, the general or specific aspects of the present invention may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0123] For example, the present invention may be realized as an assistance method executed by a computer such as an assistance system, or as a program for causing a computer to execute such an assistance method. Furthermore, the present invention may be realized as a computer-readable non-transitory recording medium having such a program recorded thereon.

[0124] In addition, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art may think of, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the spirit of the present invention. [Explanation of symbols]

[0125] 10, 10A Support System 20 Camera 25. Mike 30, 30A Information processing device 30a, 30f acquisition part 30b Storage section 30c, 30g estimation part 30d Judgment section 30e, 30i control section 30h Study Section 40 equipment 200 workspace 250 Refreshing Space 300 Collaborative Space

Claims

1. A method for supporting a user in using a plurality of spaces including a first space for performing intellectual work and a second space used by the user for a purpose different from that of the first space, comprising: acquiring user information of the user; an estimation step of estimating, based on the user information, at least one of whether the user is performing an intellectual task in the first space and whether the user is using the second space, and estimating a user state including at least one of a first parameter indicating a concentration level of the user and a second parameter of the user different from the first parameter; a control step of controlling a device provided in at least one of the first space and the second space using the user state; a learning step executed before the control step, the learning step learning using the user state before the control of the device to construct a model capable of outputting a control condition, In the control step, the device is controlled under the control conditions outputted by inputting the user state into the constructed model. How to help.

2. The second space is a space for the user to rest, the plurality of spaces includes a third space that is used for a purpose different from the first space and the second space, In the estimation step, it is estimated whether the user is performing intellectual work in the first space or taking a rest in the second space, and whether the user is using the third space; The second parameter indicates a cognitive fatigue level of the user, the user state includes a third parameter of the user that is different from the first parameter and the second parameter; The method of claim 1 .

3. In the control step, the device is controlled to recommend that the user move from a space in which the user is present to another space among the plurality of spaces. The method of claim 1 .

4. In the learning step, the model is constructed by learning using the user states before and after past control of the device. The method of claim 1 .

5. In the learning step, the model is constructed by learning using the user states before and after past control of the device and the control conditions in the past control of the device. The method of claim 1 .

6. Further, the presenting step includes presenting the user state to the user. The method of claim 1 .

7. The user information further includes at least one of attribute information of the user, a state of intellectual work of the user, and a past state of the user; In the learning step, the model is constructed by learning using the user state before the control of the device, attribute information of the user, a state of the intellectual task of the user, and at least one of the past user states. The support method according to any one of claims 1 to 6.

8. A support system for supporting a user in using a plurality of spaces including a first space for performing intellectual work and a second space used by the user for a purpose different from that of the first space, An acquisition unit that acquires user information of the user; an estimation unit that estimates, based on the user information, at least one of whether the user is performing an intellectual task in the first space and whether the user is using the second space, and estimates a user state including at least one of a first parameter indicating a concentration level of the user and a second parameter of the user different from the first parameter; a control unit that controls a device provided in at least one of the first space and the second space using the user state; a learning unit that learns using the user state before the device is controlled, to construct a model capable of outputting a control condition, The control unit controls the device under the control conditions output by inputting the user state into the constructed model. Support system.

9. A method for causing a computer to execute the support method according to claim 1, program.

Images