Fatigue level estimation system, fatigue level estimation method, and program

Abstract

A fatigue level estimation system (10) comprises: an acquisition unit (34) that acquires schedule information of a user; a selection unit (35) that selects, on the basis of an activity plan of the user in a target period, a sensor for sensing the user, the activity plan being determined according to the acquired schedule information; an estimation unit (36) that estimates the fatigue level of the user on the basis of sensing data obtained as a result of the selected sensor sensing the user during the target period; and an output unit (38) that outputs information related to the estimated fatigue level of the user.

Description

Fatigue level estimation system, fatigue level estimation method, and program

[0001] The present invention relates to a fatigue level estimation system, a fatigue level estimation method, and a program.

[0002] Patent Document 1 discloses a fatigue assessment system that can objectively assess the fatigue of a worker.

[0003] Japanese Patent Application Laid-Open No. 2019-005265

[0004] The present invention provides a fatigue level estimation system, a fatigue level estimation method, and a program that can improve the accuracy of fatigue level estimation.

[0005] A fatigue level estimation system according to one embodiment of the present invention includes an acquisition unit that acquires a user's schedule information, a selection unit that selects a sensor to sense the user based on the user's planned activities during a target period determined by the acquired schedule information, an estimation unit that estimates the user's fatigue level based on sensing data obtained by the selected sensor sensing the user during the target period, and an output unit that outputs information related to the estimated user's fatigue level.

[0006] A fatigue level estimation method according to one aspect of the present invention is a fatigue level estimation method executed by a computer, and includes an acquisition step of acquiring a user's schedule information, a selection step of selecting a sensor to sense the user based on the user's planned activities during a target period determined by the acquired schedule information, an estimation step of estimating the user's fatigue level based on sensing data obtained by the selected sensor sensing the user during the target period, and an output step of outputting information related to the estimated fatigue level of the user.

[0007] A program according to one aspect of the present invention is a program for causing the computer to execute the fatigue level estimation method.

[0008] The display fatigue level estimation system, fatigue level estimation method, and program of the present invention can improve the accuracy of fatigue level estimation.

[0009] FIG. 1 is an external view of a fatigue level estimation system according to an embodiment. FIG. 2 is a block diagram showing the functional configuration of the fatigue level estimation system according to an embodiment. FIG. 3 is a sequence diagram of a first operation example of the fatigue level estimation system according to an embodiment. FIG. 4 is a diagram showing an example of schedule information. FIG. 5 is a diagram showing an example of selection criteria information. FIG. 6 is a diagram showing an example of an advice database. FIG. 7 is a diagram showing a first example of an image showing a fatigue level estimation result. FIG. 8 is a diagram showing a second example of an image showing a fatigue level estimation result. FIG. 9 is a diagram showing a first example of an image for giving instructions regarding sensing to a user. FIG. 10 is a diagram showing a second example of an image for giving instructions regarding sensing to a user. FIG. 11 is a block diagram showing the functional configuration of a fatigue level estimation system according to a modified example.

[0010] Hereinafter, embodiments will be described with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component placement and connection forms, steps, and step order shown in the following embodiments are merely examples and are not intended to limit the present invention. Furthermore, among the components in the following embodiments, components not recited in independent claims will be described as optional components.

[0011] It should be noted that the drawings are schematic diagrams and are not necessarily strict illustrations. In addition, in the drawings, substantially the same components are denoted by the same reference numerals, and overlapping descriptions may be omitted or simplified.

[0012] (Embodiment) [Configuration] First, the configuration of a fatigue level estimation system according to an embodiment will be described. Fig. 1 is an external view of the fatigue level estimation system. Fig. 2 is a block diagram showing the functional configuration of the fatigue level estimation system according to an embodiment.

[0013] The fatigue level estimation system 10 is a system that can estimate the fatigue level of a user. Generally, the fatigue level of a user is estimated (evaluated) after the user waits in a resting state for a certain period of time, but this forces the user to wait in a resting state.

[0014] Therefore, in order to reduce such burden on the user (such as having to wait in a resting state), the fatigue level estimation system 10 estimates the user's fatigue level while the user is working. Specifically, the fatigue level estimation system 10 can estimate the user's fatigue level using appropriate sensors at appropriate times based on schedule information indicating the user's work schedule. The fatigue level estimation system 10 includes a sensor group 20, a fatigue level estimation device 30, an information terminal 40, and a display device 50.

[0015] The sensor group 20 includes multiple types of sensors for sensing the user. Specifically, the sensor group 20 includes an image sensor 21, a radio wave sensor 22, a wearable sensor 23, and a sheet-type body motion sensor 24.

[0016] The image sensor 21 is a camera that captures an image of the user. The image sensor 21 is, for example, externally attached to or built into the information terminal 40 that the user uses for office work, etc., but may also be installed in a location separate from the information terminal 40. The image sensor 21 outputs image data as sensing data.

[0017] The radio wave sensor 22 is a biosensor that emits radio waves toward the user and senses the user's pulse wave in a non-contact manner based on the reflection of weak radio waves from the user. The radio wave sensor 22 outputs pulse wave data as sensing data.

[0018] The wearable sensor 23 is a biosensor that is worn on the user's body and can sense the user's pulse wave or heartbeat. The wearable sensor 23 is, for example, a wrist-worn sensor, but may also be an ear-worn sensor. The wearable sensor 23 outputs pulse wave data or heartbeat data as sensing data.

[0019] The sheet-type body motion sensor 24 is a contact-type biosensor that can sense the pulse waves or heartbeat of a user sitting in a chair. The sheet-type body motion sensor 24 is a sheet-type (in other words, mat-type) sensor that is attached to the back or seat of a chair, and can sense the user's pulse waves or heartbeat from the movement of the user's body surface while sitting in the chair. The sheet-type body motion sensor 24 may also be attached to a bed in a rest room or the like to sense the pulse waves or heartbeat of a user lying in bed. The sheet-type body motion sensor 24 outputs pulse wave data or heartbeat data as sensing data.

[0020] The fatigue level estimation device 30 estimates the user's fatigue level based on sensing data obtained from sensors included in the sensor group 20 and outputs information related to the estimated fatigue level. The fatigue level estimation device 30 is, for example, a cloud server installed outside the facility where the user is located, but may also be an edge server installed within the facility where the user is located. The fatigue level estimation device 30 includes a communication unit 31, an information processing unit 32, and a storage unit 33.

[0021] The communication unit 31 is a communication module (communication circuit) that enables the fatigue level estimation device 30 to communicate with the sensor group 20 and the information terminal 40. The communication performed by the communication unit 31 is, for example, wired communication, but may also be wireless communication. There are no particular limitations on the communication standard used for the communication.

[0022] The information processing unit 32 is realized by a processor or a microcomputer. The information processing unit 32 includes an acquisition unit 34 that acquires schedule information of the user, a selection unit 35 that selects a sensor from the sensor group 20 based on the schedule information, an estimation unit 36 ​​that estimates the user's fatigue level based on sensing data of the selected sensor, a determination unit 37 that determines whether the estimated user's fatigue level exceeds a threshold, and an output unit 38 that outputs information related to the estimated user's fatigue level. The functions of the acquisition unit 34, the selection unit 35, the estimation unit 36, the determination unit 37, and the output unit 38 are realized by the processor or microcomputer constituting the information processing unit 32 executing a computer program stored in the storage unit 33.

[0023] The storage unit 33 is a storage device that stores various information used by the information processing unit 32, such as computer programs executed by the information processing unit 32. Specifically, the storage unit 33 is realized by a semiconductor memory or the like.

[0024] The information terminal 40 is an information terminal through which a user inputs schedule information, and is specifically a personal computer, but may also be a smartphone or tablet terminal. In the following embodiments, the information terminal 40 is also an information terminal used by a user when performing work based on the schedule information. The information terminal 40 includes a display unit 41. The display unit 41 is realized by a display panel such as a liquid crystal panel or an organic EL panel.

[0025] The display device 50 is a device used as a sub-display when the user performs work using the information terminal 40. The display device 50 is realized by a display panel such as a liquid crystal panel or an organic EL panel.

[0026] [Operation Example] As described above, the fatigue level estimation system 10 can estimate the fatigue level of a user while the user is working. When estimating the fatigue level of a user while the user is working, the user's state varies depending on the timing of estimating the fatigue level, and the difference in the user's state may lead to a decrease in estimation accuracy.

[0027] Therefore, the fatigue level estimation system 10 improves the accuracy of estimating the fatigue level by switching the sensor used for estimating the fatigue level depending on the timing of estimating the fatigue level. A first operation example of the fatigue level estimation system 10 will be described below. FIG. 3 is a sequence diagram of the operation example of the fatigue level estimation system 10.

[0028] The user inputs schedule information to the information terminal 40 running a predetermined application program (hereinafter also simply referred to as a predetermined app) that can transmit schedule information to the fatigue level estimation device 30. The predetermined app is, for example, a schedule management app that can cooperate with the fatigue level estimation device 30, but it may also be an app dedicated to the fatigue level estimation system 10. Note that the schedule information does not necessarily have to be set by the user himself / herself, and may also be set by a system, manager, or related person in the organization.

[0029] The information terminal 40 accepts input of schedule information (S11). Fig. 4 is a diagram showing an example of schedule information. As shown in Fig. 4, the schedule information associates the user's work schedule (time period and work content) with a setting of whether to allow fatigue level estimation during the time period in which the work is performed.

[0030] The information terminal 40 transmits the schedule information to the fatigue level estimation device 30, and the communication unit 31 of the fatigue level estimation device 30 receives the schedule information (S12). The acquisition unit 34 acquires the received schedule information (S13), and the selection unit 35 selects, as a target period, a time period in the schedule information in which fatigue level estimation is permitted (S14).

[0031] Next, the selection unit 35 selects a sensor to be used for estimating the fatigue level from the sensor group 20 based on the user's work schedule for the target period and the selection criteria information pre-stored in the storage unit 33 (S15). Fig. 5 is a diagram showing an example of the selection criteria information.

[0032] 5 , the selection criteria information specifies a work schedule and a sensor recommended for the work schedule. The selection unit 35 can select a sensor by comparing the user's work schedule for the target period with the selection criteria information pre-stored in the storage unit 33. For example, if the user's work schedule for the target period is document preparation, the selection unit 35 selects a pulse wave sensor (a radio wave sensor 22, a wearable sensor 23, or a sheet-type body motion sensor 24 that senses pulse waves).

[0033] 5 and the combination of sensors recommended for the work schedule are merely examples. For example, a combination of two or more sensors, such as an image sensor and a heart rate sensor, may be recommended for a web conference schedule, and the sensors recommended for each work may differ for each individual or organization.

[0034] Such selection criteria information is empirically or experimentally determined as appropriate by a designer or the like of the fatigue level estimation system 10. The selection criteria information recommends, for example, the use of the image sensor provided in the information terminal 40 for work such as a web conference in which a user uses a single display (in other words, the information terminal 40 is used but the display device 50 is not used). By determining the selection criteria in this manner, in step S17 described below, the estimation unit 36 ​​can estimate the fatigue level using sensing data (image data) from the image sensor when an image of the user can be appropriately captured by the image sensor.

[0035] Furthermore, for tasks such as document creation that require the user to concentrate and are likely to involve little physical movement (in other words, tasks in which the user's heart rate or pulse wave is likely to be stable), the use of a biosensor that senses the user's heart rate or pulse wave is recommended. By defining the selection criteria in this manner, in step S17 described below, the estimation unit 36 ​​can estimate the fatigue level using sensing data from the biosensor that senses the heart rate or pulse wave when stable sensing of the heart rate or pulse wave is possible.

[0036] Furthermore, for work that requires the user to move around, such as factory work, it is recommended to use the wearable sensor 23. By defining the selection criteria in this way, in step S17 described below, the estimation unit 36 ​​can appropriately estimate the fatigue level using the sensing data of the wearable sensor 23 when it is difficult to sense the user using a fixed sensor.

[0037] Thereafter, when the target period arrives, the estimation unit 36 ​​communicates with the sensor selected in step S15 using the communication unit 31 to acquire sensing data obtained by the sensor sensing the user (S16), and estimates the user's fatigue level based on the acquired sensing data (S17). The fatigue level is expressed, for example, as an evaluation value ranging from 0 (not fatigued) to 100 (fatigued). The fatigue level evaluation value is an example, and the fatigue level evaluation value may indicate the fatigue level in fewer than 100 levels, such as two levels: fatigued and not fatigued, or conversely, may indicate the fatigue level in more detail, such as 101 levels or more. Furthermore, the fatigue level does not necessarily have to be expressed as an evaluation value (numerical value) to the user; for example, different lights or sounds may be output depending on the fatigue level.

[0038] When pulse wave data is acquired in step S16, the estimation unit 36 ​​performs frequency analysis on the second-order derivative waveform with respect to time of the pulse wave data (the waveform of the accelerated pulse wave) to calculate the power of each frequency component of LF (frequency components of 0.05 Hz to 0.15 Hz) and HF (frequency components of 0.15 Hz to 0.40 Hz), and can estimate that the greater the LF / HF power ratio (hereinafter simply referred to as the LF / HF ratio), the greater the level of fatigue of the user.

[0039] When heart rate data is acquired in step S16, the estimation unit 36 ​​calculates the power of each of the LF and HF frequency components by performing frequency analysis on the heart rate data (time-series data of the RR intervals), and can estimate that the greater the LF / HF ratio, the higher the user's fatigue level. Note that the method of estimating fatigue level using LF / HF is merely one example, and other methods using heart rate data, such as a method using diurnal heart rate fluctuations, may also be used.

[0040] When image data showing the user's face is acquired in step S16, the estimation unit 36 ​​can calculate multiple feature amounts related to the user's face (such as facial expressions) and estimate the fatigue level based on the calculated multiple feature amounts. More specifically, the estimation unit 36 ​​can estimate the user's fatigue level using a machine learning model (trained model) that can input multiple feature amounts and output a fatigue level. Furthermore, the machine learning model for estimating the fatigue level may be a model to which deep learning is applied and that can estimate the fatigue level using image data (video data) as input. The method of estimating the fatigue level based on information about the face is merely one example, and other methods using image data, such as a method of acquiring body movement from image data, may also be used.

[0041] The above-described method for estimating a fatigue level is merely an example, and the method for estimating a fatigue level using sensing data is not particularly limited. The method for estimating a fatigue level using sensing data may be any existing method. For example, the fatigue level may be estimated not only by data obtained from a single sensor, but also by combining data obtained from multiple sensors.

[0042] After the fatigue level is estimated in step S17, the determination unit 37 determines whether the estimated user's fatigue level exceeds a threshold (S18), and identifies advice information based on the determination result (S19). For example, the storage unit 33 stores an advice database indicating the relationship between thresholds (specifically, a first threshold and a second threshold) and advice information. Fig. 6 is a diagram showing an example of the advice database. Note that, although two thresholds are set in the advice database of Fig. 6, only one threshold may be set, or three or more thresholds may be set.

[0043] Next, the output unit 38 outputs estimation result information indicating the estimation result of the user's fatigue level (S20). The estimation result information includes the fatigue level value estimated in step S17 (an example of information related to the user's fatigue level) and the advice information identified in step S19. The estimation result information is transmitted to the information terminal 40 by the communication unit 31 (S21).

[0044] When the information terminal 40 receives the estimation result information, it displays the fatigue level estimation result on the display unit 41 or the display device 50 based on the received estimation result information (S22). Figures 7 and 8 are diagrams showing examples of images showing the fatigue level estimation result.

[0045] Fig. 7 is a diagram showing an example of an image displayed when the fatigue level is relatively high, and displays advice information such as "You are fatigued. Please take appropriate rest. We recommend that you consult with your boss, counselor, or friend." On the other hand, Fig. 8 is a diagram showing an example of an image displayed when the fatigue level is relatively low, and displays advice information such as "Your fatigue level is low, but please continue to be careful."

[0046] As described above, the fatigue level estimation system 10 can estimate the fatigue level of a user while the user is working. The fatigue level estimation system 10 can improve the accuracy of fatigue level estimation by switching the sensor used for fatigue level estimation depending on the timing of fatigue level estimation.

[0047] [Instructions Related to Sensing] The fatigue level estimation system 10 (fatigue level estimation device 30) may issue instructions related to sensing to the user when acquiring the sensing data in step S16 or immediately before that.

[0048] For example, the output unit 38 of the fatigue level estimation device 30 outputs instruction information for giving instructions regarding sensing to the user, and the communication unit 31 transmits the output instruction information to the information terminal 40 .

[0049] When the information terminal 40 receives the instruction information, it displays (visualizes) an image for giving instructions regarding sensing to the user based on the received instruction information on the display unit 41 or the display device 50. Figures 9 and 10 are diagrams showing examples of images for giving instructions regarding sensing to the user.

[0050] Fig. 9 is an image displayed when the image sensor 21 is selected in step S15, and the image displays the instruction "Please look at the display in front of you as much as possible while working." Also, Fig. 10 is an image displayed when a biosensor that senses heart rate or pulse waves is selected in step S15, and the image displays the instruction "Fatigue level is being estimated. Please refrain from large movements as much as possible."

[0051] In this way, the fatigue level estimation system 10 can encourage the user to get into a state suitable for sensing by displaying instructions regarding sensing on the display unit 41 of the information terminal 40 or the display device 50, thereby improving the accuracy of sensing.

[0052] [Modification of System Configuration] In the above embodiment, some or all of the processing performed by the fatigue level estimation device 30 may be performed by the information terminal 40. Fig. 11 is a block diagram showing the functional configuration of the fatigue level estimation system 10 when the processing performed by the fatigue level estimation device 30 is executed by the information terminal 40.

[0053] 11 includes a sensor group 20, an information terminal 40a, and a display device 50. The information terminal 40a includes a display unit 41, a communication unit 42, an information processing unit 43, and a storage unit 44.

[0054] The communication unit 42 is a communication module (communication circuit) that enables the information terminal 40a to communicate with the sensor group 20 and the display device 50. The communication performed by the communication unit 42 is, for example, wired communication, but may also be wireless communication. There is no particular limitation on the communication standard used for the communication.

[0055] The information processing unit 43 is realized by a processor or a microcomputer. The information processing unit 43 includes, as functional components, an acquisition unit 45, a selection unit 46, an estimation unit 47, a determination unit 48, and an output unit 49. The functions of the acquisition unit 45, the selection unit 46, the estimation unit 47, the determination unit 48, and the output unit 49 are realized by the processor or microcomputer constituting the information processing unit 32 executing a computer program stored in the storage unit 33.

[0056] The storage unit 44 is a storage device that stores various information used by the information processing unit 43, such as computer programs executed by the information processing unit 43. Specifically, the storage unit 44 is realized by a semiconductor memory or the like.

[0057] In the fatigue level estimation system 10a, the information terminal 40a can execute the fatigue level estimation process described as being executed by the fatigue level estimation device 30. In other words, the information terminal 40a is another example of a fatigue level estimation device, and also functions as a fatigue level estimation device. In the above embodiment, the acquisition unit 34, the selection unit 35, the estimation unit 36, the determination unit 37, and the output unit 38 may be read as an acquisition unit 45, a selection unit 46, an estimation unit 47, a determination unit 48, and an output unit 49.

[0058] [Other Modifications] In the above embodiment, the fatigue level estimation system 10 is described as including the sensor group 20 and selecting (switching) a sensor included in the sensor group 20. However, the fatigue level estimation system 10 may focus on one sensor and select a target period suitable for sensing using that sensor based on the planned activities of the user included in the schedule information.

[0059] For example, if the sensor is an image sensor 21, the selection unit 35 can identify, based on the selection criteria information, that the task suitable for sensing using the image sensor 21 is a web conference, and, based on the schedule information, select the time period during which the identified task is performed (9:00-11:00 in the example of Figure 4) as the target period.

[0060] In this way, the fatigue level estimation system 10 may include an acquisition unit 34 that acquires the user's schedule information, a selection unit 35 that selects a target period suitable for sensing using a sensor that senses the user based on the user's planned activities included in the acquired schedule information, an estimation unit 36 ​​that estimates the user's fatigue level based on sensing data obtained by the sensor sensing the user during the selected target period, and an output unit 38 that outputs information related to the estimated user's fatigue level.

[0061] [Effects, etc.] Inventions derived from the disclosure of this specification are, for example, the following inventions. Hereinafter, the inventions derived from the disclosure of this specification will be described together with the effects, etc. obtained by the inventions.

[0062] Invention 1 is a fatigue level estimation system 10 comprising an acquisition unit 34 that acquires a user's schedule information, a selection unit 35 that selects a sensor to sense the user based on the user's planned activities during a target period determined by the acquired schedule information, an estimation unit 36 ​​that estimates the user's fatigue level based on sensing data obtained by the selected sensor sensing the user during the target period, and an output unit 38 that outputs information related to the estimated user's fatigue level.

[0063] Such a fatigue level estimation system 10 can improve the accuracy of estimating the user's fatigue level by estimating the user's fatigue level based on sensing data obtained from sensors selected based on the user's planned activities.

[0064] Invention 2 is a fatigue level estimation system 10 of Invention 1, in which, when the user plans to engage in an activity using a single display during the target period, the selection unit 35 selects an image sensor 21 that photographs the user as the sensor, and the estimation unit 36 ​​estimates the user's fatigue level based on image data obtained by the image sensor 21 photographing the user during the target period.

[0065] Such a fatigue level estimation system 10 can improve the accuracy of estimating fatigue level by selecting the image sensor 21 provided on the display when the user plans to engage in an activity that requires the use of a single display.

[0066] Invention 3 is the fatigue level estimation system 10 of Invention 1 or 2, in which, when the user plans to engage in an activity during the target period that is estimated to stabilize the user's heart rate or pulse wave, the selection unit 35 selects a biosensor that senses the user's heart rate or pulse wave as the sensor, and the estimation unit 36 ​​estimates the user's fatigue level based on the heart rate data or pulse wave data obtained by the biosensor photographing the user.

[0067] Such a fatigue level estimation system 10 can improve the accuracy of fatigue level estimation by selecting a biosensor that senses the user's heart rate or pulse wave when the user is planning an activity that is estimated to stabilize the user's heart rate or pulse wave.

[0068] Invention 4 is a fatigue level estimation system 10 of any of Inventions 1 to 3, in which, if the user plans to engage in an activity involving movement during the target period, the selection unit 35 selects the wearable sensor 23 worn by the user as the sensor.

[0069] Such a fatigue level estimation system 10 can improve the accuracy of estimating fatigue levels by selecting a wearable sensor 23 that is suitable for sensing the user while moving when the user is planning an activity that involves movement.

[0070] A fifth aspect of the present invention is the fatigue level estimation system 10 of any one of the first to fourth aspects, wherein the output unit 38 outputs instruction information for giving instructions regarding sensing to the user during the target period or immediately before the target period.

[0071] The fatigue level estimation system 10 can improve the accuracy of estimating the fatigue level by providing instructions regarding sensing to the user.

[0072] A sixth aspect of the present invention is the fatigue level estimation system 10 of any one of the first to fifth aspects of the present invention, wherein the target period is a period set by the user for which the user permits estimation of the fatigue level.

[0073] Such a fatigue level estimation system 10 can estimate the user's fatigue level during the period for which the user has permitted estimation of the user's fatigue level.

[0074] Invention 7 is a fatigue level estimation system 10 of any of Inventions 1 to 6, further comprising a judgment unit 37 that judges whether the estimated user's fatigue level exceeds a threshold, and an output unit 38 that outputs advice information regarding the fatigue level based on the result of the judgment.

[0075] Such a fatigue level estimation system 10 can provide the user with advice regarding the fatigue level.

[0076] Invention 8 is a fatigue level estimation method executed by a computer, including an acquisition step S13 of acquiring schedule information of a user, a selection step S15 of selecting a sensor to sense the user based on the user's planned activities during a target period determined by the acquired schedule information, an estimation step S17 of estimating the user's fatigue level based on sensing data obtained by the selected sensor sensing the user during the target period, and an output step S20 of outputting information related to the estimated user's fatigue level.

[0077] Such a fatigue level estimation method can improve the accuracy of estimating the user's fatigue level by estimating the user's fatigue level based on sensing data obtained from sensors selected based on the user's planned activities.

[0078] A ninth aspect of the present invention is a program for causing the computer to execute the fatigue level estimation method of the eighth aspect.

[0079] According to such a program, the computer can improve the accuracy of estimating the user's fatigue level by estimating the user's fatigue level based on sensing data obtained from sensors selected based on the user's planned activities.

[0080] Other Embodiments Although the fatigue level estimation system according to the embodiment has been described above, the present invention is not limited to the above embodiment.

[0081] For example, in the above embodiment, a process executed by a specific processing unit may be executed by another processing unit, the order of multiple processes may be changed, or multiple processes may be executed in parallel.

[0082] In the above-described embodiments, each component may be realized by executing a software program suitable for that component, or by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0083] Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0084] Furthermore, the general or specific aspects of the present invention may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0085] For example, the present invention may be realized as a fatigue level estimation system or a fatigue level estimation device, or as a fatigue level estimation method executed by a computer such as a fatigue level estimation system. Furthermore, the present invention may be realized as a program for causing a computer to execute the fatigue level estimation method, or as a computer-readable non-transitory recording medium on which such a program is stored.

[0086] In addition, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art would think of, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope of the present invention.

[0087] 10, 10a Fatigue level estimation system 20 Sensor group 21 Image sensor 22 Radio wave sensor 23 Wearable sensor 24 Sheet-type body movement sensor 30 Fatigue level estimation device 31, 42 Communication unit 32, 43 Information processing unit 33, 44 Memory unit 34, 45 Acquisition unit 35, 46 Selection unit 36, 47 Estimation unit 37, 48 Determination unit 38, 49 Output unit 40, 40a Information terminal 41 Display unit 50 Display device

Claims

1. A fatigue level estimation system comprising: an acquisition unit that acquires schedule information of a user; a selection unit that selects a sensor to sense the user based on the user's planned activities during a target period determined by the acquired schedule information; an estimation unit that estimates the user's fatigue level based on sensing data obtained by the selected sensor sensing the user during the target period; and an output unit that outputs information related to the estimated fatigue level of the user.

2. The fatigue level estimation system of claim 1, wherein, if the user plans to engage in an activity using a single display during the target period, the selection unit selects an image sensor that photographs the user as the sensor, and the estimation unit estimates the user's fatigue level based on image data obtained by the image sensor photographing the user during the target period.

3. A fatigue level estimation system as described in claim 1 or 2, wherein if the user plans to engage in an activity during the target period that is estimated to stabilize the user's heart rate or pulse wave, the selection unit selects a biosensor that senses the user's heart rate or pulse wave as the sensor, and the estimation unit estimates the user's fatigue level based on heart rate data or pulse wave data obtained by the biosensor photographing the user.

4. A fatigue level estimation system as described in claim 1 or 2, wherein if the user plans to engage in an activity involving movement during the target period, the selection unit selects a wearable sensor attached to the user as the sensor.

5. A fatigue level estimation system as described in claim 1 or 2, wherein the output unit outputs instruction information for giving instructions regarding the sensing to the user during the target period or immediately before the target period.

6. The fatigue level estimation system according to claim 1 or 2, wherein the target period is a period set by the user during which the user permits the estimation of the fatigue level.

7. A fatigue level estimation system as described in claim 1 or 2, further comprising a judgment unit that judges whether the estimated fatigue level of the user exceeds a threshold value, and the output unit outputs advice information regarding the fatigue level based on the result of the judgment.

8. A fatigue level estimation method executed by a computer, comprising: an acquisition step of acquiring schedule information of a user; a selection step of selecting a sensor to sense the user based on the user's planned activities during a target period determined by the acquired schedule information; an estimation step of estimating the user's fatigue level based on sensing data obtained by the selected sensor sensing the user during the target period; and an output step of outputting information related to the estimated fatigue level of the user.

9. A program for causing a computer to execute the fatigue level estimation method according to claim 8.