Information Processing Apparatus, Information Processing Method, and Program

The information processing apparatus addresses the challenge of detecting abnormal situations in work environments by adjusting detection sensitivity based on workload and work context, thereby enhancing detection accuracy and safety.

JP7696321B2Active Publication Date: 2025-06-20NS SOLUTIONS CORPORATION
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2022160124
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-10-04
Publication Date
2025-06-20
Estimated Expiration
2042-10-04

AI Technical Summary

Technical Problem

Existing techniques for detecting abnormal situations, such as falls, in work environments face challenges in accuracy due to over-sensitivity leading to false detections and under-sensitivity resulting in missed detections, particularly in contexts where the likelihood of falls is low.

Method used

An information processing apparatus that includes a specifying unit to identify the work being performed by the user and a detecting unit to detect abnormal situations using sensors. The detection sensitivity for different types of abnormal situations is adjusted based on the workload, with increased sensitivity for situations likely to result in significant harm and decreased sensitivity for situations unlikely to occur, thereby optimizing detection accuracy.

Benefits of technology

The proposed solution enhances the accuracy of detecting abnormal situations by tailoring detection sensitivity to the specific work context, reducing false positives and negatives, and improving overall safety in work environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007696321000001
    Figure 0007696321000001
  • Figure 0007696321000002
    Figure 0007696321000002
  • Figure 0007696321000003
    Figure 0007696321000003
Patent Text Reader

Abstract

To contribute to increasing the accuracy of detecting an abnormal state.SOLUTION: An information processing device includes: a specification unit that specifies at least either an item or load of work which is being performed by a user; and a detection unit that detects an abnormal state of the user via a sensor provided on or around the user, based on a determination criterion according to the at least either one specified by the specification unit.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] In recent years, automation and labor saving of work in factories, farms, etc. have advanced, and work can be performed with fewer personnel. On the other hand, when the number of personnel decreases, even if an abnormal situation such as a worker falling (falling due to tripping over something, falling due to poor physical condition, etc.) or falling occurs, it is highly likely that other workers will not notice. Especially when a person is injured due to a fall and cannot move, or loses consciousness, etc., there is a possibility of falling into a serious situation. In order to avoid falling into such a serious situation, a technique for detecting an abnormal situation such as a fall using a sensor has been proposed. Patent Document 1 discloses a technique in which an acceleration sensor is attached to a required position of a person, and a fall is detected when the acceleration obtained from the sensor exceeds a preset reference acceleration.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a desire to improve the accuracy of detecting abnormal situations. For this purpose, it is conceivable to increase the sensitivity of the sensor in order to detect abnormal situations without omission. However, if the sensitivity is increased too much, over-detection will occur. In addition, depending on the user's situation, the abnormal situations that are likely to occur and those that are unlikely to occur may differ. For example, when the user is working at a flat and low position, the possibility of the user falling is almost zero. Therefore, if a fall is detected in a situation where the user cannot fall, the possibility of false detection increases. In the prior art, in such a situation, there was a limit to the accuracy of detecting abnormal situations. The present invention has been made in view of such problems, and an object thereof is to contribute to improving the accuracy of detecting abnormal situations.

Means for Solving the Problems

[0005] In order to achieve the above object, the information processing apparatus of the present invention includes a specifying unit that specifies the work being performed by the user Load and a detecting unit that detects an abnormal situation specified by the specifying unit via a sensor provided for the user or around the user. For the load, a first type of abnormal situation and a second type of It has are determined in advance. The detection sensitivity of the first type of abnormal situation is set to increase as the load increases, and the detection sensitivity of the second type of abnormal situation is set to decrease as the load increases. The detection unit detects the first type of abnormal situation and the second type of abnormal situation according to the detection sensitivity determined according to the load and the type of abnormal situation. When the period during which the value of the load is equal to or greater than the threshold continues for a period threshold or more, the detection sensitivity is changed to a higher value. .

Effects of the Invention

[0006] According to the present invention, it is possible to contribute to improving the accuracy of detecting abnormal situations.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Mode for Carrying Out the Invention

[0008] (First Embodiment) FIG. 1 is a diagram showing an example of the system configuration of the detection system 1 of the present embodiment. The detection system 1 is a system for detecting an abnormal situation of a user, and includes a server device 10 and one or more terminal devices 20 each provided by a user who performs work such as farming work on a farm or work in a factory. The server device 10 and the terminal device 20 are each connected via a network 30. The server device 10 is an information processing device such as a server computer or a general-purpose computer that detects an abnormal situation of a user based on signals acquired via various sensors. In the present embodiment, the server device 10 detects, as abnormal situations, falling, toppling, impact, lying still, fatigue, and high heart rate. Falling means falling down. Toppling means falling from a high place. Impact means that a certain level of acceleration is applied. Lying still means not moving in a fallen state. Fatigue means that fatigue has accumulated. High heart rate means that the heart rate becomes higher than normal. The terminal device 20 is an information processing device such as a smartphone or a smartwatch that is equipped with sensors and transmits signals acquired via the sensors to the server device 10.

[0009] FIG. 2 is a diagram showing an example of the hardware configuration of the server device 10. The server device 10 includes a processor 101, a main memory device 102, an auxiliary storage device 103, and a communication interface (I / F) 104. The processor 101 is a control device that controls the server device 10. The main memory device 102 is a storage device such as a Random Access Memory (RAM) used for temporary storage of information, program deployment, etc. The auxiliary storage device 103 is a storage device such as a hard disk drive (HDD) or a solid state drive (SSD) that stores various information such as a reference value table 301 described later with reference to FIG. 3 and a sensitivity table 401 described later with reference to FIG. 4, and various programs. The communication I / F 104 is an interface used for communication with external devices such as the terminal device 20 via a network 30.

[0010] The reference value table 301 will be described with reference to FIG. 3. The reference value table 301 shows the correspondence between abnormal situations and the indicators and reference values used for determining abnormal situations. This reference value is a value indicating what value the corresponding indicator should be for it to be determined that an abnormal situation exists. In the present embodiment, the server device 10 detects an abnormal situation when the value of the indicator corresponding to the abnormal situation is equal to or greater than the reference value.

[0011] The reference value table 301 includes items of "abnormal situation" indicating an abnormal situation, "indicator" and "reference value" indicating the indicator and reference value used for determining the corresponding abnormal situation. In the present embodiment, the reference value table 301 includes indicators and reference values corresponding to each abnormal situation of falling, tumbling, impact, lying still, fatigue, and high heart rate.

[0012] In this embodiment, the indicators used for detecting a fall are the change values of the acceleration applied to the user in the vertical direction and the horizontal direction within a predetermined period (for example, 1 second, 2 seconds, etc.). Also, the indicator used for detecting a tumble is the change value of the acceleration applied to the user in the vertical direction within a predetermined period. Further, the indicator used for detecting an impact is the scalar value of the composite vector of the three-axis accelerations detectable by the acceleration sensor provided in the user within a predetermined period. Also, the indicator used for detecting lying still is the elapsed period after the inclination of the terminal device 20 becomes a value within a predetermined range and the movement of the user stops when the user takes a predetermined posture (a fallen posture, a posture lying on a desk / handle, etc., a posture hanging by a safety belt, etc.). In this embodiment, this predetermined range is a range predetermined as the range of inclination that the terminal device 20 can take when the user lies down. However, this range may be adjusted to an arbitrary range according to a designation from the user or the like. Also, the indicator used for detecting fatigue is the duration of work. Note that in this embodiment, a plurality of reference values used for detecting fatigue are determined according to the value of the wet-bulb globe temperature (WBGT value). The indicator used for detecting a high heart rate is the heart rate of the user. Each indicator is acquired by the terminal device 20 and transmitted to the server device 10. This process will be described later.

[0013] The sensitivity table 401 will be described with reference to FIG. 4. The sensitivity table 401 shows the correspondence between the items of the work being performed by the user (hereinafter referred to as work items) and the sensitivity of detecting each abnormal situation. Here, the sensitivity of detection is a measure indicating the ease of detecting the abnormal situation to be detected, and the higher the value, the easier it is to detect. In this embodiment, the sensitivity of detection takes any one of a plurality of ranked values (in this embodiment, four values of "standard", "slightly weak", "weak", and "OFF" in descending order). The height of the sensitivity is such that among "standard", "slightly weak", "weak", and "OFF", the most sensitive is "standard", the next highest is "slightly weak", the next highest is "weak", and the lowest is "OFF". Also, the sensitivity "OFF" indicates that detection is not performed.

[0014] In this embodiment, the server device 10 detects an abnormal situation of a user equipped with the terminal device 20 with a sensitivity corresponding to the work item of the work being performed by the user, which is stored in the sensitivity table 401. When detecting an abnormal situation, if the detection sensitivity is either "slightly weak" or "weak", the server device 10 corrects the value of the reference value used for determining the abnormal situation by multiplying it by a coefficient corresponding to the detection sensitivity. If the value of the index used for determining the abnormal situation is equal to or greater than the corrected reference value, the server device 10 detects an abnormal situation. This coefficient is a value greater than 1, and the smaller the corresponding sensitivity, the larger the value. For example, assume that a coefficient of 1.2 is set for "slightly weak" and a coefficient of 1.5 is set for "weak". As a result, when a value (sensor value) of an index that is determined to be an abnormal situation with the detection sensitivity of "standard" is detected, since it does not exceed the reference value with the sensitivity of "weak", it is not determined to be an abnormal situation, and it is possible to prevent being overly determined as abnormal. In this embodiment, a low detection sensitivity means a high reference value, and a high detection sensitivity means a low reference value. In this way, the server device 10 detects an abnormal situation of the user based on a judgment criterion corresponding to the work item of the work being performed by the user. Here, the judgment criterion is a criterion indicating how to detect an abnormal situation. In this embodiment, it is a criterion indicating what value of what index exceeds what reference value to be an abnormal situation.

[0015] In this embodiment, the detection sensitivity for an abnormal situation predetermined as an abnormal situation where false detection is assumed in the work is set to be equal to or lower than a predetermined threshold value (for example, "slightly weak", "weak", etc.). For example, for work items other than those with a risk of falling, such as working at heights (work at a position at a height of a predetermined height (e.g., 5 m or more) above the ground), work involving lifting using a stepladder or the like (agricultural work such as harvesting work, weeding work, etc.), work on mountain slopes (agricultural work, etc.), the possibility of the user falling is almost non-existent. Therefore, for such work items, it is assumed that if a fall is detected, it is a false detection. Thus, in the present embodiment, the sensitivity of fall detection for such work items is set to be equal to or lower than a predetermined value (in this embodiment, "weak"). In the example of FIG. 4, for work in places where toxic gas may be generated (toxic gas area work), office work, crane operation work, moving work by vehicle, work using a hammer (hammer work), the sensitivity of fall detection is set to be "weak" or lower on the assumption that false detection of a fall is likely.

[0016] Also, when a situation that can be confused with an abnormal situation is likely to occur during work, false detection of an abnormal situation is assumed. Therefore, in the present embodiment, the sensitivity of detection of such abnormal situations is predetermined so as to be equal to or lower than a predetermined threshold value (e.g., "slightly weak", "weak", etc.). In work such as work using a hammer, work using agricultural tools, and moving work by vehicle, the user is subjected to acceleration when using the hammer or agricultural tools, starting or stopping the vehicle, etc. This acceleration can be confused with the impact applied to the user. Therefore, it is assumed that the impact is falsely detected. Thus, in the present embodiment, for work items in which a situation where the user is subjected to a certain level or more of acceleration can occur, such as work using a hammer or agricultural tools and moving work by vehicle, the sensitivity of impact detection is set to be equal to or lower than a predetermined threshold value. In the example of FIG. 4, for moving work by vehicle, hammer work, harvesting work, and weeding work, the sensitivity of impact detection is set to be "weak" or lower.

[0017] Also, in this embodiment, the detection sensitivity for an abnormal situation that is predetermined as an abnormal situation in which significant damage to the user is assumed in the work is set to be equal to or higher than a predetermined threshold value (for example, "weak", "standard", etc.). Since a fall tends to cause significant damage to the user, it is desired to prevent undetected cases as much as possible. In the example of FIG. 4, for work items where there is a possibility of a fall, such as working at heights, work involving lifting and lowering using a stepladder, etc., and work on mountain slopes, the detection sensitivity is set to be "standard" or higher.

[0018] When the processor 101 receives an instruction to change the detection sensitivity of each abnormal situation for each work item based on the operation of the input device of the server device 10 by the user, the processor 101 updates the sensitivity table 401 so as to change the detection sensitivity of each abnormal situation for each work item. Further, the processor 101 may receive an instruction to change the content of the sensitivity table 401 from the terminal device 20. By using the sensitivity table 401 updated in this way, the server device 10 can detect an abnormal situation based on the judgment criteria assumed by the user.

[0019] FIG. 5 is a diagram showing an example of the hardware configuration of each of the terminal devices 20. The terminal device 20 includes a processor 201, a main memory device 202, an auxiliary storage device 203, a sensor 204, a short-range wireless communication I / F 205, a UI unit 206, and a communication I / F 207. The processor 201 is a control device that controls the terminal device 20. The main memory device 202 is a storage device such as a RAM used for temporary storage of information, program deployment, etc. The auxiliary storage device 203 is a storage device such as an HDD or SSD that stores various information and various programs. The sensor 204 is a sensor that detects predetermined information. In this embodiment, the sensor 204 includes an acceleration sensor that detects accelerations in three mutually perpendicular axes, an inclination sensor that detects the inclination of the terminal device 20, a camera, a heart rate sensor that detects the user's heart rate, a position sensor that receives GNSS signals and detects the position, and an altimeter. The short-range wireless communication I / F 205 is an interface used for short-range wireless communication with an environmental sensor (a sensor that detects wet-bulb temperature, black-bulb temperature, dry-bulb temperature, etc.) provided in the environment where the user works, a beacon that transmits a signal indicating position information, etc. Hereinafter, the signal indicating the position information transmitted by the beacon is referred to as a beacon signal. The processor 201 acquires the wet-bulb temperature, black-bulb temperature, and dry-bulb temperature in the environment where the user works from the environmental sensor via the short-range wireless communication I / F 205. The UI unit 206 includes an input unit such as a touch panel, hard buttons, a microphone, etc. used for input of information from the user, and an output unit such as a monitor, a speaker, etc. used for presentation of information to the user. The communication I / F 207 is an interface used for communication via a network 30 with an external device such as the server device 10. Note that in this embodiment, it is assumed that the terminal device 20 includes a heart rate sensor and detects the user's heart rate. However, as another example, the terminal device 20 may acquire the user's heart rate by other means. For example, the processor 201 of the terminal device 20 may acquire the user's heart rate detected by an external device (for example, a smartwatch, etc.) that includes a heart rate sensor from this external device via the short-range wireless communication I / F 205.

[0020] The functional configuration of the server device 10 will be described with reference to FIG. 6. The processor 101 of the server device 10 functions as a specific part 601, a detection part 602, and an output control part 603 by executing a program stored in the auxiliary storage device 103 or the like. Regarding the processing described below mainly centered on the specific part 601, the detection part 602, and the output control part 603, actually, the processor 101 is the main processing entity. The specific part 601 specifies the work item of the work being performed by the user equipped with the terminal device 20. The detection part 602 detects an abnormal situation of the user based on a judgment criterion corresponding to the work item specified by the specific part 601 via at least one of the sensor 204 of the terminal device 20 and an external sensor (such as an environmental sensor). The output control part 603 outputs warning information regarding the abnormal situation detected by the detection part 602.

[0021] Using FIG. 7, the detection processing of the abnormal situation of the user equipped with the terminal device 20 executed by the server device 10 will be described. When the processor 101 receives an instruction to start the detection processing of the abnormal situation of the user from the terminal device 20, it starts the processing of FIG. 7. When the processor 201 of the terminal device 20 receives an instruction to start the detection processing of the abnormal situation from the user via the UI part 206, it transmits the instruction to start the detection processing of the abnormal situation to the server device 10. Also, when the processor 201 transmits the instruction to start the detection processing of the abnormal situation, it periodically detects the acceleration applied to the terminal device 20 (user) via the sensor 204, the inclination of the terminal device 20, and the heart rate of the user, and transmits the detected information to the server device 10. However, the processor 201 may also instruct the sensor 204 to send only the value of the detected signal when it exceeds a specified threshold. In that case, the sensor 204 transmits the detected signal to the processor 201 when a signal exceeding the specified threshold is detected. Also, when the processor 201 transmits the instruction to start the detection processing of the abnormal situation, it periodically acquires signals detected from environmental sensors and beacons provided in the environment where the user performs work via the short-range wireless communication I / F 205. Then, the processor 201 periodically transmits the signals acquired from the environmental sensors and beacons to the server device 10.

[0022] In step S100, the specifying unit 601 specifies the work item of the work being performed by the user equipped with the terminal device 20. In the present embodiment, the specifying unit 601 specifies the work item of the work being performed by the user based on the position of the terminal device 20 (the position of the user). More specifically, the specifying unit 601 inquires of the terminal device 20 about the position of the terminal device 20. In response to the inquiry, the processor 201 of the terminal device 20 specifies the position (latitude, longitude, altitude) of the terminal device 20 via the position sensor and altimeter included in the sensor 204. However, the processor 201 may specify the position of the terminal device 20 by other methods. For example, when there is a device that transmits a beacon signal indicating the information of the position where the terminal device 20 exists around the terminal device 20, the processor 201 may receive this beacon signal and specify the position from the received beacon signal. The processor 201 transmits the specified position to the server device 10. The specifying unit 601 acquires the work item corresponding to the position transmitted from the terminal device 20 from the correspondence information between the position and the work item stored in the auxiliary storage device 103 in advance, and specifies the acquired work item as the work item of the user's work. After completion of the process of step S100, the specifying unit 601 advances the process to step S101. The process of step S100 is an example of a specifying step.

[0023] In step S101, the detection unit 602 specifies the detection sensitivity of each abnormal situation for the work item specified in step S100 from the sensitivity table 401 stored in the auxiliary storage device 103. After completion of the process of step S101, the specifying unit 601 advances the process to step S102.

[0024] In step S102, the detection unit 602 selects one from a plurality of different abnormal situations (falling, tumbling, impact, lying still, fatigue, high heart rate) of the detection target. Hereinafter, the abnormal situation selected in the immediately preceding step S102 is referred to as the selected abnormal situation. After the completion of the process in step S102, the specifying unit 601 advances the process to step S103. Note that when the detection sensitivity of the selected abnormal situation specified in step S101 is "OFF", after the completion of the process in step S102, the process advances to step S107.

[0025] In step S103, the detection unit 602 specifies an index corresponding to the selected abnormal situation from the reference value table 301. Then, the detection unit 602 acquires the value of the specified index. More specifically, the detection unit 602 operates as follows. When the selected abnormal situation is a fall, the detection unit 602 acquires, as the value of the index, the change values of the accelerations in the vertical and horizontal directions applied to the terminal device 20 during a predetermined period based on the acceleration information applied to the terminal device 20 received from the terminal device 20.

[0026] When the selected abnormal situation is a fall, the detection unit 602 acquires, as the value of the index, the converted value of the acceleration in the vertical direction applied to the terminal device 20 during a predetermined period based on the acceleration information applied to the terminal device 20 received from the terminal device 20. When the selected abnormal situation is an impact, the detection unit 602 acquires, as the value of the index, the scalar value of the composite vector of the three-axis accelerations applied to the terminal device 20 based on the acceleration information applied to the terminal device 20 received from the terminal device 20.

[0027] When the selected abnormal situation is lying still, the detection unit 602 acquires the following values based on the inclination of the terminal device 20 received from the terminal device 20 and the acceleration information applied to the terminal device 20. That is, the detection unit 602 acquires, as the value of the index, the period during which the inclination of the terminal device 20 is within a predetermined range corresponding to the work item of the work being performed by the user and the acceleration applied to the terminal device 20 is 0.

[0028] When the selected abnormal condition is fatigue, the detection unit 602 acquires, as the value of the index, the working duration of the user equipped with the terminal device 20 (the elapsed time from the start of the detection process of the abnormal condition). Further, the detection unit 602 requests the wet-bulb temperature, globe temperature, and dry-bulb temperature of the environment in which the user works from the terminal device 20. In response to the request, the processor 201 acquires the wet-bulb temperature, globe temperature, and dry-bulb temperature from the environmental sensor via the short-range wireless communication I / F 205 and transmits them to the server device 10. The detection unit 602 obtains a WBGT value based on the received wet-bulb temperature, globe temperature, and dry-bulb temperature.

[0029] When the selected abnormal condition is high heart rate, the detection unit 602 acquires, as the value of the index, the heart rate of the user received from the terminal device 20. After the completion of the process in step S103, the specifying unit 601 advances the process to step S104.

[0030] In step S104, the detection unit 602 acquires the reference value corresponding to the selected abnormal condition from the reference value table 301. When the selected abnormal condition is fatigue, the detection unit 602 acquires, from the reference value table 301, the reference value corresponding to the WBGT value specified in step S103. The detection unit 602 corrects the value of the acquired reference value according to the sensitivity of the detection of the selected abnormal condition specified in step S101. When the selected abnormal condition is a fall, the detection unit 602 corrects each of the two reference values.

[0031] More specifically, when the sensitivity of the selected abnormal condition is "standard", the detection unit 602 does not correct the reference value. Also, when the sensitivity of the selected abnormal condition is "slightly weak", the detection unit 602 corrects the reference value by multiplying it by a predetermined coefficient greater than 1. Further, when the sensitivity of the selected abnormal condition is "weak", the detection unit 602 corrects the reference value by multiplying it by a predetermined coefficient greater than the coefficient corresponding to "slightly weak". Note that the coefficients corresponding to "slightly weak" and "weak" sensitivity may be different values or the same value for each abnormal condition to be detected. After the completion of the process in step S104, the specifying unit 601 advances the process to step S105.

[0032] In step S105, the detection unit 602 determines whether the value of the index obtained in the immediately preceding step S103 is greater than or equal to the reference value corrected according to the sensitivity in the immediately preceding step S104. In addition, when the selected abnormal situation is a fall, if the values of both of the two indexes (the change value of the acceleration in the vertical direction and the change value of the acceleration in the horizontal direction) are greater than or equal to the corresponding reference values, the detection unit 602 determines that the value of the index is greater than or equal to the reference value.

[0033] If the detection unit 602 determines that the value of the index is greater than or equal to the reference value, it detects the selected abnormal situation and advances the process to step S106. Further, if the detection unit 602 determines that the value of the index is less than the reference value, it proceeds to step S107 on the assumption that no selected abnormal situation has occurred. The process of step S105 is an example of a detection step.

[0034] In step S106, the output control unit 603 outputs information indicating a warning against the occurrence of the selected abnormal situation to a predetermined output destination. In the present embodiment, the output control unit 603 transmits information indicating a warning against the selected abnormal situation to the information processing apparatus possessed by the administrator who manages the user, and causes this information to be displayed on the display unit of this information processing apparatus. The information indicating a warning against the abnormal situation is, for example, information indicating that the abnormal situation has occurred, information prompting a countermeasure against the occurrence of the abnormal situation, and the like. In addition, in the present embodiment, when the work item specified in step S100 is "harvesting work", the output control unit 603 transmits alert information indicating the possibility of a fall to the terminal device 20 and causes it to be displayed on the UI unit 206 to present a fall alert to the user. This is because when the harvested product is at a high place, the user may be negligent about watching their step. After completing the process of step S106, the output control unit 603 proceeds to step S107.

[0035] In step S107, the detection unit 602 determines whether all of a plurality of abnormal conditions to be detected have been selected as the selected abnormal condition in step S102. If the detection unit 602 determines that all of the plurality of abnormal conditions to be detected have been selected as the selected abnormal condition in step S102, the process proceeds to step S108. If the detection unit 602 determines that there is an abnormal condition that has not been selected as the selected abnormal condition in step S102 among the plurality of abnormal conditions to be detected, the process proceeds to step S102.

[0036] In step S108, the detection unit 602 determines whether it has received an instruction to end the detection process of the abnormal condition from the terminal device 20. If the detection unit 602 determines that it has received an instruction to end the detection process of the abnormal condition from the terminal device 20, the process of FIG. 7 is completed. Also, if the detection unit 602 determines that it has not received an instruction to end the detection process of the abnormal condition from the terminal device 20, it clears the history of being selected as the selected abnormal condition for the plurality of abnormal conditions to be detected, and the process proceeds to step S100.

[0037] As described above, with the configuration of the present embodiment, the server device 10 can contribute to improving the accuracy of detecting abnormal conditions by detecting abnormal conditions based on criteria corresponding to the work items of the work being performed by the user. Also, in the present embodiment, the server device 10 sets the detection sensitivity of an abnormal condition predetermined as an abnormal condition for which false detection is assumed to be equal to or lower than a predetermined value with respect to the work item being performed by the user. Thereby, the server device 10 can reduce the false detection of this abnormal condition. Also, the server device 10 sets the detection sensitivity of an abnormal condition predetermined as an abnormal condition for which the user's damage becomes significant to be equal to or higher than a predetermined value with respect to the work item of the work being performed by the user. Thereby, the server device 10 can reduce the non-detection of this abnormal condition.

[0038] (Second Embodiment) In this embodiment, the server device 10 detects an abnormal situation based on a judgment criterion corresponding to the workload of the work being performed by the user (hereinafter referred to as the work load), rather than the work item of the work being performed by the user. Hereinafter, the differences between the detection system 1 of this embodiment and the first embodiment will be described. The system configuration of the detection system 1 of this embodiment is the same as that of the first embodiment. Also, the hardware configurations of the server device 10 and the terminal device 20 of this embodiment are the same as those of the first embodiment.

[0039] The functional configuration of the server device 10 of this embodiment will be described. The processor 101 of this embodiment functions as a specifying unit 601, a detecting unit 602, and an output control unit 603, in the same manner as in the first embodiment. The specifying unit 601 of this embodiment specifies the workload of the work being performed by the user who has the terminal device 20. Also, the detecting unit 602 detects an abnormal situation of the user based on a judgment criterion corresponding to the workload specified by the specifying unit 601, via at least one of the sensors 204 of the terminal device 20 and external sensors (such as environmental sensors). The output control unit 603 is the same as that of the first embodiment.

[0040] In this embodiment, the server device 10 uses a sensitivity table 801 instead of the sensitivity table 401. The sensitivity table 801 is stored in the auxiliary storage device 103 in advance. The sensitivity table 801 of this embodiment will be described with reference to FIG. 8. The sensitivity table 801 of this embodiment shows the correspondence between the workload and the sensitivity of detecting each abnormal situation. The workload is a measure indicating that the greater the value, the greater the load in the work. In this embodiment, the value ranges from 0 to 100. In this embodiment, the values of the workload are ranked into four ranks: a rank of 25 or less, a rank greater than 25 and 50 or less, a rank greater than 50 and 75 or less, and a rank greater than 75 and 100 or less.

[0041] In this embodiment, for abnormal situations where false detection is assumed for the value of the workload, for predetermined abnormal situations, the detection sensitivity is set to be equal to or lower than a threshold value. For workload values in ranks of 25 or less and ranks greater than 25 and 50 or less, the detection sensitivity for fatigue is set to be "somewhat weak" or lower. This is because it is considered that the smaller the workload, the smaller the accumulation of fatigue.

[0042] Also, in this embodiment, for predetermined abnormal situations where the user's damage becomes significant for the value of the workload, the detection sensitivity is set to be equal to or higher than a threshold value. Also, for workload values in ranks of 25 or less and ranks greater than 25 and 50 or less, the detection sensitivity for high heart rate is set to be "standard" or higher. This is because the smaller the workload, the smaller the factors increasing the heart rate. Therefore, despite such a situation, the increase in the heart rate is highly likely to be due to an abnormality of the heart. However, in order to avoid the danger of high heart rate when the workload is large, the detection sensitivity for high heart rate may be set to increase as the workload increases. Thereby, the detection unit 602 can change the detection sensitivity of "fatigue" and "high heart rate" according to the value of the workload. In this embodiment, the detection unit 602 increases the detection sensitivity of "fatigue" and "high heart rate" as the value of the workload increases. Note that the detection unit 602 may also change the detection sensitivity according to the value of the workload for abnormal situations other than "fatigue" and "high heart rate". When the period in which the value of the workload is equal to or higher than a predetermined threshold value continues for a period equal to or longer than a predetermined period threshold value, the detection unit 602 assumes that the risk of industrial accidents increases due to the decrease in the physical strength and judgment of the worker, and for abnormal situations other than "fatigue" and "high heart rate" (for example, falls, trips, impacts, lying still, etc.), the detection sensitivity may also be increased to be equal to or higher than a predetermined threshold value. For example, the detection unit 602 may increase the detection sensitivity to the standard for those among falls, trips, impacts, and lying still whose detection sensitivity is less than the standard.

[0043] Using FIG. 9, the detection process of the abnormal situation of the present embodiment will be described. Below, the differences from the process of FIG. 7 among the processes of FIG. 9 will be described. The process of FIG. 9 is different from the process of FIG. 7 in that it includes the processes of step S200 and step S201 instead of the processes of step S100 and step S101. In step S200, the specifying unit 601 specifies the workload of the work being performed by the user based on the user's heart rate in the immediately preceding predetermined period acquired from the terminal device 20. If the user's rest period is included within this predetermined period, the specifying unit 601 specifies the workload based on the user's heart rate in the period after the rest period. In the present embodiment, the specifying unit 601 obtains the average heart rate of the user for each fixed section (for example, a section of a predetermined number of seconds, etc.) within the predetermined period (or the period after the rest period). Then, the specifying unit 601 determines whether the average heart rate is equal to or greater than a predetermined threshold for each section. The specifying unit 601 specifies the workload by multiplying the number of sections in which the average heart rate is equal to or greater than the predetermined threshold by a predetermined coefficient. After completing the process of step S200, the specifying unit 601 advances the process to step S201.

[0044] In step S201, the detection unit 602 specifies the detection sensitivity of each abnormal situation corresponding to the workload specified in step S200 from the sensitivity table 801 showing the correspondence between the workload and the detection sensitivity of the abnormal situation.

[0045] As described above, with the configuration of the present embodiment, the server device 10 can contribute to improving the accuracy of detecting an abnormal situation by detecting the abnormal situation based on the judgment criterion according to the workload of the work being performed by the user. Also, in the present embodiment, the server device 10 sets the detection sensitivity to a value equal to or less than a predetermined value for an abnormal situation that is assumed to be misdetected with respect to the workload of the work being performed by the user. Thereby, the server device 10 can reduce the misdetection of this abnormal situation. Further, the server device 10 increases the detection sensitivity to a predetermined abnormal state, which is an abnormal state in which the user's damage becomes serious, with respect to the work load of the work being performed by the user to a value equal to or higher than a predetermined value. Thereby, the server device 10 can reduce the undetected of this abnormal state.

[0046] (Third Embodiment) In the present embodiment, the server device 10 detects an abnormal state based on a work item of the work being performed by the user and a determination criterion corresponding to the work load of the work being performed by the user. Hereinafter, differences from the first embodiment will be described for the detection system 1 of the present embodiment. The system configuration of the detection system 1 of the present embodiment is the same as that of the first embodiment. Further, the hardware configurations of the server device 10 and the terminal device 20 of the present embodiment are the same as those of the first embodiment.

[0047] The functional configuration of the server device 10 of the present embodiment will be described. The processor 101 of the present embodiment functions as a specifying unit 601, a detecting unit 602, and an output control unit 603 in the same manner as in the first embodiment. The specifying unit 601 of the present embodiment specifies the work item and the work load of the work being performed by the user including the terminal device 20. Further, the detecting unit 602 detects an abnormal state of the user based on a determination criterion corresponding to the work item and the work load specified by the specifying unit 601. The output control unit 603 is the same as that of the first embodiment.

[0048] In the present embodiment, the server device 10 uses sensitivity tables 1001 and 1002 instead of the sensitivity table 401. The sensitivity tables 1001 and 1002 are stored in the auxiliary storage device 103 in advance. The sensitivity tables 1001 and 1002 of the present embodiment will be described with reference to FIG. 10. The sensitivity table 1001 of the present embodiment is a table showing the correspondence between the work item and the detection sensitivity of falling, toppling, impact, and lying still. Further, the sensitivity table 1002 is a table showing the correspondence between the work load and the detection sensitivity of fatigue and high heart rate.

[0049] Using FIG. 11, the detection process of the abnormal situation of the present embodiment will be described. Below, among the processes of FIG. 11, the points different from the process of FIG. 7 will be described. The process of FIG. 11 is different from the process of FIG. 7 in that it includes the processes of step S300 and step S301 instead of the processes of step S100 and step S101. In step S300, the specifying unit 601 specifies the work items of the work performed by the user by the same process as in the first embodiment. Further, the specifying unit 601 specifies the work load of the work performed by the user by the same process as in the second embodiment.

[0050] In step S301, the detection unit 602 specifies the detection sensitivity of each abnormal situation corresponding to the work item and work load specified in step S100 from the sensitivity tables 1001 and 1002.

[0051] As described above, with the configuration of the present embodiment, the server device 10 can contribute to improving the accuracy of detecting abnormal situations by detecting abnormal situations based on judgment criteria according to the work items and work loads of the work being performed by the user.

[0052] (Fourth Embodiment) In the present embodiment, the server device 10 detects an abnormal situation based on a judgment criterion according to the user's means of movement. Below, the points different from the first embodiment regarding the detection system 1 of the present embodiment will be described. The system configuration of the detection system 1 of the present embodiment is the same as that of the first embodiment. Also, the hardware configurations of the server device 10 and the terminal device 20 of the present embodiment are the same as those of the first embodiment. In the present embodiment, the abnormal situations to be detected include tipping, falling, impact, lying still, fatigue, high heart rate, and in addition, moving body tilt. Moving body tilt is an abnormal situation in which a moving body (bicycle, automobile, forklift, heavy machinery, etc.) used by the user is tilted beyond a certain degree and there is a possibility of tipping. In the present embodiment, the moving body that the user can use is equipped with an inclination sensor, an acceleration sensor, and an internal camera.

[0053] In this embodiment, the server device 10 uses a reference value table 1201 instead of the reference value table 301. The reference value table 1201 is stored in the auxiliary storage device 103 in advance. The reference value table 1201 of this embodiment will be described with reference to FIG. 12. In the example of FIG. 12, the reference value table 1201 includes information on indicators and reference values for abnormal situations of vehicle body overturning, in addition to various types of information in the example of FIG. 3. The indicator used for detecting the inclination of the moving body is the inclination of the moving body detected by an inclination sensor provided in the moving body.

[0054] Also, in this embodiment, the server device 10 uses a sensitivity table 1301 instead of the sensitivity table 401. The sensitivity table 1301 is stored in the auxiliary storage device 103 in advance. The sensitivity table 1301 of this embodiment will be described with reference to FIG. 13. The sensitivity table 1301 of this embodiment shows the correspondence between the means of movement that the user can take and the sensitivity of detecting each abnormal situation. In this embodiment, it is assumed that the means of movement that the user can take are walking, bicycle, passenger cart, automobile, motorcycle, truck, excavator, tractor, and torpedo car. However, as another example, some of these may not be included, or other means of movement such as a forklift may be included.

[0055] In this embodiment, the sensitivity of detecting an abnormal situation that is predetermined as an abnormal situation in which false detection is assumed to occur during work is set to be equal to or lower than a predetermined threshold value (for example, "slightly weak", "weak", etc.). For example, when the user's means of movement is other than walking or bicycle, it is not assumed that the user will fall or trip. Therefore, when the user's means of movement is other than walking or bicycle, it is assumed that if a fall or trip is detected, it is a false detection. Therefore, in this embodiment, the sensitivity of detecting a fall or trip for means of movement other than walking and bicycle is set to be equal to or lower than a predetermined value (in this embodiment, "weak"). In the example of FIG. 13, for a passenger cart, automobile, motorcycle, truck, excavator, tractor, and torpedo car, since false detection of a fall or trip is not assumed, the sensitivity of detecting a fall or trip is set to be "weak" or lower.

[0056] Also, when a situation that can be confused with an abnormal situation is likely to occur during work, false detection of an abnormal situation is assumed. Therefore, in the present embodiment, the detection sensitivity for such an abnormal situation is set to be equal to or lower than a predetermined threshold value (for example, "slightly weak", "weak", etc.). When riding on some moving object, an acceleration is applied to the user when starting or stopping. This acceleration can be confused with the impact applied to the user. Therefore, it is assumed that the impact may be falsely detected. Therefore, in the present embodiment, for means of movement other than walking, the detection sensitivity of the impact is set to be equal to or lower than a predetermined threshold value. In the example of FIG. 13, for a bicycle, a riding cart, an automobile, a motorcycle, a truck, a shovel car, a tractor, and a torpedo car, the detection sensitivity of the impact is set to be "slightly weak" or lower.

[0057] Also, in the present embodiment, the detection sensitivity for an abnormal situation predetermined as an abnormal situation in which significant damage to the user is assumed during work is set to be equal to or higher than a predetermined threshold value. When the user is riding on a moving object such as an automobile, if the user is in a state of lying still, it is assumed that the moving object will move unexpectedly and lead to an accident, resulting in significant damage to the user. Therefore, when the user is riding on such a moving object, it is desired to prevent the undetected state of lying still as much as possible. In the example of FIG. 13, for a riding cart, an automobile, a motorcycle, a truck, a shovel car, a tractor, and a torpedo car, the detection sensitivity of lying still is set to be "standard" or higher.

[0058] The functional configuration of the server device 10 of the present embodiment will be described. The processor 101 of the present embodiment functions as a specifying unit 601, a detecting unit 602, and an output control unit 603 in the same manner as in the first embodiment. The specific part 601 of this embodiment identifies the means of movement of the user who has the terminal device 20. Further, the detection unit 602 detects an abnormal situation of the user based on a judgment criterion corresponding to the workload identified by the specific part 601 via at least one of the sensor 204 and an external sensor. The output control unit 603 is the same as in the first embodiment. Using FIG. 14, the detection process of the abnormal situation of this embodiment will be described. Below, the differences from the process of FIG. 7 among the processes of FIG. 14 will be described. The process of FIG. 14 is different from the process of FIG. 7 in that it includes the processes of step S400 and step S401 instead of the processes of step S100 and step S101.

[0059] In step S400, the specific part 601 identifies the means of movement of the user. In this embodiment, when communication (two-way communication or one-way communication) is performed between the terminal device 20 that the user has and the communication device provided in the moving body, the specific part 601 identifies this moving body as the means of movement of the user. More specifically, the specific part 601 does the following. In this embodiment, each moving body that the user can board is provided with a communication device that emits a predetermined beacon signal that can be received in the vicinity of the moving body. When the processor 201 of the terminal device 20 receives a beacon signal from the communication device provided in the moving body via the short-range wireless communication I / F 205, the received beacon signal is transmitted to the server device 10. When the specific part 601 receives a beacon signal, based on the received beacon signal, it identifies the moving body equipped with the communication device that emitted this beacon signal, and identifies the identified moving body as the means of movement of the user. Also, when the specific part 601 does not receive any beacon signal, it identifies walking as the means of movement of the user.

[0060] Note that when the specific part 601 identifies a predetermined moving body as the means of movement of the user, it periodically acquires the information on the inclination and acceleration detected via the inclination sensor and the acceleration sensor provided in the identified moving body, and the image captured by the internal camera of the moving body. After the completion of the process in step S400, the specific unit 601 advances the process to step S401.

[0061] In step S401, the detection unit 602 specifies the detection sensitivity of each abnormal situation corresponding to the moving means specified in the immediately preceding step S400 from the sensitivity table 1301. In step S103 of the present embodiment, when the moving means of the user is a predetermined moving body, the detection unit 602, based on the value of the acceleration detected via the acceleration sensor provided in the moving body, obtains the value of the abnormal situation: an index of impact (the scalar value of the composite vector of the three-axis accelerations detectable by the acceleration sensor). However, even when the moving means of the user is a predetermined moving body, the detection unit 602 may obtain the value of the abnormal situation: an index of impact based on the value of the acceleration detected via the acceleration sensor of the terminal device 20.

[0062] Also, in the present embodiment, when the moving means of the user is a predetermined moving body, the detection unit 602 performs detection of an abnormal situation based on the signal detected via the sensor provided in the moving body. In the present embodiment, in step S103, the detection unit 602 obtains the value of the abnormal situation: an index of moving body inclination based on the value of the inclination detected via the inclination sensor, and detects the moving body inclination based on the obtained value. Further, in step S103, when the moving means of the user is a predetermined moving body, the detection unit 602 obtains the value of the abnormal situation: an index of lying still and immobile as follows. The detection unit 602 obtains the following values based on the images continuously captured in time series by the internal camera of the moving body. That is, the detection unit 602 obtains the period during which the user has remained stationary while taking a posture different from the predetermined driving posture (the posture of holding the steering wheel and looking ahead) (for example, the posture of releasing the hand from the steering wheel, the posture of lying prone on the steering wheel, etc.). Then, the detection unit 602 detects lying still and immobile using the obtained value of the period.

[0063] Also, in step S106 of the present embodiment, when the moving means is a predetermined moving body and the selected abnormal situation is an impact, the output control unit 603 outputs information indicating a warning against sudden braking as a warning against the impact.

[0064] Further, in the present embodiment, the detection unit 602 detects a user's dangerous driving based on an image of an in-vehicle camera of the moving body. When the user continues in a posture different from the predetermined driving posture for a predetermined period (for example, 3 seconds, 5 seconds, etc.), the detection unit 602 outputs information indicating a warning against dangerous driving to a predetermined output destination (for example, the terminal device 20, the display unit of the moving body, the server device 10, the information processing device of the administrator, etc.). Further, the detection unit 602 stores an image of the state of dangerous driving in the auxiliary storage device 103. Thereby, the server device 10 can contribute to the analysis of the situation during dangerous driving.

[0065] As described above, with the configuration of the present embodiment, the server device 10 can detect an abnormal situation according to the situation where the user is using different moving means by detecting an abnormal situation based on a judgment criterion corresponding to the user's moving means, and can contribute to the improvement of the accuracy of the abnormal situation. Further, in the present embodiment, the server device 10 sets the detection sensitivity to a value equal to or less than a predetermined value for a predetermined abnormal situation with respect to the user's moving means as an abnormal situation in which false detection is assumed. Thereby, the server device 10 can reduce the false detection of this abnormal situation. Also, for a predetermined abnormal situation with respect to the user's moving means as an abnormal situation in which the user's damage becomes serious, the server device 10 sets the detection sensitivity to a value equal to or greater than a predetermined value. Thereby, the server device 10 can reduce the non-detection of this abnormal situation.

[0066] Further, in the present embodiment, when the moving means is a predetermined moving body, the detection unit 602 is assumed to obtain a value of an indicator of lying still based on an image captured by the in-vehicle camera of the moving body. The period during which there is no movement of the user can be obtained more accurately from the image. As a result, the detection unit 602 can detect the user's lying still more accurately.

[0067] (Supplementary Note) In each of the above embodiments, the server device 10 was set to detect, as abnormal situations, falls, collapses, impacts, lying still, fatigue, and high heart rates. However, the server device 10 may not detect at least some of these abnormal situations, or may detect other abnormal situations (such as gas leakage, excessive decrease in heart rate, high stress, etc.). For example, the sensor 204 may include a gas sensor for detecting gas. In this case, the processor 201 of the terminal device 20 detects the gas concentration. Then, the processor 101 may acquire the gas concentration from the terminal device 20 via the gas sensor, and detect gas leakage when the acquired concentration is equal to or higher than a reference value. Also, for example, the processor 201 of the terminal device 20 may acquire the gas concentration detected by an external device (such as a gas detector) equipped with a gas sensor from this external device via the short-range wireless communication I / F 205, and transmit the acquired gas concentration to the server device 10. Also, for example, the processor 101 may detect high stress when the user's heart rate is equal to or higher than a reference value.

[0068] Also, in each of the above embodiments, the server device 10 was set to use, as an index for detecting an abnormal situation, an index such that the degree of the abnormal situation increases as the value of the index increases. However, the server device 10 may use, as an index for detecting an abnormal situation, an index such that the degree of the abnormal situation increases as the value of the index decreases (for example, the reciprocal of the index in each of the above embodiments, the heart rate when detecting an abnormal situation where the heart rate excessively decreases such as cardiac arrest, etc.). In that case, in step S104, the detection unit 602 may correct the reference value so that it becomes smaller as the sensitivity decreases, according to the sensitivity. Then, in step S105, the detection unit 602 may detect an abnormal situation when the value of the index is equal to or lower than the reference value. Thereby, the server device 10 can detect an abnormal situation according to the sensitivity even when using an index such that the degree of the abnormal situation increases as the value of the index decreases.

[0069] Also, in each of the above-described embodiments, it is assumed that the working duration of the user equipped with the terminal device 20 is used as an index for detecting an abnormal situation: fatigue. However, other indices may be used as an index for detecting an abnormal situation: fatigue. For example, the stress value of the user may be used as an index for detecting an abnormal situation: fatigue. Here, the stress value is an index value that becomes higher as it is estimated that the user is feeling stress. It is known that the sympathetic nerve is activated as the user feels more stress. Therefore, for example, in step S103, the detection unit 602 may estimate the degree of activation of the sympathetic nerve from the heart rate detected by the heart rate sensor included in the sensor 204, and obtain this as the stress value. Specifically, the detection unit 602 first measures the power spectral density in order to extract the periodic structure from the time-series data of the heart rate fluctuations. The power spectral density includes a high-frequency fluctuation component (HF component) and a low-frequency component (LF component). The detection unit 602 obtains the value obtained by summing the intensities of the LF component region (from 0.05 Hz to 0.15 Hz) and the HF component region (from 0.15 Hz to 0.40 Hz) as the value of the LF component and the value of the HF component, respectively. Then, the detection unit 602 may obtain (value of LF component) / (value of HF component) as the stress value.

[0070] In a relaxed state, that is, when the parasympathetic nerve is activated, the HF component reflecting the respiratory fluctuation and the LF component reflecting the blood pressure fluctuation appear. On the other hand, in a stressed state, that is, when the sympathetic nerve is activated, the LF component appears while the HF component decreases. Therefore, the greater the stress, the greater the stress value.

[0071] In each of the above-described embodiments, the sensor 204 includes, in this embodiment, an acceleration sensor that detects acceleration in three axial directions, an inclination sensor that detects the inclination of the terminal device 20, a camera, a heart rate sensor that detects the user's heart rate, a position sensor that receives GNSS signals and detects the position, and an altimeter. However, the sensor 204 may not include at least a part of these. For example, the sensor 204 may not include an altimeter. In this case, the processor 101 may acquire altitude information from an altimeter provided in the environment where the user performs work.

[0072] In each of the above-described embodiments, the server device 10 sets the detection sensitivity for an abnormal situation that is predefined for any one of the work item, work load, and user's means of movement of the work being performed by the user, and for which false detection is assumed, to be equal to or lower than a predefined threshold value. However, the server device 10 may set the detection sensitivity for an abnormal situation that is predefined for any one of the work item, work load, and user's means of movement of the work being performed by the user, and for which false detection is assumed, as follows. That is, the server device 10 may set the detection sensitivity for this abnormal situation to be lower than when false detection of this abnormal situation is not assumed. For example, the server device 10 may set the detection sensitivity for a work item where false detection of a fall is assumed: the detection sensitivity for a fall in office work, to be lower than the detection sensitivity for a work item where false detection of a fall is not assumed: the detection sensitivity for a fall in high-place work.

[0073] In addition, in each of the above-described embodiments, the output control unit 603 outputs warning information regarding the detected abnormal situation. The output control unit 603 may switch the display mode of the warning information according to the degree of severity of the detected abnormal situation. For example, the output control unit 603 may obtain, as a measure indicating the severity of the abnormal situation, the value of the difference obtained by subtracting the reference value from the value of the index corresponding to the abnormal situation, and switch the display mode of the warning information according to the obtained measure. For example, the output control unit 603 may switch the content of the warning information to be output according to whether the obtained measure is greater than or equal to the threshold value. For example, if the obtained measure is greater than or equal to the threshold value, the output control unit 603 may output information indicating that the situation is more serious than when it is less than the threshold value. Further, when the obtained measure is greater than or equal to the threshold value, the output control unit 603 may display the warning information in a color different from that when the measure is less than the threshold value. Further, when the obtained measure is greater than or equal to the threshold value, the output control unit 603 may output a different voice as the warning information than when the measure is less than the threshold value. Further, the output control unit 603 may receive a response indicating that the warning has been confirmed from the output destination of the information indicating the warning. Further, when the output control unit 603 does not receive this response within a predetermined period from the output of the information indicating the warning, it may notify a predetermined output destination (such as the police, fire department, etc.) of the information indicating the warning regarding the abnormal situation. Thereby, the server device 10 can improve the safety of the user.

[0074] In addition, in each of the above-described embodiments, the output control unit 603 outputs information indicating a warning regarding the abnormal situation to the information processing device provided for the administrator. However, the output control unit 603 may output the information indicating the warning regarding the abnormal situation to other output destinations. For example, the output control unit 603 may output this information to the terminal devices 20 of other users existing within a predetermined range centered on the user in whom the abnormal situation has occurred. Further, the output control unit 603 may output this information to the terminal device 20 provided for the user in whom the abnormal situation has occurred. For example, the output control unit 603 may transmit information indicating a warning regarding the occurrence of a selected abnormal situation (for example, information indicating a recommendation to take a break when the abnormal situation is fatigue, etc.) to the terminal device 20 of the user and cause the UI unit 206 to display this information. In addition, the output control unit 603 may change the output destination of the information indicating a warning according to the type of abnormal situation detected by the detection unit 602. If the abnormal situation detected by the detection unit 602 is fatigue, the output control unit 603 outputs warning information to the user's terminal device 20. If the abnormal situation detected by the detection unit 602 is a fall, the output control unit 603 may output warning information to the terminal devices 20 of other users present around the user, the information processing device of the administrator, etc. Thereby, the server device 10 can present a warning of the abnormal situation to the counterpart corresponding to the occurrence of each abnormal situation. Also, in each of the above-described embodiments, the output control unit 603 outputs by causing the display unit to display the information indicating a warning against the abnormal situation. However, the output control unit 603 may output the information indicating a warning against the abnormal situation in other modes. For example, the output control unit 603 may output the information indicating a warning against the abnormal situation as voice output via a speaker. Also, the output control unit 603 may output the information indicating a warning against the abnormal situation by vibrating a vibrator or the like, or may output the information indicating a warning against the abnormal situation by causing a lamp such as a rotating lamp to emit light.

[0075] Also, in each of the above-described embodiments, the server device 10 detects an abnormal situation of the user based on a judgment criterion corresponding to at least one of the work item and the work load of the work being performed by the user and the user's means of movement. However, the server device 10 may detect an abnormal situation of the user based on a judgment criterion corresponding to both at least one of the work item and the work load of the work being performed by the user and the user's means of movement.

[0076] For example, the detection unit 602 may be configured as follows. That is, similar to the third embodiment, the detection unit 602 obtains the detection sensitivity for each abnormal situation, and similar to the fourth embodiment, identifies the user's means of movement. Then, when the identified means of movement is walking or cycling, the detection unit 602 does not update the detection sensitivity for each abnormal situation. When the identified means of movement is a vehicle or a work vehicle, the detection unit 602 may update the sensitivity for a predetermined abnormal situation (e.g., falling, toppling, etc.) to be equal to or lower than a predetermined threshold value. Further, the detection unit 602 may identify the user's means of movement at regular intervals and update the detection sensitivity for abnormal situations according to the identified means of movement.

[0077] Also, for example, the detection unit 602 may be configured as follows. The detection unit 602 obtains the detection sensitivity for each abnormal situation in the same manner as in the fourth embodiment. Then, the detection unit 602 obtains the workload of the work being performed by the user in the same manner as in the second embodiment. If the obtained workload is equal to or greater than a predetermined threshold value, the detection unit 602 may improve the detection sensitivity for each obtained abnormal situation.

[0078] In the first and third embodiments described above, the specifying unit 601 specifies the work item based on the user's position. However, the specifying unit 601 may specify the work item of the work being performed by the user equipped with the terminal device 20 by other methods. For example, the specifying unit 601 obtains an image of the surroundings of the terminal device 20 (e.g., an image of the user, an image of the environment around the user, etc.) captured by the camera of the terminal device 20. The specifying unit 601 obtains the image of the surroundings of the terminal device 20 by requesting the terminal device 20 to provide the image of the surroundings of the terminal device 20. The processor 201 of the terminal device 20 captures an image of the surroundings of the terminal device 20 via the camera of the sensor 204 in response to the request and transmits the captured image to the server device 10. However, the specifying unit 601 may obtain an image of the surroundings of the terminal device 20 captured by a camera different from the camera of the terminal device 20. For example, the specifying unit 601 may obtain an image captured by another camera (e.g., a helmet-mounted camera, a body camera, etc.) equipped by the user equipped with the terminal device 20, an image captured by a fixed camera provided around the user, etc.

[0079] The specific unit 601 may specify work items based on the acquired image. For example, when the specific unit 601 recognizes a tool (such as an agricultural tool, tool, device, vehicle, etc.) used for the work of a specific work item from the image, the work item of the work using the recognized tool may be specified as the work item of the work performed by the user.

[0080] Also, for example, the specific unit 601 may acquire information of a different type from the user's position (for example, information on the time during processing, etc.), and specify the work item of the user's work from the correspondence information between this type of information and the work item. For example, when the work item of the work performed by the user is determined according to the time (for example, summer: weeding work, autumn: harvesting work, etc.), the specific unit 601 may specify the work item according to the time of processing.

[0081] Also, for example, when a work schedule is determined for each user, the specific unit 601 may do the following. That is, the specific unit 601 may acquire the identification information of the user from the terminal device 20, specify the schedule of the user with the acquired identification information, and specify the work item of the work performed by the user at the time of processing. Also, for example, the specific unit 601 may inquire about the work item of the work performed by the user to the terminal device 20. The processor 201 makes an inquiry about the work item to the user via the UI unit 206 in response to the inquiry. When the processor 201 receives an input of a work item (such as a touch input, voice input, gesture input, etc.) from the user via the UI unit 206, it transmits the input work item to the server device 10. The specific unit 601 may specify the work item received from the terminal device 20 as the work item of the work performed by the user.

[0082] Also, for example, when the processor 201 of the terminal device 20 reads the code information (such as two-dimensional code, barcode, chameleon code, color bit, etc.) attached to the tool used for the work via the camera of the sensor 204, the read code information may be transmitted to the server device 10. The specifying unit 601 may specify the work item of the work performed by the user based on this code information. For example, the specifying unit 601 may specify the work item of the work using the tool corresponding to this code. Also, for example, when the processor 201 of the terminal device 20 communicates with a short-range communication device (such as an RFID chip, an NFC card, etc.) attached to the tool used for the work via the communication I / F 207, the information of the tool attached with the short-range communication device that has performed the communication may be transmitted to the server device 10. The specifying unit 601 may specify the work item of the work performed by the user based on this tool information. For example, the specifying unit 601 may specify the work item of the work using this tool.

[0083] Also, in the above-described second and third embodiments, the specifying unit 601 is assumed to specify the work load of the work being performed by the user based on the user's heart rate. However, the specifying unit 601 may specify the work load of the work being performed by the user in other manners. For example, the specifying unit 601 specifies the work item of the work being performed by the user. Here, it is assumed that the correspondence information between the work item and the work load in a certain period of the work is stored in advance in the auxiliary storage device 103. The specifying unit 601 may specify, as the work load of the work being performed by the user, the value obtained by multiplying the work load in a certain period corresponding to the work item specified from this correspondence information by the period for which the user has continued the work.

[0084] Also, for example, it is assumed that the correspondence information between the information of a predetermined type (such as the location, time, user identification information, etc. of the work) and the work load is stored in advance in the auxiliary storage device 103. In this case, the specifying unit 601 may acquire the information of this predetermined type from the terminal device 20, and acquire, as the work load of the work being performed by the user, the work load corresponding to the acquired information from this correspondence information. Also, for example, assume that the user's schedule is predetermined and the workload for each task is also predetermined. In this case, the specifying unit 601 may specify the workload of the task that the user is performing based on this information.

[0085] Also, the specifying unit 601 may correct the workload based on weather information (temperature, humidity, illuminance, WBGT value, UV index, wind speed, etc.), environmental information (gas concentration, radioactivity, photochemical oxidant concentration, etc.), and the like. For example, if the WBGT value is equal to or greater than a predetermined value, the specifying unit 601 may correct the workload by multiplying it by a predetermined coefficient greater than 1. Also, if the temperature is equal to or less than a predetermined value, the specifying unit 601 may correct the workload by multiplying it by a predetermined coefficient less than 1. Also, for example, the specifying unit 601 may accept the specification of the value of the workload of the task that the user is performing. For example, the specifying unit 601 may receive, from the terminal device 20, the value of the workload input by the user in the terminal device 20.

[0086] Also, in the above-described fourth embodiment, the mobile body is provided with a communication device that transmits a beacon signal, and when the terminal device 20 receives this beacon signal, the specifying unit 601 specifies the mobile body provided with the communication device that transmits this beacon signal as the user's means of movement. However, the specifying unit 601 may specify the user's means of movement in other ways. For example, each mobile body may be provided with a communication device different from the communication device that transmits a beacon signal. For example, each mobile body may be provided with a communication device such as an RFID tag or an NFC card. In that case, when the processor 201 of the terminal device 20 receives predetermined information from these communication devices via the communication I / F 207, it transmits the received information to the server device 10. When receiving this information, the specifying unit 601 may specify the mobile body provided with the communication device that transmitted this information based on the received information, and specify the specified mobile body as the user's means of movement.

[0087] Also, for example, when the processor 201 of the terminal device 20 reads code information (such as two-dimensional code, barcode, chameleon code, color bit, etc.) attached to the moving body via the camera of the sensor 204, the read code information may be transmitted to the server device 10. The specifying unit 601 may specify the moving body to which this code is attached based on this code information, and may specify the specified moving body as the user's means of movement.

[0088] Also, for example, the specifying unit 601 may specify the user's means of movement based on an image of the surroundings of the terminal device 20 captured by a camera of the terminal device 20, a camera equipped with the user, an external fixed camera, an internal camera of the moving body, or the like. When the specifying unit 601 recognizes at least a part of the moving body (for example, appearance, internal facilities (seat, handle, etc.)) from the image of the surroundings of the terminal device 20, this moving body may be specified as the user's means of movement.

[0089] Also, for example, the specifying unit 601 may specify the user's means of movement based on the sound around the terminal device 20. For example, when the specifying unit 601 recognizes a predetermined sound (such as engine sound) generated when the moving body moves from the ambient sound around the terminal device 20 recorded by the microphone of the terminal device 20, this moving body may be specified as the user's means of movement.

[0090] Also, for example, the specifying unit 601 may specify the user's means of movement based on the user's speed. For example, the specifying unit 601 obtains the speed of the terminal device 20 from the temporal change of the position information of the terminal device 20, and if the obtained speed is equal to or higher than a predetermined threshold value (for example, 30 km / h), the user's means of movement may be specified as a predetermined moving body (for example, automobile, motorcycle).

[0091] Furthermore, the above-described apparatus, program, and method may be implemented as a single device or may be implemented by sharing components among a plurality of devices, and include various aspects. Also, it can be appropriately changed, such as part being software and part being hardware. Furthermore, the invention is also established as a recording medium for a program that controls the device. Of course, the recording medium for the program may be a magnetic recording medium, a semiconductor memory, or any recording medium developed in the future, and can be considered in exactly the same way.

Explanation of Signs

[0092] 1… Detection system, 10… Server device, 20… Terminal device, 30… Network, 101… Processor, 102… Main memory device, 103… Auxiliary storage device, 104 Communication I / F, 201… Processor, 202… Main memory device, 203… Auxiliary storage device, 204… Sensor, 205… Short-range wireless communication I / F, 206… UI unit, 207… Communication I / F, 301… Reference value table, 401… Sensitivity table, 801… Sensitivity table, 1001… Sensitivity table, 1002… Sensitivity table, 1201… Reference value table, 1301… Sensitivity table

Claims

1. A specifying unit that specifies the load of the work being performed by the user; A detection unit that detects a first type of abnormal situation and a second type of abnormal situation that are predetermined for the load specified by the specifying unit via a sensor provided to the user or around the user; and having: The sensitivity of detection of the first type of abnormal situation is set to increase as the load increases; The sensitivity of detection of the second type of abnormal situation is set to decrease as the load increases; The detection unit: Detects the first type of abnormal situation and the second type of abnormal situation according to the sensitivity of detection determined according to the load and the type of abnormal situation; An information processing apparatus that changes the sensitivity of detection to a higher value when the period in which the value of the load is equal to or greater than a threshold value continues for a period threshold value or more.

2. The information processing apparatus according to claim 1, wherein the specifying unit specifies the load based on the position of the user.

3. The information processing apparatus according to claim 1, wherein the specifying unit acquires information of a predetermined type, and specifies the load based on the acquired information and correspondence information between the information of the predetermined type and the load.

4. The information processing apparatus according to any one of claims 1 to 3, further comprising an output control unit that outputs warning information regarding the abnormal situation detected by the detection unit to a predetermined output destination.

5. The information processing apparatus according to claim 4, wherein the output control unit outputs the warning information to the output destination corresponding to the type of abnormal situation detected by the detection unit.

6. An information processing method executed by an information processing apparatus, A specifying step of specifying the load of the work being performed by the user; A detection step of detecting a first type of abnormal situation and a second type of abnormal situation predetermined for the load specified in the specific step via the user or a sensor provided around the user including The sensitivity of detecting the first type of abnormal situation is set to increase as the load increases, The sensitivity of detecting the second type of abnormal situation is set to decrease as the load increases, In the detection step, According to the sensitivity of detection determined according to the load and the type of abnormal situation, the first type of abnormal situation and the second type of abnormal situation are detected, An information processing method for changing the sensitivity of detection to a higher value when the period during which the value of the load is equal to or greater than a second threshold continues for a period threshold or more.

7. To a computer, A specific step of specifying the load of the work being performed by the user, A detection step of detecting a first type of abnormal situation and a second type of abnormal situation predetermined for the load specified in the specific step via the user or a sensor provided around the user causing it to execute, The sensitivity of detecting the first type of abnormal situation is set to increase as the load increases, The sensitivity of detecting the second type of abnormal situation is set to decrease as the load increases, In the detection step, According to the sensitivity of detection determined according to the load and the type of abnormal situation, the first type of abnormal situation and the second type of abnormal situation are detected, A program for changing the sensitivity of detection to a larger value when the period during which the value of the load is equal to or greater than a threshold continues for a period threshold or more.

Citation Information

Patent Citations

  • Emergency informing system

    JP2000194973A

  • Fall detecting method and fall rescuing device

    JP2004252618A

  • Device, system, method, and program for supporting health management

    JP2020149150A