Work management system, work management method, and program

Abstract

To accurately identify an anomaly caused by a worker.SOLUTION: A work management system includes: a first acquisition unit which acquires a video captured by an imaging apparatus provided so as to image a predetermined spatial range in a work site; a second acquisition unit which acquires biological state information to be obtained by detecting a predetermined state of a living body who serves as a worker in the work site; an anomaly determination unit which determines an anomaly based on the biological state information acquired by the second acquisition unit; a video acquisition unit which acquires, in response to an occurrence of an anomaly determined by the anomaly determination unit, a video for a predetermined period based on a time at which the anomaly occurred, as an anomaly response video, from the video acquired by the first acquisition unit; and an information processing unit which causes a storage unit to store anomaly occurrence status information indicating an occurrence status of the anomaly, including the anomaly response video acquired by the video acquisition unit.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a work management system, a work management method, and a program. [Background technology]

[0002] There is known a technology in which the operating state of a process is photographed and stored in a memory, and in response to a trigger signal being output from a detection device installed on the production line, video data recorded in the memory going back a predetermined time from the time the trigger signal was input is saved in a non-overwritable manner (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-122319 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, abnormalities occurring at work sites where production or other work is carried out may be caused not only by equipment on the production line, but also by workers. Considering this, it is preferable to be able to accurately identify abnormalities caused by workers.

[0005] In consideration of the above-mentioned problems, an object of the present invention is to enable an abnormality caused by an operator to be accurately detected. [Means for solving the problem]

[0006] One aspect of the present invention that solves the above-mentioned problems is a work management system that includes a first acquisition unit that acquires video captured by an imaging device that is configured to capture a predetermined spatial range at a work site; a second acquisition unit that acquires biological condition information obtained by detecting a predetermined state of a living body as a worker at the work site; an abnormality determination unit that makes a determination regarding an abnormality based on the biological condition information acquired by the second acquisition unit; a video acquisition unit that, in response to the abnormality determination unit determining that an abnormality has occurred, acquires video from the video acquired by the first acquisition unit for a predetermined period based on the time the abnormality occurred as an abnormality response video; and an information processing unit that stores abnormality occurrence status information in a memory unit, which includes the abnormality response video acquired by the video acquisition unit and indicates the occurrence status of the abnormality.

[0007] One aspect of the present invention is a work management method in a work management system, the work management method including: a first acquisition step in which a first acquisition unit acquires video captured by an imaging device configured to capture a predetermined spatial range at a work site; a second acquisition step in which a second acquisition unit acquires biological condition information obtained by detecting a predetermined state of a living body as a worker at the work site; an abnormality determination step in which an abnormality determination unit makes a determination regarding an abnormality based on the biological condition information acquired by the second acquisition step; a video acquisition step in which, in response to a determination that an abnormality has occurred by the abnormality determination step, the video acquisition unit acquires video of a predetermined period based on the time the abnormality occurred from the video acquired by the first acquisition step as an abnormality response video; and an information processing step in which an information processing unit stores abnormality occurrence status information in a memory unit, the abnormality occurrence status information including the abnormality response video acquired by the video acquisition step and indicating the occurrence status of the abnormality.

[0008] One aspect of the present invention is a program for causing a computer in a work management system to function as an information processing unit that includes a first acquisition unit that acquires video captured by an imaging device configured to capture a predetermined spatial range at a work site, a second acquisition unit that acquires biological condition information obtained by detecting a predetermined state of a living body as a worker at the work site, an abnormality determination unit that makes a determination regarding an abnormality based on the biological condition information acquired by the second acquisition unit, a video acquisition unit that, in response to the abnormality determination unit determining that an abnormality has occurred, acquires video from the video acquired by the first acquisition unit for a predetermined period based on the time the abnormality occurred as an abnormality response video, and an abnormality occurrence status information that indicates the occurrence status of the abnormality, including the abnormality response video acquired by the video acquisition unit, in a memory unit. [Effects of the Invention]

[0009] According to the present invention, an effect is obtained in that abnormalities caused by the worker can be accurately grasped. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of a work management system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of a functional configuration of a location management server according to the present embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of the functional configuration of an image and biological condition information management server according to the present embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a functional configuration of a work management server according to the present embodiment. [Figure 5] FIG. 4 is a diagram illustrating an example of abnormality occurrence status information according to the present embodiment. [Figure 6] 10 is a diagram illustrating an example of a procedure executed by the work management system according to the present embodiment in relation to storing abnormality occurrence status information in response to the occurrence of an abnormality. [Figure 7] FIG. 10 is a diagram illustrating an example of a procedure in which the work management system in this embodiment causes a target worker to create a report in response to the occurrence of an abnormality. [Figure 8] FIG. 10 is a diagram illustrating an example of a work management screen according to the present embodiment. [Figure 9] 10A and 10B are diagrams illustrating an example of a procedure executed by the work management system according to the present embodiment in relation to generating a work management screen. [Figure 10] 10A and 10B are diagrams illustrating an example of a procedure for the work management system according to the present embodiment to display a warning using a projector. DETAILED DESCRIPTION OF THE INVENTION

[0011] [Overall configuration example of a work management system] 1 shows an example of the overall configuration of a work management system according to this embodiment. The work management system according to this embodiment manages work at a work site WS based on abnormalities that occur in response to workers WK, such as work mistakes at the work site WS. The work site WS may be, for example, a factory where products are manufactured and processed. Although the figure shows one worker WK at the work site WS, there may be multiple workers WK at the work site WS.

[0012] The worker WK carries a transmitter 10 compatible with a positioning system used to measure the worker's current location. The transmitter 10 may be, for example, in the form of a card. The positioning system of this embodiment may be a system using UWB (Ultra Wide Band). The transmitter 10 may be configured to emit positioning radio waves compatible with UWB.

[0013] The worker WK also carries a biological condition sensor 20. The biological condition sensor 20 detects the biological condition of the worker WK and outputs the detected biological condition information. The biological condition here is obtained based on the living body of the worker WK and is not particularly limited as long as it can be used, for example, to determine the occurrence of an abnormality. The biological condition may be, for example, the worker WK's heart rate, blood pressure, etc. The measured values ​​of the heart rate and blood pressure may change suddenly due to, for example, an increase in stress caused by the worker WK making a work error. The biological condition may also be information indicating the worker WK's movement, for example, detected by an acceleration sensor. For example, if the worker WK makes an unusual movement, such as stumbling, falling, or making very quick movements to correct a mistake, the acceleration sensor detects an acceleration pattern different from normal.

[0014] The biological condition sensor 20 is connected to the network NW via the gateway 60, and is thereby able to transmit biological condition information indicating the detected biological condition to the video and biological condition information management server 400. The biological condition information transmitted by the biological condition sensor 20 is assigned a worker ID that identifies the corresponding worker WK.

[0015] In the following description, the biological condition sensor 20 is a wearable terminal such as a smart watch that is attached to the wrist of the worker WK, and a case will be taken as an example in which the heart rate is detected (measured) as biological condition information.

[0016] In the figure, the biological condition sensor 20 is connected to the network NW via a gateway 60. The biological condition sensor 20 is connected to the work management server 500 via the network NW so as to be able to communicate with the work management server 500. Note that the biological condition sensor 20 may be connected to the network NW without going through the gateway 60.

[0017] Furthermore, the worker WK carries a worker terminal 100. The worker terminal 100 is a terminal used by the worker WK. A work management application may be installed on the worker terminal 100. The work management application has a function of providing the worker WK with information about abnormalities that have occurred at the work site. Alternatively, the worker terminal 100 may be configured to achieve the same function as the work management application by accessing a work management website provided by the work management server 500 using a web browser. The following explanation will be given as an example of a case where the work management application is installed on the worker terminal 100.

[0018] In the figure, the worker terminal 100 is connected to the network NW via a gateway 60. The worker terminal 100 is connected to the work management server 500 via the network NW so that it can communicate with them. Note that the worker terminal 100 may be connected to the network NW without going through the gateway 60. The worker terminal 100 may be, for example, a smartphone or a tablet terminal.

[0019] Furthermore, cameras (an example of an imaging device) 40 are provided at predetermined positions in the work site WS. The cameras 40 are installed so as to capture images of predetermined imaging ranges (an example of spatial ranges) in the work site WS. The camera 40 is connected to the network NW via the gateway 60, and is thereby able to transmit captured images to the image / biological condition information management server 400. The images transmitted by the camera 40 are assigned a camera ID indicating the camera 40 that sent the images (or may be information indicating the imaging range of the camera 40 that sent the images).

[0020] Furthermore, a projector 50 is provided at each predetermined position in the work site WS. The projector 50 is installed so as to project an image onto the floor or wall at a predetermined location in the work site. The projector 50 is connected to the network NW via a gateway 60. The projector 50 displays the image under the control of the work management server 500.

[0021] The work site WS is also provided with an administrator terminal 200. The administrator terminal 200 is a terminal used, for example, by an administrator of the work site WS. A work management application may be installed on the administrator terminal 200, similar to the worker terminal 100. Note that different permissions may be set for the work management application installed on the worker terminal 100 and the work management application installed on the administrator terminal 200. The administrator terminal 200 may be connected to the network NW via the gateway 60, thereby being able to communicate with, for example, the work management server 500. Alternatively, the administrator terminal 200 may be connected to the network NW without going through the gateway 60. The administrator terminal 200 may be a smartphone, a tablet terminal, a personal computer, or the like.

[0022] The position management server 300 is a server that manages the positions of the workers WK at the work site WS. In this embodiment, the positions of the workers WK at the work site WS are measured by a positioning system using the position management server 300 and the transmitter 10 as follows. At the work site WS, one receiver 30 is fixedly installed at each of a plurality of predetermined positions. The plurality of receivers 30 are connected to a position management server 300 via a gateway 60 and a network NW, for example.

[0023] A transmitter 10 carried by a worker WK emits pulsed radio waves for positioning. The emitted radio waves are received by multiple receivers 30 located within the range of the radio waves. The receiver 30 that receives the radio waves from the transmitter 10 measures the time it takes for the radio waves transmitted from the transmitter 10 to arrive at the coordinates where the receiver 30 is located (signal arrival time), the strength of the received radio waves, and the like, and transmits measurement information including the measured signal arrival time and signal arrival angle to the location management server 300. The location management server 300 calculates the location of the transmitter 10 based on the signal arrival time and signal arrival angle included in each piece of measurement information received from the multiple receivers 30. In this embodiment, each of the locations of the transmitter 10 calculated in this manner is treated as the location measured for the worker WK who carries the transmitter 10. Furthermore, in order to associate the location measured by the location management server 300 with the worker WK, the transmitter 10 may transmit to the receiver 30 a transmitter ID that is uniquely associated with the worker WK. The receiver 30 transmits the measurement information including the received transmitter ID to the location management server 300. The location management server 300 can associate the measured location of the transmitter 10 with the transmitter ID. Since the worker ID of the worker WK is uniquely associated with the transmitter ID, it becomes possible to associate the measured location of the transmitter 10 with the worker WK.

[0024] Such a UWB positioning system is capable of measuring position with an accuracy of, for example, several tens of centimeters. Therefore, in this embodiment, too, it is possible to determine the positions of the worker WK and the cart TR at the work site WS with a high accuracy of several tens of centimeters.

[0025] In this embodiment, the location management server 300 may be configured to calculate the location in real time based on measurement information for each worker WK at the work site WS that is constantly transmitted from the receiver 30, and to obtain location information indicating the calculated location. The location management server 300 is connected to the video / biological condition information management server 400 and the work management server 500 via the network NW, and can transmit the location information acquired as described above to the video / biological condition information management server 400 or the work management server 500.

[0026] The video and biological condition information management server 400 stores the video transmitted from the biological condition sensor 20 for each worker WK. The video and biological condition information management server 400 may be configured to cyclically store video for a predetermined time period corresponding to one worker WK. The video and biological condition information management server 400 also stores the biological condition information transmitted from the camera 40. The video and biological condition information management server 400 may be configured to cyclically store biological condition information for a predetermined period of time corresponding to one worker WK.

[0027] The work management server 500 manages work at the work site WS by storing abnormality occurrence status information corresponding to each abnormality that occurs for each worker WK. In other words, the work management server 500 stores a history of abnormalities that have occurred due to the worker WK. The work management server 500 can also display information based on the abnormality occurrence status information on the worker terminal 100 and the administrator terminal 200.

[0028] [Example of location management server functional configuration] An example of the functional configuration of location management server 300 will be described with reference to Fig. 2. Location management server 300 may be configured with hardware such as a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and storage devices such as HDD (Hard Disk Drive) and SSD (Solid State Drive). The functions of location management server 300 shown in the figure are realized by a CPU provided in location management server 300 executing a program.

[0029] The location management server 300 in the figure includes a communication unit 301 and a control unit 302 . The communication unit 301 is a part that performs communication via the network NW. The control unit 302 executes various controls in the location management server 300. The control unit 302 includes an acquisition unit 321 (an example of a third acquisition unit). The acquisition unit 321 calculates a position corresponding to each transmitter ID based on the measurement information transmitted from each receiver 30, and acquires the calculated position. Since the transmitter ID is managed in association with the worker ID in, for example, the work management server 500, the position acquired by the acquisition unit 321 corresponding to each transmitter ID corresponds to each worker WK. The position acquired in this manner indicates the current position of the worker WK.

[0030] [Example of functional configuration of video and biological status information management server] An example of the functional configuration of the video and biological condition information management server 400 will be described with reference to Fig. 3. The video and biological condition information management server 400 may be configured to include, as hardware, a CPU, ROM, RAM, and storage devices such as HDD and SSD. The functions of the video and biological condition information management server 400 shown in the figure are realized by a CPU provided in the video and biological condition information management server 400 executing a program.

[0031] The image and biological condition information management server 400 in the figure includes a communication unit 401, a control unit 402, and a storage unit 403.

[0032] The communication unit 401 is a part that performs communication via the network NW.

[0033] The control unit 402 executes various controls in the video and biological condition information management server 400. The control unit 402 includes an acquisition unit 421 (an example of a first acquisition unit and a second acquisition unit), an abnormality determination unit 422, a video acquisition unit 423, and an information processing unit 424.

[0034] The acquisition unit 421 acquires the video transmitted from each of the cameras 40 and stores the acquired video in the video storage unit 431. The acquisition unit 421 may cyclically store video for a certain period of time in the video storage unit 431, overwriting the oldest video first. The acquiring unit 421 also acquires the biological condition information transmitted from each of the biological condition sensors 20.

[0035] The abnormality determination unit 422 may determine whether an abnormality has occurred based on the biological condition information acquired by the acquisition unit 421. Specifically, the abnormality determination unit 422 may determine that an abnormality has occurred when the heart rate, which is the biological condition information, transitions from a normal state to an abnormal state value. When such a change in the heart rate occurs, it can be assumed that the worker WK has made some kind of work error, which has caused sudden stress. Furthermore, the abnormality determination unit 422 may determine (identify) the date and time when it is determined that an abnormality has occurred as the date and time of the abnormality occurrence. When determining that an abnormality has occurred, the abnormality determination section 422 may also estimate the severity of the abnormality that has occurred based on, for example, the heart rate or other biological condition information. In addition, the abnormality determination unit 422 may be configured to make a determination regarding the occurrence of an abnormality using a trained model that has been trained to output a determination result regarding the occurrence of an abnormality in response to input of heart rate or other specified biological condition information.

[0036] In response to the abnormality determination unit 422 determining that an abnormality has occurred, the video acquisition unit 423 acquires video (abnormality response video) for a predetermined period based on the date and time of the abnormality occurrence from the video stored in the video storage unit 431 in which the worker WK who responded to the abnormality has been captured. As a specific example, the predetermined period of time that the anomaly response video corresponds to may be about one minute. Furthermore, the temporal relationship between the reference date and time of the anomaly occurrence and the predetermined period is not particularly limited. For example, the predetermined period may be set to have the same time width before and after the date and time of the anomaly occurrence, or may be a certain amount of time prior to the time of the anomaly occurrence.

[0037] The information processing unit 424 generates abnormality occurrence status information indicating the status of the occurrence of the abnormality in response to the determination that an abnormality has occurred by the abnormality determination unit 422. The abnormality occurrence status information includes the abnormality response video acquired by the video acquisition unit 423. The information processing unit 424 transmits the generated abnormality occurrence status information to the work management server 500 , thereby causing the abnormality occurrence status information storage unit 532 of the work management server 500 to store the abnormality occurrence status information.

[0038] The storage unit 403 stores various types of information corresponding to the video and biological condition information management server 400. The storage unit 403 includes a video storage unit 431 and a camera installation information storage unit 432.

[0039] The video storage unit 431 stores the video information transmitted from each of the cameras 40 for each worker WK. The video / biological condition information management server 400 may be configured to cyclically store video for a predetermined time period corresponding to one worker WK.

[0040] The camera installation information storage unit 432 stores camera installation information for each camera 40. The camera installation information is information relating to the installation of each camera 40. The camera installation information corresponding to one camera 40 may include a camera ID indicating the corresponding camera, a position where the corresponding camera 40 is installed in the work site WS, an imaging range of the corresponding camera 40 (which may be shown as a coordinate range in the work site WS, for example), etc.

[0041] [Example of functional configuration of work management server] An example of the functional configuration of the work management server 500 will be described with reference to Fig. 4. The work management server 500 may be configured with hardware such as a CPU, ROM, RAM, and storage devices such as HDDs and SSDs. The functions of the work management server 500 shown in Fig. 4 are realized by the CPU provided in the work management server 500 executing a program.

[0042] The work management server 500 in the figure includes a communication unit 501, a control unit 502, and a storage unit 503.

[0043] The communication unit 501 is a part that performs communication via a network.

[0044] The control unit 502 executes various controls in the work management server 500. The control unit 502 includes a presentation unit 521. The presentation unit 521 performs processing to present information on the worker terminal 100 and the manager terminal 200 based on the abnormality occurrence status stored in the abnormality occurrence status information storage unit 532 .

[0045] The storage unit 503 stores various types of information corresponding to the work management server 500. The storage unit 503 includes a worker information storage unit 531, an abnormality occurrence status information storage unit 532, a work site map storage unit 533, and a projector installation information storage unit 534.

[0046] The worker information storage unit 531 stores worker information for each worker WK. The worker information corresponding to one worker may include the worker ID, the transmitter ID of the transmitter 10 held by the corresponding worker WK, the worker's name, contact information (email address, telephone number, etc.), age, gender, department in charge, work schedule, etc.

[0047] The abnormality occurrence status information storage unit 532 stores abnormality occurrence status information corresponding to each abnormality that has occurred.

[0048] Fig. 5 shows an example of anomaly occurrence status information corresponding to the occurrence of one anomaly. The anomaly occurrence status information in Fig. 5 includes fields for the event ID, worker ID, date and time of the anomaly occurrence, location of the anomaly occurrence, anomaly response video, and report. The event ID field stores the ID (event ID) assigned to the corresponding abnormality (event). The worker ID field stores the worker ID indicating the corresponding worker. The field of the abnormality occurrence date and time indicates the date and time when the corresponding abnormality occurred (the abnormality occurrence date and time). The field of the abnormality occurrence position stores the position where the corresponding abnormality is assumed to have occurred (abnormality occurrence position). The abnormality occurrence position may be the position where the corresponding worker WK was present when the abnormality occurred. The field for abnormality response video stores abnormality response video in response to the occurrence of an abnormality in response. The report field stores the report created by the responding worker WK as a report of the occurrence of the abnormality.

[0049] Returning to the explanation in Figure 4. The work site map storage unit 533 stores a work site map. The work site map is a map showing the inside of the work site WS. The work site map may be, for example, a two-dimensional map of the work site WS viewed from a planar direction, or may be a three-dimensional map.

[0050] The projector installation information storage unit 534 stores projector installation information for each projector 50. The projector installation information corresponding to one projector 50 may include a projector ID indicating the corresponding projector 50, a position where the corresponding projector 50 is installed in the work site WS, a position in the work site WS where the corresponding projector 50 projects and displays an image (display target position), etc.

[0051] The location management server 300, the video and biological condition information management server 400, and the work management server 500 may each be a server installed on a network, or may be constructed as a cloud server. Furthermore, two or more of the location management server 300, the video image and biological condition information management server 400, and the work management server 500 may be integrated. At least one of the location management server 300, the video image and biological condition information management server 400, and the work management server 500 may be distributed among a plurality of servers, each of which is assigned a predetermined function. For example, the video image and biological condition information management server 400 may be distributed among a server that manages video images and a server that manages biological condition information.

[0052] [Procedure example: storing information on abnormal occurrences] An example of a procedure executed by the work management system of this embodiment in relation to storing abnormality occurrence status information in response to the occurrence of an abnormality will be described with reference to the sequence diagram of Figure 6. For the sake of clarity, the figure shows the procedure for one worker WK. Step S100: A worker WK is working at a predetermined position in the work site WS.

[0053] Step S102: When a worker WK is working at a work site WS, the receiver 30 constantly transmits measurement information associated with the worker WK to the location management server 300. The acquisition unit 321 of the location management server 300 calculates the location of the worker WK based on the received measurement information and acquires the calculated location information. The acquisition unit 321 constantly acquires such location information in response to the measurement information being constantly transmitted.

[0054] Step S104: While the worker WK is performing the work, some abnormality occurs, such as a worker error or equipment trouble.

[0055] Step S106: In response to the abnormality occurring in step S104, the heart rate information (biological condition information) measured by the biological condition sensor 20 worn by the corresponding worker WK and transmitted to the video / biological condition information management server 400 changes from a normal state to an abnormal state. The abnormality determination unit 422 in the video image / biological condition information management server 400 determines that an abnormality has occurred based on the heart rate that changes as described above. The abnormality determination unit 422 also acquires the date and time when it is determined that an abnormality has occurred as the abnormality occurrence date and time.

[0056] Step S108: In the video / biological condition information management server 400, the information processing unit 424 executes a process for acquiring the position where the abnormality determined in step S106 has occurred (abnormality occurrence position). For this reason, the information processing unit 424 transmits a location information request to the location management server 300. The location information request is a command requesting location information indicating the current location of the worker WK (target worker) who caused the abnormality determined this time. The location information request includes the worker ID of the target worker. The worker ID of the target worker may be the worker ID attached to the biological condition information used to determine the occurrence of the abnormality in step S106.

[0057] Step S110: The control unit 302 of the location management server 300 identifies a current location associated with the same worker ID of the target worker as included in the location information request transmitted in step S108, from among the current locations of each worker WK currently acquired by the acquisition unit 321. The control unit 302 transmits location information indicating the identified current location to the video image and biological condition information management server 400.

[0058] Step S112: The information processing unit 424 of the video image / biological condition information management server 400 acquires the current location of the target operator indicated by the location information transmitted in step S110 as the location where the abnormality occurred. The current location of the target operator can be treated as the location where the abnormality determined in this step S106 occurred.

[0059] Step S114: The video acquisition unit 423 of the video and biological condition information management server 400 acquires anomaly response video of a location including the abnormality occurrence position. To this end, the video acquisition unit 423 refers to the camera installation information stored in the camera installation information storage unit 432 to identify the camera 40 that captured the image capturing range including the abnormality occurrence position acquired in response to step S112. The video acquisition unit 423 acquires, from the videos stored in the video storage unit 431 and captured by the identified camera 40, video of a predetermined period based on the abnormality occurrence date and time acquired in step S106, as anomaly response video corresponding to the occurrence of this abnormality.

[0060] Step S116: The information processing unit 424 generates abnormality occurrence status information. When generating the abnormality occurrence status information, the information processing unit 424 issues an event ID that uniquely identifies the event that is the abnormality that has occurred this time. The information processing unit 424 generates abnormality occurrence status information including the issued event ID, the operator ID of the target operator attached to the biological condition information used to determine the occurrence of an abnormality in step S106, the date and time of the abnormality occurrence acquired in step S106, the abnormality occurrence position acquired in response to step S110, and the abnormality response video acquired in step S114. That is, in correspondence with Fig. 5, the information processing unit 424 generates abnormality occurrence status information including items other than the report shown in the figure.

[0061] Step S118: The information processing unit 424 transmits the abnormality occurrence status information generated in step S116 to the work management server 500.

[0062] The control unit 502 of the work management server 500 stores the abnormality occurrence status information transmitted in step S118 in the abnormality occurrence status information storage unit 532.

[0063] [Procedure example: Creating a report] An example of a procedure in which the work management system of this embodiment causes a target worker to create a report in response to the occurrence of an abnormality will be described with reference to the sequence diagram of FIG. The procedure in Fig. 6 may be executed at a predetermined timing after the procedure in Fig. 6 is completed, for example. That is, the procedure in Fig. 6 may be executed immediately after the procedure in Fig. 6 is completed, or may be executed in response to a predetermined execution timing (e.g., after a predetermined time has elapsed, after the target worker has completed their work, or at the start of work on the next day) being reached after the procedure in Fig. 6 is completed.

[0064] Step S200: In the work management server 500, the notification unit 521 generates an abnormality notification email addressed to the email address of the target worker and sends the generated abnormality notification email. The worker terminal 100 of the target worker notifies the reception of the sent abnormality notification email.

[0065] Step S202: The target worker opens the abnormality occurrence notification email by operating his / her own worker terminal 100. From the contents of the opened abnormality occurrence notification email, the target worker can understand that the abnormality has occurred due to him / her. The body of the email notifying the occurrence of an abnormality contains a URL for the report input form. The relevant worker clicks on the URL for the input form.

[0066] Step S204: In response to the operation of tapping (or clicking) the URL of the input form, the worker terminal 100 of the target worker accesses the URL using, for example, a web browser (which may be a work management application).

[0067] Step S206: In response to the URL being accessed in step S204, the work management server 500 sends the report input form of the accessed URL to the web browser of the worker terminal 100. The report input form is displayed on the screen of the web browser of the worker terminal 100.

[0068] Step S208: Although not shown in the figure, a report input form allows input of answers to predetermined questions regarding the occurrence of abnormalities in the response. The target worker performs an operation to input answers to each question in the report input form. The answer input may be, for example, selection from options by operating check boxes or radio buttons, or inputting text into a text input field.

[0069] Step S210: When the target worker completes inputting information into the report input form, the worker performs a send operation. In response to the send operation, the information entered into the report input form (input information) is sent from the web browser of the worker terminal 100 to the work management server 500.

[0070] Step S212: In the work management server 500, the presentation unit 521 generates a report that reflects the contents of the input information sent in step S210, and stores the generated report in the abnormality occurrence status information storage unit 532 so as to store the report in the abnormality occurrence status information for the target worker.

[0071] In the procedure shown in the figure, the target worker is notified of the occurrence of an abnormality by email, but the target worker may also be notified of the occurrence of an abnormality as a push notification to the work management application of the target worker's worker terminal 100. In this case, for example, a report input form may be displayed on the screen of the work management application by performing a predetermined operation on the work management application that has been notified, allowing input operations to be made into the report input form.

[0072] In addition, when the number of occurrences of abnormalities caused by one worker WK exceeds a predetermined number, the presentation unit 521 of the work management server 500 may determine that there is a problem with the target worker WK, and may send information (warning information) to the worker terminal 100 of the target worker WK or the administrator terminal 200 to call attention to the work of the worker WK. In this case, for example, when new abnormality occurrence status information is stored in the abnormality occurrence status information storage unit 532, the presentation unit 521 calculates the number of abnormality occurrence status information pieces that store the same worker ID as the newly stored abnormality occurrence status information. The presentation unit 521 generates warning information when the calculated number of abnormality occurrence status information pieces reaches a predetermined number. The generated warning information may include, for example, a message indicating that there have been many occurrences of abnormalities corresponding to the target worker WK and that caution is required in the future. The warning information may also indicate a history of abnormalities that have occurred due to the target worker WK. The presentation unit 521 may be configured to transmit the generated attention-calling information to the worker terminal 100 of the target worker WK and the manager terminal 200.

[0073] [Procedure example: Displaying the work management screen] In the work management system of this embodiment, a work management screen can be displayed on the worker terminal 100 or the manager terminal 200. Figure 8 shows an example of a work management screen. The work management screen in this figure displays a two-dimensional work site map showing the work site WS as seen from above. Two warning marks MK are also displayed on the work site map. The warning mark MK indicates the location corresponding to the abnormality occurrence position acquired in response to the determination that an abnormality has occurred by the abnormality determination unit 422. In other words, the warning mark MK is a sign that has the function of notifying the worker WK or the manager of the locations where abnormalities have occurred so far at the work site WS.

[0074] At the work site WS, an abnormality may occur multiple times at the same location (abnormality occurrence location). A location where an abnormality occurs multiple times in this manner is an environment prone to, for example, worker mistakes or equipment malfunctions, and therefore requires the worker WK and manager to exercise due caution. Therefore, the warning mark MK may be displayed in different colors depending on the number of times an abnormality has occurred at the corresponding location. For example, the warning mark MK may be displayed in yellow, red, or other colors that are more likely to draw attention as the number of abnormalities increases.

[0075] Furthermore, when an operation such as a tap is performed on the warning mark MK, a screen may be displayed that plays an abnormality response video associated with the location (abnormality occurrence position) indicated by the operated warning mark MK. Note that if an abnormality has occurred multiple times at the location of the operated warning mark MK, multiple pieces of abnormality occurrence status information corresponding to the location of the operated warning mark MK are stored in the abnormality occurrence status information storage unit 532. Therefore, if an abnormality has occurred multiple times at the location of the operated warning mark MK, there will be multiple abnormality response videos corresponding to the location of the operated warning mark MK. In this case, the user terminal (the worker terminal 100 or the administrator terminal 200) may display a list of the corresponding multiple abnormality response videos and play an abnormality response video selected by operation from the displayed list. Alternatively, the user terminal (the worker terminal 100 or the administrator terminal 200) may sequentially play back the multiple abnormality response videos corresponding to the location of the operated warning mark MK in a predetermined order (for example, in order according to the date and time of the occurrence of the corresponding abnormality).

[0076] An example of a procedure executed by the work management system of this embodiment in relation to generating a work management screen will be described with reference to the sequence diagram of Fig. 9. The procedure in Fig. 9 may be executed by a worker, worker terminal 100, and work management server 500, or may be executed by an administrator, administrator terminal 200, and work management server 500. The following description will be given taking as an example a case where the procedure is executed by an administrator, administrator terminal 200, and work management server 500.

[0077] Step S300: The administrator operates the work management application running on the administrator terminal 200 to display a work management screen.

[0078] Step S302: In response to an operation to display the work management screen, the work management application of the administrator terminal 200 accesses the work management screen provided by the work management server 500. In other words, the work management application of the administrator terminal 200 requests the work management screen.

[0079] Step S304: The presentation unit 521 of the work management server 500 generates a work management screen in response to the access in step S302. When generating the work management screen, the presentation unit 521 acquires a work site map from the work site map storage unit 533. The presentation unit 521 also references the abnormality occurrence status information stored in the abnormality occurrence status information storage unit 532 to identify the abnormality occurrence locations and calculate the number of abnormality occurrences for each abnormality occurrence location. The presentation unit 521 places warning marks MK on the work site map in correspondence with the identified abnormality occurrence locations. The presentation unit 521 also assigns a style to each warning mark MK according to the calculated number of abnormality occurrences.

[0080] Step S306: The presentation unit 521 transmits the work management screen generated in step S304 to the administrator terminal 200 that is the access source.

[0081] Step S308: The administrator terminal 200 displays the transmitted work management screen on the application screen of the work management application. On the displayed work management screen, a warning mark MK is placed at the position where an abnormality has occurred so far (abnormality occurrence position), as shown in FIG.

[0082] Step S310: Here, the administrator has performed an operation on one of the warning marks MK arranged on the work management screen.

[0083] Step S312: In response to the operation on the warning mark MK, the work management application of the administrator terminal 200 transmits an abnormality response video request to the work management server 500. The abnormality response video request includes information indicating the abnormality occurrence position indicated by the operated warning mark MK.

[0084] Step S314: The presentation unit 521 of the work management server 500 acquires the abnormality response video from the abnormality occurrence status information stored in the abnormality occurrence status information storage unit 532, which stores the same abnormality occurrence location as included in the received abnormality response video request. The presentation unit 521 transmits the acquired anomaly handling video to the administrator terminal 200 that has made the request.

[0085] Step S316: The administrator terminal 200 plays back the transmitted anomaly handling video.

[0086] Step S318: The administrator watches the anomaly handling video that has been played. By watching the anomaly handling video in this manner, the administrator can specifically confirm the circumstances under which the anomaly occurred.

[0087] As described above, when there are multiple anomaly response videos corresponding to the operated warning mark MK, the presentation unit 521 of the work management server 500 may first display a list screen of the multiple anomaly response videos on the administrator terminal 200, and then play the anomaly response video selected by an operation on the displayed list screen on the worker terminal 100. Alternatively, the presentation unit 521 of the work management server 500 may sequentially play the multiple anomaly response videos on the worker terminal 100 in a predetermined playback order.

[0088] 9, a warning mark MK is placed in response to a determination that a first abnormality has occurred at a location corresponding to one abnormality occurrence position. However, considering the possibility of an error in determining the occurrence of an abnormality, it may not be appropriate to immediately place a warning mark MK in response to the occurrence of the first abnormality. Therefore, the presentation unit 521 may be configured to place a warning mark MK at a corresponding position on the work site map only when the number of times that an abnormality has been determined to have occurred at a location corresponding to one abnormality occurrence position reaches a predetermined number or more. Furthermore, for example, the presentation unit 521 may erase the corresponding warning mark MK if a determination of the next abnormality does not occur even after a predetermined time has passed since the date and time when the last abnormality occurred at the abnormality occurrence location where the warning mark MK is placed.

[0089] [Procedure example: Warning display using a projector at a work site] In the work management system of this embodiment, as a worker WK moves to the location where an abnormality has occurred at the work site WS, a warning is displayed by projecting an image using a projector 50 onto the floor, wall, or other location corresponding to the location where the abnormality has occurred.

[0090] An example of a procedure for the work management system of this embodiment to display a warning using the projector 50 will be described with reference to the sequence diagram of FIG.

[0091] Step S400: The control unit 302 of the location management server 300 constantly transmits to the work management server 500 the location information, which is acquired by the acquisition unit 321 and indicates the current location of each worker WK.

[0092] Step S402: In the work management server 500, the notification unit 521 waits for the worker WK to change from a state where the worker WK is not present in the notification area to a state where the worker WK is present in the notification area. The notification area is an area set corresponding to each abnormality occurrence position at the work site WS, and is an area of ​​a predetermined range based on the corresponding abnormality occurrence position. The notification unit 521 acquires the current position of each worker WK based on the position information constantly transmitted from the position management server 300. When the notification unit 521 detects that one of the acquired current positions has moved from outside the notification area to within the notification area, it determines that the worker WK is now present in the notification area. Here, in response to a certain worker WK entering a certain notification area, the notification unit 521 determines that the worker WK is present in the notification area.

[0093] Step S404: In response to determining that the worker WK is present in the notification area, the presentation unit 521 identifies the projector 50 that corresponds to the target notification area among the projectors 50 installed at the work site WS. For example, the presentation unit 521 may refer to the projector installation information stored in the projector installation information storage unit 534 and identify the projector 50 whose display target position matches the position range within the work site WS included in the target notification area.

[0094] Step S406: The presentation unit 521 transmits the display data to the projector 50 identified in step S404.

[0095] Step S408: The projector 50 projects image light based on the display data transmitted in step S406 onto the corresponding notification area, thereby displaying a warning in the corresponding notification area.

[0096] The warning display by the projector 50 may be stopped when the presentation unit 521 determines that the worker WK is no longer present in the corresponding notification area, or may be stopped when a predetermined time has elapsed since the warning display was started. Instead of the projector 50, the warning display may be displayed by a display placed in the notification area, or a display device embedded in the floor or wall.

[0097] As described above, the work management system of this embodiment makes it possible to accurately grasp abnormalities caused by the workers WK working at the work site WS.

[0098] In addition, programs for implementing the functions of the above-mentioned worker terminal 100, administrator terminal 200, location management server 300, video and biological condition information management server 400, and work management server 500 may be recorded on a computer-readable recording medium, and the programs may be loaded into a computer system and executed to perform the functions of the above-mentioned worker terminal 100, administrator terminal 200, location management server 300, video and biological condition information management server 400, and work management server 500. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. The term "computer system" may also include multiple computer devices connected via a network, including communication lines such as the Internet, WAN, LAN, and dedicated lines. The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as HDDs and SSDs built into a computer system. In this way, the recording medium storing the programs may also be a non-transitory recording medium such as a CD-ROM. The term "recording medium" also includes internal or external recording media accessible from a distribution server for distributing the program. The program code stored on the distribution server's recording medium may be different from the program code in a format executable on a terminal device. In other words, the format in which the program is stored on the distribution server is not important as long as it can be downloaded from the distribution server and installed in a format executable on a terminal device. The program may be divided into multiple parts, each downloaded at a different time and then combined on a terminal device, or each divided program may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a storage medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network.The program may also be a program for realizing some of the above-mentioned functions, or may be a so-called differential file (differential program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0099] <Additional Notes> (1) One aspect of this embodiment is a work management system that includes a first acquisition unit that acquires video captured by an imaging device that is configured to capture a predetermined spatial range at a work site; a second acquisition unit that acquires biological condition information obtained by detecting a predetermined state of a living body as a worker at the work site; an abnormality determination unit that makes a determination regarding an abnormality based on the biological condition information acquired by the second acquisition unit; a video acquisition unit that, in response to the abnormality determination unit determining that an abnormality has occurred, acquires video of a predetermined period of time based on the time the abnormality occurred from the video acquired by the first acquisition unit as an abnormality response video; and an information processing unit that stores abnormality occurrence status information in a memory unit, the abnormality occurrence status information including the abnormality response video acquired by the video acquisition unit and indicating the occurrence status of the abnormality.

[0100] (2) One aspect of the present embodiment is the work management system described in (1), in which the abnormality occurrence status information may include the time when the abnormality occurred.

[0101] (3) One aspect of this embodiment is the work management system described in (1) or (2), wherein the imaging device is provided in plurality so as to capture images of different spatial ranges, and further includes a second acquisition unit that acquires position information indicating a position measured for a worker at the work site, and the information processing unit may store abnormality occurrence status information including abnormality response video acquired from the imaging device that captures an image of a predetermined spatial range including the position of the worker indicated by the position information acquired by the second acquisition unit in a memory unit.

[0102] (4) One aspect of this embodiment is a work management system according to any one of (1) to (3), further comprising a third acquisition unit that acquires location information obtained by measuring the location of the worker at the work site, and the information processing unit may include the location information acquired by the third acquisition unit corresponding to the time when the abnormality occurred in the abnormality occurrence status information.

[0103] (5) One aspect of this embodiment is a work management system described in any one of (1) to (4), wherein the second acquisition unit acquires biological condition information for each of a plurality of workers, the abnormality determination unit makes a determination regarding an abnormality for each of the plurality of workers based on the biological condition information acquired by the second acquisition unit for each of the plurality of workers, and the information processing unit may store abnormality occurrence status information for a worker among the plurality of workers for whom an abnormality has been determined to have occurred by the abnormality determination unit in a memory unit.

[0104] (6) One aspect of this embodiment is a work management method in a work management system, including: a first acquisition step in which a first acquisition unit acquires video captured by an imaging device configured to capture a predetermined spatial range at a work site; a second acquisition step in which a second acquisition unit acquires biological condition information obtained by detecting a predetermined condition of a living body as a worker at the work site; an abnormality determination step in which an abnormality determination unit makes a determination regarding an abnormality based on the biological condition information acquired by the second acquisition step; a video acquisition step in which, in response to determining that an abnormality has occurred by the abnormality determination step, the video acquisition unit acquires video of a predetermined period based on the time the abnormality occurred from the video acquired by the first acquisition step as an abnormality response video; and an information processing step in which an information processing unit stores abnormality occurrence status information in a memory unit, including the abnormality response video acquired by the video acquisition step, and indicating the occurrence status of the abnormality.

[0105] (7) One aspect of this embodiment is a program for causing a computer in a work management system to function as an information processing unit that includes a first acquisition unit that acquires video captured by an imaging device configured to capture a predetermined spatial range at a work site, a second acquisition unit that acquires biological condition information obtained by detecting a predetermined state of a living body as a worker at the work site, an abnormality determination unit that makes a determination regarding an abnormality based on the biological condition information acquired by the second acquisition unit, a video acquisition unit that, in response to the abnormality determination unit determining that an abnormality has occurred, acquires video from the video acquired by the first acquisition unit for a predetermined period based on the time the abnormality occurred as an abnormality response video, and an abnormality occurrence status information that indicates the occurrence status of the abnormality, including the abnormality response video acquired by the video acquisition unit, in a memory unit. [Explanation of symbols]

[0106] 10 transmitter, 20 biological condition sensor, 30 receiver, 40 camera, 50 projector, 60 gateway, 100 worker terminal, 200 administrator terminal, 300 location management server, 301 communication unit, 302 control unit, 321 acquisition unit, 400 video / biological condition information management server, 401 communication unit, 402 control unit, 403 memory unit, 421 acquisition unit, 422 abnormality determination unit, 423 video acquisition unit, 424 information processing unit, 431 video memory unit, 432 camera installation information memory unit, 500 work management server, 501 communication unit, 502 control unit, 503 memory unit, 521 presentation unit, 531 worker information memory unit, 532 abnormality occurrence status information memory unit, 533 work site map memory unit, 534 projector installation information memory unit

Claims

1. a first acquisition unit that acquires an image captured by an imaging device that is provided to capture an image of a predetermined spatial range at a work site; a second acquisition unit that acquires biological condition information obtained by detecting a predetermined condition of a living body of a worker at a work site; an abnormality determination unit that determines abnormality based on the biological condition information acquired by the second acquisition unit; a video acquisition unit that acquires, in response to the determination by the anomaly determination unit that an abnormality has occurred, from the video acquired by the first acquisition unit, video of a predetermined period based on the time when the abnormality has occurred as an abnormality response video; an information processing unit that stores, in a storage unit, abnormality occurrence status information that includes the abnormality response video acquired by the video acquisition unit and indicates the occurrence status of the abnormality; A work management system comprising:

2. The abnormality occurrence status information includes the time when the abnormality occurred. The work management system according to claim 1 .

3. a plurality of the imaging devices are provided so as to image different spatial ranges, a second acquisition unit that acquires position information indicating a position measured for a worker at the work site; The information processing unit stores, in a storage unit, abnormality occurrence status information including an abnormality response video acquired from an imaging device that captures an image of a predetermined spatial range including the position of the worker indicated by the position information acquired by the second acquisition unit. The work management system according to claim 1 or 2.

4. a third acquisition unit that acquires position information obtained by measuring the position of the worker at the work site; The information processing unit includes, in the abnormality occurrence status information, the location information acquired by the third acquisition unit corresponding to the time when the abnormality occurred. The work management system according to claim 1 or 2.

5. the second acquisition unit acquires biological condition information for each of a plurality of workers; the abnormality determination unit determines abnormalities for each of the plurality of workers based on the biological condition information acquired by the second acquisition unit for each of the plurality of workers; The information processing unit stores, in a storage unit, abnormality occurrence status information of a worker in whom an abnormality has been determined by the abnormality determination unit, among the plurality of workers. The work management system according to claim 1 or 2.

6. A work management method in a work management system, a first acquisition step in which a first acquisition unit acquires an image captured by an imaging device provided to capture an image of a predetermined spatial range in a work site; a second acquisition step in which a second acquisition unit acquires biological condition information obtained by detecting a predetermined condition of a living body of a worker at a work site; an abnormality determination step in which an abnormality determination unit determines whether or not there is an abnormality based on the biological condition information acquired in the second acquisition step; a video acquisition step in which, in response to the determination that an abnormality has occurred in the abnormality determination step, the video acquisition unit acquires, from the video acquired in the first acquisition step, video of a predetermined period based on the time when the abnormality has occurred, as an abnormality response video; an information processing step in which an information processing unit stores abnormality occurrence status information, which includes the abnormality response video acquired by the video acquisition step and indicates the occurrence status of the abnormality, in a storage unit; Work management methods including:

7. The computer in the work management system, a first acquisition unit that acquires an image captured by an imaging device that is provided to capture an image of a predetermined spatial range in a work site; a second acquisition unit that acquires biological condition information obtained by detecting a predetermined condition of a living body of a worker at a work site; an abnormality determination unit that determines abnormality based on the biological condition information acquired by the second acquisition unit; a video acquisition unit that acquires, in response to the determination by the abnormality determination unit that an abnormality has occurred, from the video acquired by the first acquisition unit, video of a predetermined period based on the time when the abnormality occurred as an abnormality response video; an information processing unit that stores, in a storage unit, abnormality occurrence status information that includes the abnormality response video acquired by the video acquisition unit and indicates the occurrence status of the abnormality; A program to function as a

Images