Actual operation site management system of work machine
The work site management system addresses the challenge of inaccurate safety assessments by using a detection and recording system to provide detailed safety insights, enhancing the ability to implement targeted safety measures.
Patent Information
- Application Number
- JP2023084026
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-22
- Publication Date
- 2024-12-04
AI Technical Summary
Existing work site management systems fail to accurately distinguish between situations where the object detection sensor is disabled by operators and sites with high safety levels, leading to difficulties in understanding the safety situation at the operating site, and are prone to false detections due to external disturbances.
A work site management system that includes a detection device monitoring the work machine and its surroundings, a recording device to record machine information and detection effectiveness rates, a server to aggregate data, and a terminal device to display safety information, enabling users to grasp the safety situation by visualizing detection effectiveness and event occurrences.
Enables accurate assessment of safety conditions at work sites, encouraging timely safety measures by distinguishing between sites with disabled sensors and high safety levels, and identifying areas requiring priority patrols or guidance.
Smart Images

Figure 2024167748000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a work site management system for managing a work site of a work machine. [Background technology]
[0002] The work machine is equipped with an object detection sensor that monitors the area around the work machine and detects objects (including people) in the vicinity, and if an event occurs that poses a risk of an accident (a near miss event) such as the work machine coming into sudden contact with a detected object, the work machine is equipped with a function that issues a warning to the operator and restricts the operation of the work machine.
[0003] Patent Document 1 discloses a technology that accumulates information such as the position, direction, and time when an object was detected, as well as the operation being performed at the time of detection, and provides site managers with a report on the occurrence trends of near-miss events. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6805883 Summary of the Invention [Problem to be solved by the invention]
[0005] At the work site where a work machine is in operation, there are situations where the work machine must continue working while detecting objects in the vicinity, such as when the work machine is working in a narrow space while close to a wall, or when personnel assisting the work are positioned near the work machine. In such situations, since restricting the operation of the work machine may be dangerous, the operator may disable the operation of the object detection sensor before working. In addition, at the work site where a work machine is in operation, there are situations where false detections of the object detection sensor frequently occur due to the influence of disturbances such as dust or snow. In such situations, the operator may find warning notifications associated with false detections annoying and may disable the operation of the object detection sensor before working.
[0006] The technology disclosed in Patent Document 1 does not take into consideration the fact that an operator works with the object detection sensor disabled. Therefore, with the technology disclosed in Patent Document 1, it is difficult to distinguish between a site where work is being performed with the object detection sensor disabled and a site where the safety level is high and no near-miss events have occurred. Therefore, with the technology disclosed in Patent Document 1, it is difficult for users such as site managers to accurately grasp the safety situation at the site.
[0007] In view of the above circumstances, an object of the present invention is to enable a user to accurately grasp the safety situation at a work site where a work machine is operating, and to encourage the user to implement safety measures. [Means for solving the problem]
[0008] In order to solve the above-mentioned problems, the present invention provides a work machine working site management system comprising a work machine equipped with a detection device that monitors the condition of the work machine or the vicinity of the work machine to detect an event occurring to the work machine that involves an accident risk, a recording device that records machine information including position information and operation information of the work machine and detection information of the detection device, and a switch that sets the operation of the detection device to enabled or disabled, a server that receives the machine information recorded in the recording device from a plurality of the work machines and compiles the plurality of pieces of machine information for each work site of the work machine, and a terminal device that receives and displays the compiled results of the machine information from the server, and is a work machine working site management system that manages the status of the work site, wherein the work machine calculates a ratio between the time when the operation of the detection device is set to enabled or disabled and the operation time of the work machine based on setting information of the switch, and records the ratio in the recording device by including it in the machine information, the server transmits the compiled result of the detection information of each detection device of the plurality of work machines and the ratio to the terminal device, and the terminal device displays the compiled result of the detection information and the ratio. Effect of the Invention
[0009] According to the present invention, it is possible to allow a user to accurately understand the safety situation at the operating site of a work machine, and to encourage the user to implement safety measures. [Brief description of the drawings]
[0010] [Figure 1] FIG. 2 is a diagram showing the external configuration of a work machine. [Diagram 2] FIG. 1 is a diagram showing the configuration of an operation site management system. [Diagram 3] 6 is a flowchart showing the operation of the recording device with respect to calculation of a detection effectiveness rate and extraction of machine information. [Figure 4] 6 is a flowchart showing the operation of the communication device regarding transmission of machine information to a server. [Diagram 5] FIG. 2 is a diagram for explaining the structure of data stored in a server. [Figure 6] FIG. 6 is a diagram showing a management screen of an operating site displayed on the terminal device shown in FIG. 5. [Figure 7] FIG. 7 is a diagram showing another example of the management screen shown in FIG. 6. [Figure 8] 8 is a diagram showing a video list displayed on a terminal device and linked to the heat maps shown in FIGS. 6 and 7. FIG. [Figure 9] 9 is a diagram showing a video playback screen linked to the video list shown in FIG. 8 and displayed on a terminal device. [Figure 10] 10 is a diagram showing another example of the video playback screen shown in FIG. 9. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the embodiments, the same reference numerals denote the same configurations or functions, and unless otherwise specified, the description thereof will be omitted.
[0012] FIG. 1 is a diagram showing the external configuration of a work machine 60. As shown in FIG.
[0013] The work machine 60 operating at the work site managed by the work site management system 100 may be a construction machine such as a hydraulic excavator, a wheel loader, or a dump truck. Although a hydraulic excavator is shown in Fig. 1 as an example of the work machine 60, the work machine 60 is not particularly limited.
[0014] The work machine 60 is equipped with a prime mover 1, which is an engine or an electric motor, and a main pump 2, which is a hydraulic pump driven by the prime mover 1. In the work machine 60, a lower traveling body 3, an upper rotating body 4, and a front working mechanism 5 are each independently operated by the hydraulic oil supplied from the main pump 2.
[0015] The lower traveling body 3 is composed of a pair of traveling bodies 6 (only one side is shown in FIG. 1), and is operated by the rotation of a traveling hydraulic motor 7. The upper rotating body 4 is connected to the upper part of the lower traveling body 3 via a rotating device 8, and is operated by the rotation of a swing hydraulic motor (not shown).
[0016] The front working mechanism 5 is mounted on the upper rotating body 4. The front working mechanism 5 includes a boom 9 rotatably supported on the upper rotating body 4, a boom cylinder 10 for driving the boom 9, an arm 11 rotatably supported on the boom 9, an arm cylinder 12 for driving the arm 11, a bucket 13 rotatably supported on the arm 11, and a bucket cylinder 14 for driving the bucket 13. The hydraulic cylinders 10, 12, and 14 are extended and contracted by hydraulic oil supplied from the main pump 2, and rotate the boom 9, the arm 11, and the bucket 13 about the respective rotation shafts 15, 16, and 161 as fulcrums. In this way, the front working mechanism 5 performs work such as excavation or ground leveling. The attitude of the front working mechanism 5 can be detected by an inertial measurement unit (IMU) (not shown) or the like provided on the boom 9, the arm 11, and the bucket 13.
[0017] The work site management system 100 has a work machine 60, a server 25, and a terminal device 70, and is a system that manages the status of the work site where the work machine 60 is operating. In explaining the work site management system 100, first, the work machine 60 will be explained using Figs. 2 to 4.
[0018] FIG. 2 is a diagram showing the configuration of the operation site management system 100.
[0019] A camera 17 and a detection device 18 for monitoring the periphery of the work machine 60 are provided outside the cab mounted on the upper rotating body 4 of the work machine 60. A video processing device 19, a control device 20, a display 21, and a recording device 22 are provided inside the cab. The video processing device 19, the control device 20, the display 21, and the recording device 22 are connected to each other so as to be able to communicate with each other via an on-board network 23 such as a CAN.
[0020] The camera 17 is composed of a plurality of cameras 17 that capture images of the front, rear, right, and left of the work machine 60. Each camera 17 is connected to an image processing device 19. Images captured by each camera 17 are input to the image processing device 19. The image processing device 19 combines the images captured by each camera 17 and outputs a combined image such as a surround view image or an overhead image in which the boundaries between the images of adjacent cameras 17 are blended to the display 21. The image processing device 19 may output to the display 21 an image in which the images of each camera 17 are divided, or the image captured by each camera 17 as is. The display 21 displays the input image and outputs the image to the recording device 22.
[0021] The detection device 18 monitors the state of the work machine 60 or the periphery of the work machine 60 to detect an event (near-miss event) occurring to the work machine 60 that involves an accident risk. Specifically, the detection device 18 includes an object detection sensor that monitors the periphery of the work machine 60 and detects objects present in the periphery of the work machine 60. If an event occurs in which the distance between the work machine 60 and an object in the periphery of the work machine 60 falls below a predetermined distance and the object approaches the work machine 60, the detection device 18 detects the event as an event involving a contact risk, which is one of the accident risks. The predetermined distance is a value that is set in advance taking safety, etc. into consideration.
[0022] The detection device 18 also includes an abnormality detection sensor that monitors the state of the work machine 60 and detects an abnormality in the work machine 60. For example, the detection device 18 monitors the attitudes of the undercarriage 3 and the upper rotating body 4 of the work machine 60, and when an event occurs in which the inclination angle of these exceeds a predetermined angle, detects the event as an event involving a tipping risk, which is one of the accident risks. The predetermined angle is a value that is set in advance in consideration of safety, etc. For example, the detection device 18 monitors the attitude and load amount of the front working implement 5 and the rotation speed of the upper rotating body 4 of the work machine 60, and when an event occurs in which the rotation speed of the upper rotating body 4 exceeds a predetermined speed that is set in advance according to each rotation angle and load amount of the front working implement 5, detects the event as an event involving a tipping risk, which is one of the accident risks. For example, the detection device 18 monitors the traveling speed of the work machine 60, and when an event occurs in which the traveling speed exceeds a predetermined speed that is set in advance, detects the event as an event involving a contact risk, which is one of the accident risks.
[0023] The detection device 18 is connected to a control device 20 that performs overall control of the work machine 60. When an event involving an accident risk as described above is detected, the detection device 18 outputs detection information of the event to the control device 20. The control device 20 acquires the detection information of the detection device 18 and outputs it to a recording device 22.
[0024] The control device 20 is a controller that performs hydraulic control of the work machine 60, and is connected to a swing operation lever 26a, a travel operation lever 26b, and a gate lock lever 27 that permits operation of the work machine 60, which are operated by an operator. The control device 20 acquires operation information of each operation lever, such as the operation amount of the swing operation lever 26a, the operation amount of the travel operation lever 26b, and the locked or unlocked state of the gate lock lever 27, and outputs this information to the recording device 22. In the locked state, the gate lock lever 27 prohibits operation of the lower traveling body 3, the upper rotating body 4, and the front working implement 5, and in the unlocked state, permits these operations by operation of the respective operation levers.
[0025] The operation information of each control lever is one piece of operation information of the work machine 60. In addition to the operation information of each control lever, the operation information of the work machine 60 includes the following information. The operation information includes the travel speed of the work machine 60, the orientation of the lower running body 3 and the upper rotating body 4 (e.g., the orientation of the lower running body 3), the tilt angle of the lower running body 3 and the upper rotating body 4 (e.g., the tilt angle of the lower running body 3 with respect to the ground), the attitude of the front working implement 5 (e.g., the rotation angles of the boom 9, the arm 11 and the bucket cylinder 14), the attitude of the upper rotating body 4 (e.g., the swing angle of the upper rotating body 4), the rotation speed of the prime mover 1, and hydraulic information of each hydraulic device including the main pump 2 and each hydraulic cylinder 10, 12, 14. The control device 20 acquires the operation information of the work machine 60 and outputs it to the recording device 22.
[0026] The control device 20 is also connected to a switch 28 that is operated by an operator at any timing. The switch 28 is a switch that sets the operation of the detection device 18 to enabled or disabled. The control device 20 obtains setting information of the switch 28 determined by an input operation by the operator, and outputs the setting information to the recording device 22.
[0027] The recording device 22 records machine information of the work machine 60. The machine information of the work machine 60 includes the identification information, position information, operation information, detection information of the detection device 18, and images captured by each camera 17 or a composite image obtained by combining these images (image displayed on the display 21). The position information of the work machine 60 is acquired by a communication device 24 connected to the recording device 22 and output to the recording device 22. It is preferable, but not essential, that the image be recorded as machine information.
[0028] When an event involving an accident risk is detected by the detection device 18, the recording device 22 records the time of detection of the event, including it in the machine information. At this time, the recording device 22 calculates the ratio of the time during which the operation of the detection device 18 is set to enabled or disabled to the operating time of the work machine 60 based on the setting information of the switch 28, and records it as part of the machine information. In this embodiment, the recording device 22 calculates a detection effectiveness rate that indicates the ratio of the time during which the operation of the detection device 18 is set to enabled to the operating time of the work machine 60 as the ratio. The detection effectiveness rate indicates the proportion of the time during which the operation of the detection device 18 is set to enabled to the operating time of the work machine 60. When detection information of the detection device 18 is input from the control device 20, the recording device 22 calculates the detection effectiveness rate at the time when the event was detected, and records the calculated detection effectiveness rate as part of the machine information.
[0029] Furthermore, when an event involving an accident risk is detected by the detection device 18, the recording device 22 extracts, from the recorded machine information of the work machine 60, machine information for a preset period spanning before and after the detection of the event. The recording device 22 saves the extracted machine information (including the detection effectiveness rate) as transmission data to be transmitted from the communication device 24 to the server 25.
[0030] The communication device 24 is equipped with a GNSS receiver or the like, and acquires position information of the work machine 60. The communication device 24 is also communicatively connected to the server 25 via a wireless communication network. The communication device 24 transmits to the server 25 the machine information recorded in the recording device 22, specifically, the machine information stored as transmission data for the server 25.
[0031] 3 is a flowchart showing the operation of the recording device 22 with respect to the calculation of the detection validity rate and the extraction of machine information. The value of the operation time counter is incremented per unit time while the operation time counter is ON, and indicates the operation time of the work machine 60. The value of the detection validity time counter is incremented per unit time while the detection validity time counter is ON, and indicates the time during which the operation of the detection device 18 is set to valid.
[0032] In step S1, the recording device 22 determines whether or not the gate lock lever 27 is in an unlocked state. If the gate lock lever 27 is in an unlocked state (step S1: Yes), the recording device 22 proceeds to step S3. If the gate lock lever 27 is in a locked state (step S1: No), the recording device 22 proceeds to step S2.
[0033] In step S2, the recording device 22 turns off an operation time counter that counts the operation time of the work machine 60 and an effective detection time counter that counts the time the operation of the detection device 18 is set to effective, and stops adding the operation time and the effective detection time. After this, the recording device 22 proceeds to step S1.
[0034] In step S3, the recording device 22 turns on the operating time counter.
[0035] In step S4, the recording device 22 determines whether or not the operation of the detection device 18 is enabled, based on the setting information of the switch 28. If the operation of the detection device 18 is enabled (step S4: Yes), the recording device 22 proceeds to step S6. If the operation of the detection device 18 is disabled (step S4: No), the recording device 22 proceeds to step S5.
[0036] In step S5, the recording device 22 turns off the detection effective time counter and stops counting the detection effective time. After that, the recording device 22 moves to step S1.
[0037] In step S6, the recording device 22 turns on the detection effective time counter.
[0038] In step S7, the recording device 22 determines whether or not the detection information of the detection device 18 has been input from the control device 20. If the detection information of the detection device 18 has been input (step S7: Yes), the recording device 22 proceeds to step S8. If the detection information of the detection device 18 has not been input (step S7: No), the recording device 22 proceeds to step S1.
[0039] In step S8, the recording device 22 starts extracting machine information in chronological order from a point T1 seconds before the point in time when the detection device 18 detected an event involving an accident risk. This T1 second is set in advance.
[0040] In step S9, the recording device 22 determines whether or not T2 seconds have elapsed since the start of the extraction of the mechanical information. This T2 seconds is set in advance. The recording device 22 continues extracting the mechanical information until T2 seconds have elapsed (step S9: No). When T2 seconds have elapsed (step S9: Yes), the recording device 22 ends the extraction of the mechanical information. After this, the recording device 22 proceeds to step S10.
[0041] In step S10, the recording device 22 stores the extracted machine information as transmission data to the server 25. Furthermore, the recording device 22 calculates the detection effectiveness rate at the time when the detection information of the detection device 18 is input in step S7, i.e., the detection effectiveness rate at the time when an event involving an accident risk is detected by the detection device 18. The recording device 22 can calculate the detection effectiveness rate at that time by referring to the value of the detection effectiveness time counter and the value of the operation time counter at that time and dividing the value of the detection effectiveness time counter by the value of the operation time counter. The recording device 22 includes the calculated detection effectiveness rate in the extracted machine information and stores it as transmission data to the server 25.
[0042] In step S11, the recording device 22 determines whether or not the key switch of the work machine 60 has been turned OFF and the vehicle body power supply has been turned OFF. If the vehicle body power supply has been turned OFF (step S11: Yes), the recording device 22 proceeds to step S12. If the vehicle body power supply has not been turned OFF (step S11: No), the recording device 22 proceeds to step S1.
[0043] In step S12, the recording device 22 turns off the operating time counter and the detection valid time counter, stops adding the operating time and the detection valid time, and ends the operation shown in Fig. 3. At this time, the vehicle power supply is turned off, but since the recording device 22 is driven by a battery power supply of a different system, the recording device 22 does not turn off the power of the recording device 22 until saving of all the transmitted data is completed.
[0044] 4 is a flowchart showing the operation of the communication device 24 regarding the transmission of machine information to the server 25. The flowchart shown in FIG. 4 is executed in parallel with the flowchart of the recording device 22 shown in FIG.
[0045] In step S21, when the key switch is turned ON and the vehicle body power supply is turned ON, the communication device 24 is powered ON.
[0046] In step S22, the communication device 24 performs a process of establishing communication with the server 25, and determines whether or not communication with the server 25 is possible. If communication with the server 25 is possible (step S22: Yes), the communication device 24 proceeds to step S23. If communication with the server 25 is not possible (step S22: No), the communication device 24 retries the process of establishing communication with the server 25.
[0047] In step S23, the communication device 24 determines whether or not there is any transmission data to be transmitted to the server 25 that was stored in the recording device 22 in step S10 of Fig. 3 that has not been transmitted to the server 25. If there is any transmission data stored in the recording device 22 that has not been transmitted (step S23: Yes), the communication device 24 proceeds to step S24. If there is no transmission data stored in the recording device 22 that has not been transmitted (step S23: No), the communication device 24 proceeds to step S22.
[0048] In step S24, the communication device 24 determines whether or not only one piece of transmission data remains unsent in the recording device 22. If only one piece of transmission data remains unsent in the recording device 22 (step S24: Yes), the communication device 24 proceeds to step S25. If multiple pieces of transmission data remain unsent in the recording device 22 (step S24: No), the communication device 24 proceeds to step S26.
[0049] In step S25, the communication device 24 transmits the transmission data that remains unsent to the recording device 22 to the server 25. After that, the communication device 24 proceeds to step S27.
[0050] In step S26, the communication device 24 transmits the oldest transmission data among the plurality of transmission data remaining in the recording device 22 and not yet transmitted to the server 25. After that, the communication device 24 proceeds to step S27.
[0051] In step S27, the communication device 24 determines whether or not the transmission of the transmission data to the server 25 is completed. If the transmission is completed (step S27: Yes), the communication device 24 proceeds to step S29. If the transmission is in progress (step S27: No), the communication device 24 proceeds to step S28.
[0052] In step S28, the communication device 24 determines whether or not it is in a state where it can communicate with the server 25. If it is in a state where it can communicate with the server 25 (step S28: Yes), the communication device 24 proceeds to step S27. If it is not in a state where it can communicate with the server 25 (step S28: No), the communication device 24 interrupts the transmission and proceeds to step S22.
[0053] In step S29, the communication device 24 determines whether or not the key switch of the work machine 60 has been turned OFF and the vehicle body power supply has been turned OFF. If the vehicle body power supply has been turned OFF (step S29: Yes), the communication device 24 proceeds to step S30. If the vehicle body power supply has not been turned OFF (step S29: No), the communication device 24 proceeds to step S22.
[0054] In step S30, the communication device 24 turns off the power of the communication device 24, and ends the operation shown in Fig. 4. At this time, although the vehicle power supply is turned off, the communication device 24 is driven by a battery power supply of a different system, so the communication device 24 does not turn off the power of the communication device 24 until the transmission of all the transmission data is completed.
[0055] Next, the server 25 and the terminal device 70 will be described with reference to Fig. 5 to Fig. 10. Fig. 5 is a diagram illustrating the structure of data stored in the server 25.
[0056] The multiple pieces of transmission data transmitted by the multiple work machines 60 are received by the server 25. Each of the multiple pieces of received data received by the server 25 includes machine information recorded in the recording device 22 of each of the multiple work machines 60. There are as many pieces of machine information received by the server 25 as there are work machines 60. It is possible to identify which work machine 60 each of the multiple pieces of machine information was transmitted from, based on the identification information of the work machine 60.
[0057] In the example of FIG. 5, a plurality of pieces of machine information 29a, 29b received by the server 25 are shown. Each of the plurality of pieces of machine information 29a, 29b can be identified as to which work machine 60 the machine information was transmitted from, based on the identification information 30a, 30b of the work machine 60. Each of the pieces of machine information 29a, 29b includes time series data 31a, 31b and constant data 32a, 32b. The time series data 31a, 31b is data for a period from T1 seconds before the detection time of the detection device 18 to T2 seconds after the detection time, starting from the detection time of the detection device 18. The time series data 31a, 31b includes, for example, images captured by each camera 17 or a composite image of these (images displayed on the display 21), operation information of each operation lever, and detection information of the detection device 18. The constant data 32a, 32b is data at the detection time of the detection device 18. The constant data 32a, 32b include, for example, the time of the detection, the position information of the work machine 60 at the detection time, and the detection effectiveness rate at the detection time.
[0058] Fig. 6 is a diagram showing a management screen of the operation site displayed on the terminal device 70 shown in Fig. 5. Fig. 7 is a diagram showing another example of the management screen shown in Fig. 6.
[0059] In response to a request from the terminal device 70 based on a user's input operation, the server 25 compiles multiple pieces of machine information transmitted from the multiple work machines 60 for each operating site of the work machines 60, and transmits the compilation results of the machine information to the terminal device 70. The terminal device 70 receives the compilation results of the machine information transmitted from the server 25, and displays them using a Web browser or the like.
[0060] In particular, the server 25 compiles detection information from each detection device 18 of the multiple work machines 60. The server 25 transmits the compilation result of the detection information and the detection validity rate to the terminal device 70. The terminal device 70 displays the compilation result of the detection information and the detection validity rate.
[0061] This allows the operation site management system 100 to visualize the percentage of the detection device 18 that was set to enabled based on the results of the detection device 18 detecting an event involving an accident risk. Therefore, the operation site management system 100 can make it easier for the user to distinguish whether the operation site to be managed is a site where work is being carried out with the operation of the detection device 18 set to disabled, or a site where the safety level of the site is high and no events involving an accident risk have occurred. Therefore, the operation site management system 100 can allow the user to accurately grasp the safety status of the operation site of the work machine 60, and can encourage the implementation of safety measures.
[0062] Specifically, the server 25 tally up the number of detections or the detection frequency, which is the number of times or the frequency at which an event involving an accident risk is detected by each detection device 18, and the detection location, which is the location at which the event is detected. The detection location is identified from the position information of the work machine 60 at the time when the event involving an accident risk is detected by the detection device 18. The server 25 creates a heat map that expresses the number of detections or the detection frequency of the event at the detection location with a change in color. The server 25 draws the created heat map by superimposing it on a map of the operation site. The server 25 transmits the drawn heat map to the terminal device 70. The terminal device 70 displays the heat map transmitted from the server 25.
[0063] As a result, the operation site management system 100 can visualize information on locations in the operation site where events involving accident risks are likely to occur and information on the detection effectiveness rate. Therefore, the operation site management system 100 can easily allow the user to grasp locations in the operation site where safety patrol is required as a priority. For example, in a location where the detection effectiveness rate is high and the number of detections is low, it is estimated that the safety awareness of the operator and surrounding workers is high and the safety level of the site is high. On the other hand, in a location where the detection effectiveness rate is high and the number of detections is high, the safety awareness of the surrounding workers may be low. In this case, the user can determine that the location is one where safety patrol is required as a priority. In addition, if the detection effectiveness rate is low, the operation site may have a harsh working environment where the work machine 60 must work in a narrow space while approaching a wall. In this case, the user can determine that the user should recheck the safety patrol and video of the operation site to identify the cause of the low detection effectiveness rate. In this way, the operation site management system 100 can allow the user to accurately and easily grasp the safety situation of the operation site of the work machine 60, and can further encourage the implementation of safety measures.
[0064] In the operation site management system 100, when the detection effectiveness rate is high and the number of detections is low, the server 25 may analyze that the safety awareness of the operator and surrounding workers is high and the safety level of the site is high, and transmit the analysis result to the terminal device 70 and display it on the terminal device 70. Similarly, when the detection effectiveness rate is high and the number of detections is high, the server 25 may analyze that the safety awareness of the surrounding workers may be low and that the site needs to be prioritized for safety patrol, and transmit the analysis result to the terminal device 70 and display it on the terminal device 70. Similarly, when the detection effectiveness rate is low, the server 25 may analyze that the operation site may have a harsh working environment and that the safety patrol and video of the operation site should be rechecked to identify the cause of the low detection effectiveness rate, and transmit the analysis result to the terminal device 70 and display it on the terminal device 70.
[0065] As a result, the operation site management system 100 can allow the user to accurately and more easily grasp the safety status of the operation site of the work machine 60, and can further encourage the implementation of safety measures.
[0066] In addition, the server 25 compiles detection time periods, which are time periods during which an event involving an accident risk was detected by each detection device 18, and transmits the collected detection time periods to the terminal device 70. The terminal device 70 displays the compiled detection time periods, for example, on the same screen as the heat map.
[0067] This allows the operation site management system 100 to visualize information on time periods when events involving accident risks are likely to occur within the operation site and information on the detection effectiveness rate. Therefore, the operation site management system 100 allows the user to easily grasp time periods within the operation site when safety patrols need to be prioritized. Therefore, the operation site management system 100 allows the user to accurately and easily grasp the safety status of the operation site of the work machine 60, further encouraging the implementation of safety measures.
[0068] Furthermore, the server 25 compiles the detection date, which is the date when an event involving an accident risk was detected by each detection device 18, and the details of the operation of each work machine 60 that was being performed when the event was detected, and transmits them to the terminal device 70. The terminal device 70 displays the compiled detection date and operation details on the same screen as the heat map, for example.
[0069] As a result, the operation site management system 100 can visualize information on operations that are likely to cause events involving accident risks among operations performed while the work machine 60 is working, and information on the detection effectiveness rate. Therefore, the operation site management system 100 can allow the user to easily understand operations that require careful operation among operations of the work machine 60, and can encourage the user to provide guidance to the operator. Therefore, the operation site management system 100 can allow the user to accurately and easily understand the safety status of the operation site of the work machine 60, and can further encourage the implementation of safety measures.
[0070] Furthermore, the server 25 compiles details of the detection directions, which are directions in which an object approaching the work machine 60 was detected by each detection device 18, and transmits the details to the terminal device 70. The terminal device 70 displays the compiled details of the detection directions, for example, on the same screen as the heat map.
[0071] This allows the operation site management system 100 to visualize information on directions in which events involving accident risks are likely to occur around the work machine 60 and information on the detection effectiveness rate. Therefore, the operation site management system 100 allows the user to easily understand directions in the vicinity of the work machine 60 that require careful checking, and can encourage the user to provide guidance to the operator. Therefore, the operation site management system 100 allows the user to accurately and easily understand the safety status of the operation site of the work machine 60, and can further encourage the implementation of safety measures.
[0072] Furthermore, the terminal device 70 accepts an input operation from the user to select the work machine 60 for which the heat map is to be displayed, and transmits the operation to the server 25. The server 25 collects detection information from the detection devices 18 provided on the work machine 60 selected by the input operation, creates and draws a heat map, and transmits the drawn heat map to the terminal device 70. The terminal device 70 displays the heat map for the work machine 60 selected by the input operation.
[0073] As a result, the operation site management system 100 can visualize information on the work machines 60 that are prone to incidents involving accident risks among the work machines 60 operating at the operation site, and information on the detection effectiveness rate. Therefore, the operation site management system 100 can allow the user to easily identify the work machines 60 that require careful operation among the work machines 60 operating at the operation site, and can encourage the user to provide guidance to the operators. Therefore, the operation site management system 100 can allow the user to accurately and easily understand the safety status of the operation site of the work machines 60, and can further encourage the implementation of safety measures.
[0074] Furthermore, the terminal device 70 accepts a user input operation specifying a collection period for the detection information of each detection device 18, and transmits the operation to the server 25. The server 25 collects the detection information of the detection devices 18 for the collection period specified by the input operation, creates and draws a heat map, and transmits the drawn heat map to the terminal device 70. The terminal device 70 displays the heat map for the collection period specified by the input operation.
[0075] This allows the operation site management system 100 to visualize information on periods during the entire construction period of the operation site when events involving accident risks are likely to occur and information on the detection effectiveness rate. Therefore, the operation site management system 100 can allow the user to easily understand periods during the entire construction period of the operation site when safety measures need to be implemented with priority and the construction process corresponding to said periods. Therefore, the operation site management system 100 can allow the user to accurately and easily understand the safety status of the operation site of the work machine 60, and can further encourage the implementation of safety measures.
[0076] In addition, the server 25 transmits to the terminal device 70 the images (including the composite image) captured when the detection device 18 detects an event involving an accident risk, in association with the heat map. The terminal device 70 displays the images associated with the heat map.
[0077] As a result, the operation site management system 100 can visualize information on the detection effectiveness rate while reproducing, as an image, the situation at a location at the operation site where an event involving an accident risk is likely to occur. Therefore, the operation site management system 100 can allow the user to specifically understand, from the image, the cause of the event that occurred at a location at the operation site where the implementation of safety measures is required as a priority. Therefore, the operation site management system 100 can allow the user to more accurately and easily understand the safety situation at the operation site of the work machine 60, and can further encourage the implementation of safety measures.
[0078] Furthermore, the terminal device 70 accepts an input operation by the user specifying a position on the heat map and transmits it to the server 25. The server 25 transmits to the terminal device 70 images (including a composite image of these images) captured when the event was detected in a predetermined range including the position specified by the input operation. The terminal device 70 displays the images associated with the predetermined range including the position specified by the input operation.
[0079] As a result, the work site management system 100 allows the user to more specifically and easily grasp the cause of the event that occurred at a location in the work site where the implementation of safety measures is required as a priority. Therefore, the work site management system 100 allows the user to more accurately and more easily grasp the safety status of the work site of the work machine 60, and further encourages the implementation of safety measures.
[0080] As shown in Figure 6, the management screen of the operation site displayed on the terminal device 70 has at least an operating machine list window 33 that displays a list of work machines 60 operating at the operation site, an aggregation period window 36 that displays the period for which detection information of the detection device 18 is aggregated, a heat map window 37 that displays a heat map 38 superimposed on a map 39, a detection time period window 40 that displays the detection time period, a detection date window 41 that displays the detection date and operation details, and a detection direction window 42 that displays the detection direction of an object approaching the work machine 60.
[0081] The names of all work machines 60 operating at the work site are displayed in the operating machine list window 33. A switch 34 is assigned to the name of each work machine 60 in the operating machine list window 33. When a user viewing the terminal device 70 activates the switch 34, detection information from the detection device 18 provided on the activated work machine 60 is compiled. The operating machine list window 33 displays the detection effectiveness rate 35 of each work machine 60 in association with the name of each work machine 60.
[0082] The tally period window 36 can receive a user input operation that specifies the tally period for detection information of each detection device 18. The tally period window 36 displays the tally period for detection information specified by the user's input operation. Detection information for the tally period displayed in the tally period window 36 is tallied, and a heat map 38 is created and drawn.
[0083] The heat map window 37 displays a heat map 38 that expresses the number of detections or frequency of an event involving an accident risk at a detection location where the event was detected during the collection period as a change in color (change in hue, saturation, or brightness). The expression format of the heat map 38 may be a format in which the color is darker (brighter) in proportion to the density of the detection locations. The heat map 38 is displayed superimposed on a map 39 of the operation site.
[0084] The detection time window 40 displays the number of detections or the detection frequency of an event involving an accident risk for each predetermined time period as a detection time period based on the time when the event involving an accident risk was detected during the collection period. The detection date window 41 displays the number of detections of an event involving an accident risk during the collection period and a breakdown of the operations performed at the time of the detection of the event for each detection date of the event. In the example of FIG. 6, the operations are classified into traveling operation, turning operation, and other operations for each detection date, but this is not limited to this, and it is also possible to add the operation of the front working implement 5, or to add individual operations of the boom 9, arm 11, and bucket 13. The detection direction window 42 displays the breakdown of the detection direction of an object approaching the work machine 60 during the collection period as a percentage. The example of FIG. 6 shows that 50% of the detections were to the right of the work machine 60, 20% were to the left, and 30% were to the rear during the collection period.
[0085] The detection effectiveness rate 35 may be displayed for each work machine 60 in the operating machine list window 33 as shown in FIG. 6, or may be displayed in a dedicated window as shown in FIG. 7. In this case, the dedicated window for the detection effectiveness rate 35 may display the detection effectiveness rate of the object detection sensor included in the detection device 18 and the detection effectiveness rate of the anomaly detection sensor in a distinguished manner. That is, the switch 28 of the work machine 60 can be set to enable or disable the operation of the object detection sensor and the operation of the anomaly detection sensor in a distinguished manner. The recording device 22 can record the detection information of the object detection sensor and the detection information of the anomaly detection sensor in a distinguished manner. The recording device 22 can calculate and record the detection effectiveness rate of the object detection sensor and the detection effectiveness rate of the anomaly detection sensor in a distinguished manner. The server 25 can collect the detection information of the object detection sensor and the detection information of the anomaly detection sensor in a distinguished manner for each detection device 18, and create a heat map 38.
[0086] When any position on the heat map 38 shown in Figures 6 and 7 is specified by a user input operation (e.g., a click), a list of images captured when the event was detected within a specified range including the specified position or composite images of these (hereinafter also referred to as the "image list") is displayed.
[0087] FIG. 8 is a diagram showing a video list displayed on a terminal device 70 and linked to the heat map 38 shown in FIGS.
[0088] As shown in Fig. 8, the video list displayed on the terminal device 70 has a thumbnail column 43 displaying a thumbnail of the video, an occurrence date and time column 44 displaying the date and time when the event was detected, an event column 45 displaying the contents of the event, an operation details column 46 displaying the details of the operation being performed at the time when the event was detected, and a work machine column 47 identifying the work machine 60 on which the event was detected. Note that in the example of the hydraulic excavator D in Fig. 8, at the occurrence date and time of 12:45 on April 7, 2021, an approach from or to an object was detected to the left of the hydraulic excavator D, and a warning was issued, indicating that the operation at that time was a traveling operation.
[0089] When any row in the video list shown in FIG. 8 is designated by a user's input operation (e.g., clicking), a video playback screen is displayed for playing the video displayed in thumbnail column 43 of the designated row.
[0090] Fig. 9 is a diagram showing a video playback screen linked to the video list shown in Fig. 8 and displayed on terminal device 70. Fig. 10 is a diagram showing another example of the video playback screen shown in Fig. 9.
[0091] As shown in FIG. 9, the video playback screen displayed on terminal device 70 has a video title field 48 that displays the information listed in the video list, a map window 49 that displays a map 39 of the operation site including the detection location of the event, a video window 51 that plays back the video, and an operation information window 55 that displays at least one of the operation information and operation information at the time when the event was detected.
[0092] The map window 49 displays a map 39 of the work site similar to that in the heat map window 37. An icon 50 of the work machine 60 is displayed at the detection position of the event. For example, the video window 51 simultaneously displays four-split images of the front, rear, left, and right of the work machine 60 on the same screen. Alternatively, the video window 51 displays, for example, an overhead image showing the entire circumference of the work machine 60 from an upper viewpoint. The video window 51 switches between the four-split image and the overhead image or simultaneously displays them by a user's input operation (e.g., a click). The video in the video window 51 is played by pressing a play button 52 by a user's input operation (e.g., a click), and is stopped by pressing a stop button 53. The video in the video window 51 is adjusted in playback position by sliding the position of a seek bar 54 by a user's input operation (e.g., a drag or click). At least one of the operation information and the operation information is displayed in a graph format in the operation information window 55. The graph in the operation information window 55 is displayed in synchronization with the image in the image window 51. The graph in the operation information window 55 is displayed sliding in accordance with the position of the seek bar .
[0093] 10, the video playback screen displayed on the terminal device 70 may have a message field 56 that displays whether the operation of the detection device 18 is set to enabled or disabled at the playback position of the video in the video window 51. In other words, the work machine 60 can record in the recording device 22 not only video for a preset period spanning before and after the detection of the event, but also video for a period when the operation of the detection device 18 was set to disabled, and transmit the recorded video to the server 25.
[0094] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the above-mentioned embodiments, and various modifications can be made without departing from the spirit of the present invention. In the present invention, the configuration of one embodiment can be added to the configuration of another embodiment, the configuration of one embodiment can be replaced with the configuration of another embodiment, or a part of the configuration of one embodiment can be deleted. [Explanation of symbols]
[0095] 17: camera, 18: detection device, 22: recording device, 28: switch, 29a, 29b: machine information, 25: server, 60: work machine, 70: terminal device
Claims
1. A work machine comprising: a detection device that monitors the state of the work machine or the periphery of the work machine to detect an event occurring to the work machine that involves an accident risk; a recording device that records machine information including position information and operation information of the work machine and detection information of the detection device; and a switch that sets the operation of the detection device to enabled or disabled; a server that receives the machine information recorded in the recording device from a plurality of the work machines and compiles the plurality of pieces of machine information for each operation site of the work machines; a terminal device that receives the tabulated result of the machine information from the server and displays the result; A work site management system for managing a situation of the work site, the work machine calculates a ratio between the time during which the operation of the detection device is set to be enabled or disabled and the operating time of the work machine based on the setting information of the switch, and records the ratio in the recording device as part of the machine information; the server transmits to the terminal device a compilation result of the detection information of each detection device of the plurality of work machines and the ratio; The terminal device displays the aggregation result and the ratio of the detection information. A work machine operation site management system comprising:
2. the server compiles a detection count or detection frequency, which is the number of times or frequency at which the event was detected by each of the detection devices, and a detection location of the event, creates a heat map in which the detection count or the detection frequency at the detection location is expressed by color changes, draws the created heat map by superimposing it on a map of the operation site, and transmits the drawn heat map to the terminal device; The terminal device displays the heat map.
2. A work machine operation site management system according to claim 1.
3. the server collects detection time periods, which are time periods during which the events were detected by the detection devices, and transmits the collected detection time periods to the terminal device; The terminal device displays the detection time period.
3. A work machine operation site management system according to claim 2.
4. the server compiles a detection date, which is the date on which the event was detected by each of the detection devices, and a breakdown of the operation of each work machine that was being performed at the time the event was detected, and transmits the collected information to the terminal device; The terminal device displays the detection date and the details of the operation.
3. A work machine operation site management system according to claim 2.
5. the detection device detects, as the event, that a distance between an object in the vicinity of the work machine and the work machine falls below a predetermined distance and the object approaches the work machine; the server compiles a breakdown of detection directions, which are directions in which the object approaching the work machine was detected by each of the detection devices, and transmits the breakdown to the terminal device; The terminal device displays a breakdown of the detected directions.
3. A work machine operation site management system according to claim 2.
6. the terminal device accepts an input operation by a user to select the work machine that is a target for displaying the heat map, and transmits the input operation to the server; the server aggregates the detection information of the detection devices provided on the work machine selected by the input operation to create and draw the heat map, and transmits the drawn heat map to the terminal device; The terminal device displays the heat map for the work machine selected by the input operation.
3. A work machine operation site management system according to claim 2.
7. the terminal device accepts an input operation by a user specifying a period for which the detection information of each of the detection devices is to be collected, and transmits the input operation to the server; the server aggregates the detection information for the aggregation period specified by the input operation to create and draw the heat map, and transmits the drawn heat map to the terminal device; The terminal device displays the heat map for the aggregation period specified by the input operation.
3. A work machine operation site management system according to claim 2.
8. The work machine further includes a camera that captures images of the surroundings of the work machine, The recording device records the image captured when the event is detected by the detection device, together with the machine information; The work machine transmits the machine information including the image to the server, the server transmits the image to the terminal device in association with the heat map; The terminal device displays the image associated with the heat map.
3. A work machine operation site management system according to claim 2.
9. the terminal device accepts an input operation by a user specifying a position on the heat map and transmits the input operation to the server; the server transmits to the terminal device the video captured when the event is detected within a predetermined range including the position specified by the input operation; The terminal device displays the image associated with the predetermined range including the position specified by the input operation.
9. A work machine operation site management system according to claim 8.
Citation Information
Patent Citations
Construction machinery
JP6805883B2
