Vehicle information collection system
The vehicle body information collection system accurately determines the cause of dangerous events in construction machinery by combining operational and condition data with visual imagery, improving safety by identifying the root cause of incidents.
Patent Information
- Application Number
- JP2021059058
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-31
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2041-03-31
AI Technical Summary
Existing vehicle body information collection systems for construction machinery struggle to accurately determine the cause of dangerous events, as they cannot differentiate between the operation of the construction machine's body, its condition, or the surrounding situation.
A vehicle body information collection system that includes an information detection device to detect vehicle operation and condition information, cameras to capture surroundings, and a control device to record and extract relevant data when changes are detected, allowing for a comprehensive analysis of vehicle operation and condition before and after the event.
Enables accurate identification of the cause of dangerous events by integrating operational and condition data with visual imagery, enhancing the understanding of the event's origin and preventing future accidents.
Smart Images

Figure 0007588540000001 
Figure 0007588540000002 
Figure 0007588540000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a vehicle body information collection system, and more particularly to a vehicle body information collection system for a construction machine. [Background technology]
[0002] In the field of automobiles, dashcams are used to record images captured by cameras attached to the front and rear of the vehicle in order to investigate the cause of accidents. When an accident occurs, reviewing the images recorded in the dashcam helps to understand the circumstances at the time of the accident and helps to clarify the cause. Recently, in the field of construction machinery, there is an increasing need to install recording devices such as dashcams in order to investigate the causes of dangerous events such as accidents and near misses.
[0003] For example, Patent Document 1 discloses a technology that includes multiple cameras that are attached to a rotating body of a construction machine and capture images in different directions, a recording device that records video captured by the cameras, a camera selection device that selects a camera from the multiple cameras according to the operation of the construction machine, and a control device that records the video captured by the camera selected by the camera selection device in the recording device. According to this technology, a camera according to the operation of the construction machine is selected, which reduces pressure on the recording device capacity compared to recording videos from all cameras, and makes it easy to grasp the situation around the construction machine when an accident occurs from the video. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2018-53537 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, with the technology described in Patent Document 1, when an accident occurs, it is difficult to determine whether the cause is due to the operation of the construction machine, the condition of the construction machine, or the surrounding conditions, so there is a problem in that the cause of the dangerous event cannot be accurately identified.
[0006] In view of the above circumstances, an object of the present invention is to provide a vehicle information gathering system that can accurately grasp the cause of a dangerous event. [Means for solving the problem]
[0007] The vehicle body information collection system of the present invention comprises an information detection device that detects at least one of information regarding the vehicle body operation of a construction machine and information regarding the vehicle body condition, a camera that captures images of the surroundings of the construction machine, a recording device that records the information detected by the information detection device and the images captured by the camera, and a control device, wherein the control device detects a change in at least one of the vehicle body operation and the vehicle body condition based on the information detected by the information detection device, and when a change is detected, extracts the information detected by the information detection device and the image captured by the camera within a predetermined time width before and after the time the change was detected, and records them in the recording device.
[0008] In the vehicle information collection system according to the present invention, the control device detects at least one change in vehicle operation and vehicle state based on information detected by the information detection device, and when a change is detected, extracts the information detected by the information detection device and the video captured by the camera for a predetermined time width before and after the time the change is detected, and records them in the recording device. In this way, in addition to the video for the predetermined time width before and after the time the change is detected, at least one of the information on vehicle operation and the information on the vehicle state for a predetermined time width before and after the time the change is detected is also recorded, so that by looking back using both the video and the detection information, the cause of the occurrence of a dangerous event can be grasped more accurately than when looking back using only the video as in the conventional case. Effect of the Invention
[0009] According to the present invention, the cause of a hazardous event can be accurately grasped. [Brief description of the drawings]
[0010] [Figure 1] 1 is a schematic configuration diagram showing a vehicle body information collection system according to an embodiment; [Diagram 2] 1 is a block diagram showing a vehicle body information collection system according to an embodiment; [Diagram 3] 4 is an example showing a change in the operation input amount of a turning operation lever. [Figure 4] 1 is an example showing a change in the posture of a construction machine. [Diagram 5] 1A and 1B are diagrams illustrating changes in the posture of a construction machine. [Figure 6] FIG. 2 is a diagram showing an example of data recording in a recording device. [Figure 7] 13 is an example showing the content displayed on the terminal device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, an embodiment of a vehicle body information collection system according to the present invention will be described with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals and duplicated explanations will be omitted.
[0012] Fig. 1 is a schematic configuration diagram showing a vehicle body information collection system according to an embodiment, and Fig. 2 is a block diagram showing the vehicle body information collection system according to an embodiment. The vehicle body information collection system 1 of this embodiment includes a construction machine 10, a server device 20 configured to be able to communicate with the construction machine 10, and a terminal device 30 configured to be able to communicate with the server device 20.
[0013] Examples of the construction machine 10 include hydraulic excavators, cranes, wheel loaders, bulldozers, dump trucks, etc., but here, an example of a hydraulic excavator will be described. The construction machine 10 includes a lower traveling body 11 having a pair of left and right crawlers (tracks), an upper rotating body 12 rotatably provided on the upper part of the lower traveling body 11, and a front device 13 rotatably provided on the upper rotating body 12 in the vertical direction.
[0014] The lower traveling body 11, the upper rotating body 12, and the front device 13 each operate independently using hydraulic oil sent from a main hydraulic pump (not shown). The main hydraulic pump is driven by an engine (not shown) serving as a prime mover.
[0015] A pair of left and right traveling hydraulic motors 111 are disposed on the lower traveling structure 11. When these traveling hydraulic motors 111 are driven, the left and right crawlers are respectively driven. This enables the lower traveling structure 11 to move forward or backward.
[0016] The upper rotating body 12 is connected vertically to the lower traveling body 11 with a rotating device 121 as its axis. When a swing hydraulic motor (not shown) of the swing device 121 is driven, the upper rotating body 12 swings relative to the lower traveling body 11. The upper rotating body 12 has a cab 122 and a machine room 123. The cab 122 is provided on the left side of the upper rotating body 12. The machine room 123 is provided behind the cab 122. Inside the machine room 123, the above-mentioned main hydraulic pump, engine, etc. are arranged.
[0017] The front device 13 is attached to the upper rotating body 12 so as to be rotatable in the vertical direction. The front device 13 has a boom 131, an arm 132, a bucket 133, and cylinders (boom cylinder, arm cylinder, bucket cylinder) that drive these, respectively. Each cylinder is made of a hydraulic actuator and expands and contracts by hydraulic oil sent from the main hydraulic pump.
[0018] The construction machine 10 also includes four cameras (front camera 14a, rear camera 14b, left camera 14c, and right camera 14d), two GNSS (Global Navigation Satellite System) antennas 15a, 15b, a communication device 16, a recording device 17, an information detection device 18, and a control device 19.
[0019] The forward camera 14a is attached, for example, to the outside of the windshield of the cab 122, captures an image in front of the construction machine 10, and outputs the captured image to the recording device 17. The rearward camera 14b is attached, for example, to the rear of the machine room 123, captures an image in the rear of the construction machine 10, and outputs the captured image to the recording device 17. The left camera 14c is attached, for example, to the left side of the upper rotating body 12, captures an image to the left of the construction machine 10, and outputs the captured image to the recording device 17. The right camera 14d is attached, for example, to the right side of the upper rotating body 12, captures an image to the right of the construction machine 10, and outputs the captured image to the recording device 17. Hereinafter, these cameras may be collectively referred to as cameras 14.
[0020] The GNSS antennas 15a and 15b receive signals (in other words, radio waves) from multiple positioning satellites (not shown) located above the Earth, and acquire position information (e.g., latitude, longitude, altitude) of the construction machine 10 based on the received signals. The position information acquired by the GNSS antennas 15a and 15b is output to the recording device 17 and the control device 19, respectively.
[0021] The communication device 16 is, for example, a wireless device for communicating with the server device 20 via a wireless base station 21 .
[0022] The information detection device 18 is a type of sensor that is attached to the construction machine 10 and detects information related to vehicle body operation and vehicle body state. First, "vehicle body operation" and "vehicle body state" will be described.
[0023] In this embodiment, the lower traveling body 11, the upper rotating body 12, and the front device 13 constitute the body of the construction machine 10. Therefore, "body operation" refers to the motion of the lower traveling body 11, the upper rotating body 12, and the front device 13 caused by the operation of the operator or remote operation. On the other hand, "body state" includes the states of the engine, the main hydraulic pump, the pilot hydraulic pump, etc., for realizing body operation, and the fastening and unfastening state of the seat belt. Examples of the engine state include the ON / OFF switching state of the engine, the switching state of the engine speed, etc.
[0024] In addition to the above-mentioned GNSS antennas 15a, 15b, the sensors that detect information related to vehicle operation include a vehicle IMU (Inertial Measurement Unit) that detects the angular velocity and acceleration of the upper rotating body 12, a boom IMU that detects the attitude of the boom 131, an arm IMU that detects the attitude of the arm 132, a bucket IMU that detects the attitude of the bucket 133, a rotation angle sensor that detects the rotation angle between the upper rotating body 12 and the lower running body 11, sensors that detect the operation input amount of each operating lever, sensors that detect the amount of oil flowing in each cylinder, and sensors that detect the amount of oil flowing in each hydraulic motor.
[0025] On the other hand, examples of sensors for detecting information related to the vehicle body state include a sensor for detecting engine speed, a sensor for detecting hydraulic oil temperature, a sensor for detecting pilot oil pressure, a sensor for detecting the load (pressure) of each cylinder, etc. Information detection device 18 outputs information detected by each sensor to recording device 17 and control device 19, respectively.
[0026] The recording device 17 is, for example, made of a non-volatile memory, and has a constant record storage unit 171 and an event record storage unit 172. The constant record storage unit 171 constantly records the images output from the front camera 14a, the rear camera 14b, the left camera 14c, and the right camera 14d, and the detection information output from the information detection device 18. On the other hand, when a change in at least one of the vehicle body operation and the vehicle body state is detected, the event record storage unit 172 records, as an event record, the images of the camera 14 and the detection information of the information detection device 18 for a predetermined time width before and after the time when the change is detected, in accordance with an instruction from the control device 19.
[0027] In the continuous record storage unit 171, when the memory capacity reaches the maximum value as shown in Fig. 6(a), a method is used in which a predetermined amount of old data (i.e., detection information and video) is sequentially erased and new data is overwritten, or when the memory capacity reaches the maximum value as shown in Fig. 6(b), a method is used in which all old data is erased and new data is recorded. On the other hand, in the event record storage unit 172, the data is not erased or overwritten until transmission to the server device 20 described later is completed and the data can be confirmed by an administrator or supervisor (hereinafter referred to as "administrator, etc.").
[0028] The control device 19 is configured by a microcomputer that combines, for example, a CPU (Central Processing Unit) that executes calculations, a ROM (Read Only Memory) as a secondary storage device that records programs for the calculations, and a RAM (Random Access Memory) as a temporary storage device that stores the calculation progress and temporary control variables, and controls the entire construction machine 10 by executing the stored programs. For example, the control device 19 periodically transmits the images and detection information recorded in the continuous record storage unit 171 to the server device 20 via the communication device 16.
[0029] As shown in Fig. 2, the control device 19 of this embodiment has a change detection unit 191. The change detection unit 191 detects a change in at least one of the vehicle body operation and the vehicle body state based on the information detected by the information detection device 18. More specifically, the change detection unit 191 detects a change in at least one of the vehicle body operation and the vehicle body state by comparing the information detected by the information detection device 18 with a preset threshold. For example, the change detection unit 191 detects a state in which the amount of change in the vehicle body operation or the vehicle body state in a predetermined time or unit time is equal to or greater than a predetermined threshold.
[0030] The thresholds here are set for each part (e.g., model part) related to vehicle body operation and vehicle body state, divided into a start-up stage, an operating stage, and a stop stage. For example, in the case of an engine, thresholds are set for the engine start, operating, and stop, respectively.
[0031] Model parts related to the operation of the lower traveling body 11 include, for example, a traveling operation lever, a traveling hydraulic motor 111, a crawler, a sprocket, etc. Model parts related to the operation of the upper rotating body 12 include, for example, a swing operation lever, a swing hydraulic motor, etc. Model parts related to the operation of the front device 13 include, for example, each operation lever for operating the boom 131, the arm 132, and the bucket 133, a boom cylinder, an arm cylinder, a bucket cylinder, etc. On the other hand, model parts related to the vehicle body state include, for example, an engine, a main hydraulic pump, a pilot hydraulic pump, a seat belt, etc.
[0032] A specific example of change detection by the change detection section 191 will be described below with reference to FIGS.
[0033] FIG. 3 is an example showing changes in the amount of operation input to a turning operation lever. As shown in FIG. 3, a series of turning operations is divided into, for example, a start-up stage, an operating stage, and a stop stage. In each stage, a threshold value for the amount of operation input to the turning operation lever is set based on past experience, etc. In FIG. 3, the dashed lines indicate the set threshold values, and the solid lines indicate the detection values (i.e., detection information) detected by a sensor that detects the amount of operation input to the operation lever. Note that in FIG. 3, the dashed lines in parts of the start-up stage, operating stage, and stop stage overlap with the detection values indicated by the solid lines, and are therefore invisible.
[0034] As shown by the dashed line in Fig. 3, the threshold value for the operation input amount of the swing operation lever is set to gradually increase at the start stage, be kept at a constant value at the operation stage, and gradually decrease at the stop stage. The detected value shown by the solid line suddenly decreases at point 115. At this time, the change detection unit 191 compares the detected value with the set threshold value and detects that a change has occurred in the operation input amount of the swing operation lever.
[0035] The threshold value may be a fixed value with no fluctuation range, or may have a certain fluctuation range (for example, a fluctuation range of ±30%) from the average value. The threshold value may also be arbitrarily changed by a manager, etc. This is effective when a manager, etc. at a construction site wants to restrict speed or sudden operations, and can ensure that on-site workers comply with the safety regulations at the construction site.
[0036] 4 is an example showing a change in the attitude of the construction machine. The attitude of the construction machine 10 is calculated by the control device 19 based on, for example, the detection results of the GNSS antennas 15a and 15b and the angular velocity detected by the vehicle body IMU.
[0037] In normal work, the posture of the construction machine 10 hardly changes over time. For example, as shown in Fig. 4, if the posture of the construction machine 10 changes suddenly in section 116, the change detection unit 191 detects that a change has occurred in the posture of the construction machine 10. Examples of sudden changes in the posture of the construction machine 10 include when the construction machine 10 loses balance on a slope and falls or crashes, when one of the tracks falls into a ditch, or when the suspended load swings and tips over, as shown in Fig. 5.
[0038] The threshold for detecting a change in the attitude of the construction machine 10 is set to have a fluctuation range of ±30% relative to the average value of the attitude position defined by the GNSS antennas 15a, 15b over a one-minute period, for example.
[0039] As described above, when the change detection unit 191 detects a change in at least one of the vehicle body operation and the vehicle body state, the control device 19 extracts the information detected by the information detection device 18 and the image captured by the camera 14 for a predetermined time width before and after the time the change is detected, and records them in the event record storage unit 172. For example, when a change in the operation input amount of the turning operation lever is detected by the change detection unit 191 as described above, the control device 19 extracts from the continuous record storage unit 171 the detection information of the information detection device 18 and the image of the camera 14 for 30 seconds (a total of 60 seconds) before and after the time the change is detected, and records them in the event record storage unit 172 as an event record.
[0040] At this time, the control device 19 also transmits the event record to the server device 20 via the communication device 16 in real time.
[0041] On the other hand, the server device 20 is a cloud server that manages multiple construction machines including the construction machine 10, and is communicably connected to the construction machine 10 via, for example, a wireless base station 21. The server device 20 is configured by a microcomputer that combines, for example, a CPU that executes calculations, a ROM as a secondary storage device that records programs for the calculations, and a RAM as a temporary storage device that saves the calculation progress and temporary control variables, and collects and manages vehicle body information of the construction machine 10 by executing the stored programs.
[0042] For example, the server device 20 records and stores the detection information and video periodically transmitted from the construction machine 10 (i.e., the same as the content recorded in the constant record storage unit 171), and the event record transmitted in real time when a change is detected (i.e., the same as the detection information and video recorded in the event record storage unit 172). When an event record transmitted from the construction machine 10 is received, the server device 20 transmits the event record to the terminal device 30 in real time, and causes the terminal device 30 to display the event record.
[0043] The terminal device 30 is a terminal such as a PC (Personal Computer), tablet, or smartphone that is communicatively connected to the server device 20 and has a display screen that displays information transmitted from the server device 20. The terminal device 30 is owned by, for example, an administrator.
[0044] Fig. 7 is an example showing the contents displayed on the terminal device. As shown in Fig. 7, the display screen 31 of the terminal device 30 is provided with a video display section 311 that displays the video recorded as an event record, and an information display section 312 that displays the detection information recorded as an event record. In addition, a seek bar and the change detection time are displayed at the bottom of the display screen 31. Note that a pin mark 313 displayed on the seek bar indicates the position of the change detection time.
[0045] The administrator or the like can then check the detection information and video for a predetermined time span before and after the time the change was detected by viewing the content displayed on the display screen 31. The administrator or the like can also freely adjust the playback position of the video by operating the seek bar.
[0046] In the vehicle body information collection system 1 according to this embodiment, the change detection unit 191 detects at least one change in the vehicle body operation and the vehicle body state based on the information detected by the information detection device 18, and when a change is detected, the control device 19 extracts the detection information of the information detection device 18 and the image of the camera 14 for a predetermined time width before and after the time when the change is detected, and records them as an event record in the event record storage unit 172. In addition to the image for the predetermined time width before and after the time when the change is detected, at least one of the information on the vehicle body operation and the information on the vehicle body state for the predetermined time width before and after the time when the change is detected is also recorded. Therefore, by looking back using both the image and the detection information, the cause of the occurrence of a dangerous event can be grasped more accurately than when looking back using only the image as in the conventional case.
[0047] In other words, by looking back using both the video and the detection information, it is easy to determine whether the cause of the dangerous event was due to the operation of the construction machine 10, the condition of the vehicle, or the surrounding conditions, so that the cause of the dangerous event can be accurately identified.
[0048] Furthermore, by recording the event record in this manner, it is possible to prevent the record from being forgotten and to eliminate the need to search for data to determine the cause of the occurrence of a dangerous event.
[0049] In addition, when a change is detected, the manager or the like can check the detection information and video for a predetermined time span around the time the change was detected in real time via the terminal device 30, so that the cause of the near miss can be quickly and accurately grasped and accidents can be prevented by alerting the operator. For example, if a certain near miss occurs frequently and the manager or the like can read from the detection information and video displayed on the terminal device 30 that there is a possibility of operator fatigue or environmental changes at the work site, accidents can be prevented by alerting the operator or improving the work site environment.
[0050] Furthermore, by constantly monitoring the construction machine 10 via the information detection device 18 and detecting changes in at least one of the vehicle operation and vehicle condition of the construction machine 10 via the change detection unit 191, a certain sense of tension can be created in the operator, which also contributes to improving the operator's safety awareness.
[0051] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various design modifications can be made without departing from the spirit of the present invention as described in the claims. [Explanation of symbols]
[0052] 1 Vehicle information collection system 10. Construction machinery 11 Undercarriage 12 Upper rotating body 13 Front equipment 14a Front camera 14b Rear camera 14c Left camera 14d Right camera 15a, 15b GNSS antenna 16 Communication Equipment 17 Recording Devices 18 Information detection device 19 Control device 20 Server device 30 Terminal Equipment 171 Permanent Records Storage Department 172 Event Records Storage Department 191 Change detection section
Claims
1. An information detection device for detecting at least one of information related to vehicle body operation of a construction machine having a hydraulic pump driven by a prime mover and a front device operated by hydraulic oil supplied from the hydraulic pump and information related to a vehicle body state for realizing the vehicle body operation; A camera that captures an image of the surroundings of the construction machine; a recording device that records the information detected by the information detection device and the image captured by the camera; A control device; Equipped with The information detection device has a sensor that detects the operation of the construction machine including the front device caused by the operation as a sensor that detects information related to the vehicle body operation, and has a sensor that detects the state of the prime mover or the hydraulic pump for realizing the vehicle body operation as a sensor that detects information related to the vehicle body state, The control device detects changes in at least one of vehicle operation and vehicle condition based on information detected by the information detection device, and when a change is detected, extracts the information detected by the information detection device and the image captured by the camera during a predetermined time period before and after the time the change was detected, and records them in the recording device.This vehicle information collection system is characterized by the above.
2. the control device detects a change in at least one of a vehicle body operation and a vehicle body state by comparing the information detected by the information detection device with a preset threshold value; 2. The vehicle body information collecting system according to claim 1, wherein the threshold values are set for each part related to vehicle body operation and vehicle body state, separately for a start-up stage, an operating stage, and a stop stage.
3. The construction machine further includes a server device configured to be able to communicate with the construction machine, The vehicle body information collection system according to claim 1 or 2, wherein the control device transmits to the server device information detected by the information detection device and video captured by the camera within a predetermined time period before and after the change in at least one of the vehicle body operation and the vehicle body state is detected.
4. The server device further includes a terminal device configured to be able to communicate with the server device, The vehicle body information collection system of claim 3, wherein the server device transmits to the terminal device information detected by the information detection device and images captured by the camera during a predetermined time period before and after the change in at least one of the vehicle body operation and the vehicle body state is detected, and displays the information on the terminal device.
Citation Information
Patent Citations
Work machine
JP2018053537A
Data processing system of construction machine
JP2021022179A
