Video Recording Device

The integration of multiple cameras on construction machinery to create a synchronized composite overhead and forward view addresses the challenge of accurately capturing dangerous events, facilitating better incident investigation.

JP7588538B2Active Publication Date: 2024-11-22HITACHI CONSTRUCTION MACHINERY CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2021055711
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-29
Publication Date
2024-11-22
Estimated Expiration
2041-03-29

AI Technical Summary

Technical Problem

Existing video recording devices on construction machinery capture images only from the front, making it difficult to accurately determine the occurrence of dangerous events due to the machine's multi-directional movements and the bucket's perpendicular motion, which complicates the investigation of such incidents.

Method used

A video recording device that integrates images from multiple cameras mounted on a construction machine to create a composite overhead view, synthesizing these images with a forward view to provide a synchronized recording of both perspectives.

Benefits of technology

Enables accurate grasping of the occurrence situation of dangerous events by allowing simultaneous viewing of the machine's forward equipment and surrounding environment, enhancing the investigation of such incidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007588538000001
    Figure 0007588538000001
  • Figure 0007588538000002
    Figure 0007588538000002
  • Figure 0007588538000003
    Figure 0007588538000003
Patent Text Reader

Abstract

To provide a video recording device capable of accurately grasping the occurrence situation of a dangerous event.SOLUTION: A video recording device 20 is mounted on a construction machine 1 having a front device 4 and records videos captured by a plurality of cameras attached to the construction machine 1. The video recording device 20 comprises a video synthesizing unit 27 that synthesizes a bird's-eye view video using videos captured by a first camera 21, a second camera 22, a third camera 23, and a fourth camera 24, and a video recording unit 28 that records the bird's-eye view video synthesized by the video synthesizing unit 27 and a forward video imaged by the front camera 25 as one video in the same time series.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a video recording device mounted on a construction machine. [Background technology]

[0002] In the field of automobiles, dashcams are used to record images captured by cameras installed on the front and rear of the vehicle in order to investigate the cause of accidents. When an accident occurs, reviewing the images recorded in the dashcam helps to understand the situation at the time of the accident and helps to clarify the cause. Recently, in the field of construction machinery, there is an increasing need to install video recording devices such as dashcams in order to investigate the causes of dangerous events such as accidents and near misses.

[0003] 2. Description of the Related Art As an example of a video recording device mounted on a construction machine, as described in Patent Document 1, a camera is known that is attached to the front of a hydraulic excavator and provides the operator with information regarding the excavation status of the bucket. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6689763 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the camera described in Patent Document 1 only captures the image in front of the construction machine, so there is a problem in that the occurrence of a dangerous event cannot be accurately grasped only from the image in front of the construction machine captured by the camera. In response to this problem, the application of the above-mentioned automobile drive recorder to construction machines has been considered, but unlike automobiles, whose main purpose is to move and whose accident situation can be grasped from images in front and behind the vehicle, construction machines move in all directions by turning in addition to excavating with a bucket, so if an automobile drive recorder is applied as is, it is still not possible to accurately grasp the occurrence of a dangerous event.

[0006] One possible solution would be to use overhead video footage from cameras attached to the front, back, left and right sides of the construction machine. However, because the bucket of a construction machine moves perpendicular to the ground during excavation work, it is difficult to grasp the bucket's movement from overhead video footage, making it insufficient for investigating the cause of dangerous incidents.

[0007] In view of the above circumstances, an object of the present invention is to provide a video recording device that can accurately grasp the occurrence situation of a dangerous event. [Means for solving the problem]

[0008] The video recording device of the present invention is mounted on a construction machine equipped with a front device and records video captured by multiple cameras attached to the construction machine, wherein the multiple cameras include a front camera that captures an image in front of the construction machine including the front device, and the video recording device synthesizes an overhead image based on the images captured by the multiple cameras, and records the synthesized overhead image and the forward image captured by the front camera as a single image in the same chronological order.

[0009] In the video recording device according to the present invention, an overhead video is synthesized based on the videos captured by multiple cameras, and the synthesized overhead video and the front video captured by the front camera are recorded as one video in the same time series. Therefore, the front video showing the state of the front device and the overhead video of the surroundings of the construction machine can be viewed in one video, so that the movement of the front device and the situation around the construction machine can be confirmed simultaneously, and the occurrence of a dangerous event can be accurately grasped. Moreover, since the front video and the overhead video are recorded in the same time series, that is, the video is recorded while maintaining the temporal relationship between the two, the occurrence of a dangerous event can be grasped more accurately. Effect of the Invention

[0010] According to the present invention, the occurrence status of a dangerous event can be accurately grasped. [Brief description of the drawings]

[0011] [Figure 1] 1 is a side view showing a construction machine on which a video recording device is mounted. [Diagram 2] 1 is a configuration diagram showing a video recording device according to a first embodiment. [Diagram 3] FIG. 2 is a conceptual diagram showing an image recorded in the video recording device according to the first embodiment. [Figure 4] FIG. 11 is a configuration diagram showing a video recording device according to a second embodiment. [Diagram 5] FIG. 11 is a conceptual diagram showing an image recorded in a video recording device according to the second embodiment. [Figure 6] FIG. 13 is a conceptual diagram showing an image recorded in a video recording device according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] An embodiment of a video recording device according to the present invention will be described below with reference to the drawings, but before that, a construction machine in which the video recording device is installed will be described. In the following description, a hydraulic excavator will be used as an example of the construction machine, but the construction machine may be a crane or the like.

[0013] Fig. 1 is a side view showing a construction machine on which a video recording device is mounted. As shown in Fig. 1, the construction machine 1 includes a lower traveling body 2 that travels by driving a pair of left and right crawlers, an upper rotating body 3 that is rotatably provided on the upper part of the lower traveling body 2, and a front device 4 that is rotatably provided on the upper rotating body 3 in the vertical direction.

[0014] The lower traveling body 2, the upper rotating body 3, and the front device 4 each operate independently using hydraulic oil sent by a main pump 13. The main pump 13 is driven by an engine 17 serving as a prime mover.

[0015] The upper rotating body 3 has a cab 5 and a machine room 6. The cab 5 is provided on the left side of the upper rotating body 3. The machine room 6 is provided behind the cab 5. Inside the machine room 6, the above-mentioned main pump 13 and engine 17 are arranged.

[0016] The upper rotating body 3 is connected to the lower traveling body 2 so as to be rotatable relative to the lower traveling body 2, and is provided with a swing hydraulic motor 18. When the swing hydraulic motor 18 is driven, the upper rotating body 3 rotates relative to the lower traveling body 2. In addition, a pair of left and right traveling hydraulic motors 19 are disposed on the lower traveling body 2. When these traveling hydraulic motors 19 are driven, the left and right crawlers are respectively driven. This allows the lower traveling body 2 to move forward or backward.

[0017] The front device 4 is provided at the center of the front of the upper rotating body 3 and to the right of the operator's cab 5. This front device 4 has a boom 7, an arm 8, a bucket 9, a boom cylinder 10 for driving the boom 7, an arm cylinder 11 for driving the arm 8, and a bucket cylinder 12 for driving the bucket 9. The boom 7 is rotatably attached to the upper rotating body 3 via a rotating shaft 14. The arm 8 is rotatably attached to the tip of the boom 7 via a rotating shaft 15, and the bucket 9 is rotatably attached to the tip of the arm 8 via a rotating shaft 16.

[0018] The boom cylinder 10, arm cylinder 11, and bucket cylinder 12 are each composed of a hydraulic actuator and extend and retract using hydraulic oil supplied from a main pump 13 to drive the boom 7, arm 8, and bucket 9 to perform tasks such as excavation and leveling.

[0019] [First embodiment] Fig. 2 is a configuration diagram showing the video recording device according to the first embodiment. As shown in Fig. 2, the construction machine 1 further includes a plurality of cameras (a first camera 21, a second camera 22, a third camera 23, a fourth camera 24, and a front camera 25), a video recording device 20 that records images captured by these cameras, a monitor 26 for displaying information, etc., and a communication unit 29 for connecting to a network 30.

[0020] The monitor 26 is disposed in the cab 5, and displays various information and the like to inform the operator. The communication unit 29 is formed of a wireless device for connecting to a network 30, for example.

[0021] The first camera 21 is attached, for example, to the front of the upper rotating body 3, and captures an image in front of the construction machine 1 and outputs the captured image to an image synthesis unit 27 (described later) of the image recording device 20. The second camera 22 is attached, for example, to the right side of the upper rotating body 3, and captures an image to the right of the construction machine 1 and outputs the captured image to the image synthesis unit 27. The third camera 23 is attached, for example, to the rear of the upper rotating body 3, and captures an image to the rear of the construction machine 1 and outputs the captured image to the image synthesis unit 27. The fourth camera 24 is attached, for example, to the left side of the upper rotating body 3, and captures an image to the left of the construction machine 1 and outputs the captured image to the image synthesis unit 27.

[0022] On the other hand, the front camera 25 is attached to the outside of the cab 5, captures images of the area in front of the construction machine 1 including the front device 4, and outputs the captured images to a video recording unit 28 (described later) of the video recording device 20. More specifically, the front camera 25 is attached to the outside of the windshield of the cab 5, and captures images of the area in front of the construction machine 1 including the front device 4 as well as part of the lower traveling body 2 (described in detail later).

[0023] Both the front camera 25 and the first camera 21 capture images in front of the construction machine 1, but the front camera 25 captures an image of a relatively close range including the front device 4, while the first camera 21 captures an image of a relatively distant range. In this embodiment, the first camera 21 captures an image of a range farther away than the front device 4. For this reason, the image captured by the front camera 25 includes the front device 4, but the image captured by the first camera 21 does not include the front device 4.

[0024] The video recording device 20 is connected to each device of the construction machine 1, including the monitor 26, via an on-board network 33 such as a CAN (Controller Area Network). The video recording device 20 is configured, for example, by a microcomputer that combines a CPU (Central Processing Unit) that executes calculations, a ROM (Read Only Memory) as a secondary storage device that records programs for the calculations, and a RAM (Random Access Memory) as a temporary storage device that records the progress of the calculations and temporary control variables, and performs processes such as compositing, processing, and recording of images by executing the stored programs.

[0025] The video recording device 20 includes a video synthesis unit 27 and a video recording unit 28. The video synthesis unit 27 synthesizes an overhead video using the videos captured by the first camera 21, the second camera 22, the third camera 23, and the fourth camera 24. Specifically, the video synthesis unit 27 synthesizes the videos captured and output by the first camera 21, the second camera 22, the third camera 23, and the fourth camera 24 into an overhead video of the entire surroundings of the construction machine 1 (i.e., a surround view that allows a 360° view of the surroundings to be confirmed). A method for synthesizing an overhead video using the videos captured by the cameras may use a well-known technique, and detailed description thereof will be omitted. Then, the video synthesis unit 27 outputs the synthesized overhead video to the video recording unit 28 via the video transmission cable 31 and to the monitor 26 via the video transmission cable 32.

[0026] Video recording unit 28 records the forward image captured by forward camera 25 and the overhead image synthesized by image synthesis unit 27 as one image in the same chronological order. In addition, video recording unit 28 uploads the one image to network 30 via communication unit 29.

[0027] 3 is an image diagram showing an image recorded in the image recording device according to the first embodiment. As shown in FIG. 3, in one image recorded in the image recording unit 28, a front image 34 captured by the front camera 25 is arranged at the top, and an overhead image 35 synthesized by the image synthesis unit 27 is arranged at the bottom. In addition to the front device 4, the front image 34 includes a part of the crawler as the lower traveling body 2 and an excavation site 36 as the work target. On the other hand, the overhead image 35 includes an overhead image of the entire periphery of the construction machine 1. Note that the lines displayed in the overhead image 35 are the seams between adjacent images.

[0028] The image recorded in the image recording unit 28 is not necessarily limited to the image shown in FIG. 3. For example, the overhead image 35 may be arranged at the top of the image and the forward image 34 at the bottom, or the forward image 34 and the overhead image 35 may be arranged side by side in the left-right direction.

[0029] It is preferable to unify the orientation of the images when arranging the forward image 34 and the overhead image 35. That is, when the forward image 34 shown in Fig. 3 is arranged to match the line of sight of the operator, the overhead image 35 is arranged so that the forward part in the overhead image 35 also matches the forward image 34. In Fig. 3, the forward image 34 and the overhead image 35 are arranged so that the top is the front of the construction machine 1, the bottom is the rear of the construction machine 1, the left is the left side of the construction machine 1, and the right is the right side of the construction machine 1, in accordance with the line of sight of the operator. In this way, the orientation of the construction machine 1 can be intuitively grasped.

[0030] According to the video recording device 20 of this embodiment, the video synthesis unit 27 synthesizes the overhead video 35 based on the videos captured by the first camera 21, the second camera 22, the third camera 23, and the fourth camera 24, and the video recording unit 28 records the front video captured by the front camera 25 and the overhead video synthesized by the video synthesis unit 27 as one video in the same chronological order. Therefore, the front video 34 showing the state of the work of the front device 4 and the overhead video 35 of the entire surroundings of the construction machine 1 can be viewed in one video, so that the movement of the front device 4, the traveling state of the lower traveling body 2, the rotation state of the upper rotating body 3, and the surrounding conditions of the construction machine 1 can be simultaneously confirmed, and the occurrence of a dangerous event can be accurately grasped. Moreover, the front video 34 and the overhead video 35 are recorded in the same chronological order, that is, the forward video 34 and the overhead video are recorded in a state in which the temporal relationship between them is maintained, so that the occurrence of a dangerous event can be grasped more accurately. As a result, it becomes easier to investigate the cause of the occurrence of a dangerous event.

[0031] [Second embodiment] A second embodiment of the video recording device will be described below with reference to Figures 4 and 5. Video recording device 20A of this embodiment differs from the first embodiment described above in that an overhead image is synthesized using images captured by second camera 22, third camera 23, fourth camera 24, and front camera 25. Other structures are similar to those of the first embodiment, so repeated explanations will be omitted.

[0032] As shown in Fig. 4, the construction machine 1 on which the video recording device 20A of this embodiment is mounted is not equipped with the first camera 21 that captures an image in front of the construction machine 1, and when synthesizing an overhead image, the image synthesis unit 27 uses the forward image captured by the forward camera 25 in addition to the images captured by the second camera 22, the third camera 23, and the fourth camera 24. For this reason, the image synthesis unit 27 and the forward camera 25 are connected by an image transmission cable 37. The forward camera 25 outputs the captured forward image to the image recording unit 28, and also outputs it to the image synthesis unit 27 via the image transmission cable 37.

[0033] The image synthesis unit 27 synthesizes an overhead image using images captured by the second camera 22, the third camera 23, the fourth camera 24 and the front camera 25, and outputs the synthesized overhead image to the monitor 26 and the image recording unit 28, respectively.

[0034] Fig. 5 is an image diagram showing an image recorded in the image recording device according to the second embodiment. As shown in Fig. 5, in one image recorded in the image recording unit 28, a front image 34 captured by the front camera 25 is arranged at the top, and an overhead image 35 synthesized by the image synthesis unit 27 is arranged at the bottom. Since the front image captured by the front camera 25 is used as the overhead image 35, the portion of the overhead image 35 corresponding to the front image also includes images of the boom 7, arm 8, and bucket 9, as well as the front image 34.

[0035] It is preferable that the overhead image 35 includes an image of the movement of the front equipment 4, that is, the movement of the boom 7, the arm 8, and the bucket 9. In this way, the working status of the front equipment 4 can be confirmed through the overhead image 35 in addition to the forward image 34, so that the occurrence of a dangerous event can be more accurately grasped by checking the working status of the front equipment 4 from different angles.

[0036] According to the video recording device 20A of this embodiment, in addition to obtaining the same effect as the first embodiment described above, it is possible to omit the first camera 21 by using the forward image captured by the forward camera 25 to synthesize the overhead image, so that a cost reduction effect can be expected.

[0037] [Third embodiment] The overhead image synthesized by the image synthesis unit 27 does not necessarily have to be an overhead image of the entire surroundings of the construction machine 1, and since the situation in front of the construction machine 1 can be confirmed via the forward image 34 captured by the forward camera 25, it may be an overhead image of the surroundings of the construction machine 1 excluding the area in front of the construction machine 1.

[0038] Therefore, in the third embodiment, the first camera 21 that captures an image in front of the construction machine 1 is not attached, and when synthesizing an overhead image, the image synthesis unit 27 uses only the images captured by the second camera 22, the third camera 23, and the fourth camera 24. The synthesized overhead image shows the left side, rear, and right side of the construction machine 1, as shown in Fig. 6, for example, and the portion showing the front of the construction machine 1 is painted black.

[0039] In this way, the situation in front of the construction machine 1 can be confirmed via the forward image 34 captured by the forward camera 25, and the situations to the left, right, and rear of the construction machine 1 can be confirmed via the overhead image 35, making it possible to accurately grasp the occurrence of a dangerous event.

[0040] In addition to the above-described embodiment, the video recording device of the present invention can be modified in various ways. Two typical examples will be described below.

[0041] [Variation 1] In the first modified example, the front camera 25 described in the first embodiment is eliminated, and the first camera 21 is used to capture an image of the area in front of the construction machine 1 including the front device 4. The front images captured by the first camera 21 are output to the image synthesis unit 27 and the image recording unit 28. That is, the image captured by the front camera 25 is used to synthesize the overhead image 35, and is also used for the front image 34. In this case, the first camera 21 corresponds to the "front camera" recited in the claims.

[0042] According to such a modified example, in addition to obtaining the same effects as those of the first embodiment, the number of cameras can be reduced, and therefore, the effect of reducing costs can be expected.

[0043] [Variation 2] In the second modified example, the front camera 25 described in the first embodiment is attached inside the cab 5, and the front camera 25 can be used to capture an image of the hands of the operator of the construction machine 1 in addition to the front device 4 and the crawler. Therefore, the forward image captured by the front camera 25 includes an image of the hands of the operator of the construction machine 1 in addition to the image of the front device 4 and the image of the crawler of the lower traveling body 2.

[0044] According to this modified example, in addition to obtaining the same effect as the first embodiment, the operating status of the operator can be confirmed via the forward image 34 captured by the forward camera 25, so that the occurrence of a dangerous event can be grasped more accurately.

[0045] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various design modifications can be made without departing from the spirit of the present invention as described in the claims. [Explanation of symbols]

[0046] 1. Construction machinery 2 Undercarriage 3. Upper rotating body 4 Front equipment 20,20A Video recording device 21 Camera No. 1 22 Second Camera 23 Third Camera 24 4th Camera 25 Front Camera 26 Monitor 27 Video synthesis section 28 Video Recording Section 29 Communications Department 30 Network 31,32 Video transmission cable 33 In-vehicle network

Claims

1. A video recording device that is mounted on a construction machine equipped with a front device and records images captured by a plurality of cameras attached to the construction machine, the plurality of cameras include at least a front camera that images a front of the construction machine including the front device, a second camera that images a right side of the construction machine, a third camera that images a rear side, and a fourth camera that images a left side of the construction machine, The video recording device is A video recording device comprising: an image synthesis unit that synthesizes an overhead image of the surroundings of the construction machine based on images captured by at least the second camera, the third camera, and the fourth camera among the multiple cameras; and a video recording unit that records the synthesized overhead image and a forward image including the front device captured by the front camera as a single image in the same chronological order, wherein the forward image recorded as the single image in the video recording unit is positioned so as to coincide with the front in the overhead image.

2. 2. The video recording device according to claim 1, wherein the forward image captured by the forward camera further includes an image of at least one of a lower body of the construction machine and the hands of an operator of the construction machine.

3. 3. The video recording device according to claim 1, wherein the overhead image is an overhead image of the surroundings of the construction machine excluding an area in front of the construction machine, or an overhead image of the entire surroundings of the construction machine.

4. 4. The video recording device according to claim 1, wherein the overhead image includes an image of the movement of the front device.

5. The plurality of cameras further includes a first camera that captures an image of the front of the construction machine that is farther away than the front device without including the front device, 2. The video recording device according to claim 1, wherein the video synthesis unit synthesizes an overhead video from the videos captured by the first camera, the second camera, the third camera, and the fourth camera.

Citation Information

Patent Citations

  • Drive information recording device and vehicle periphery image reproduction system

    JP2012253609A

  • Work machine

    JP2016194237A

  • Excavator

    JP6689763B2