Work machine and work system

By attaching image pickup devices to the ends of the work machine body to capture images of the side surfaces and surroundings, the system addresses the limitation of existing cameras, enabling better obstacle detection and crawler direction awareness, thus enhancing operational safety and efficiency.

JP2025068502APending Publication Date: 2025-04-28KOBELCO CONSTR MASCH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023178456
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-10-16
Publication Date
2025-04-28

AI Technical Summary

Technical Problem

Existing cameras on work machines are unable to capture images of the front-rear and surroundings of the machine body, limiting the ability to confirm the position of obstacles and the direction of the crawler.

Method used

The work machine is equipped with an image pickup device attached to both ends of the machine body, facing one side in the front and back direction, with an imaging range that includes the side surfaces of the front and rear end portions and the spaces outside these surfaces.

Benefits of technology

This configuration allows for the capture of images that include the side surfaces of the front and rear end portions of the machine body and the surrounding spaces, enabling operators to grasp the direction of the crawler and the positional relationship with obstacles, thereby improving operational safety and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025068502000001_ABST
    Figure 2025068502000001_ABST
Patent Text Reader

Abstract

To provide a work machine and a work system capable of imaging the front and rear ends of the machine body and the surrounding area.SOLUTION: The work machine comprises a machine body 24 and a side imaging device 75 attached to the left and right ends of the machine body 24 and facing one of the front and rear directions of the machine body 24. The imaging range of the side imaging device 75 includes the side surfaces of the front and rear ends of the machine body 24 and the space outside these side surfaces.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a work machine and a work system equipped with an imaging device. [Background technology]

[0002] Patent Document 1 discloses a camera provided on an upper rotating body for photographing an area in front of the upper rotating body, while Patent Document 2 discloses a camera provided on the upper rotating body for photographing an area to the side of the upper rotating body. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2006-219894 A [Patent Document 2] JP 2017-92908 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the cameras in Patent Documents 1 and 2 cannot capture the front and rear ends of the machine body and their surroundings. Therefore, the images from these cameras cannot confirm the conditions of the front and rear ends of the machine body and their surroundings. If the conditions of the front and rear ends of the machine body and their surroundings can be confirmed, it would be easier to grasp the positions of obstacles around the front and rear ends, the direction of the crawlers, the installation surface of the crawlers, and the like. Therefore, it is desirable to be able to capture images of the front and rear ends of the machine body and their surroundings.

[0005] An object of the present invention is to provide a work machine and a work system capable of capturing images of the front and rear ends of the machine body and the surrounding areas. [Means for solving the problem]

[0006] The present invention is characterized in that it comprises a machine body and an imaging device attached to the left or right end of the machine body and facing one of the front or rear directions of the machine body, and the imaging range of the imaging device includes the side of the front or rear end of the machine body and the space outward from this side. Effect of the Invention

[0007] According to the present invention, the imaging range of the imaging device includes the side surfaces of the front and rear ends of the machine body and the space outside these side surfaces. By setting the imaging range of the imaging device in this manner, it is possible to capture images including the side surfaces of the front and rear ends of the machine body and the space outside these side surfaces. This makes it possible to capture images of the front and rear ends of the machine body and their surroundings. This imaging makes it possible to obtain images including the side surfaces of the front and rear ends of the machine body and the space outside these side surfaces. From this image, an operator operating the work machine or an operator remotely operating the work machine may be able to ascertain the orientation of the crawlers, etc. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a working system. [Diagram 2] FIG. [Diagram 3] FIG. 3 is an enlarged view of a main part A in FIG. [Figure 4] FIG. 2 is a perspective view of the machine body seen obliquely from the front. [Diagram 5] FIG. 11 is a perspective view of a machine body in a modified example, as viewed obliquely from the front. [Figure 6] FIG. [Figure 7] FIG. [Figure 8] FIG. 13 is a diagram showing an image captured by the right side imaging device. [Figure 9] FIG. 13 is a diagram showing an image captured by the left side imaging device. [Figure 10] FIG. 2 illustrates multiple monitors. [Figure 11]FIG. 2 is a functional configuration diagram of the work system. [Figure 12] FIG. 2 is a diagram showing a monitor provided in the simulator. [Figure 13] FIG. 13 is an enlarged view of a main part B in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[0010] (Working system configuration) A work system 100 according to an embodiment of the present invention has an operation device 1 and a work machine 20, as shown in Fig. 1 which is a diagram showing the work system 100. The operation device 1 is a device for operating the work machine 20, and is, for example, a cockpit constituting a remote operation device (remote operation means). An operator remotely operates the work machine 20 by operating the operation device 1. Here, there may be multiple work machines 20 to which the operation device 1 is connected. In this case, the operator remotely operates the multiple work machines 20 in turn by switching the work machine 20 to which it is connected.

[0011] (Work machine configuration) 1, the work machine 20 is a machine that performs work using an attachment 30, such as a hydraulic excavator. The work machine 20 has a machine body 24 equipped with a lower traveling body 21 and an upper rotating body 22, the attachment 30, and a cylinder 40.

[0012] The lower traveling structure 21 is a section that allows the work machine 20 to travel, and is equipped with, for example, crawlers. The upper rotating structure 22 is attached to the upper part of the lower traveling structure 21 so as to be able to rotate via a rotating device 25. A cab (operator's compartment) 23 is provided at the front of the upper rotating structure 22. An operating device (not shown) for operating the work machine 20 is provided inside the cab 23. The cab 23 is provided with a boarding gate 23a (see FIG. 9) for an operator to get on and off.

[0013] The attachment 30 is attached to the upper rotating body 22 so as to be rotatable in the vertical direction. The attachment 30 includes a boom 31, an arm 32, and a bucket 33. The boom 31 is attached to the upper rotating body 22 so as to be rotatable (raised and lowered) in the vertical direction. The arm 32 is attached to the boom 31 so as to be rotatable in the vertical direction. The bucket 33 is a tip attachment that is the tip of the attachment 30, and is attached to the arm 32 so as to be rotatable in the front-to-rear direction of the upper rotating body 22. The bucket 33 is a part that performs tasks such as excavating, leveling, and scooping soil and sand.

[0014] The work object held by the bucket 33 is not limited to soil and sand, but may be stones or waste (industrial waste, etc.). The end attachment is not limited to the bucket 33, but may be a lifting magnet for holding scrap iron or the like, a nibbler for clamping the object, or a breaker for crushing the object.

[0015] The cylinder 40 is capable of hydraulically rotating the attachment 30. The cylinder 40 is a hydraulic telescopic cylinder. Note that the cylinder 40 may be an electric cylinder. The cylinder 40 includes a boom cylinder 41, an arm cylinder 42, and a bucket cylinder 43.

[0016] The boom cylinder 41 rotates the boom 31 relative to the upper rotating body 22. A base end of the boom cylinder 41 is rotatably attached to the upper rotating body 22. A tip end of the boom cylinder 41 is rotatably attached to the boom 31.

[0017] The arm cylinder 42 rotates the arm 32 relative to the boom 31. A base end of the arm cylinder 42 is rotatably attached to the boom 31. A tip end of the arm cylinder 42 is rotatably attached to the arm 32.

[0018] The bucket cylinder 43 rotates the bucket 33 relative to the arm 32. A base end of the bucket cylinder 43 is rotatably attached to the arm 32. A tip end of the bucket cylinder 43 is rotatably attached to a link member 34 that is rotatably attached to the bucket 33.

[0019] The work machine 20 also has a sensor 50. The sensor 50 has a turning angle sensor 52, a tilt angle sensor 60, and a tilt angle sensor 55.

[0020] The turning angle sensor 52 detects the turning angle of the upper turning body 22 with respect to the lower traveling body 21. The turning angle sensor 52 is, for example, an encoder, a resolver, or a gyro sensor.

[0021] The inclination angle sensor 60 detects the attitude of the attachment 30. The inclination angle sensor 60 includes a boom inclination angle sensor 61, an arm inclination angle sensor 62, and a bucket inclination angle sensor 63.

[0022] The boom inclination angle sensor 61 is attached to the boom 31 and detects the attitude of the boom 31. The boom inclination angle sensor 61 is a sensor that acquires the inclination angle of the boom 31 with respect to the horizontal line, and is, for example, an inclination (acceleration) sensor. Note that the boom inclination angle sensor 61 may be a rotation angle sensor that detects the rotation angle of the boom foot pin (boom base end) or a stroke sensor that detects the stroke amount of the boom cylinder 41.

[0023] The arm inclination angle sensor 62 is attached to the arm 32 and detects the posture of the arm 32. The arm inclination angle sensor 62 is a sensor that obtains the inclination angle of the arm 32 with respect to the horizontal line, and is, for example, an inclination (acceleration) sensor. Note that the arm inclination angle sensor 62 may be a rotation angle sensor that detects the rotation angle of the arm connecting pin (base end of the arm) or a stroke sensor that detects the stroke amount of the arm cylinder 42.

[0024] The bucket inclination angle sensor 63 is attached to the link member 34 and detects the attitude of the bucket 33. The bucket inclination angle sensor 63 is a sensor that obtains the inclination angle of the bucket 33 with respect to the horizontal line, and is, for example, an inclination (acceleration) sensor. Note that the bucket inclination angle sensor 63 may be a rotation angle sensor that detects the rotation angle of the bucket connecting pin (bucket base end) or a stroke sensor that detects the stroke amount of the bucket cylinder 43.

[0025] The inclination angle sensor 55 is provided on the upper rotating body 22 and detects the inclination angle of the upper rotating body 22 with respect to the horizontal plane. The inclination angle sensor 55 is, for example, an inclination (acceleration) sensor or an IMU (Inertial Measurement Unit).

[0026] The work machine 20 also has an imaging device 70. The imaging device 70 captures images of the surroundings of the work machine 20. The imaging device 70 may capture two-dimensional images or three-dimensional images. The imaging device 70 may include a monocular camera or a stereo camera. The imaging device 70 may include a TOF (Time Of Flight) sensor that detects distance based on the time from when a wave is emitted until the reflected wave returns, or may include a sensor that detects distance based on the frequency of the reflected wave. The imaging device 70 may include a device that detects three-dimensional information using light (e.g., laser light), and may include, for example, LiDAR (Light Detection and Ranging). The imaging device 70 may include a device that detects three-dimensional information using radio waves (e.g., millimeter wave radar, etc.). Only one imaging device 70 may be provided, or multiple imaging devices 70 may be provided. In this embodiment, multiple imaging devices 70 are provided and are monocular cameras. The imaging device 70 has a front imaging device 71, an upper imaging device 72, a lower imaging device 73, a side imaging device 75, and an attachment imaging device 76.

[0027] Fig. 2 shows a view of the work machine 20 viewed diagonally from above. Fig. 3 shows an enlarged view of a main part A in Fig. 2. As shown in Fig. 3, the front imaging device 71, the upper imaging device 72, and the lower imaging device 73 are provided in the cab 23, for example, in the upper part of the cab 23. In this embodiment, the front imaging device 71, the upper imaging device 72, and the lower imaging device 73 are each attached to a bracket 78 provided at the front end of the roof panel on the upper part of the cab 23.

[0028] The front imaging device 71 faces the front of the upper rotating body 22. The front imaging device 71 captures an image of the front of the upper rotating body 22. The imaging range of the front imaging device 71 includes the attachment 30.

[0029] The upper imaging device 72 is disposed above the front imaging device 71. The upper imaging device 72 faces diagonally upward from the upper rotating body 22. The upper imaging device 72 images an area diagonally upward from the upper rotating body 22. The imaging range of the upper imaging device 72 includes the boom 31.

[0030] The lower imaging device 73 is disposed below the front imaging device 71. The lower imaging device 73 faces diagonally downward from the upper rotating body 22. The lower imaging device 73 images an image diagonally downward from the upper rotating body 22. The imaging range of the lower imaging device 73 includes the front of the cab 23. Depending on the rotation angle of the upper rotating body 22 relative to the lower traveling body 21, the imaging range of the lower imaging device 73 may include the lower traveling body 21, for example, including a crawler.

[0031] Returning to FIG. 1 , the attachment imaging device 76 is attached to the attachment 30. In this embodiment, the attachment imaging device 76 is attached to the arm 32. The attachment imaging device 76 is attached to the arm 32 so as to face towards the bucket 33. The attachment imaging device 76 captures an image of the bucket 33. The imaging range of the attachment imaging device 76 includes the bucket 33.

[0032] The side imaging devices (imaging devices) 75 are attached to both left and right ends of the machine body 24. The left and right direction of the machine body 24 is a direction perpendicular to the paper surface of FIG. 1. In this embodiment, the side imaging devices 75 are attached to the upper rotating body 22, but may be attached to the lower traveling body 21. In this embodiment, the side imaging devices 75 face forward of the upper rotating body 22, but may face rearward of the upper rotating body 22.

[0033] 4, which is a perspective view of the machine body 24 seen from diagonally forward, the side imaging device 75R on the right side in the left-right direction of the upper rotating body 22 (left side in FIG. 4) is attached to a housing (guard) that constitutes the upper rotating body 22. The side imaging device 75L on the left side in the left-right direction of the upper rotating body 22 (right side in FIG. 4) is attached to the top of the cab 23. In the height direction of the upper rotating body 22, the attachment position of the right side imaging device 75R is lower than the attachment position of the left side imaging device 75L.

[0034] The right side imaging device 75R is attached to a right bracket 79R provided at the right end of the housing of the upper rotating body 22. At least a part of the right side imaging device 75R protrudes from the right end of the upper rotating body 22 in the left-right direction of the upper rotating body 22. For example, the center of the imaging range of the right side imaging device 75R protrudes from the right end of the upper rotating body 22 in the left-right direction of the upper rotating body 22. For example, the entire right side imaging device 75R protrudes from the right end of the upper rotating body 22 in the left-right direction of the upper rotating body 22. For example, the part of the right bracket 79R to which the side imaging device 75R is attached protrudes from the right end of the upper rotating body 22 in the left-right direction of the upper rotating body 22. The center of the imaging range of the side imaging device 75R protrudes outward from the right end of the upper rotating body 22, so that the side surface of the front end of the upper rotating body 22 is reliably included in the imaging range of the side imaging device 75R. The left side imaging device 75L is attached to a left bracket 79L provided at the left end of the upper part of the cab 23. The portion of the left bracket 79L to which the side imaging device 75L is attached protrudes outward from the left end of the cab 23 in the left-right direction of the upper rotating body 22. The center of the imaging range of the side imaging device 75L protrudes outward from the left end of the cab 23, so that the side surface of the front end of the upper rotating body 22 is reliably included in the imaging range of the side imaging device 75L.

[0035] 5, which is a perspective view of the machine body 24 seen obliquely from the front, the left side imaging device 75L may be attached via a bracket to the left end of the housing of the upper rotating body 22, behind the cab 23. In this case, the portion of the bracket to which the side imaging device 75L is attached protrudes outward from the left end of the upper rotating body 22 in the left-right direction of the upper rotating body 22.

[0036] It is not essential that at least a part of the side imaging device 75R protrudes outward from the right end of the upper rotating body 22, and that at least a part of the side imaging device 75L protrudes outward from the left end of the cab 23. For example, in a case where the side surface of the front end portion of the upper rotating body 22 has a shape that expands outward in the width direction of the upper rotating body 22 from the top to the bottom of the side surface, the side imaging device 75R and the side imaging device 75L may be attached so as not to protrude outward. In this case, the side surface of the front end portion of the upper rotating body 22 can be included in the imaging range of the side imaging device 75R and the side imaging device 75L.

[0037] 6, which is a right side view of the work machine 20, the right side imaging device 75R images an area diagonally downward relative to the front-to-rear direction of the upper rotating body 22. The imaging range of the right side imaging device 75R includes the side surface (right side surface) of the front end portion of the machine body 24 and the space outward from this side surface. The right side imaging device 75R images an image such that the side surface of the front end portion of the machine body 24 and the space outward from this side surface are reflected.

[0038] 7, which is a left side view of the work machine 20, the left side imaging device 75L images an area diagonally downward relative to the fore-aft direction of the upper rotating body 22. The imaging range of the left side imaging device 75L includes the side surface (left side surface) of the front end portion of the machine body 24 and the space outward from this side surface. The left side imaging device 75L images an image such that the side surface of the front end portion of the machine body 24 and the space outward from this side surface are reflected in the image.

[0039] An image captured by the right side imaging device 75R is shown in Fig. 8. As shown in Fig. 8, the imaging range of the right side imaging device 75R includes the side surface of the front end of the upper revolving body 22 (the right side surface of the front end of the machine body 24 in Fig. 8) and the space outward from this side surface (the right space located to the right of the right side surface of the front end, the front space located forward of the right space, and the lower space located below the right space in Fig. 8). The imaging range of the imaging device of the right side imaging device 75R includes the space below the upper revolving body 22. The space below the upper revolving body 22 is a space located outward from the side surface of the front end of the upper revolving body 22 (located to the right of the right side surface of the front end of the upper revolving body 22 in Fig. 8) and located below the lowest part of the upper revolving body 22.

[0040] An image captured by the left side imaging device 75L is shown in FIG. 9. As shown in FIG. 9, the imaging range of the left side imaging device 75L includes the side of the front end of the upper revolving body 22 (the left side of the front end of the machine body 24 in FIG. 9) and the space outward from this side (the left space located to the left of the left side of the front end, the front space located forward from the left space, and the lower space located forward from the left space in FIG. 9). The imaging range of the imaging device of the left side imaging device 75L includes the space below the upper revolving body 22. The space below the upper revolving body 22 is a space located outward from the side of the front end of the upper revolving body 22 (located to the left of the left side of the front end of the upper revolving body 22 in FIG. 9) and below the lowest part of the upper revolving body 22. The imaging range of the left side imaging device 75L includes the side of the cab 23 and the space outward from this side. The imaging range of the left side imaging device 75L includes the side surface of the boarding gate 23a of the cab 23 and the space outside this side surface.

[0041] By setting the imaging range of the side imaging device 75 as described above, it is possible to capture an image including the side surface of the front end portion of the machine body 24 and the space outward from this side surface. This makes it possible to image the front end portion of the machine body 24 and its surroundings. This imaging makes it possible to obtain an image including the side surface of the front end portion of the machine body 24 and the space outward from this side surface. From this image, an operator remotely operating the work machine 20 may be able to ascertain the orientation of the crawlers, etc.

[0042] In addition, the side imaging device 75 captures images so as to capture the side surface of the front end portion of the machine body 24 and the space outside this side surface. This makes it possible to image the front end portion of the machine body 24 and its surroundings. This makes it possible to obtain an image of the front end portion of the machine body 24 and its surroundings.

[0043] The side imaging devices 75 are attached to both left and right ends of the machine body 24. This makes it possible to capture images of the front end of the machine body 24 and its surroundings on both left and right sides of the machine body 24.

[0044] In addition, the side imaging device 75 is attached to the upper rotating body 22. Therefore, an image of the front end of the upper rotating body 22 and its surroundings can be obtained. From this image, the operator remotely operating the work machine 20 can grasp the situation of the front end of the upper rotating body 22 and its surroundings. This makes it easier for the operator remotely operating the work machine 20 to grasp the positional relationship between the front end of the upper rotating body 22 and obstacles present in its surroundings, and can operate the work machine 20 so as to avoid, for example, the front end of the upper rotating body 22 hitting an obstacle or the like.

[0045] The imaging range of the side imaging device 75 also includes the space below the upper rotating body 22. By setting the imaging range of the side imaging device 75 in this manner, it is possible to image the area below the upper rotating body 22. This makes it possible to obtain an image of the area below the upper rotating body 22. From this image, the operator remotely operating the work machine 20 can easily grasp the orientation of the lower traveling body 21 (crawler), the installation surface (ground) beside the lower traveling body 21, and the like.

[0046] The left side imaging device 75L is mounted on the cab 23. The imaging range of the side imaging device 75L includes the side surface (left side surface) of the cab 23 and the space outside this side surface (to the left, forward, and below the left side surface of the cab 23 in FIG. 9). By setting the imaging range of the side imaging device 75L in this manner, it is possible to image the side surface of the cab 23 and its surroundings. From this image, the operator who remotely operates the work machine 20 can grasp the situation of the side surface of the cab 23 and its surroundings. This makes it easier for the operator who remotely operates the work machine 20 to grasp the positional relationship between the side surface of the cab 23 and obstacles present in its surroundings, and can operate the work machine 20 so as to avoid, for example, the side surface of the cab 23 hitting an obstacle.

[0047] Moreover, the imaging range of the left side imaging device 75L includes the side of the boarding gate 23a and the space outside this side. By setting the imaging range of the side imaging device 75L in this manner, it is possible to image the side of the boarding gate 23a and its surroundings. This makes it possible to obtain an image of the side of the boarding gate 23a and its surroundings. From this image, it is possible to grasp the situation of the side of the boarding gate 23a and its surroundings. This makes it possible to monitor, for example, a worker trying to get into the cab 23 from the boarding gate 23a.

[0048] (Configuration of the operation device) 1, the operation device 1 has an input device 2, an output device 3, and a driver's seat 4. The driver's seat 4 has a seat and a backrest for an operator to sit on and operate the operation device 1. The input device 2, the output device 3, and the driver's seat 4 are arranged on a common housing (not shown).

[0049] The input device 2 is operated by an operator. The input device 2 is equivalent to an operating device provided in the cab 23 of the work machine 20, and is arranged around the driver's seat 4. The input device 2 has, for example, a pair of left and right travel levers and a pair of left and right travel pedals in front of the driver's seat 4. The travel levers and travel pedals are used to remotely control the travel direction and travel speed of the crawlers of the lower traveling body 21.

[0050] The input device 2 also has, for example, a pair of left and right operating levers. These are disposed on the left and right frames of the driver's seat 4, respectively. The operating levers are used to remotely operate the attachment 30. The input device 2 also has various switches, such as a key switch. These are disposed on the right frame of the driver's seat 4, for example. The key switch is used to start and stop the engine.

[0051] A seat tilt device (not shown) is provided at the driver's seat 4. The seat tilt device is a device that changes the tilt angle of the driver's seat 4 with respect to a horizontal plane. This seat tilt device reproduces the tilt of the upper rotating body 22 detected by the tilt angle sensor 55 at the driver's seat 4. In addition, a device may be installed that turns the driver's seat 4 to the right when it is detected that the upper rotating body 22 is turning right based on the rotation angle of the upper rotating body 22 detected by the rotation angle sensor 52, and turns the driver's seat 4 to the left when it is detected that the upper rotating body 22 is turning left.

[0052] The output device 3 has a plurality of monitors (display devices) 11 arranged in front of the driver's seat 4, and a speaker. The speaker outputs sound picked up by a microphone mounted on the work machine 20.

[0053] FIG. 10 shows multiple monitors 11. In this embodiment, the number of monitors 11 is seven. The main monitor 11a is disposed in the center of the seven monitors 11. The main monitor 11a displays an image captured by the front imaging device 71. The upper central monitor 11b is disposed above the main monitor 11a. The upper central monitor 11b displays an image captured by the upper imaging device 72 and an image captured by the attachment imaging device 76 side by side. The lower central monitor 11c is disposed below the main monitor 11a. The lower central monitor 11c displays an image captured by the lower imaging device 73.

[0054] A right monitor 11d is disposed to the right of the main monitor 11a. The right monitor 11d displays an image captured by the side imaging device 75R. A left monitor 11e is disposed to the left of the main monitor 11a. The left monitor 11e displays an image captured by the side imaging device 75L.

[0055] An upper right monitor 11f is disposed to the right of the upper central monitor 11b. The upper right monitor 11f displays information such as the communication status and work status of the work machine 20, and an analysis report of the work site status. An upper left monitor 11g is disposed to the left of the upper central monitor 11b. The upper left monitor 11g displays an image captured by an overhead camera set up at the work site.

[0056] By displaying the image captured by the imaging device 70 on the monitor 11, it is possible to improve the operability of the operator who is seated in the driver's seat 4 and remotely operates the work machine 20 while looking at the monitor 11. Note that the number and display contents of the monitors 11a to 11g are not limited to this.

[0057] Here, the main monitor 11a, the upper central monitor 11b, and the lower central monitor 11c have horizontally long screens. The main monitor 11a, the upper central monitor 11b, and the lower central monitor 11c are, for example, 27-inch monitors. On the other hand, the right monitor 11d, the left monitor 11e, the upper right monitor 11f, and the upper left monitor 11g have vertically long screens. The right monitor 11d, the left monitor 11e, the upper right monitor 11f, and the upper left monitor 11g are, for example, 15.6-inch monitors.

[0058] The length of the short side of the main monitor 11a is equal to the length of the long side of the right monitor 11d and the left monitor 11e, and the length of the short side of the upper central monitor 11b is equal to the length of the long side of the upper right monitor 11f and the upper left monitor 11g.

[0059] The driver's seat 4 and the monitor 11 are arranged in consideration of the operator's effective visual field. The effective visual field is a region of the visual field that can be recognized relatively clearly within the range of a human's visual field (a target can be seen only by moving one's eyes without moving one's head), and is the center of the visual field and the region around it. For example, the effective visual field is an area that extends about 30 degrees to the right from the center of the visual field, about 30 degrees to the left from the center of the visual field, about 20 degrees upward from the center of the visual field, and about 20 degrees downward from the center of the visual field. Since human eyes are arranged side by side, the width in the horizontal direction in the effective visual field is larger than the width in the vertical direction. Note that peripheral vision, which is the range outside the effective visual field, is an area that is difficult to recognize.

[0060] The driver's seat 4 and the monitor 11 are arranged so that the monitor 11 falls within the effective visual field of the operator when the operator sitting in the driver's seat 4 turns his / her gaze forward. Specifically, the relative positions of the driver's seat 4 and the monitor 11 in the left-right direction and the front-rear direction are arranged so that the left and right ends and the top and bottom ends of the monitor 11 fall within the effective visual field of the operator sitting on the seat of the driver's seat 4. For example, the relative positions of the monitor 11 and the driver's seat 4 in the left-right direction are adjusted and arranged so that the center position of the monitor 11, which is equidistant from the left and right ends in the left-right direction, coincides or matches with the line of sight on an extension line extended forward from the center position in the width direction of the seat or backrest of the driver's seat 4. Then, the relative positions of the monitor 11 and the driver's seat 4 in the front-rear direction are adjusted and arranged so that the left and right ends of the monitor 11 fall within the effective visual field of the operator sitting on the seat of the driver's seat 4. In addition, the monitor 11 and the driver's seat 4 are positioned with their relative positions adjusted in the vertical direction so that the upper and lower ends of the monitor 11 are within the effective visual field of the operator sitting on the seat of the driver's seat 4. This reduces the burden on the operator who watches the monitor 11.

[0061] Furthermore, since the driver's seat 4 and the monitor 11 adjusted in this manner are mounted on a common housing, it is possible to maintain the relative positions of the driver's seat 4 and the monitor 11. Note that the configuration may be such that at least one of the relative positions of the driver's seat 4 and the monitor 11 in the left-right direction, the front-rear direction, and the up-down direction is adjustable with the driver's seat 4 and the monitor 11 mounted on the housing.

[0062] In addition, by arranging the horizontally long monitors 11a, 11b, and 11c vertically in the center of the monitors 11, and arranging the vertically long monitors 11d, 11e, 11f, and 11g on the left and right of the horizontally long monitors 11a, 11b, and 11c, it becomes easier to fit the entire multiple monitors 11 within the effective visual field of a human being. This reduces the burden on the operator who views the monitors 11.

[0063] The upper central monitor 11b, the main monitor 11a, and the lower central monitor 11c are arranged in this order from top to bottom. The upper central monitor 11b displays an image above the upper revolving body 22, the main monitor 11a displays an image in front of the upper revolving body 22, and the lower central monitor 11c displays an image below the upper revolving body 22. Therefore, when the operator looks at the three monitors 11 arranged in the vertical direction, the operator can easily grasp the situation from above to below the upper revolving body 22. This reduces the burden on the operator who looks at the monitors 11. The images displayed on the monitors 11a, 11b, and 11c are images including the space in front of the work machine 20 that the operator looks at through the front window of the cab 23 when he gets into the cab 23 and operates the work machine 20, and these images are displayed on the monitors 11a, 11b, and 11c arranged to be aligned with the center position in the left-right direction of the effective field of view, so that the burden on the operator who looks at the monitors 11 can be further reduced.

[0064] The left monitor 11e, the main monitor 11a, and the right monitor 11d are arranged in this order from left to right. The left monitor 11e displays an image of the left side of the upper rotating body 22, the main monitor 11a displays an image of the front side of the upper rotating body 22, and the right monitor 11d displays an image of the right side of the upper rotating body 22. Therefore, when an operator looks at the three monitors 11 arranged in the left-right direction, the operator can easily grasp the situation from the left to the right side of the upper rotating body 22. This reduces the burden on the operator who looks at the monitors 11.

[0065] Furthermore, by using the image captured by the front imaging device 71 and the image captured by the side imaging device 75, the situation in front of the machine body 24 can be grasped in more detail than when only the image captured by the front imaging device 71 is used. Therefore, the operability of the operator who operates the work machine 20 can be suitably improved.

[0066] The image to the right of the upper rotating body 22 displayed on the right monitor 11d is an image that includes the right side of the front end of the upper rotating body 22 and the space outside this right side, which is reflected in the mirror when the operator checks the mirror located on the right side of the attachment 30 of the work machine 20 from inside the cab 23 while inside the cab 23 to operate the work machine 20, and by displaying this image on the right monitor 11d, the workability of the operator operating the work machine 20 can be suitably improved.

[0067] The image to the left of the upper rotating body 22 displayed on the left monitor 11e is an image including the left side surface of the front end of the upper rotating body 22 and the space outside this left side surface that are reflected in the mirror when the operator checks the mirror arranged on the left side of the front part of the cab 23 from inside the cab 23 when he gets into the cab 23 and operates the work machine 20, and by displaying this image on the left monitor 11e, the operability of the operator operating the work machine 20 can be suitably improved. In addition, the side surface of the boarding gate 23a and the space outside this side surface included in the image to the left of the upper rotating body 22 displayed on the left monitor 11e are spaces that the operator can check through the side window of the cab 23 by turning his head to the left when he gets into the cab 23 and operates the work machine 20, and by displaying an image including this space on the left monitor 11e, the operability of the operator operating the work machine 20 can be more suitably improved.

[0068] Furthermore, the images displayed on monitors 11d, 11e, 11f, and 11g are less frequently attended by the operator operating the work machine 20 compared to images including the space in front of the work machine 20 displayed on monitors 11a, 11b, and 11c, but are images that need to be viewed as appropriate depending on the operating conditions of the work machine 20. For this reason, by arranging monitors 11a, 11b, and 11c in the center of the effective field of vision and arranging monitors 11d, 11e, 11f, and 11g to the left and right of the center of the effective field of vision, it is possible to suitably improve the operability of the operator operating the work machine 20.

[0069] It should be noted that the work machine 20 may not be remotely operated, but may be operated by an operator in the cab 23. In this case, the image captured by the imaging device 70 may be displayed on a display or the like provided in the cab 23.

[0070] In addition, the images displayed in a vertical line in the center of the horizontal direction of the monitor 11 may not necessarily include all images captured by the front imaging device 71, the upper imaging device 72, and the lower imaging device 73. For example, images captured by the front imaging device 71 and the upper imaging device 72, or images captured by the front imaging device 71 and the lower imaging device 73 may be displayed in a vertical line on the monitor 11. In this case, the monitor 11c may not be arranged. In addition, the input device 2 may be provided with a switch for switching between displaying images captured by the front imaging device 71 and the upper imaging device 72, or displaying images captured by the front imaging device 71 and the lower imaging device 73, on the two monitors 11a and 11b. In this way, when the monitor 11c is not arranged, the operator's workability can be suitably improved by the amount that the field of view does not need to be directed downward.

[0071] (Functional configuration of the working system) As shown in FIG. 11, which is a functional configuration diagram of the work system 100, the work machine 20 has a work machine controller 81, a work machine communication device 82, and a storage device 83.

[0072] The work machine side communication device 82 is capable of communicating with a later-described operation device side communication device 8 of the operation device 1. The storage device 83 stores, for example, work content taught by remote operation using the operation device 1.

[0073] The information detected by the sensor 50 is input to the work machine controller 81. Specifically, information relating to the swing angle (posture) of the upper swing body 22 relative to the lower traveling body 21 detected by the swing angle sensor 52 is input to the work machine controller 81. Information relating to the posture of the boom 31 detected by the boom inclination angle sensor 61 is also input to the work machine controller 81. Information relating to the posture of the arm 32 detected by the arm inclination angle sensor 62 is also input to the work machine controller 81. Information relating to the posture of the bucket 33 detected by the bucket inclination angle sensor 63 is also input to the work machine controller 81. Information relating to the inclination angle of the upper swing body 22 relative to the horizontal plane detected by the inclination angle sensor 55 is also input to the work machine controller 81.

[0074] Furthermore, image data captured by the imaging device 70 is input to the work machine controller 81 .

[0075] In this embodiment, the work machine 20 is remotely operated. The work machine controller 81 controls the lower structure 21, the swing device 25 and the attachment 30 in accordance with operation instructions sent from the operation device 1.

[0076] The work machine controller 81 may automatically control the work machine 20. That is, the work machine 20 may be operated automatically. In this case, the work machine controller 81 controls the upper rotating body 22 and the attachment 30 so that the upper rotating body 22 and the attachment 30 perform a series of operations. The work machine controller 81 automatically operates the swing device 25 and the attachment 30 based on the detection value of the sensor 50. In this case, the monitor 11 displays an image captured by the imaging device 70 of the automatically operated work machine 20. As the input device 2, an interruption device for interrupting the automatic operation of the work machine 20 based on the operation of an operator who monitors the automatically operated work machine 20 by watching the monitor 11, and a resumption device for resuming the interrupted automatic operation may be installed. In addition, the operation device 1 may be equipped with a device for switching between a state in which the work machine 20 is automatically operated and a state in which it is remotely operated according to an operation instruction sent from the operation device 1, and further, the state in which the work machine 20 is operated by an operator in the cab 23 may also be configured to be switchable by the device.

[0077] The series of operations performed by the work machine 20 is, for example, to dig up soil from a soil pit (not shown) with the bucket 33 (excavation), rotate the upper rotating body 22 toward a dump truck (not shown) while holding the soil (lifting rotation), dump the soil onto the bed of the dump truck (not shown) (discharging), and rotate the upper rotating body 22 toward the soil pit (return rotation), etc. The series of operations may be taught by operation using an operating device provided in the cab 23 or by remote operation using the operating device 1.

[0078] The operation device 1 includes a controller 7 , an input device 2 , an operation device side communication device 8 , a monitor 11 , and a speaker 12 .

[0079] The operation device side communication device 8 is capable of communicating with a work machine side communication device 82 of the work machine 20.

[0080] The controller 7 sends operation instruction signals from the input device 2 to a work machine controller 81 of the work machine 20. The controller 7 receives video data captured by the imaging device 70 from the work machine 20 and displays it on the monitor 11. The controller 7 also receives audio data picked up by a microphone mounted on the work machine 20 from the work machine 20 and outputs it from the speaker 12.

[0081] In remote operation, by using the images captured by the side imaging device 75, the workability of the operator remotely operating the work machine 20 can be improved.

[0082] The work machine 20 may be placed in a virtual space, and the work of the work machine 20 may be simulated in the virtual space. In other words, a simulator may simulate the work of the work machine 20 operating in accordance with an operation instruction signal from the input device 2. Even in this case, the image virtually captured by the side imaging device 75 in the virtual space is displayed on the monitor 11, thereby improving the operability of the operator who operates the work machine 20 in the virtual space.

[0083] Here, the monitor 90 of the simulator is shown in FIG. 12. As shown in FIG. 12, the monitor 90 of the simulator has, for example, two monitors 91 and 92 arranged vertically. For example, the upper monitor 91 displays the image of the upper central monitor 11b, the image of the upper right monitor 11f, and the image of the upper left monitor 11g. Also, the upper monitor 91 displays the upper half of the image of the main monitor 11a, the upper half of the image of the right monitor 11d, and the upper half of the image of the left monitor 11e. For example, the lower monitor 92 displays the lower half of the image of the main monitor 11a, the lower half of the image of the right monitor 11d, the lower half of the image of the left monitor 11e, and the image of the lower central monitor 11c. That is, in the simulator, the entire image of the seven monitors 11 shown in FIG. 10 may be split into two and displayed on the two monitors 91 and 92.

[0084] 13, which is an enlarged view of a main part B in FIG. 12, in the simulator, a shadow 95 may be displayed in the image captured by the imaging device 70. This shadow 95 allows the user to grasp the sense of distance to the ground.

[0085] (effect) As described above, according to the work machine 20 of this embodiment, the imaging range of the side imaging device 75 includes the side surface of the front-rear end of the machine body 24 and the space outside the side surface. By setting the imaging range of the side imaging device 75 in this manner, it is possible to image an image including the side surface of the front-rear end of the machine body 24 and the space outside the side surface. This makes it possible to image the front-rear end of the machine body 24 and its surroundings. This imaging makes it possible to obtain an image including the side surface of the front-rear end of the machine body 24 and the space outside the side surface. From this image, an operator who operates the work machine 20 or an operator who remotely operates the work machine 20 can easily grasp the positional relationship between the front-rear end and obstacles present in the surroundings. In addition, even if the operator does not look at the information captured by the side imaging device 75, information including the side surface of the front-rear end of the machine body 24 and the space outside the side surface can be captured by the side imaging device 75. Therefore, this information can be used for controlling the work machine 20, etc.

[0086] In addition, the side imaging device 75 captures images so as to capture the side surfaces of the front-rear ends of the machine body 24 and the space outside these side surfaces. This makes it possible to image the front-rear ends of the machine body 24 and their surroundings. This makes it possible to obtain images of the front-rear ends of the machine body 24 and their surroundings.

[0087] The side imaging devices 75 are attached to both left and right ends of the machine body 24. This makes it possible to capture images of the front and rear ends of the machine body 24 and the surroundings thereof on both left and right sides of the machine body 24.

[0088] In addition, the side imaging device 75 is attached to the upper rotating body 22. Therefore, an image of the front-rear end of the upper rotating body 22 and its surroundings can be obtained. From this image, the operator who operates the work machine 20 or the operator who remotely operates the work machine 20 can grasp the situation of the front-rear end of the upper rotating body 22 and its surroundings. This makes it easier for the operator who operates the work machine 20 or the operator who remotely operates the work machine 20 to grasp the positional relationship between the front end of the upper rotating body 22 and obstacles present in its surroundings, and can operate the work machine 20 so as to avoid obstacles or the like hitting the front-rear end of the upper rotating body 22, for example.

[0089] The imaging range of the side imaging device 75 also includes the space below the upper rotating body 22. By setting the imaging range of the side imaging device 75 in this manner, it is possible to image the area below the upper rotating body 22. This makes it possible to obtain an image of the area below the upper rotating body 22. From this image, an operator who operates the work machine 20 or an operator who remotely operates the work machine 20 can easily grasp the orientation of the lower traveling body 21 (crawler), the installation surface (ground) beside the lower traveling body 21, and the like.

[0090] Further, the side imaging device 75L is attached on the cab 23. The imaging range of the side imaging device 75L includes the side of the cab 23 and the space outside the side. By setting the imaging range of the side imaging device 75L in this manner, it is possible to image the side of the cab 23 and its surroundings. As a result, an image of the side of the cab 23 and its surroundings can be obtained. From this image, the operator who operates the work machine 20 or the operator who remotely operates the work machine 20 can grasp the situation of the side of the cab 23 and its surroundings. As a result, the operator who operates the work machine 20 or the operator who remotely operates the work machine 20 can easily grasp the positional relationship between the side of the cab 23 and obstacles present in its surroundings, and can operate the work machine 20 so as to avoid, for example, the side of the cab 23 hitting an obstacle.

[0091] The imaging range of the side imaging device 75L includes the side of the boarding gate 23a and the space outside the side. By setting the imaging range of the side imaging device 75L in this manner, it is possible to image the side of the boarding gate 23a and its surroundings. This makes it possible to obtain an image of the side of the boarding gate 23a and its surroundings. From this image, it is possible to grasp the situation of the side of the boarding gate 23a and its surroundings. This makes it possible to monitor, for example, a worker trying to get into the cab 23 from the boarding gate 23a.

[0092] The machine body 24 also has a front imaging device 71 that images the area in front of the machine body 24. By using the image captured by the front imaging device 71 and the image captured by the side imaging device 75, the operability of the operator who operates the work machine 20 and the operator who remotely operates the work machine 20 can be improved. In particular, when the side imaging device 75 faces the front of the machine body 24, by using the image captured by the front imaging device 71 and the image captured by the side imaging device 75, the situation in front of the machine body 24 can be grasped in more detail than when only the image captured by the front imaging device 71 is used. In this case, the operability of the operator who operates the work machine 20 and the operator who remotely operates the work machine 20 can be suitably improved.

[0093] Furthermore, according to the work system 100 of this embodiment, the image captured by the side imaging device 75 is displayed on the monitor 11. By using the video captured by the side imaging device 75, it is possible to improve the operability of the operator who operates the work machine 20 and the operator who remotely operates the work machine 20.

[0094] Furthermore, the work machine 20 is remotely operated. By using the images captured by the side imaging device 75, the operability of the operator who remotely operates the work machine 20 can be improved.

[0095] Furthermore, the work of the work machine 20 is simulated in the virtual space. By using the images captured by the side imaging device 75, it is possible to improve the workability of the operator who operates the work machine 20 in the virtual space.

[0096] Although the embodiments of the present invention have been described above, they are merely illustrative examples and do not limit the present invention, and the specific configurations and the like can be appropriately modified in design. Furthermore, the actions and effects described in the embodiments of the invention are merely a list of the most preferable actions and effects resulting from the present invention, and the actions and effects of the present invention are not limited to those described in the embodiments of the present invention.

[0097] For example, a bird's-eye view of the work machine 20 may be displayed on the monitor 11 (e.g., the upper right monitor 11f) shown in Fig. 10. This bird's-eye view may be captured by a camera installed at the work site or an aircraft such as a drone. Moreover, this bird's-eye view may be created by a known method from images captured by a plurality of cameras mounted on the machine body 24 and capturing images of the front, rear, left and right of the machine body 24.

[0098] Furthermore, in the operation device 1, a projection device such as a projector and a screen may be used instead of the multiple monitors 11. In this case, an image from the projection device is projected onto the screen. [Explanation of symbols]

[0099] 1 Operating device 2 Input Devices 3 Output Device 4 Driver's seat 7 Controller 8 Control device side communication device 11 Monitor (display device) 12 Speaker 20 Work Machinery 21 Undercarriage 22 Upper rotating body 23 Cab Gate 23a 24 Machine body 25 Swivel 30 Attachment 31 Boom 32 Arm 33 Bucket 34 Link member 40 Cylinder 41 Boom cylinder 42 Arm Cylinder 43 Bucket Cylinder 50 Sensors 52 Rotation angle sensor 55 Inclination Angle Sensor 60 Inclination Sensor 61 Boom tilt angle sensor 62 Arm inclination angle sensor 63 Bucket tilt angle sensor 70 Imaging Device 71 Front imaging device 72 Upward Imaging Device 73 Downward Imaging Device 75 Side imaging device (imaging device) 76 Attachment imaging device 78 Bracket 79R Right side bracket 79L Left side bracket 81 Work machine side controller 82 Work machine communication device 83 Storage device 90,91,92 Monitor 95 Shadow 100 Working Systems

Claims

1. The machine body, an imaging device attached to one of the left and right ends of the machine body and facing one of the front and rear directions of the machine body; having A work machine characterized in that the imaging range of the imaging device includes the side surfaces at the front and rear ends of the machine body and the space outward of these side surfaces.

2. The work machine according to claim 1, wherein the imaging device captures images so as to capture side surfaces at the front-rear end portions of the machine body and a space outward from the side surfaces.

3. The work machine according to claim 1, wherein the image capturing devices are attached to both left and right ends of the machine body.

4. The machine body includes: A lower running body; An upper rotating body rotatably attached to an upper portion of the lower traveling body; having The work machine according to claim 1 , wherein the imaging device is attached to the upper rotating body.

5. 5. The work machine according to claim 4, wherein an imaging range of the imaging device includes a space below the upper rotating body.

6. The upper rotating body has a cab, The imaging device is attached to an upper portion of the cab, 5. The work machine according to claim 4, wherein an imaging range of the imaging device includes a side surface of the cab and a space outside the side surface.

7. The cab has a boarding gate, 7. A work machine according to claim 6, wherein an imaging range of said imaging device includes a side surface of said boarding gate and a space outside said side surface.

8. 2. The work machine according to claim 1, further comprising a front imaging device attached to the machine body for imaging an image in front of the machine body.

9. A work machine according to any one of claims 1 to 8; a display device that displays an image captured by the imaging device; and A work system comprising:

10. 10. A work system according to claim 9, further comprising a remote control means for remotely controlling the work machine.

11. the work machine is disposed in a virtual space; 10. A work system according to claim 9, further comprising a calculation means for simulating work by said work machine in said virtual space.

Citation Information

Patent Citations

  • Camera controlling device in remote control of construction machinery

    JP2006219894A

  • Video transmission system for remote control construction machine

    JP2017092908A