Work range display system

The work range display system addresses the challenge of visualizing autonomous work machine operations by using sensors and displays to indicate work ranges and paths, improving safety and coordination.

JP7948373B2Active Publication Date: 2026-11-11KOBELCO CONSTR MASCH CO LTD
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
JP2025118191
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2025-07-14
Publication Date
2026-11-11
Estimated Expiration
2041-07-27

AI Technical Summary

Technical Problem

Existing technologies fail to allow visual recognition of the work range of an autonomous work machine from outside the machine, hindering effective coordination and safety around the work site.

Method used

A work range display system comprising a work range setting unit and a display unit that sets and visually indicates the work range outside the autonomous work machine using sensors, illumination devices, and monitors to provide real-time information on the work area and movement paths.

Benefits of technology

Enables visual confirmation of the work range and movement paths of autonomous work machines from outside, enhancing safety and coordination with other machines and workers by providing real-time, condition-based visual displays.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007948373000001
    Figure 0007948373000001
  • Figure 0007948373000002
    Figure 0007948373000002
  • Figure 0007948373000003
    Figure 0007948373000003
Patent Text Reader

Abstract

To allow a person to visually recognize a work range of an automatically operating work machine from the outside of the automatically operating work machine.SOLUTION: A work range display system 1 includes a work range setting unit 16 and a display unit 40. The work range setting unit 16 sets the work range A of an automatically operating work machine 10. The display unit 40 displays the position of the work range A outside the automatically operating work machine 10 based on information on the work range A set by the work range setting unit 16.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a work range display system that displays the work range of an autonomous work machine.

Background Art

[0002] For example, Patent Document 1 describes a technology for displaying the work range of a work machine (the excavation range in that document) on a monitor inside the cab of the work machine.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] With the technology described in that document, a person cannot visually recognize the work range of the work machine from outside the work machine. In addition, while a work range is set for an autonomously operated work machine (autonomous work machine), since this work range is information, a person cannot visually recognize the work range.

[0005] Accordingly, an object of the present invention is to provide a work range display system that allows a person to visually recognize the work range of an autonomous work machine from outside the autonomous work machine.

Means for Solving the Problem

[0006] The work range display system includes a work range setting unit and a display unit. The work range setting unit sets the work range of the autonomous work machine. The display unit displays the position of the work range outside the autonomous work machine based on the information on the work range set in the work range setting unit.

Effects of the Invention

[0007] With the above configuration, the working range of the automated work machine can be visually observed by a person from outside the automated work machine. [Brief explanation of the drawing]

[0008] [Figure 1] This is a top view of the work range display system 1. [Figure 2] This figure is equivalent to Figure 1 when the non-autonomous work machine 20 shown in Figure 1 is remotely controlled. [Figure 3] Figure 1 is a block diagram of the work range display system 1. [Figure 4] This figure shows the remote control monitor 27a shown in Figure 2. [Figure 5] Figure 1 shows a top-down view of the work area A, etc. [Modes for carrying out the invention]

[0009] The work range display system 1 will be described with reference to Figures 1 to 5.

[0010] As shown in Figure 1, the work range display system 1 displays the work range A of the automated work machine 10. The work range display system 1 allows a person (such as a worker or operator) to visually confirm the work range A. The work range display system 1 comprises the automated work machine 10, the automated work machine position sensor 15 shown in Figure 3, the work range setting unit 16, the non-autonomous work machine 20 (see Figure 1), the non-autonomous work machine position sensor 25, the remote control unit 27, the controller 30, and the display unit 40.

[0011] As shown in Figure 1, the automated work machine 10 is a work machine that performs work by automatic operation. The automated work machine 10 is, for example, a construction machine that performs construction work, and may be, for example, an excavator or a crane (the same applies to the non-autonomous work machine 20). The following describes the case where the automated work machine 10 is an excavator (the same applies to the non-autonomous work machine 20). The automated work machine 10 comprises a lower traveling body 11, an upper rotating body 12, and an attachment 13.

[0012] The lower traveling body 11 drives the automated work machine 10. The lower traveling body 11 is equipped with, for example, crawler tracks.

[0013] The upper slewing body 12 is rotatably mounted on the lower traveling body 11. The upper slewing body 12 comprises a cab 12a and a counterweight 12b. The cab 12a is the part from which an operator can operate the automated work machine 10. When the automated work machine 10 is operating automatically, the operator does not need to be in the cab 12a. The counterweight 12b is a weight used to balance the automated work machine 10 in the longitudinal direction.

[0014] Attachment 13 is the part that performs the work. For example, attachment 13 comprises a boom 13a, an arm 13b, and a tip attachment 13c. The boom 13a is mounted on the upper slewing body 12 so as to be able to raise and lower (rotate vertically). The arm 13b is mounted rotatably to the boom 13a. The tip attachment 13c is provided at the tip of attachment 13 and is rotatably mounted to the arm 13b. The tip attachment 13c may be, for example, a bucket for scooping up soil, a device for gripping objects (such as a grapple), or a device for crushing or excavating (such as a breaker).

[0015] The automated work machine position sensor 15 (see Figure 3) detects the position of the automated work machine 10. The automated work machine position sensor 15 detects the position and orientation of a reference part of the automated work machine 10 relative to the work site. The reference part of the automated work machine 10 may be, for example, a specific part of the upper slewing body 12 or the lower traveling body 11, or it may be, for example, the attachment part (boom foot) of the boom 13a to the upper slewing body 12. The automated work machine position sensor 15 may perform detection using a positioning system (for example, a satellite positioning system). The positioning system may be a satellite positioning system, or for example, a GNSS (global navigation satellite system). The positioning system may also use a total station. The automated work machine position sensor 15 may be mounted on the automated work machine 10 or installed outside the automated work machine 10. The automated work machine position sensor 15 may detect the position based on a two-dimensional image or a distance image (an image containing distance information).

[0016] The work range setting unit 16 (see Figure 3) sets the work range A of the automated work machine 10. Details of the work range A will be described later.

[0017] The non-autonomous operation work machine 20 is a different work machine from the automated operation work machine 10. The non-autonomous operation work machine 20 operates according to the operator's commands. The non-autonomous operation work machine 20 may also be a work machine operated by an operator riding on the non-autonomous operation work machine 20 (a manned work machine). As shown in Figure 2, the non-autonomous operation work machine 20 may also be a work machine operated by remote control via a remote control unit 27 (a remotely controlled work machine). As shown in Figure 1, the non-autonomous operation work machine 20, like the automated operation work machine 10, comprises a lower traveling body 21, an upper rotating body 22, and an attachment 23. The upper rotating body 22 includes an operator's cab 22a.

[0018] The non-autonomous work machine position sensor 25 (see Figure 3) detects the position of the non-autonomous work machine 20. A specific example of the non-autonomous work machine position sensor 25 is the same as that of the autonomous work machine position sensor 15.

[0019] As shown in FIG. 2, the remote control unit 27 is a part (such as a remote control seat and its peripheral devices) where an operator operates the non-autonomous work machine 20 when the non-autonomous work machine 20 is a remote-controlled work machine. The remote control unit 27 includes a remote control monitor 27a. The remote control monitor 27a displays an image captured by the non-autonomous work machine 20 (for example, the cab 22a) (see FIG. 4). The operator of the remote control unit 27 operates the non-autonomous work machine 20 while viewing the image on the remote control monitor 27a.

[0020] The controller 30 (see FIG. 3) is a computer that performs signal input / output, calculation (processing), information storage, and the like. For example, the functions of the controller 30 are realized by executing a program stored in a storage unit of the controller 30 at a calculation unit. The controller 30 controls the display unit 40. For example, the controller 30 may be capable of communicating with at least one of the autonomous work machine 10 and the non-autonomous work machine 20 shown in FIG. 1. As shown in FIG. 3, the controller 30 may be capable of communicating with at least one of the autonomous work machine position sensor 15, the work range setting unit 16, the non-autonomous work machine position sensor 25, and the remote control unit 27. For example, the controller 30 determines the display content of the display unit 40, controls the display position of the display unit 40, and the like.

[0021] The display unit 40 displays the position of the work range A (see FIG. 1). The display unit 40 displays the position of the work range A based on the information of the work range A set in the work range setting unit 16. The display unit 40 may display information related to the work range A other than the position of the work range A. As shown in FIG. 1, the display unit 40 displays the position of the work range A outside the autonomous work machine 10.

[0022] This display unit 40 may be, for example, an irradiation device 40a, a monitor 40b (see FIG. 2), or an augmented reality device 40c. In the following, the controller 30 will be described with reference to FIG. 3.

[0023] As shown in Figure 1, the illumination device 40a is a device that illuminates the work site of the automated work machine 10 with light. The illumination device 40a directly indicates the position of the work area A at the work site. The illumination position (direction) of the illumination device 40a is controlled (adjusted) by instructions from the controller 30. The content of the illumination by the illumination device 40a may also be controlled by instructions from the controller 30. For example, the light emitted by the illumination device 40a may be light from an incandescent bulb or laser light. The illumination device 40a may be a machine-mounted illumination device 40a1 or a site-installed illumination device 40a2.

[0024] The machine-mounted illumination device 40a1 is mounted on the automated work machine 10, and may be mounted on, for example, the upper rotating body 12, or on, for example, the attachment 13. In the example shown in Figure 1, the machine-mounted illumination device 40a1 is positioned at the rear of the upper rotating body 12 (for example, the counterweight 12b or its vicinity). In this example, the machine-mounted illumination device 40a1 illuminates from the rear of the upper rotating body 12, towards the rear of the upper rotating body 12 (opposite the direction in which the attachment 13 protrudes relative to the upper rotating body 12). In this case, the light emitted by the machine-mounted illumination device 40a1 is not obstructed by the attachment 13. The machine-mounted illumination device 40a1 may also illuminate forward from the upper rotating body 12 (in the direction in which the attachment 13 protrudes relative to the upper rotating body 12), or it may illuminate to the side. The machine-mounted illumination device 40a1 may be configured to illuminate the entire circumference (or nearly the entire circumference) around the upper rotating body 12.

[0025] The orientation (angle, irradiation direction) of the machine-mounted irradiation device 40a1 relative to the upper rotating body 12 is variable. The vertical orientation of the machine-mounted irradiation device 40a1 relative to the upper rotating body 12 is also variable and is controlled, for example, by a command from the controller 30.

[0026] The lateral (left-right) orientation of the machine-mounted irradiation device 40a1 relative to the upper rotating body 12 may be fixed or variable. The lateral orientation of the machine-mounted irradiation device 40a1 relative to the upper rotating body 12 may be variable only within a predetermined range or may be variable over the entire circumference (360°). The lateral orientation of the machine-mounted irradiation device 40a1 relative to the work site is controlled by at least one of the following: rotation of the upper rotating body 12 relative to the lower traveling body 11, and a change in the lateral orientation of the machine-mounted irradiation device 40a1 relative to the upper rotating body 12.

[0027] When the orientation of the machine-mounted illumination device 40a1 relative to the upper rotating body 12 is controlled, the controller 30 may stop the automated work machine 10. In this case, compared to when the automated work machine 10 is not stopped, the control of the illumination direction of the machine-mounted illumination device 40a1 becomes simpler, and the computational load on the controller 30 can be reduced. The orientation of the machine-mounted illumination device 40a1 relative to the upper rotating body 12 may be controlled while the automated work machine 10 is operating. In this case, even when the automated work machine 10 is operating, the machine-mounted illumination device 40a1 can reliably display the position of the work range A. As a result, interference between the automated work machine 10 and objects around it (non-automated work machines 20, workers, etc.) may be suppressed.

[0028] The field-installed illumination device 40a2 is installed outside the automated work machine 10. The field-installed illumination device 40a2 is installed at the work site. The field-installed illumination device 40a2 may also be mounted on a non-autonomous work machine 20 (the non-autonomous work machine 20 may be included in the "work site"). The field-installed illumination device 40a2 may be installed in only one location or in multiple locations. If the field-installed illumination device 40a2 is installed in only one location, it cannot illuminate areas that are in the shadow of an object (e.g., the automated work machine 10). If the field-installed illumination device 40a2 is installed in multiple locations, the range that can be illuminated by the field-installed illumination device 40a2 is wider than when it is installed in only one location.

[0029] Monitor 40b is located outside the automated work machine 10, as shown in Figure 2. Monitor 40b is, for example, a remote control monitor 27a. As shown in Figure 4, the remote control monitor 27a displays video of the work site taken from the non-autonomous work machine 20 (see Figure 2) (for example, from the operator's cab 22a). Monitor 40b superimposes a display indicating the work area A onto this video of the work site. More specifically, the non-autonomous work machine position sensor 25 shown in Figure 3 detects the position and orientation of the non-autonomous work machine 20 shown in Figure 2. The controller 30 unifies the coordinate system of the position and orientation of the non-autonomous work machine 20, the coordinate system of the video of the work site taken from the operator's cab 22a, and the coordinate system of the work area A (for example, unifying them to the coordinate system of the work site). As shown in Figure 4, the controller 30 calculates the position of the work area A in the video of the work site displayed on monitor 40b. The monitor 40b then displays a display indicating the location of work area A superimposed on the video of the work site, so as if the location of work area A were displayed at the actual location of work area A in the actual work site. Note that if the non-autonomous work machine 20 is remotely controlled, the location of work area A may be displayed by the machine-mounted illumination device 40a1, as shown in Figure 1.

[0030] The augmented reality device 40c is a device that displays an indication of the work area A overlaid on the actual work site scenery or video of the work site (for example, a display as shown in Figure 4). The augmented reality device 40c may be, for example, smart glasses worn by the operator of the remote control unit 27 shown in Figure 2. The augmented reality device 40c shown in Figure 1 may be smart glasses worn by the operator riding in the non-autonomous work machine 20 (human-operated work machine) or by workers at the work site. The augmented reality device 40c may also be a tablet terminal or the like that displays the work area A superimposed on the video of the work site. The augmented reality device 40c may also be a device (such as a head-up display) that projects onto the driver's cab 22a of the non-autonomous work machine 20 (human-operated work machine) in which the operator is riding.

[0031] (Work area A) As described above, the display unit 40 displays the location of the work area A. This work area A can be set as follows, for example: [Example 1] The work area A may be the area (target area) in which work on the work object O is scheduled to be performed by the automated work machine 10. The work object O may be soil, stone, wood, metal, a structure, or waste. [Example 1a] The work area A may also be the area (capture area A1a) in which the automated work machine 10 is scheduled to capture the work object O. For example, if the work object O is soil, the capture area A1a is the area in which soil excavation will be performed, for example, the area in which a pile of soil exists. [Example 1b] As shown in Figure 5, the work area A may also be the area (release area A1b) in which the automated work machine 10 is scheduled to release the work object O. For example, if the work object O is soil, the release area A1b is the area in which soil removal will be performed, for example, the area in which the loading platform of a transport vehicle exists.

[0032] [Example 2] The work area A may be the area that the automated work machine 10 is scheduled to pass through when it moves (target trajectory, target movement path, etc.). "When the automated work machine 10 moves" means, for example, at least one of the following: when the lower traveling body 11 moves, when the upper rotating body 12 rotates, and when the attachment 13 is activated. The "movement" of the automated work machine 10 is included in the "work" of the automated work machine 10. [Example 2a] The work area A may be the area that the attachment 13 is scheduled to pass through when the automated work machine 10 rotates (rotation area A2a), or it may be the area that the upper rotating body 12 is scheduled to pass through. For example, rotation area A2a may include the area that the attachment 13 is scheduled to pass through when the tip attachment 13c moves from the capture area A1a to the release area A1b while the tip attachment 13c has captured the work object O (when it rotates while lifting). For example, the rotation range A2a may include the range that the attachment 13 is scheduled to pass through when the tip attachment 13c moves from the release range A1b towards the capture range A1a with the workpiece O released (when it rotates back). [Example 2b] The work range A may also be the range that the automated work machine 10 is scheduled to pass through when it is traveling (target movement path).

[0033] (Setting the work area A) The work range A may be set by teaching, or by other methods (e.g., numerical input).

[0034] Teaching is performed, for example, as follows: An operator boards the automated work machine 10 shown in Figure 1 and operates the automated work machine 10, or remotely operates the automated work machine 10 via remote control. For example, by operating the automated work machine 10, the operator positions a specific part of the attachment 13 (for example, the tip of the attachment 13) at a specific location within the range to be set as the capture range A1a. Then, based on the position where the specific part of the attachment 13 is positioned, the range to be set as the work range A is determined.

[0035] Specifically, for example, the capture range A1a may be set as follows. Here, we assume that the capture range A1a is a rectangle when viewed from above. In this case, for example, when an operator operates the automated work machine 10, a specific part of the attachment 13 is positioned at points Pa and Pc, which are diagonal points of the capture range A1a. The coordinates of point Pa (xa, ya, za) and point Pc (xc, yc, zc) are then obtained. The coordinates of the midpoint Pm between points Pa and Pc are ((xa+xc) / 2, (ya+yc) / 2, (za+zc) / 2). Here, assuming that the upper rotating body 12 is facing the midpoint Pm, the front-to-back direction of the upper rotating body 12 (the direction in which the attachment 13 extends) is defined as the direction in which the two sides of the rectangular capture range A1a extend. In this case, the coordinates of the remaining two points (points Pb and Pd) within the rectangular capture range A1a are automatically determined. As a result, the position (coordinates) of the capture range A1a is determined. Note that if the capture range A1a is rectangular, three or more points may be taught. The capture range A1a does not have to be rectangular when viewed from above. Also, the release range A1b may be set by teaching in the same way as the capture range A1a.

[0036] Furthermore, for example, the slewing range A2a shown in Figure 5 may be set as follows. For example, an operator controls the automated work machine 10 to perform a lifting slewing (or return slewing) operation. At this time, the trajectory of a specific part of the attachment 13 is set as the target trajectory. Then, assuming that the specific part of the attachment 13 moves along the target trajectory, the range that the attachment 13 is expected to pass through is set as the slewing range A2a. Note that these methods for setting the work range A are examples, and the work range A can be set in various ways.

[0037] (Display of the location of work area A) The display unit 40 shown in Figure 1 can display the position of the work area A in various ways. The figure displayed by the display unit 40 to indicate the position of the work area A may be a figure showing a part of the work area A (for example, the central part), a figure showing the outer perimeter of the work area A (frame-shaped, ring-shaped, etc.), or a figure showing the entire (or nearly entire) interior of the work area A. The figure showing the position of the work area A may be a point, a line, a polygon, a circle, an ellipse, or a shape similar to these.

[0038] The display unit 40 may display the position of the central part of the work area A. For example, the illumination device 40a may illuminate the central part of the work area A. In this case, the controller 30 controls the orientation (illumination direction) of the illumination device 40a so that it faces the central part of the work area A. The monitor 40b (see Figure 2) or the augmented reality device 40c may also display the position of the central part of the work area A. Specifically, the "central part of the work area A" refers to, for example, the centroid of the work area A as viewed from above and the surrounding area. More specifically, if the work area A is a rectangular capture area A1a as viewed from above, the central part of the work area A is the midpoint Pm and the surrounding area (for example, the central part of a pile of earth).

[0039] The display unit 40 may display the position of the outer perimeter of the work area A. For example, if the work area A is a polygon when viewed from above, the display unit 40 may display a polygonal frame shape (see Figure 4). For example, if the work area A is a circle or an ellipse when viewed from above, the display unit 40 may display a circular or elliptical ring shape. The display unit 40 may display a shape that shows the entire (or nearly entire) interior of the work area A. More specifically, the display unit 40 may display a shape that is filled in within the work area A.

[0040] The display unit 40 may change the color and shape of the display indicating the position of the work range A according to certain conditions.

[0041] (Display of information related to work area A, excluding the location of work area A) The display unit 40 may display information about work range A other than the location of work range A. The display unit 40 may change the manner in which the location of work range A is displayed (whether or not to display it, the color and shape of the display, etc.) based on the information about work range A other than the location of work range A. The display unit 40 may display information about work range A other than the location of work range A separately from the display of the location of work range A. Specific examples of the display of information about work range A other than the location of work range A are as follows.

[0042] (Display showing the time until the start of work by the automated work machine 10) The display unit 40 may display the time until the automated work machine 10 starts working. For example, the display unit 40 may display the time until the automated work machine 10 starts working (for example, working on the work object O). The display unit 40 may display the time until the automated movement (turning or driving) of the automated work machine 10 starts. For example, the display unit 40 may display a number indicating the remaining time until the automated work machine 10 starts working, in a countdown manner. For example, the display unit 40 may change the manner of displaying the position of the work range A (whether or not to display it, the color and shape of the display, etc.) according to the remaining time until the automated work machine 10 starts working.

[0043] Specifically, for example, if the automated work machine 10 starts moving while the non-autonomous work machine 20 is working within the detection range A1a, there is a risk of interference between the non-autonomous work machine 20 and the automated work machine 10. If the display unit 40 displays the time until the automated work machine 10 starts working, the operator of the non-autonomous work machine 20 can take measures to prevent this interference from occurring.

[0044] (Display of information regarding the progress of the work of the automated work machine 10) The display unit 40 may display information regarding the progress of the work of the automated work machine 10. For example, when a non-autonomous work machine 20 and an automated work machine 10 are working in cooperation, displaying information about the work of the automated work machine 10 on the display unit 40 improves convenience for the operator of the non-autonomous work machine 20.

[0045] Specifically, for example, when the automated work machine 10 is performing the task of capturing a work object O within the capture range A1a, the display unit 40 may display information regarding the amount of work object O remaining within the capture range A1a. The display unit 40 may change the display mode (whether or not to display, the color and shape of the display, etc.) based on whether or not the amount of work object O is below a threshold. The amount of work object O may be monitored by, for example, an imaging device (not shown).

[0046] (Display of information regarding the operation of the automated work machine 10) For example, the display unit 40 may display whether or not the automated work machine 10 is operating (i.e., whether it is stopped). Specifically, for example, the display unit 40 may display an indication that the automated work machine 10 is operating when it is in operation. In this case, interference between the automated work machine 10 and the non-autonomous work machines 20 and workers in the vicinity of the automated work machine 10 can be suppressed.

[0047] (Displayed only if the display conditions are met) The display unit 40 may only display information when the display execution conditions are met. The display execution conditions are set in the controller 30 based on the need for display by the display unit 40 and can be set in various ways.

[0048] By having the display unit 40 display only when the display execution conditions are met, the computational load on the controller 30 can be reduced. For example, if the display unit 40 is a machine-mounted illumination device 40a1, the controller 30 needs to control the illumination position of the machine-mounted illumination device 40a1 in accordance with the operation of the automated work machine 10. By having the display unit 40 display only when the display execution conditions are met, the computational load on the controller 30 for this control is reduced. For example, if the display unit 40 is a field-installed illumination device 40a2, the light emitted by the field-installed illumination device 40a2 may be blocked by the automated work machine 10 or non-autonomous work machine 20, potentially causing illumination at a location unrelated to the work area A. By having the display unit 40 display only when the display execution conditions are met, the possibility of illumination at a location unrelated to the work area A can be reduced. Furthermore, if the display unit 40 is the monitor 40b shown in Figure 4 and is the remote control monitor 27a, the display unit 40 will only display information when the display execution conditions are met, making it easier to view the video of the work site taken from the driver's cab 22a.

[0049] For example, the display execution conditions may include the state in which the non-automated work machine 20 shown in Figure 1 is in a state where it should replenish the work object O in the capture range A1a (for example, replenish the soil pile with soil). For example, the display execution conditions may include the state in which the amount of work object O in the capture range A1a is below a certain threshold (let's call it the first threshold). Also, for example, the display execution conditions may include the state in which the non-automated work machine 20 is set to replenish the work object O in the capture range A1a. Specifically, for example, when the controller 30 receives a command (soil pile replenishment signal) indicating that it is in a state to replenish the work object O in the capture range A1a, it may display the position of the capture range A1a on the display unit 40. For example, when the replenishment of the work object O by the non-automated work machine 20 is completed, the controller 30 may receive a command (replenishment completion signal) from the non-automated work machine 20 indicating that the replenishment is complete and end the display on the display unit 40.

[0050] For example, if the amount of work object O exceeds a certain amount, and a large pile of soil is created, it may no longer be necessary to display the location of the capture range A1a. Therefore, the display execution conditions may include the condition that the amount of work object O in the capture range A1a is less than or equal to a certain threshold (let's call this the second threshold). Note that the second threshold is a value that is sufficiently larger than the first threshold mentioned above.

[0051] (Specific example) Further specific examples of the operation of the work range display system 1 will be explained. Here, we will describe a case where an automated work machine 10, through automated operation, captures a work object O in the capture range A1a (e.g., excavation) and releases it to a transport vehicle in the release range A1b (e.g., soil removal). While the automated work machine 10 is performing work through automated operation, a non-autonomous work machine 20 performs "other work" (e.g., shaping a pile of soil or shaping a slope in a location different from the capture range A1a) at a location different from where the automated work machine 10 is performing work. At this time, the operator of the non-autonomous work machine 20 may perform the "other work" while checking whether or not there is a work object O in the capture range A1a. Here, when the amount of work object O in the capture range A1a falls below the first threshold, the display unit 40 displays a message to that effect (a message indicating that the amount of work object O in the capture range A1a has fallen below the first threshold). In this case, the operator can know that the amount of work object O in the capture range A1a has fallen below the first threshold.

[0052] When there are no more (or nearly no more) work objects O that the automated work machine 10 can capture, the automated work machine 10 stops. Specifically, when the amount of work objects O in the capture range A1a falls below a certain threshold (referred to as the third threshold), the automated work machine 10 stops. The third threshold may be equal to the first threshold, or it may be less than the first threshold. When the automated work machine 10 stops, the display unit 40 displays a message indicating that the automated work machine 10 has stopped. In this case, the operator can be aware that the automated work machine 10 has stopped.

[0053] For example, an operator who has confirmed indicators such as one showing that the work object O has fallen below a first threshold, and another showing that the automated work machine 10 has stopped, moves the non-autonomous work machine 20 to the vicinity of the capture range A1a. Also, a command (earth pile replenishment signal) indicating that the work object O is ready to be replenished in the capture range A1a is transmitted from the non-autonomous work machine 20 or the remote control unit 27 (see Figure 2) to the controller 30. The controller 30 then displays the location of the capture range A1a on the display unit 40. The operator can then visually confirm the location of the capture range A1a. For example, even if the capture range A1a is flat ground without any earth piles, the operator can still visually confirm its location. Then, the operator's actions cause the non-autonomous work machine 20 to replenish the work object O in the capture range A1a (for example, by creating an earth pile).

[0054] Subsequently, the replenishment of the work object O into the capture range A1a is completed. At this time, a command (replenishment completion signal) indicating that the replenishment of the work object O into the capture range A1a has been completed may be transmitted from the non-automatic operation work machine 20 or the remote control unit 27 (see Figure 2) to the controller 30, either by operator action or otherwise. Alternatively, the completion of the replenishment of the work object O into the capture range A1a may be detected by an imaging device (not shown). When the replenishment of the work object O into the capture range A1a is completed (or when the pile of earth and sand has become sufficiently high), the controller 30 terminates the display on the display unit 40.

[0055] After the replenishment of the work object O within the capture range A1a is complete, the automated work machine 10 starts (resumes) the operation of capturing the work object O within the capture range A1a. Before the automated work machine 10 starts the operation, the display unit 40 displays the time remaining until the automated work machine 10 starts the operation. Also, before the automated work machine 10 starts the operation, the display unit 40 displays the direction in which the automated work machine 10 will rotate when it starts the operation (rotation range A2a). In this case, interference between the automated work machine 10 and objects around the automated work machine 10 (non-automated work machines 20 and operators) is suppressed.

[0056] (Effects of the first invention) The effects of the work range display system 1 shown in Figure 1 are as follows. The work range display system 1 comprises a work range setting unit 16 (see Figure 3) and a display unit 40.

[0057] [Configuration 1] The work range setting unit 16 (see Figure 3) sets the work range A of the automated work machine 10. The display unit 40 displays the location of the work range A outside the automated work machine 10 based on the information of the work range A set in the work range setting unit 16.

[0058] The following effect can be obtained with the above [Configuration 1]. The working range A of the automated work machine 10 is information such as coordinates, and as such, it cannot be recognized by people (operators or workers, etc.). Therefore, in the above [Configuration 1], the display unit 40 displays the working range A outside the automated work machine 10. Thus, the working range A of the automated work machine 10 can be visually confirmed by people from outside the automated work machine 10.

[0059] (Effects of the second invention) [Configuration 2] The display unit 40 (illumination device 40a) is a device that illuminates the work site of the automated work machine 10 with light.

[0060] With the above [Configuration 2], the display by the display unit 40 can be directly seen by people at the work site. Therefore, the position of the display unit 40 can be reliably seen by people.

[0061] (Effects of the third invention) [Configuration 3] The display unit 40 (irradiation device 40a) illuminates the central part of the work area A.

[0062] With the above [Configuration 3], the display unit 40 (irradiation device 40a) can be configured more simply compared to cases where it is necessary to illuminate the outer perimeter of the work area A or the entire interior of the work area A.

[0063] (Effects of the fourth invention) [Configuration 4] The display unit 40 (machine-mounted illumination device 40a1) is mounted on the automated work machine 10.

[0064] With the above [Configuration 4], it is not necessary to provide the display unit 40 in a location different from the automated work machine 10. Therefore, the work range display system 1 can be configured simply. Note that when the work range display system 1 is equipped with the above [Configuration 4], components of the work range display system 1 other than the display unit 40 (for example, the work range setting unit 16 (see Figure 3)) may be located outside the automated work machine 10.

[0065] (Effects of the fifth invention) [Configuration 5] The display unit 40 (field-installed illumination device 40a2) is installed on the outside of the automated work machine 10.

[0066] With the above configuration [5], the degree of freedom in the display position of the display unit 40 (field-installed illumination device 40a2) can be increased compared to when the display unit 40 (machine-mounted illumination device 40a1) is mounted on the automated work machine 10.

[0067] (Effects of the sixth invention) [Configuration 6] As shown in Figure 2, the display unit 40 (for example, monitor 40b) is provided on the remote control unit 27 of the remotely controlled work machine (the remotely controlled, non-autonomous work machine 20).

[0068] As described in [Configuration 6] above, the operator of the remotely controlled non-autonomous work machine 20 can visually confirm the work range A of the autonomous work machine 10.

[0069] (Effects of the seventh invention) [Configuration 7] The work range A includes the range (capture range A1a) in which the automated work machine 10 is scheduled to capture the work object O.

[0070] With the above [Configuration 7], the location of the capture range A1a can be made visible to a person.

[0071] As a result, the following effects may be obtained: For example, it may be possible to inform a person of the location where the work object O should be replenished. Also, for example, it may be possible to inform a person of the area in which the automated work machine 10 will enter in order to capture the work object O. As a result, it may be possible to suppress interference between the automated work machine 10 and objects around it (non-autonomous work machines 20 or workers).

[0072] (Effects of the 8th Invention) [Configuration 8] As shown in Figure 5, the working range A includes the range that the automated work machine 10 is expected to pass through when it moves (e.g., the turning range A2a).

[0073] As described in [Configuration 8] above, it is possible to inform people how the automated work machine 10 will move. As a result, interference between the automated work machine 10 and objects around it (such as non-autonomous work machines 20 and workers) can be suppressed.

[0074] (Effects of the 9th Invention) [Configuration 9] The display unit 40 shown in Figure 1 will only display information when the display execution conditions, which are set based on the need for display by the display unit 40, are met.

[0075] The above configuration [9] can suppress the display unit 40 from displaying unnecessary information. As a result, for example, the computational load on the device that controls the display of the display unit 40 (for example, the controller 30 (see Figure 3)) may be reduced. For example, it may be possible to suppress the display of the display unit 40 from becoming overly complex.

[0076] (modified version) The above embodiments may be modified in various ways. For example, the function, arrangement, shape, and operation of each component of the above embodiments may be changed, or only partially changed. For example, the connections between the components shown in Figure 3 may be changed. For example, thresholds and ranges may be constant, changed by manual operation, or changed automatically according to certain conditions. For example, the number of components may be changed, or some components may not be provided. For example, what has been described as multiple different members or parts may be treated as a single member or part. For example, what has been described as a single member or part may be divided and provided as multiple different members or parts. Specifically, for example, the work range setting unit 16 and the controller 30 may be provided separately or as a single unit. [Explanation of symbols]

[0077] 1. Working Range Display System 10 Automated Driving Work Machines 16. Working range setting unit 20 Non-autonomous operation work machines (remotely controlled work machines) 27 Remote Control Unit 40 Display section A. Work area O Workpiece

Claims

1. A work range setting unit for setting the work range of an automated work machine, Based on the work range information set in the work range setting unit, a display unit is provided outside the automated work machine to display the location of the work range, A controller that controls the display unit, Equipped with, The aforementioned work range includes the capture range in which the automated work machine is expected to capture the work object, The controller causes the display unit to display information only when the display execution conditions set based on the need for display by the display unit are met. The display execution condition includes receiving a command indicating that the work object is in a state where it should be added to the capture range, The controller, upon receiving the command, causes the location within the capture range to be displayed on the display unit. Work area display system.

2. A work range display system according to claim 1, When the controller receives a command indicating that the replenishment of the work object within the capture range is complete, it terminates the display of the position within the capture range by the display unit. Work area display system.

3. A work range display system according to claim 1, The controller terminates the display of the location within the capture range by the display unit when the amount of the work object within the capture range is greater than the second threshold. Work area display system.

4. A work range display system according to any one of claims 1 to 3, The state in which the work object should be replenished within the capture range includes a state in which the amount of the work object within the capture range is less than or equal to a first threshold. Work area display system.

5. A work range display system according to claim 4, When the amount of work objects within the capture range falls below a third threshold at which there are no more work objects that the automated work machine can capture, the automated work machine is stopped. Work area display system.

6. A work range display system according to any one of claims 1 to 4, When the position within the capture range is displayed on the display unit, the automated operating machine is stopped. Work area display system.

Citation Information

Patent Citations

  • Excavation machine with excavating state display device

    JP2008121280A

  • Notification management device and notification management method

    JP2017074918A

  • Work machine

    JP2019060109A

  • Alerting device for construction machine

    JP2019105105A

  • Construction machine

    JP2019173352A