Control method of work vehicle

Abstract

To allow an operator of a work vehicle looking at a display part to intuitively and easily detect the existence of an obstacle around the work vehicle, and allow the operator to sense danger such as collision between an obstacle and the work vehicle.SOLUTION: A control method of a work vehicle includes: displaying an image acquired in a corresponding peripheral region of the work vehicle on an image display region of a display part of the work vehicle; detecting whether or not an obstacle exists in the region; displaying at least a part of belt-like notification information on the outer edge of the image, in response to the detection of the obstacle; and preventing display of the notification information, during non-detection of the obstacle.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a control method for a work vehicle. [Background technology]

[0002] Conventionally, various monitoring systems have been proposed for monitoring the surroundings of a work vehicle such as a shovel. For example, Patent Document 1 discloses a system that captures the surroundings of the shovel with a camera, displays the captured image on a display unit, and highlights the area of ​​a person included in the image by surrounding it with a frame. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2017-101420 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in a configuration in which the captured image and a frame are displayed on the display unit in an overlapping manner as in Patent Document 1, multiple pieces of information are displayed on top of each other, making it difficult to see. In addition, if a person in an image is small compared to the entire image, the frame surrounding the person in the image will be small compared to the entire image. This makes it difficult for the operator (driver) of the work vehicle to intuitively sense the presence of an obstacle around the work vehicle by looking at the display unit. As a result, there is a problem in that it is difficult for the operator to sense danger such as a collision between the work vehicle and an obstacle.

[0005] The present invention has been made to solve the above-mentioned problems, and its object is to provide a control method for a work vehicle that enables an operator of the work vehicle looking at a display unit to intuitively and easily detect the presence of an obstacle around the work vehicle, thereby enabling the operator to easily detect dangers such as a collision between the work vehicle and the obstacle. [Means for solving the problem]

[0006] A work vehicle control method according to one aspect of the present invention includes displaying an image acquired in a corresponding area around the work vehicle in an image display area of ​​a display unit of the work vehicle, detecting whether an obstacle is present in the area, and displaying at least a portion of a band-shaped notification information on the outer edge of the image in response to detection of the obstacle, and not displaying the notification information when the obstacle is not detected. Effect of the Invention

[0007] According to the above control method, the operator of the work vehicle looking at the display can intuitively and easily detect the presence of an obstacle around the work vehicle, and can easily detect the danger of a collision between the work vehicle and the obstacle. [Brief description of the drawings]

[0008] [Figure 1] 1 is a side view showing a schematic configuration of a hydraulic excavator, which is an example of a work vehicle according to an embodiment of the present invention. [Diagram 2] FIG. 2 is an explanatory diagram showing a configuration of a main part of the above-mentioned hydraulic excavator. [Diagram 3] 3 is an explanatory diagram showing an example of each display area on a display screen of a display unit of the hydraulic excavator. FIG. [Figure 4] 4 is an explanatory diagram showing a display example of the display unit. FIG. [Diagram 5] 10A to 10C are explanatory diagrams showing other examples of the display areas on the display screen of the display unit. [Figure 6] 11 is an explanatory diagram showing another display example of the display unit. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The following describes an embodiment of the present invention with reference to the drawings.

[0010] [1. Work vehicles] 1 is a side view showing a schematic configuration of a hydraulic excavator 1, which is an example of a work vehicle according to this embodiment. The hydraulic excavator 1 includes a lower traveling structure 2, a work machine 3, and an upper rotating structure 4.

[0011] Here, directions in FIG. 1 are defined as follows. First, the direction in which the lower traveling body 2 moves straight is the fore-aft direction, one side of which is the "front" and the other side is the "rear". In FIG. 1, as an example, the side of the blade 23 relative to the traveling motor 22 is shown as the "front". Also, the lateral direction perpendicular to the fore-aft direction is the left-right direction. In this case, the left side as seen from the operator (operator) sitting in the cockpit 41a is the "left" and the right side is the "right". Furthermore, the direction of gravity perpendicular to the fore-aft and left-right directions is the up-down direction, with the upstream side of the gravity direction being the "up" and the downstream side being the "down".

[0012] The lower traveling body 2 is driven by power from the engine 40 to travel the hydraulic excavator 1. The lower traveling body 2 is equipped with a pair of left and right crawlers 21 and a pair of left and right traveling motors 22. Each traveling motor 22 is a hydraulic motor. The left and right traveling motors 22 drive the left and right crawlers 21, respectively, to move the hydraulic excavator 1 forward and backward. The lower traveling body 2 is provided with a blade 23 for performing ground leveling work and a blade cylinder 23a. The blade cylinder 23a is a hydraulic cylinder that rotates the blade 23 up and down.

[0013] The work machine 3 is driven by power from an engine 40 and performs excavation work to dig up earth and sand. The work machine 3 includes a boom 31, an arm 32, and a bucket 33. The boom 31, the arm 32, and the bucket 33 can be independently driven to perform excavation work.

[0014] The boom 31 is rotated by a boom cylinder 31a. A base end of the boom cylinder 31a is supported on the front part of the upper rotating body 4 and is movable so as to be telescopic. The arm 32 is rotated by an arm cylinder 32a. A base end of the arm cylinder 32a is supported on the tip part of the boom 31 and is movable so as to be telescopic. The bucket 33 is rotated by a bucket cylinder 33a. A base end of the bucket cylinder 33a is supported on the tip part of the arm 32 and is movable so as to be telescopic. The boom cylinder 31a, the arm cylinder 32a, and the bucket cylinder 33a are constituted by hydraulic cylinders.

[0015] The bucket 33 is provided at the tip of the work machine 3 and is a container-shaped member with claws for performing excavation work. The bucket 33 is rotatably attached to the tip of the arm 32 via a pin 34. Furthermore, the bucket 33 is connected to a bucket cylinder 33a via a link mechanism 35.

[0016] A hook 36 for crane work is attached to the tip of the arm 32. The hook 36 is a hook-shaped member for performing crane work, and is rotatably provided on the link mechanism 35. Here, the crane work refers to a lifting work for suspending and raising and lowering an object to be suspended. The hook 36 is rotatably supported with the axis of the link mechanism 35 as a pivot point, and can change its position between an unfolded state (see FIG. 1) in which it protrudes from the bucket 33, and a stored state (not shown) in which it is stored on the bucket 33 side. For example, when performing excavation work using the bucket 33, the hook 36 is in the stored state. On the other hand, when performing crane work using the hook 36, the hook 36 is in the unfolded state.

[0017] The upper rotating body 4 is configured to be rotatable relative to the lower traveling body 2 via a swivel bearing (not shown). A control unit 41, a swivel base 42, a swivel motor 43, an engine room 44, etc. are arranged on the upper rotating body 4. The upper rotating body 4 rotates via the swivel bearing by driving the swivel motor 43, which is a hydraulic motor. In addition to an engine 40 that provides power to each unit, multiple hydraulic pumps P0 (see FIG. 2) are arranged at the rear of the upper rotating body 4.

[0018] Each hydraulic pump P0 supplies working oil (pressurized oil) to a hydraulic motor (e.g., the left and right travel motors 22, the swing motor 43) and a hydraulic cylinder (e.g., the blade cylinder 23a, the boom cylinder 31a, the arm cylinder 32a, the bucket cylinder 33a). The hydraulic motor and the hydraulic cylinder that are driven by the supply of working oil from any hydraulic pump P0 are collectively called a hydraulic actuator AC (see FIG. 2).

[0019] A cockpit 41a is disposed in the cockpit section 41 in which an operator sits. Operation sections 41b are disposed around the cockpit 41a (particularly in front, on the left and right).

[0020] The operation unit 41b is composed of an operation lever, a switch, a button, etc. for driving the hydraulic actuator AC. The operator sits in the cockpit 41a and operates the operation unit 41b to drive the hydraulic actuator AC. This allows the lower traveling body 2 to travel, the blade 23 to perform ground leveling work, the work machine 3 to perform excavation work, crane work, the upper rotating body 4 to rotate, etc.

[0021] [2. Main components of hydraulic excavator] 2 shows a schematic configuration of the main parts of the hydraulic excavator 1. The hydraulic excavator 1 further includes a monitoring unit 50, a control unit 60, a monitor device 70, a rotating light 81, a light emitting unit 82, and an alarm unit 83.

[0022] (2-1. Monitoring Department) The monitoring unit 50 monitors the surroundings by detecting the presence or absence of obstacles around the hydraulic excavator 1. The above-mentioned obstacles include objects to be monitored such as people, objects, and animals. In other words, the hydraulic excavator 1 is equipped with a monitoring unit 50 that monitors the surroundings of the hydraulic excavator 1. In this embodiment, the monitoring unit 50 monitors the surroundings of the hydraulic excavator 1 by acquiring images of the surroundings of the hydraulic excavator 1 and detecting whether or not there are obstacles around the hydraulic excavator 1. More specifically, the monitoring unit 50 has the following configuration.

[0023] The monitoring unit 50 has an imaging unit 51, an image processing unit 52, and an overhead image generating unit 53. The imaging unit 51 includes a right camera 51a, a left camera 51b, and a rear camera 51c that capture images of the right, left, and rear of the hydraulic excavator 1, respectively. In other words, the monitoring unit 50 has the imaging unit 51 that captures images. The imaging unit 51 also includes multiple cameras (the right camera 51a, the left camera 51b, and the rear camera 51c) that capture images of the surroundings of the hydraulic excavator 1. Note that the images captured by the imaging unit 51 are, for example, moving images, but may also be still images captured at a predetermined frame rate.

[0024] The image processing unit 52 performs image recognition processing on an input of an image acquired by the imaging unit 51 (for example, an image captured to the right side), thereby detecting whether or not an object included in the image is an obstacle and the type of obstacle (person / object / animal), and detecting an intrusion into the monitoring area. That is, the monitoring unit 50 has the image processing unit 52 that detects whether or not an obstacle exists around the hydraulic excavator 1 by image recognition processing on the image acquired by the imaging unit 51. The image processing unit 52 also detects the type of obstacle by the image recognition processing.

[0025] The overhead image generating unit 53 generates an overhead image (bird's-eye view image) centered on the hydraulic excavator 1 through image processing from a plurality of images acquired by the plurality of cameras (right camera 51a, left camera 51b, rear camera 51c) of the imaging unit 51. That is, the monitoring unit 50 has the overhead image generating unit 53 that generates an overhead image through image processing from a plurality of images acquired by the plurality of cameras.

[0026] The image processing unit 52 and the overhead image generating unit 53 are configured by, for example, a central processing unit called a CPU (Central Processing Unit) or a computing device such as a GPU (Graphics Processing Unit).

[0027] In addition, the number, installation locations, and installation method of the cameras in the monitoring unit 50 are not particularly limited as long as the obstacles can be detected within a required range. Also, instead of the cameras, an obstacle sensor may be used to detect the obstacles. As the obstacle sensor, a known distance measuring device capable of acquiring distance information of the obstacle can be used. For example, an ultrasonic radar using ultrasonic waves, a millimeter wave radar using millimeter wave radio waves, a LIDAR that measures the scattered light in response to laser irradiation to obtain the distance, a stereo camera that has a function of multiple cameras integrated and measures the distance to the object from the captured image, and the like can be used as the obstacle sensor. Also, when an obstacle sensor is used, the position information of the obstacle can be acquired based on the phase difference information of the light emission / light reception timing when irradiating light, and the presence or absence of the obstacle can be determined based on the light intensity information at the time of receiving the light.

[0028] The monitoring unit 50 monitors the surroundings of the hydraulic excavator 1 in a plurality of monitoring sections that are divided according to the distance from the hydraulic excavator 1. For example, the image processing unit 52 can detect an obstacle based on the above image and determine the distance of the obstacle from the hydraulic excavator 1 by image processing. If the monitoring range around the hydraulic excavator 1 is divided into a monitoring section D1 having a radius of less than 2 m centered on the hydraulic excavator 1 and a monitoring section D2 having a radius of 2 m or more and 3 m or less, the image processing unit 52 can determine whether the detected obstacle belongs to the monitoring section D1 or D2 based on the distance of the obstacle from the hydraulic excavator 1. That is, the monitoring unit 50 can monitor whether an obstacle exists in the plurality of monitoring sections D1 and D2. The monitoring unit 50 may determine the distance of the obstacle from the hydraulic excavator 1 by the obstacle sensor described above and determine whether the detected obstacle belongs to the monitoring section D1 or D2.

[0029] (2-2. Control Unit) The control unit 60 controls the operation of each part of the hydraulic excavator 1. Such a control unit 60 is configured with an electronic control unit called an ECU (Electronic Control Unit). The control unit 60 may include a storage unit. The storage unit stores programs for operating the control unit 60 and various types of information. As such a storage unit, a RAM (Random Access Memory), a ROM (Read Only Memory), a non-volatile memory, etc. can be used.

[0030] (2-3.Monitor device) The monitor device 70 is disposed near the cockpit 41a (for example, diagonally forward) and displays various information to provide necessary information to the operator seated in the cockpit 41a. The monitor device 70 has a display unit 71 and an input unit 72. The monitor device 70 itself may have an ECU (monitor ECU) therein, and each unit in the monitor device 70 may be controlled by the monitor ECU.

[0031] The display unit 71 is formed of, for example, a liquid crystal display device, and displays various types of information. For example, the display unit 71 displays images acquired by the monitoring unit 50. That is, the hydraulic excavator 1 of this embodiment is equipped with the display unit 71 that displays images acquired by the monitoring unit 50. Furthermore, when the monitoring unit 50 detects the presence of an obstacle around the hydraulic excavator 1, the display unit 71 also displays notification information indicating the presence of the obstacle. Details of the display screen of the display unit 71 will be described later.

[0032] The input unit 72 is operated by an operator to set and input various pieces of information. The input unit 72 is configured, for example, by a touch panel input device arranged over the display unit 71. The input unit 72 may be configured by mechanical input buttons or a jog dial. The operator can also switch the display screen of the display unit 71 (for example, switch between the screen shown in FIG. 4 and the screen shown in FIG. 6) by operating the input unit 72 (for example, by pressing a predetermined position).

[0033] (2-4. Rotating light, light emitting unit, alarm unit) The rotating light 81 shown in FIG. 2 is composed of a lamp that rotates when the monitoring unit 50 detects an obstacle. The light-emitting unit 82 is composed of, for example, a light-emitting diode (LED), and turns on or blinks when the monitoring unit 50 detects an obstacle. The alarm unit 83 is composed of a buzzer that outputs a sound when the monitoring unit 50 detects an obstacle. The alarm unit 83 may be composed of a sound output unit that outputs a voice (electronic sound) when the monitoring unit 50 detects an obstacle. The rotation of the lamp of the rotating light 82, the lighting (or blinking) of the light-emitting unit 82, and the output of the buzzer sound or voice by the alarm unit 63 allow the operator to recognize that the monitoring unit 50 has detected an obstacle.

[0034] As described above, when the monitoring unit 50 detects an obstacle, the display unit 71, rotating light 81, light-emitting unit 82, and alarm unit 83 of the monitor device 70 output an alarm by displaying an icon or the like, rotating a lamp, emitting light, and outputting a sound. From this, it can be said that the display unit 71, rotating light 81, light-emitting unit 82, and alarm unit 83 constitute an alarm device 90 that outputs an alarm based on the monitoring result of the monitoring unit 50. In other words, the hydraulic excavator 1 of this embodiment is equipped with an alarm device 90 that outputs an alarm based on the monitoring result of the monitoring unit 50. Note that the alarm device 90 does not need to be equipped with all of the display unit 71, rotating light 81, light-emitting unit 82, and alarm unit 83, and may be configured to include at least any one of them.

[0035] [3. Hydraulic circuit] Next, the hydraulic circuit of the hydraulic excavator 1 will be described with reference to Figures 1 and 2. The hydraulic excavator 1 includes a plurality of hydraulic actuators AC, a hydraulic pump P0 that pumps hydraulic oil to the plurality of hydraulic actuators AC, and a pilot pump PP. Note that, for the sake of convenience, Figure 2 shows a hydraulic circuit corresponding to one hydraulic actuator AC, but similar hydraulic circuits are configured for the other hydraulic actuators AC.

[0036] The multiple hydraulic actuators AC include left and right travel motors 22 which are travel hydraulic actuators that drive the lower travel structure 2, a blade cylinder 23a which is a hydraulic actuator that rotates the blade 23 up and down, a swing motor 43 which is a swing hydraulic actuator that drives the upper swing structure 3, and a boom cylinder 31a, arm cylinder 32a, and bucket cylinder 33a which are work hydraulic actuators that drive the work implement 3. The blade cylinder 23a, boom cylinder 31a, arm cylinder 32a, and bucket cylinder 33a are collectively referred to as a hydraulic cylinder CY.

[0037] The hydraulic excavator 1 may be configured to have a so-called boom swing function for swinging the work implement 3 (boom 31) left and right relative to the upper rotating body 4. When the hydraulic excavator 1 has the boom swing function, the hydraulic cylinder CY also includes a swing cylinder which is a hydraulic actuator for swinging the boom 31. In general, the boom swing function is provided on mini excavators (small hydraulic excavators) used for construction in narrow spaces.

[0038] The multiple hydraulic pumps P0 include a variable displacement pump and a fixed displacement pump, and are driven by the engine 40. The variable displacement pump pumps pressure-feed oil to the left and right traveling motors 22, the boom cylinder 31a, the arm cylinder 32a, and the bucket cylinder 33a. The fixed displacement pump pumps pressure-feed oil to the blade cylinder 23a, the rotation motor 43, and the swing cylinder (not shown).

[0039] The actuators AC are each provided with a corresponding directional control valve CV. The directional control valve CV is a pilot-type directional control valve capable of switching the direction and flow rate of pressure oil pumped from the hydraulic pump P0 (variable displacement pump or fixed displacement pump), and is also called a control valve. The directional control valves CV in this embodiment include directional control valves corresponding to the left and right traveling motors 22, a directional control valve corresponding to the boom cylinder 31a, a directional control valve corresponding to the arm cylinder 32a, a directional control valve corresponding to the bucket cylinder 33a, a directional control valve corresponding to the blade cylinder 23a, a directional control valve corresponding to the swing motor 43, and a directional control valve corresponding to the swing cylinder.

[0040] The pilot pump PP discharges pilot oil which serves as an input command for the directional control valves CV. The pilot pump PP driven by the engine 40 discharges pressure oil to generate pilot pressure in a pilot oil passage. In the hydraulic excavator 1, pilot oil passages are provided which extend from the pilot pump PP to each of the directional control valves CV.

[0041] The operation unit 41b has a remote control valve RV for switching the direction and pressure of the pressure oil supplied to the directional control valve CV. The remote control valve RV is supplied with pressure oil discharged from the pilot pump PP. The remote control valve RV generates pilot pressure according to the operation direction and operation amount of the operation unit 41b. The operation unit 41b includes, for example, a travel lever for traveling the hydraulic excavator 1 and a control lever for operating the work machine 3, etc.

[0042] A solenoid valve SV is provided in an oil passage between the pilot pump PP and each remote control valve RV. The solenoid valve SV adjusts the pilot pressure generated by the pilot pump PP in response to a control command from the control unit 60. By adjusting the pilot pressure, for example, it is possible to simultaneously stop the drive of a plurality of hydraulic actuators AC and to uniformly control the drive speeds of the plurality of hydraulic actuators AC.

[0043] [4. Details of the display screen] Next, the display screen of the display unit 71 will be described in detail. Fig. 3 is an explanatory diagram showing an example of each display area on the display screen of the display unit 71. The display unit 71 has an image display area R1 and an alarm information display area R2. The display of information in the image display area R1 and the alarm information display area R2 of the display unit 71 is controlled by the control unit 60.

[0044] The image display area R1 is an area for displaying an image acquired by the monitoring unit 50. Note that the "image acquired by the monitoring unit 50" refers to, for example, the overhead image Bv (see FIG. 4) generated by the overhead image generating unit 53 of the monitoring unit 50. The notification information display area R2 is an area for displaying notification information W (see FIG. 4) indicating the presence of an obstacle when the monitoring unit 50 detects the presence of an obstacle.

[0045] That is, the display unit 71 has an image display area R1 that displays an image acquired by the monitoring unit 50, and an alarm information display area R2 that displays alarm information W indicating the presence of an obstacle when the monitoring unit 50 detects the presence of an obstacle.

[0046] In this embodiment, the notification information display region R2 is located outside the image display region R1 in the display unit 71. Moreover, in the display unit 71, the notification information display region R2 is located adjacent to the image display region R1.

[0047] 4 shows a state in which an overhead image Bv is displayed in the image display region R1 of the display unit 71, and alarm information W is displayed in the alarm information display region R2. The overhead image Bv displayed in the image display region R1 includes images T1 to T3 of people who are captured as obstacles in the image. Furthermore, the image display region R1 also displays a vehicle image S showing the hydraulic excavator 1. In this way, the display unit 71 displays the overhead image Bv in the image display region R1 together with the vehicle image S showing the hydraulic excavator 1.

[0048] The notification information W displayed in the notification information display region R2 includes band-shaped information P, direction information A, and type information M.

[0049] The strip information P is information displayed in a strip shape along the edge R1a of the image display region R1 (see FIG. 3). In FIG. 4, since a person is reflected to the left of the hydraulic excavator 1 in the overhead image Bv displayed in the image display region R1 (see T1 and T2), strip information P1 is displayed in an arc shape along the edge R1a of the image display region R1 at a position corresponding to the left of the hydraulic excavator 1 in the notification information display region R2. Furthermore, since a person is also reflected behind the hydraulic excavator 1 in the overhead image Bv (see T3), strip information P2 is displayed in an arc shape along the edge R1a of the image display region R1 at a position corresponding to the rear of the hydraulic excavator 1 in the notification information display region R2. In this way, the notification information W includes strip information P (P1, P2) displayed in a strip shape along the edge R1a of the image display region R1.

[0050] Note that "a position corresponding to the left of the hydraulic excavator 1 in the notification information display region R2" may be a position where the operator can recognize that the display position of the strip information P1 in the notification information display region R2 is "to the left of the vehicle image S showing the hydraulic excavator 1," and the direction is not limited to strictly to the left. For example, "a position corresponding to the left" includes a position diagonally forward to the left or diagonally backward to the left in addition to strictly to the left. Therefore, in the following description, for example, "a position corresponding to the rear" includes a position diagonally backward to the left or diagonally backward to the right in addition to strictly to the rear, and "a position corresponding to the right" includes a position diagonally forward to the right or diagonally backward to the right in addition to strictly to the right.

[0051] The direction information A is information indicating the direction of an obstacle reflected in an image (for example, the overhead image Bv) as seen from the hydraulic excavator 1. In FIG. 4, a person is reflected to the left of the hydraulic excavator 1 in the overhead image Bv, so a leftward arrow icon is displayed as direction information A1 in the notification information display region R2 at a position corresponding to the left of the hydraulic excavator 1. In addition, a person is reflected behind the hydraulic excavator 1 in the overhead image Bv, so a backward arrow icon is displayed as direction information A2 in the notification information display region R2 at a position corresponding to the rear of the hydraulic excavator 1. In this way, the notification information W includes the direction information A indicating the direction of an obstacle reflected in an image acquired by the monitoring unit 50 relative to the hydraulic excavator 1.

[0052] The type information M is information indicating the type of obstacle detected by the image processing unit 53 of the monitoring unit 50. When the image processing unit 53 detects a "person" as an obstacle to the left of the hydraulic excavator 1 by image processing, an icon indicating that the detected obstacle is a "person" is displayed as type information M1 in the notification information display region R2 at a position corresponding to the left of the hydraulic excavator 1. When the image processing unit 53 detects a "person" as an obstacle behind the hydraulic excavator 1 by image processing, an icon indicating that the detected obstacle is a "person" is displayed as type information M2 in the notification information display region R2 at a position corresponding to the rear of the hydraulic excavator 1. In this way, the notification information W includes type information M indicating the type of obstacle detected by the image processing unit 53.

[0053] As described above, since the notification information W is displayed in the notification information display region R2 at a position corresponding to the direction of the obstacle relative to the hydraulic excavator 1, it can be said that the display unit 71 displays the notification information W as follows: That is, when the monitoring unit 50 detects the presence of an obstacle, the display unit 71 displays the notification information W in the notification information display region R2 at a position corresponding to the direction of the obstacle reflected in the image relative to the hydraulic excavator 1.

[0054] Furthermore, in this embodiment, as described above, the monitoring unit 50 monitors the surroundings of the hydraulic excavator 1 in a plurality of monitoring sections D1 and D2. Thus, when the monitoring unit 50 detects the presence of an obstacle, the display unit 71 displays the notification information W in a color corresponding to the monitoring section in which the obstacle exists. For example, when the monitoring unit 50 detects an obstacle in the monitoring section D1 (within a radius of less than 2 m from the hydraulic excavator 1), the display unit 71 displays the notification information W in, for example, red. On the other hand, when the monitoring unit 50 detects an obstacle in the monitoring section D2 (within a radius of 2 m or more and 3 m or less from the hydraulic excavator 1), the display unit 71 displays the notification information W in, for example, yellow.

[0055] That is, of the set monitoring sections D1 and D2, if the monitoring unit 50 detects an obstacle in monitoring section D1, which has a high risk of contact between the obstacle and the hydraulic excavator 1, the notification information W is colored red. On the other hand, if the monitoring unit 50 detects an obstacle in monitoring section D2, which has a low risk of contact between the obstacle and the hydraulic excavator 1 but requires attention, the notification information W is colored yellow.

[0056] 4, for example, when a "person" is detected as an obstacle in monitoring section D2 to the left of the hydraulic excavator 1, band-shaped information P1, direction information A1, and type information M1 are displayed in yellow as the notification information W. When a "person" is detected as an obstacle in monitoring section D1 behind the hydraulic excavator 1, band-shaped information P2, direction information A2, and type information M2 are displayed in red as the notification information W. For convenience, in FIG. 4, the notification information W displayed in yellow is shown by a dashed line, and the notification information W displayed in red is shown by a solid line.

[0057] In this embodiment, as shown in FIG. 3 and FIG. 4, in the display unit 71, the notification information display region R2 is located outside the image display region R1. Therefore, even if an obstacle reflected in an image (for example, an overhead image Bv) displayed in the image display region R1 is small compared to the entire image, the notification information W indicating the presence of the obstacle can be displayed relatively large in the notification information display region R2 while being clearly distinguished from the image. For example, the band-shaped information P1 included in the notification information W can be displayed larger (wider) than the images T1 and T2 in the notification information display region R2. Similarly, the band-shaped information P2 included in the notification information W can be displayed larger (wider) than the image T3. By displaying the notification information W in this way, the operator can intuitively and easily perceive the presence of an obstacle around the hydraulic excavator 1. As a result, the operator can easily perceive the danger of a collision between the hydraulic excavator 1 and an obstacle and be warned.

[0058] In addition, in the present embodiment, in a configuration in which the alarm information display region R2 is positioned adjacent to the image display region R1 in the display unit 71, the alarm information display region R2 is close to the image display region R1. Therefore, when the alarm information W is displayed in the alarm information display region R2, the operator can easily check the image displayed in the image display region R1 and confirm the presence of an obstacle by looking at the alarm information W.

[0059] Furthermore, the display unit 71 displays the notification information W in the notification information display region R2 at a position corresponding to the direction of the obstacle reflected in the image (for example, the overhead image Bv) based on the hydraulic excavator 1. This allows the operator to intuitively and easily recognize the direction in which the obstacle exists relative to the hydraulic excavator 1 from the display position of the notification information W in the notification information display region R2. For example, in the example of FIG. 4, the operator can intuitively and easily recognize that the direction in which the obstacle exists is to the left of the hydraulic excavator 1 from the display positions of the band-shaped information P1, the direction information A1, and the type information M1 as the notification information W. Furthermore, the operator can intuitively and easily recognize that the direction in which the obstacle exists is behind the hydraulic excavator 1 from the display positions of the band-shaped information P2, the direction information A2, and the type information M2 as the notification information W.

[0060] In addition, since the strip-shaped information P is displayed in a strip shape along the edge R1a of the image display region R1, it is easy for the operator to visually recognize it. Therefore, since the notification information W includes the strip-shaped information P, the operator can easily recognize the presence of an obstacle based on the strip-shaped information P.

[0061] Furthermore, the notification information W includes the direction information A. This allows the operator to intuitively and easily recognize the direction in which an obstacle exists relative to the hydraulic excavator 1 by looking at the displayed direction information A. For example, in the example of FIG. 4, the operator can intuitively and easily recognize that the direction in which an obstacle exists is to the left of the hydraulic excavator 1 by looking at the direction information A1 as the notification information W. Furthermore, the operator can intuitively and easily recognize that the direction in which an obstacle exists is behind the hydraulic excavator 1 by looking at the direction information A2 as the notification information W.

[0062] Furthermore, when the monitoring unit 50 detects the presence of an obstacle, the display unit 71 displays the notification information W in a color corresponding to the monitoring section D1 or D2 in which the obstacle exists. By looking at the color of the displayed notification information W, the operator can immediately determine to which monitoring section the obstacle detected by the monitoring unit 50 belongs. Then, the operator can intuitively recognize whether or not the obstacle is close to the hydraulic excavator 1, and easily recognize the degree of danger.

[0063] Moreover, the monitoring unit 50 has an imaging unit 51 and an image processing unit 52. The image processing unit 52 detects whether or not an obstacle is present around the hydraulic excavator 1 by performing image recognition processing on the image acquired by the imaging unit 51. Therefore, it is possible to realize the monitoring unit 50 that monitors the periphery of the hydraulic excavator 1 without using an obstacle sensor. In other words, it is possible to realize a monitoring unit 50 with a simple configuration that does not use an obstacle sensor.

[0064] Furthermore, the notification information W includes type information M. This allows the operator to easily recognize the type of obstacle (e.g., person / animal / other) present around the hydraulic excavator 1 by looking at the displayed type information M.

[0065] Furthermore, in the image display region R1, the display unit 71 displays the overhead image Bv together with the vehicle image S indicating the hydraulic excavator 1. In this case, by visually recognizing both the vehicle image S and the overhead image Bv, when an obstacle appears in the overhead image Bv, the operator can easily recognize the position of the obstacle relative to the hydraulic excavator 1.

[0066] [5. Supplementary Information] FIG. 5 is an explanatory diagram showing another example of each display area on the display screen of the display unit 71. The image display area R1 of the display unit 71 may include a plurality of image display areas R1-1 to R1-3. The image display areas R1-1 to R1-3 display images acquired by the monitoring unit 50. More specifically, the image display areas R1-1 to R1-3 display camera images Cv-1 to Cv-3 (see FIG. 6) captured and acquired by the left camera 51a, the right camera 51b, and the rear camera 51c constituting the imaging unit 51 of the monitoring unit 50, respectively. Note that in the display unit 71, the alarm information display area R2 is located outside the image display area R1 (R1-1 to R1-3) and is located adjacent to the image display area R1 (R1-1 to R1-3), which are similar to the examples of FIG. 3 and FIG. 4.

[0067] In this way, even when the image display region R1 includes a plurality of image display regions R1-1 to R1-3, the display unit 71 can display the alarm information W at a predetermined position in the alarm information display region R2, similar to the case of Fig. 4. For example, Fig. 6 is an explanatory diagram showing another display example of the display unit 71. When a "person" is reflected as an obstacle in the camera image Cv-1 captured by the left camera 51a and the monitoring unit 50 detects this obstacle, the display unit 71 can display the alarm information W (band-shaped information P1, direction information A1, type information M1) in the alarm information display region R2 at a position corresponding to the direction of the obstacle reflected in the camera image Cv-1 based on the hydraulic excavator 1 (for example, in the vicinity of the image display region R1-1). Similarly, when a "person" appears as an obstacle in the camera image Cv-3 captured by the rear camera 51c and the monitoring unit 50 detects this obstacle, the display unit 71 can display alarm information W (strip information P2, directional information A2, type information M2) in the alarm information display area R2 at a position corresponding to the direction of the obstacle captured in the camera image Cv-3 relative to the hydraulic excavator 1 (for example, near the image display area R1-3).

[0068] 6, strip-shaped information P (P1, P2) as notification information is displayed in the shape of a frame surrounding the entire outer periphery of camera images Cv-1, Cv-3. In this case, the correspondence between camera images Cv-1, Cv-3 and strip-shaped information P1, P2 becomes clear, so that an operator can easily recognize in which direction an obstacle exists relative to the hydraulic excavator 1 by looking at the notification information W (strip-shaped information P1, P2). Note that strip-shaped information P may be displayed in a strip shape along only a part of the outer periphery of camera image Cv-1, etc.

[0069] In this embodiment, the hydraulic excavator 1, which is a construction machine, has been taken as an example of the work vehicle, but the work vehicle is not limited to the hydraulic excavator and may be other construction machines such as a wheel loader, or agricultural machines such as a combine harvester. In other words, the display method of the display unit 71 described in this embodiment can be applied to construction equipment and agricultural machines other than the hydraulic excavator 1.

[0070] Although the embodiment of the present invention has been described above, the scope of the present invention is not limited to this, and the invention can be expanded or modified without departing from the spirit of the invention. [Industrial Applicability]

[0071] The present invention can be used in work vehicles such as construction machines and agricultural machines. [Explanation of symbols]

[0072] 1. Hydraulic excavator (work vehicle) 50 Monitoring Department 51 Imaging unit 51a Left camera (imaging unit, camera) 51b Right camera (imaging unit, camera) 51c Rear camera (imaging unit, camera) 52 Image processing section 53 Bird's-eye view image generation unit 71 Display section Bv bird's-eye view image Cv-1, Cv-2, Cv-3 camera images A, A1, A2 direction information M, M1, M2 type information P, P1, P2 Band information D1, D2 Monitoring classification R1, R1-1, R1-2, R1-3 Image display area R2 Notification information display area W Notification Information

Claims

1. Displaying an image acquired in a corresponding area around the work vehicle in an image display area of ​​a display unit of the work vehicle; Detecting whether an obstacle is present in the area; A work vehicle control method comprising: displaying at least a portion of band-shaped notification information on the outer edge of the image in response to detection of the obstacle; and not displaying the notification information when the obstacle is not detected.

2. The method for controlling a work vehicle according to claim 1 , wherein the notification information is displayed on an upper end side and a lower end side of the image display area.

3. The method for controlling a work vehicle according to claim 1 or 2, wherein the notification information is displayed so as to extend from one left and right end side to the other left and right end side of the image display area.

4. The method for controlling a work vehicle according to claim 1 , wherein the notification information includes dotted line display information.

Images